Nov 06 11:36:30 devstack cinder-volume[76042]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Nov 06 11:36:30 devstack cinder-volume[76042]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Nov 06 11:36:30 devstack cinder-volume[76042]: we strongly recommend against using it for new projects. Nov 06 11:36:30 devstack cinder-volume[76042]: If you are already using Eventlet, we recommend migrating to a different Nov 06 11:36:30 devstack cinder-volume[76042]: framework. For more detail see Nov 06 11:36:30 devstack cinder-volume[76042]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Nov 06 11:36:30 devstack cinder-volume[76042]: import eventlet # noqa Nov 06 11:36:32 devstack cinder-volume[76042]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=76042) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Nov 06 11:36:32 devstack cinder-volume[76042]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=76042) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Nov 06 11:36:32 devstack cinder-volume[76042]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=76042) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Nov 06 11:36:33 devstack cinder-volume[76042]: INFO dbcounter [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] Registered counter for database cinder Nov 06 11:36:33 devstack cinder-volume[76042]: DEBUG oslo_db.sqlalchemy.engines [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76042) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 06 11:36:34 devstack cinder-volume[76042]: DEBUG dbcounter [-] [76042] Writer thread running {{(pid=76042) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Nov 06 11:36:34 devstack cinder-volume[76042]: INFO cinder.rpc [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Nov 06 11:36:34 devstack cinder-volume[76042]: INFO cinder.rpc [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Nov 06 11:36:34 devstack cinder-volume[76042]: DEBUG oslo_db.sqlalchemy.engines [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76042) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 06 11:36:34 devstack cinder-volume[76042]: INFO cinder.volume.manager [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] Determined volume DB was empty at startup. Nov 06 11:36:34 devstack cinder-volume[76042]: DEBUG cinder.volume.manager [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] Cinder Volume DB check: vol_db_empty=True {{(pid=76042) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Nov 06 11:36:34 devstack cinder-volume[76042]: INFO cinder.volume.manager [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] Service not found for updating active_backend_id, assuming default for driver init. Nov 06 11:36:34 devstack cinder-volume[76042]: WARNING stevedore.named [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 06 11:36:34 devstack cinder-volume[76042]: WARNING castellan.key_manager [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 06 11:36:34 devstack cinder-volume[76042]: WARNING cinder.keymgr.conf_key_mgr [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 06 11:36:34 devstack cinder-volume[76042]: DEBUG cinder.volume.drivers.lvm [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=76042) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:109}} Nov 06 11:36:34 devstack cinder-volume[76042]: DEBUG oslo_concurrency.processutils [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=76042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:36:34 devstack cinder-volume[76042]: DEBUG oslo_concurrency.processutils [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] CMD "cinder-rtstool verify" returned: 0 in 0.397s {{(pid=76042) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_db.sqlalchemy.engines [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76042) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 06 11:36:35 devstack cinder-volume[76042]: INFO cinder.rpc [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] Automatically selected cinder-volume objects version 1.39 as minimum service version. Nov 06 11:36:35 devstack cinder-volume[76042]: INFO cinder.rpc [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version. Nov 06 11:36:35 devstack cinder-volume[76042]: WARNING stevedore.named [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 06 11:36:35 devstack cinder-volume[76042]: WARNING castellan.key_manager [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 06 11:36:35 devstack cinder-volume[76042]: INFO cinder.volume.manager [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] Image-volume cache enabled for host devstack@lvmdriver-1. Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_db.sqlalchemy.engines [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76042) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 06 11:36:35 devstack cinder-volume[76042]: INFO oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] Starting 1 workers Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] Started child 76206 {{(pid=76042) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] Full set of CONF: {{(pid=76042) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] ******************************************************************************** {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] Configuration options gathered from: {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] ================================================================================ {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Nov 06 11:36:35 devstack cinder-volume[76206]: INFO cinder.service [-] Starting cinder-volume node (version 29.0.1) Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] allow_availability_zone_fallback = False {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] allow_compression_on_image_upload = False {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] allowed_direct_url_schemes = [] {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] api_rate_limit = True {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] auth_strategy = keystone {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] az_cache_duration = 3600 {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] backend_availability_zone = None {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] backend_host = None {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] backend_name = None {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] backend_stats_polling_interval = 60 {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] backup_api_class = cinder.backup.api.API {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] backup_name_template = backup-%s {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] backup_use_same_host = False {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] backup_use_temp_snapshot = False {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] chap_password = **** {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] chap_username = {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] cinder_internal_tenant_project_id = ca6a1b9dba25443790332d791fad7827 {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] cinder_internal_tenant_user_id = e7ba6dd3780e4a6c97773800d63c345c {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] cloned_volume_same_az = True {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] cluster = None {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] compression_format = gzip {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] compute_api_class = cinder.compute.nova.API {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] config_dir = [] {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] config_source = [] {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] control_exchange = openstack {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] debug = True {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] default_availability_zone = None {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] default_group_type = None {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] default_volume_type = lvmdriver-1 {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] disk_geometry = None {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] driver_client_cert = None {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] driver_client_cert_key = None {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] driver_data_namespace = None {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] driver_ssl_cert_path = None {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] driver_ssl_cert_verify = False {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] driver_use_ssl = False {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] enable_force_upload = False {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] enable_new_services = True {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] enable_unsupported_driver = False {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] enabled_backends = ['lvmdriver-1'] {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] enforce_multipath_for_image_xfer = False {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] filter_function = None {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] glance_api_insecure = False {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] glance_api_servers = ['http://192.168.122.9/image'] {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] glance_api_ssl_compression = False {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] glance_ca_certificates_file = None {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] glance_catalog_info = image:glance:publicURL {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] glance_certfile = None {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] glance_keyfile = None {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] glance_num_retries = 3 {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] glance_request_timeout = None {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] goodness_function = None {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] graceful_shutdown_timeout = 5 {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] group_api_class = cinder.group.api.API {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] host = devstack {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] image_compress_on_upload = True {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] image_conversion_address_space_limit = 1 {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 11:36:35 devstack cinder-volume[76206]: INFO cinder.volume.manager [None req-dfb3ac36-31ad-4b86-90b9-e94dd672334b None None] Starting volume driver LVMVolumeDriver (3.0.0) Nov 06 11:36:35 devstack cinder-volume[76206]: DEBUG oslo_concurrency.processutils [None req-dfb3ac36-31ad-4b86-90b9-e94dd672334b None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] image_conversion_cpu_limit = 60 {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] image_conversion_disable = False {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] image_introspection_address_space_limit = 1 {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] image_introspection_cpu_limit = 60 {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] image_upload_use_cinder_backend = False {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] image_upload_use_internal_tenant = False {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] image_volume_cache_enabled = False {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] image_volume_cache_max_count = 0 {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] image_volume_cache_max_size_gb = 0 {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] init_host_max_objects_retrieval = 0 {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] instance_format = [instance: %(uuid)s] {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] iscsi_target_flags = {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] iscsi_write_cache = on {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] iser_helper = tgtadm {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] iser_ip_address = 192.168.122.9 {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] iser_port = 3260 {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] log_color = False {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] log_config_append = None {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] log_dir = None {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] log_file = None {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] log_options = True {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] log_rotate_interval = 1 {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] log_rotate_interval_type = days {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] log_rotation_type = none {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 11:36:35 devstack cinder-volume[76206]: DEBUG oslo_concurrency.processutils [None req-dfb3ac36-31ad-4b86-90b9-e94dd672334b None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.030s {{(pid=76206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 11:36:35 devstack cinder-volume[76206]: DEBUG oslo_concurrency.processutils [None req-dfb3ac36-31ad-4b86-90b9-e94dd672334b None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] max_age = 0 {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] max_logfile_count = 30 {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] max_logfile_size_mb = 200 {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] max_over_subscription_ratio = 20.0 {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] message_reap_interval = 86400 {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] message_ttl = 2592000 {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] migration_create_volume_timeout_secs = 300 {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] monkey_patch = False {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] monkey_patch_modules = [] {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] my_ip = 192.168.122.9 {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] no_snapshot_gb_quota = False {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] num_iser_scan_tries = 3 {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] num_shell_tries = 3 {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] num_volume_device_scan_tries = 3 {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] nvmeof_conn_info_version = 1 {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] nvmet_ns_id = 10 {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] nvmet_port_id = 1 {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] osapi_max_limit = 1000 {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] osapi_volume_ext_list = [] {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 11:36:35 devstack cinder-volume[76206]: DEBUG oslo_concurrency.processutils [None req-dfb3ac36-31ad-4b86-90b9-e94dd672334b None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.027s {{(pid=76206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] osapi_volume_listen = 0.0.0.0 {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] osapi_volume_listen_port = 8776 {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] osapi_volume_use_ssl = False {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] osapi_volume_workers = None {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] per_volume_size_limit = -1 {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 11:36:35 devstack cinder-volume[76206]: DEBUG oslo_concurrency.processutils [None req-dfb3ac36-31ad-4b86-90b9-e94dd672334b None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] periodic_fuzzy_delay = 60 {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] periodic_interval = 60 {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] project_id_regex = [0-9a-f\-]+ {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] public_endpoint = None {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] publish_errors = False {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] quota_backup_gigabytes = 1000 {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] quota_backups = 10 {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] quota_gigabytes = 1000 {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] quota_groups = 10 {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] quota_snapshots = 10 {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] quota_volumes = 10 {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] rate_limit_burst = 0 {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] rate_limit_except_level = CRITICAL {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] rate_limit_interval = 0 {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] reinit_driver_count = 3 {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] replication_device = **** {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] report_discard_supported = False {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 11:36:35 devstack cinder-volume[76206]: DEBUG oslo_concurrency.processutils [None req-dfb3ac36-31ad-4b86-90b9-e94dd672334b None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.031s {{(pid=76206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:36:35 devstack cinder-volume[76206]: DEBUG oslo_concurrency.processutils [None req-dfb3ac36-31ad-4b86-90b9-e94dd672334b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=76206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] report_interval = 120 {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] reservation_clean_interval = 86400 {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] reservation_expire = 86400 {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] reserved_image_namespaces = [] {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] reserved_percentage = 0 {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] rpc_response_timeout = 120 {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] run_external_periodic_tasks = True {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] scst_target_driver = iscsi {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] scst_target_iqn_name = None {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] service_down_time = 720 {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] shell_completion = None {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] snapshot_name_template = snapshot-%s {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] snapshot_same_host = True {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] split_loggers = False {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] state_path = /opt/stack/data/cinder {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] storage_availability_zone = nova {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] storage_protocol = iSCSI {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] syslog_log_facility = LOG_USER {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] target_helper = lioadm {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] target_ip_address = 192.168.122.9 {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] target_port = 3260 {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] target_protocol = iscsi {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] target_secondary_ip_addresses = [] {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] trace_flags = None {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] transfer_api_class = cinder.transfer.api.API {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] transport_url = **** {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] until_refresh = 0 {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] use_chap_auth = False {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] use_default_quota_class = True {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 11:36:35 devstack sudo[76239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] use_journal = False {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] use_json = False {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] use_multipath_for_image_xfer = False {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] use_stderr = False {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] use_syslog = False {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] verify_glance_signatures = enabled {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 11:36:35 devstack sudo[76239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] volume_api_class = cinder.volume.api.API {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] volume_backend_name = None {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] volume_clear = zero {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] volume_clear_ionice = None {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] volume_clear_size = 0 {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] volume_copy_bps_limit = 0 {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] volume_dd_blocksize = 1M {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] volume_name_template = volume-%s {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] volume_service_inithost_offload = False {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] volume_usage_audit_period = month {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] zoning_mode = None {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] oslo_concurrency.disable_process_locking = False {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] os_brick.lightos_discovery_client_address = localhost {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] os_brick.wait_mpath_device_interval = 1 {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] keystone_authtoken.auth_section = None {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] keystone_authtoken.auth_type = password {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] keystone_authtoken.auth_version = None {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] keystone_authtoken.cache = None {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] keystone_authtoken.certfile = None {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] keystone_authtoken.delay_auth_decision = False {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] keystone_authtoken.http_connect_timeout = None {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] keystone_authtoken.include_service_catalog = True {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] keystone_authtoken.insecure = False {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] keystone_authtoken.interface = public {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] keystone_authtoken.keyfile = None {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] keystone_authtoken.memcache_password = **** {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] keystone_authtoken.memcache_secret_key = **** {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] keystone_authtoken.memcache_security_strategy = None {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] keystone_authtoken.memcache_username = None {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] keystone_authtoken.region_name = None {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] keystone_authtoken.service_token_roles_required = True {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] keystone_authtoken.service_type = None {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] keystone_authtoken.token_cache_time = 300 {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.9/identity {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] cache.backend = dogpile.cache.null {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] cache.backend_argument = **** {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] cache.backend_expiration_time = None {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] cache.config_prefix = cache.oslo {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] cache.debug_cache_backend = False {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] cache.enable_retry_client = False {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] cache.enable_socket_keepalive = False {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] cache.enabled = False {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] cache.expiration_time = 600 {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] cache.hashclient_dead_timeout = 60.0 {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] cache.hashclient_retry_attempts = 2 {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] cache.hashclient_retry_timeout = 1.0 {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] cache.memcache_dead_retry = 300 {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] cache.memcache_pool_maxsize = 10 {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] cache.memcache_pool_unused_timeout = 60 {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] cache.memcache_sasl_enabled = False {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] cache.memcache_servers = ['localhost:11211'] {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] cache.password = **** {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] cache.proxies = [] {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] cache.redis_db = 0 {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] cache.redis_sentinel_service_name = mymaster {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] cache.redis_server = localhost:6379 {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] cache.retry_attempts = 2 {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] cache.retry_delay = 0.0 {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] cache.socket_keepalive_count = 1 {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] cache.socket_keepalive_idle = 1 {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] cache.socket_keepalive_interval = 1 {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] cache.socket_timeout = 1.0 {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] cache.tls_allowed_ciphers = None {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] cache.tls_cafile = None {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] cache.tls_certfile = None {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] cache.tls_enabled = False {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] cache.tls_keyfile = None {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] cache.username = None {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] coordination.backend_url = **** {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] database.asyncio_connection = **** {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] database.asyncio_slave_connection = **** {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] database.backend = sqlalchemy {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] database.connection = **** {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] database.connection_debug = 0 {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] database.connection_parameters = {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] database.connection_recycle_time = 3600 {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] database.connection_trace = False {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] database.db_inc_retry_interval = True {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] database.db_max_retries = 20 {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] database.db_max_retry_interval = 10 {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] database.db_retry_interval = 1 {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] database.max_overflow = 50 {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] database.max_pool_size = 5 {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] database.max_retries = 10 {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] database.mysql_sql_mode = TRADITIONAL {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] database.mysql_wsrep_sync_wait = None {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] database.pool_timeout = None {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] database.retry_interval = 10 {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] database.slave_connection = **** {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] database.sqlite_synchronous = True {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] database.synchronous_reader = True {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] database.use_db_reconnect = False {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] oslo_messaging_metrics.metrics_process_name = {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] oslo_messaging_tracing.insecure = False {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] profiler.connection_string = messaging:// {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] profiler.enabled = False {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] profiler.es_doc_type = notification {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] profiler.es_scroll_size = 10000 {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] profiler.es_scroll_time = 2m {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] profiler.filter_error_trace = False {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] profiler.hmac_keys = **** {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] profiler.sentinel_service_name = mymaster {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] profiler.socket_timeout = 0.1 {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] profiler.trace_requests = False {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] profiler.trace_sqlalchemy = False {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] profiler_jaeger.process_tags = {} {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] profiler_jaeger.service_name_prefix = None {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] profiler_otlp.service_name_prefix = None {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] oslo_policy.enforce_new_defaults = True {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] oslo_policy.policy_default_rule = default {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] oslo_policy.policy_file = policy.yaml {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] oslo_policy.remote_timeout = 60.0 {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] privsep_osbrick.capabilities = [21, 2] {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] privsep_osbrick.group = None {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] privsep_osbrick.helper_command = None {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] privsep_osbrick.log_daemon_traceback = False {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] privsep_osbrick.thread_pool_size = 4 {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] privsep_osbrick.user = None {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] cinder_sys_admin.group = None {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] cinder_sys_admin.helper_command = None {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] cinder_sys_admin.user = None {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] service_user.auth_section = None {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] service_user.auth_type = password {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] service_user.cafile = None {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] service_user.certfile = None {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] service_user.collect_timing = False {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] service_user.insecure = False {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] service_user.keyfile = None {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] service_user.send_service_user_token = True {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] service_user.split_loggers = False {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] service_user.timeout = None {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] service_user.tls_ciphers = None {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] service_user.tls_min_version = None {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] glance.auth_section = None {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] glance.auth_type = password {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] glance.certfile = None {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] glance.collect_timing = False {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] glance.insecure = False {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] glance.keyfile = None {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] glance.region_name = None {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] glance.split_loggers = False {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] glance.timeout = None {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] glance.tls_ciphers = None {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] glance.tls_min_version = None {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] backend_defaults.backend_availability_zone = None {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] backend_defaults.chap_password = **** {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] backend_defaults.chap_username = {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] backend_defaults.disk_geometry = None {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] backend_defaults.driver_client_cert = None {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] backend_defaults.driver_client_cert_key = None {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] backend_defaults.driver_data_namespace = None {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] backend_defaults.driver_ssl_cert_path = None {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] backend_defaults.driver_use_ssl = False {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] backend_defaults.enable_unsupported_driver = False {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] backend_defaults.extra_capabilities = {} {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] backend_defaults.filter_function = None {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] backend_defaults.goodness_function = None {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] backend_defaults.image_volume_cache_enabled = False {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] backend_defaults.iscsi_target_flags = {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] backend_defaults.iscsi_write_cache = on {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] backend_defaults.iser_helper = tgtadm {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] backend_defaults.iser_ip_address = 192.168.122.9 {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] backend_defaults.iser_port = 3260 {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] backend_defaults.lvm_mirrors = 0 {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] backend_defaults.lvm_share_target = False {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] backend_defaults.lvm_type = auto {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] backend_defaults.num_shell_tries = 3 {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] backend_defaults.nvmet_ns_id = 10 {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] backend_defaults.nvmet_port_id = 1 {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] backend_defaults.replication_device = **** {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] backend_defaults.report_discard_supported = False {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] backend_defaults.reserved_percentage = 0 {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] backend_defaults.scst_target_driver = iscsi {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] backend_defaults.scst_target_iqn_name = None {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] backend_defaults.storage_protocol = iSCSI {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] backend_defaults.target_helper = tgtadm {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] backend_defaults.target_ip_address = 192.168.122.9 {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] backend_defaults.target_port = 3260 {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] backend_defaults.target_protocol = iscsi {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] backend_defaults.trace_flags = None {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] backend_defaults.unique_fqdn_network = True {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] backend_defaults.use_chap_auth = False {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] backend_defaults.volume_backend_name = None {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] backend_defaults.volume_clear = zero {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] backend_defaults.volume_clear_ionice = None {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] backend_defaults.volume_clear_size = 0 {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] backend_defaults.volume_group = cinder-volumes {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] oslo_reports.file_event_handler = None {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] oslo_reports.file_event_handler_interval = 1 {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] oslo_reports.log_dir = None {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] lvmdriver-1.backend_availability_zone = None {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] lvmdriver-1.backend_host = None {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] lvmdriver-1.chap_password = **** {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] lvmdriver-1.chap_username = None {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] lvmdriver-1.chiscsi_conf = None {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] lvmdriver-1.disk_geometry = None {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] lvmdriver-1.driver_client_cert = None {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] lvmdriver-1.driver_client_cert_key = None {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] lvmdriver-1.driver_data_namespace = None {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] lvmdriver-1.driver_use_ssl = None {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] lvmdriver-1.extra_capabilities = None {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] lvmdriver-1.filter_function = None {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] lvmdriver-1.goodness_function = None {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] lvmdriver-1.iscsi_target_flags = None {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] lvmdriver-1.iscsi_write_cache = None {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] lvmdriver-1.iser_helper = None {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] lvmdriver-1.iser_ip_address = None {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] lvmdriver-1.iser_port = None {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] lvmdriver-1.iser_target_prefix = None {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] lvmdriver-1.lvm_conf_file = None {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] lvmdriver-1.lvm_mirrors = None {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] lvmdriver-1.lvm_share_target = None {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] lvmdriver-1.lvm_type = auto {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] lvmdriver-1.num_shell_tries = None {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] lvmdriver-1.nvmet_ns_id = None {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] lvmdriver-1.nvmet_port_id = None {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] lvmdriver-1.replication_device = **** {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] lvmdriver-1.report_discard_supported = None {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] lvmdriver-1.reserved_percentage = None {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] lvmdriver-1.scst_target_driver = None {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] lvmdriver-1.storage_protocol = None {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] lvmdriver-1.target_helper = lioadm {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] lvmdriver-1.target_ip_address = None {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] lvmdriver-1.target_port = 3260 {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] lvmdriver-1.target_prefix = iqn.2010-10.org.openstack: {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] lvmdriver-1.target_protocol = iscsi {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] lvmdriver-1.trace_flags = None {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] lvmdriver-1.unique_fqdn_network = None {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] lvmdriver-1.use_chap_auth = None {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] lvmdriver-1.volume_clear = zero {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] lvmdriver-1.volume_clear_ionice = None {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] lvmdriver-1.volume_clear_size = None {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] lvmdriver-1.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] lvmdriver-1.volume_group = stack-volumes-lvmdriver-1 {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] lvmdriver-1.volumes_dir = None {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] oslo_messaging_rabbit.hostname = devstack {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] oslo_messaging_rabbit.ssl = False {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] oslo_messaging_rabbit.ssl_version = {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] oslo_messaging_notifications.driver = [] {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] oslo_messaging_notifications.retry = -1 {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] oslo_messaging_notifications.transport_url = **** {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] key_manager.fixed_key = **** {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] barbican.barbican_api_version = None {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] barbican.barbican_endpoint = None {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] barbican.barbican_endpoint_type = public {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] barbican.barbican_region_name = None {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] barbican.cafile = None {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] barbican.certfile = None {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] barbican.collect_timing = False {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] barbican.insecure = False {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] barbican.keyfile = None {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] barbican.number_of_retries = 60 {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] barbican.retry_delay = 1 {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] barbican.send_service_user_token = False {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] barbican.split_loggers = False {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] barbican.timeout = None {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] barbican.tls_ciphers = None {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] barbican.tls_min_version = None {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] barbican.verify_ssl = True {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] barbican.verify_ssl_path = None {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] barbican_service_user.auth_section = None {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] barbican_service_user.auth_type = None {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] barbican_service_user.cafile = None {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] barbican_service_user.certfile = None {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] barbican_service_user.collect_timing = False {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] barbican_service_user.insecure = False {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] barbican_service_user.keyfile = None {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] barbican_service_user.split_loggers = False {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] barbican_service_user.timeout = None {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] barbican_service_user.tls_ciphers = None {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] barbican_service_user.tls_min_version = None {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] vault.approle_role_id = **** {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] vault.approle_secret_id = **** {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] vault.auth_method = approle {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] vault.auth_path = None {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] vault.kv_mountpoint = secret {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] vault.kv_path = None {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] vault.kv_version = 2 {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] vault.namespace = None {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] vault.root_token_id = **** {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] vault.ssl_ca_crt_file = None {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] vault.timeout = 60.0 {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] vault.token_file = None {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] vault.token_role = None {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] vault.use_ssl = False {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:36:35 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] ******************************************************************************** {{(pid=76042) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Nov 06 11:36:35 devstack sudo[76239]: pam_unix(sudo:session): session closed for user root Nov 06 11:36:35 devstack cinder-volume[76206]: DEBUG oslo_concurrency.processutils [None req-dfb3ac36-31ad-4b86-90b9-e94dd672334b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.399s {{(pid=76206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:36:35 devstack cinder-volume[76206]: DEBUG oslo_concurrency.processutils [None req-dfb3ac36-31ad-4b86-90b9-e94dd672334b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:36:35 devstack sudo[76395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 06 11:36:35 devstack sudo[76395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:36:36 devstack sudo[76395]: pam_unix(sudo:session): session closed for user root Nov 06 11:36:36 devstack cinder-volume[76206]: DEBUG oslo_concurrency.processutils [None req-dfb3ac36-31ad-4b86-90b9-e94dd672334b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.291s {{(pid=76206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:36:36 devstack cinder-volume[76206]: DEBUG oslo_concurrency.processutils [None req-dfb3ac36-31ad-4b86-90b9-e94dd672334b None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=76206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 06 11:36:36 devstack cinder-volume[76206]: INFO cinder.brick.local_dev.lvm [None req-dfb3ac36-31ad-4b86-90b9-e94dd672334b None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool Nov 06 11:36:36 devstack cinder-volume[76206]: DEBUG oslo_concurrency.processutils [None req-dfb3ac36-31ad-4b86-90b9-e94dd672334b None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:36:36 devstack cinder-volume[76206]: DEBUG oslo_concurrency.processutils [None req-dfb3ac36-31ad-4b86-90b9-e94dd672334b None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.024s {{(pid=76206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:36:36 devstack cinder-volume[76206]: DEBUG oslo_concurrency.processutils [None req-dfb3ac36-31ad-4b86-90b9-e94dd672334b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:36:36 devstack sudo[76491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Nov 06 11:36:36 devstack sudo[76491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:36:36 devstack sudo[76491]: pam_unix(sudo:session): session closed for user root Nov 06 11:36:36 devstack cinder-volume[76206]: DEBUG oslo_concurrency.processutils [None req-dfb3ac36-31ad-4b86-90b9-e94dd672334b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.302s {{(pid=76206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:36:36 devstack cinder-volume[76206]: DEBUG cinder.brick.local_dev.lvm [None req-dfb3ac36-31ad-4b86-90b9-e94dd672334b None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=76206) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:567}} Nov 06 11:36:36 devstack cinder-volume[76206]: DEBUG oslo_concurrency.processutils [None req-dfb3ac36-31ad-4b86-90b9-e94dd672334b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:36:36 devstack sudo[76592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 06 11:36:36 devstack sudo[76592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:36:36 devstack sudo[76592]: pam_unix(sudo:session): session closed for user root Nov 06 11:36:36 devstack cinder-volume[76206]: DEBUG oslo_concurrency.processutils [None req-dfb3ac36-31ad-4b86-90b9-e94dd672334b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.576s {{(pid=76206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:36:36 devstack cinder-volume[76206]: DEBUG oslo_concurrency.processutils [None req-dfb3ac36-31ad-4b86-90b9-e94dd672334b None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:36:36 devstack cinder-volume[76206]: DEBUG oslo_concurrency.processutils [None req-dfb3ac36-31ad-4b86-90b9-e94dd672334b None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.033s {{(pid=76206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:36:36 devstack cinder-volume[76206]: DEBUG oslo_concurrency.processutils [None req-dfb3ac36-31ad-4b86-90b9-e94dd672334b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:36:37 devstack sudo[76801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 06 11:36:37 devstack sudo[76801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:36:37 devstack sudo[76801]: pam_unix(sudo:session): session closed for user root Nov 06 11:36:37 devstack cinder-volume[76206]: DEBUG oslo_concurrency.processutils [None req-dfb3ac36-31ad-4b86-90b9-e94dd672334b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.300s {{(pid=76206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:36:37 devstack cinder-volume[76206]: DEBUG oslo_concurrency.processutils [None req-dfb3ac36-31ad-4b86-90b9-e94dd672334b None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:36:37 devstack cinder-volume[76206]: DEBUG oslo_concurrency.processutils [None req-dfb3ac36-31ad-4b86-90b9-e94dd672334b None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.015s {{(pid=76206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:36:37 devstack cinder-volume[76206]: DEBUG oslo_concurrency.processutils [None req-dfb3ac36-31ad-4b86-90b9-e94dd672334b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=76206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:36:37 devstack sudo[76828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster Nov 06 11:36:37 devstack sudo[76828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:36:37 devstack sudo[76828]: pam_unix(sudo:session): session closed for user root Nov 06 11:36:37 devstack cinder-volume[76206]: DEBUG oslo_concurrency.processutils [None req-dfb3ac36-31ad-4b86-90b9-e94dd672334b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.320s {{(pid=76206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:36:37 devstack cinder-volume[76206]: DEBUG oslo_concurrency.processutils [None req-dfb3ac36-31ad-4b86-90b9-e94dd672334b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:36:37 devstack sudo[76913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Nov 06 11:36:37 devstack sudo[76913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:36:37 devstack sudo[76913]: pam_unix(sudo:session): session closed for user root Nov 06 11:36:37 devstack cinder-volume[76206]: DEBUG oslo_concurrency.processutils [None req-dfb3ac36-31ad-4b86-90b9-e94dd672334b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.263s {{(pid=76206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:36:37 devstack cinder-volume[76206]: DEBUG oslo_concurrency.processutils [None req-dfb3ac36-31ad-4b86-90b9-e94dd672334b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:36:37 devstack sudo[76916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Nov 06 11:36:37 devstack sudo[76916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:36:38 devstack sudo[76916]: pam_unix(sudo:session): session closed for user root Nov 06 11:36:38 devstack cinder-volume[76206]: DEBUG oslo_concurrency.processutils [None req-dfb3ac36-31ad-4b86-90b9-e94dd672334b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.283s {{(pid=76206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:36:38 devstack cinder-volume[76206]: DEBUG oslo_concurrency.processutils [None req-dfb3ac36-31ad-4b86-90b9-e94dd672334b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:36:38 devstack sudo[76945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 06 11:36:38 devstack sudo[76945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:36:38 devstack sudo[76945]: pam_unix(sudo:session): session closed for user root Nov 06 11:36:38 devstack cinder-volume[76206]: DEBUG oslo_concurrency.processutils [None req-dfb3ac36-31ad-4b86-90b9-e94dd672334b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.347s {{(pid=76206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:36:38 devstack cinder-volume[76206]: DEBUG oslo_concurrency.processutils [None req-dfb3ac36-31ad-4b86-90b9-e94dd672334b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:36:38 devstack sudo[77008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 06 11:36:38 devstack sudo[77008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:36:38 devstack sudo[77008]: pam_unix(sudo:session): session closed for user root Nov 06 11:36:38 devstack cinder-volume[76206]: DEBUG oslo_concurrency.processutils [None req-dfb3ac36-31ad-4b86-90b9-e94dd672334b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.303s {{(pid=76206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:36:38 devstack cinder-volume[76206]: DEBUG oslo_concurrency.processutils [None req-dfb3ac36-31ad-4b86-90b9-e94dd672334b None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:36:38 devstack cinder-volume[76206]: DEBUG oslo_concurrency.processutils [None req-dfb3ac36-31ad-4b86-90b9-e94dd672334b None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.025s {{(pid=76206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:36:38 devstack cinder-volume[76206]: DEBUG oslo_concurrency.processutils [None req-dfb3ac36-31ad-4b86-90b9-e94dd672334b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:36:38 devstack sudo[77012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 06 11:36:38 devstack sudo[77012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:36:39 devstack sudo[77012]: pam_unix(sudo:session): session closed for user root Nov 06 11:36:39 devstack cinder-volume[76206]: DEBUG oslo_concurrency.processutils [None req-dfb3ac36-31ad-4b86-90b9-e94dd672334b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.269s {{(pid=76206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:36:39 devstack cinder-volume[76206]: INFO cinder.volume.drivers.lvm [None req-dfb3ac36-31ad-4b86-90b9-e94dd672334b None None] Enabling LVM thin provisioning by default because a thin pool exists. Nov 06 11:36:39 devstack cinder-volume[76206]: DEBUG oslo_concurrency.processutils [None req-dfb3ac36-31ad-4b86-90b9-e94dd672334b None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:36:39 devstack cinder-volume[76206]: DEBUG oslo_concurrency.processutils [None req-dfb3ac36-31ad-4b86-90b9-e94dd672334b None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.019s {{(pid=76206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:36:39 devstack cinder-volume[76206]: DEBUG oslo_concurrency.processutils [None req-dfb3ac36-31ad-4b86-90b9-e94dd672334b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:36:39 devstack sudo[77016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 06 11:36:39 devstack sudo[77016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:36:39 devstack sudo[77016]: pam_unix(sudo:session): session closed for user root Nov 06 11:36:39 devstack cinder-volume[76206]: DEBUG oslo_concurrency.processutils [None req-dfb3ac36-31ad-4b86-90b9-e94dd672334b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.298s {{(pid=76206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:36:39 devstack cinder-volume[76206]: DEBUG cinder.volume.drivers.lvm [None req-dfb3ac36-31ad-4b86-90b9-e94dd672334b None None] Updating volume stats {{(pid=76206) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Nov 06 11:36:39 devstack cinder-volume[76206]: DEBUG oslo_concurrency.processutils [None req-dfb3ac36-31ad-4b86-90b9-e94dd672334b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:36:39 devstack sudo[77019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Nov 06 11:36:39 devstack sudo[77019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:36:39 devstack sudo[77019]: pam_unix(sudo:session): session closed for user root Nov 06 11:36:39 devstack cinder-volume[76206]: DEBUG oslo_concurrency.processutils [None req-dfb3ac36-31ad-4b86-90b9-e94dd672334b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.282s {{(pid=76206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:36:39 devstack cinder-volume[76206]: DEBUG oslo_concurrency.processutils [None req-dfb3ac36-31ad-4b86-90b9-e94dd672334b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:36:39 devstack sudo[77028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 06 11:36:39 devstack sudo[77028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:36:39 devstack sudo[77028]: pam_unix(sudo:session): session closed for user root Nov 06 11:36:39 devstack cinder-volume[76206]: DEBUG oslo_concurrency.processutils [None req-dfb3ac36-31ad-4b86-90b9-e94dd672334b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.288s {{(pid=76206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:36:39 devstack cinder-volume[76206]: DEBUG oslo_concurrency.processutils [None req-dfb3ac36-31ad-4b86-90b9-e94dd672334b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:36:40 devstack sudo[77031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 06 11:36:40 devstack sudo[77031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:36:40 devstack sudo[77031]: pam_unix(sudo:session): session closed for user root Nov 06 11:36:40 devstack cinder-volume[76206]: DEBUG oslo_concurrency.processutils [None req-dfb3ac36-31ad-4b86-90b9-e94dd672334b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.268s {{(pid=76206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:36:40 devstack cinder-volume[76206]: DEBUG oslo_concurrency.processutils [None req-dfb3ac36-31ad-4b86-90b9-e94dd672334b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:36:40 devstack sudo[77034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 06 11:36:40 devstack sudo[77034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:36:40 devstack sudo[77034]: pam_unix(sudo:session): session closed for user root Nov 06 11:36:40 devstack cinder-volume[76206]: DEBUG oslo_concurrency.processutils [None req-dfb3ac36-31ad-4b86-90b9-e94dd672334b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.270s {{(pid=76206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:36:40 devstack cinder-volume[76206]: INFO cinder.volume.driver [None req-dfb3ac36-31ad-4b86-90b9-e94dd672334b None None] Driver hasn't implemented _init_vendor_properties() Nov 06 11:36:40 devstack cinder-volume[76206]: DEBUG cinder.volume.driver [None req-dfb3ac36-31ad-4b86-90b9-e94dd672334b None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=76206) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Nov 06 11:36:40 devstack cinder-volume[76206]: DEBUG oslo_db.sqlalchemy.engines [None req-dfb3ac36-31ad-4b86-90b9-e94dd672334b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76206) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 06 11:36:40 devstack cinder-volume[76206]: DEBUG dbcounter [-] [76206] Writer thread running {{(pid=76206) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Nov 06 11:36:40 devstack cinder-volume[76206]: DEBUG cinder.db.api [None req-dfb3ac36-31ad-4b86-90b9-e94dd672334b None None] Building query based on filter {{(pid=76206) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Nov 06 11:36:40 devstack cinder-volume[76206]: DEBUG cinder.image.image_utils [None req-dfb3ac36-31ad-4b86-90b9-e94dd672334b None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=76206) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1325}} Nov 06 11:36:40 devstack cinder-volume[76206]: INFO cinder.keymgr.migration [None req-cee97a0b-a8a9-4abd-ba98-38b1b1ba9b37 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Nov 06 11:36:40 devstack cinder-volume[76206]: DEBUG cinder.volume.drivers.lvm [None req-dfb3ac36-31ad-4b86-90b9-e94dd672334b None None] Updating volume stats {{(pid=76206) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Nov 06 11:36:40 devstack cinder-volume[76206]: DEBUG oslo_concurrency.processutils [None req-dfb3ac36-31ad-4b86-90b9-e94dd672334b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:36:40 devstack sudo[77039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Nov 06 11:36:40 devstack sudo[77039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:36:40 devstack sudo[77039]: pam_unix(sudo:session): session closed for user root Nov 06 11:36:40 devstack cinder-volume[76206]: DEBUG oslo_concurrency.processutils [None req-dfb3ac36-31ad-4b86-90b9-e94dd672334b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.271s {{(pid=76206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:36:40 devstack cinder-volume[76206]: DEBUG oslo_concurrency.processutils [None req-dfb3ac36-31ad-4b86-90b9-e94dd672334b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:36:40 devstack sudo[77042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 06 11:36:40 devstack sudo[77042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:36:41 devstack sudo[77042]: pam_unix(sudo:session): session closed for user root Nov 06 11:36:41 devstack cinder-volume[76206]: DEBUG oslo_concurrency.processutils [None req-dfb3ac36-31ad-4b86-90b9-e94dd672334b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.242s {{(pid=76206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:36:41 devstack cinder-volume[76206]: DEBUG oslo_concurrency.processutils [None req-dfb3ac36-31ad-4b86-90b9-e94dd672334b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:36:41 devstack sudo[77045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 06 11:36:41 devstack sudo[77045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:36:41 devstack sudo[77045]: pam_unix(sudo:session): session closed for user root Nov 06 11:36:41 devstack cinder-volume[76206]: DEBUG oslo_concurrency.processutils [None req-dfb3ac36-31ad-4b86-90b9-e94dd672334b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.244s {{(pid=76206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:36:41 devstack cinder-volume[76206]: DEBUG oslo_concurrency.processutils [None req-dfb3ac36-31ad-4b86-90b9-e94dd672334b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:36:41 devstack sudo[77049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 06 11:36:41 devstack sudo[77049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:36:41 devstack sudo[77049]: pam_unix(sudo:session): session closed for user root Nov 06 11:36:41 devstack cinder-volume[76206]: DEBUG oslo_concurrency.processutils [None req-dfb3ac36-31ad-4b86-90b9-e94dd672334b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.250s {{(pid=76206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:36:41 devstack cinder-volume[76206]: DEBUG cinder.manager [None req-dfb3ac36-31ad-4b86-90b9-e94dd672334b None None] Notifying Schedulers of capabilities ... {{(pid=76206) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 11:36:41 devstack cinder-volume[76206]: INFO cinder.volume.manager [None req-dfb3ac36-31ad-4b86-90b9-e94dd672334b None None] Driver initialization completed successfully. Nov 06 11:36:41 devstack cinder-volume[76206]: INFO cinder.manager [None req-dfb3ac36-31ad-4b86-90b9-e94dd672334b None None] Initiating service 2 cleanup Nov 06 11:36:41 devstack cinder-volume[76206]: INFO cinder.manager [None req-dfb3ac36-31ad-4b86-90b9-e94dd672334b None None] Service 2 cleanup completed. Nov 06 11:36:41 devstack cinder-volume[76206]: DEBUG cinder.service [None req-dfb3ac36-31ad-4b86-90b9-e94dd672334b None None] Creating RPC server for service cinder-volume {{(pid=76206) start /opt/stack/cinder/cinder/service.py:231}} Nov 06 11:36:41 devstack cinder-volume[76206]: DEBUG cinder.service [None req-dfb3ac36-31ad-4b86-90b9-e94dd672334b None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=76206) start /opt/stack/cinder/cinder/service.py:237}} Nov 06 11:36:41 devstack cinder-volume[76206]: INFO cinder.volume.manager [None req-dfb3ac36-31ad-4b86-90b9-e94dd672334b None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0) Nov 06 11:36:41 devstack cinder-volume[76206]: DEBUG cinder.volume.drivers.lvm [None req-dfb3ac36-31ad-4b86-90b9-e94dd672334b None None] Updating volume stats {{(pid=76206) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Nov 06 11:36:41 devstack cinder-volume[76206]: DEBUG oslo_concurrency.processutils [None req-dfb3ac36-31ad-4b86-90b9-e94dd672334b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:36:41 devstack sudo[77055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Nov 06 11:36:41 devstack sudo[77055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:36:42 devstack sudo[77055]: pam_unix(sudo:session): session closed for user root Nov 06 11:36:42 devstack cinder-volume[76206]: DEBUG oslo_concurrency.processutils [None req-dfb3ac36-31ad-4b86-90b9-e94dd672334b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.302s {{(pid=76206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:36:42 devstack cinder-volume[76206]: DEBUG oslo_concurrency.processutils [None req-dfb3ac36-31ad-4b86-90b9-e94dd672334b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:36:42 devstack sudo[77058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 06 11:36:42 devstack sudo[77058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:36:42 devstack sudo[77058]: pam_unix(sudo:session): session closed for user root Nov 06 11:36:42 devstack cinder-volume[76206]: DEBUG oslo_concurrency.processutils [None req-dfb3ac36-31ad-4b86-90b9-e94dd672334b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.272s {{(pid=76206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:36:42 devstack cinder-volume[76206]: DEBUG oslo_concurrency.processutils [None req-dfb3ac36-31ad-4b86-90b9-e94dd672334b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:36:42 devstack sudo[77061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 06 11:36:42 devstack sudo[77061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:36:42 devstack sudo[77061]: pam_unix(sudo:session): session closed for user root Nov 06 11:36:42 devstack cinder-volume[76206]: DEBUG oslo_concurrency.processutils [None req-dfb3ac36-31ad-4b86-90b9-e94dd672334b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.274s {{(pid=76206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:36:42 devstack cinder-volume[76206]: DEBUG oslo_concurrency.processutils [None req-dfb3ac36-31ad-4b86-90b9-e94dd672334b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:36:42 devstack sudo[77064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 06 11:36:42 devstack sudo[77064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:36:42 devstack sudo[77064]: pam_unix(sudo:session): session closed for user root Nov 06 11:36:42 devstack cinder-volume[76206]: DEBUG oslo_concurrency.processutils [None req-dfb3ac36-31ad-4b86-90b9-e94dd672334b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.252s {{(pid=76206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:36:42 devstack cinder-volume[76206]: INFO cinder.volume.manager [None req-dfb3ac36-31ad-4b86-90b9-e94dd672334b None None] Driver post RPC initialization completed successfully. Nov 06 11:36:45 devstack cinder-volume[76042]: DEBUG dbcounter [-] [76042] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=76042) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 11:36:52 devstack cinder-volume[76206]: DEBUG dbcounter [-] [76206] Writing DB stats cinder:SELECT=11,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=76206) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 11:36:53 devstack cinder-volume[76206]: DEBUG dbcounter [-] [76206] Writing DB stats cinder:SELECT=3,cinder:UPDATE=1 {{(pid=76206) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 11:37:35 devstack cinder-volume[76206]: DEBUG oslo_service.periodic_task [None req-6dd84f9e-91b5-4421-85be-b2658bb39695 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76206) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 11:37:35 devstack cinder-volume[76206]: DEBUG cinder.volume.drivers.lvm [None req-6dd84f9e-91b5-4421-85be-b2658bb39695 None None] Updating volume stats {{(pid=76206) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Nov 06 11:37:35 devstack cinder-volume[76206]: DEBUG oslo_concurrency.processutils [None req-6dd84f9e-91b5-4421-85be-b2658bb39695 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:37:35 devstack sudo[78966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Nov 06 11:37:35 devstack sudo[78966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:37:35 devstack sudo[78966]: pam_unix(sudo:session): session closed for user root Nov 06 11:37:35 devstack cinder-volume[76206]: DEBUG oslo_concurrency.processutils [None req-6dd84f9e-91b5-4421-85be-b2658bb39695 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.259s {{(pid=76206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:37:35 devstack cinder-volume[76206]: DEBUG oslo_concurrency.processutils [None req-6dd84f9e-91b5-4421-85be-b2658bb39695 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:37:35 devstack sudo[78969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 06 11:37:35 devstack sudo[78969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:37:35 devstack sudo[78969]: pam_unix(sudo:session): session closed for user root Nov 06 11:37:35 devstack cinder-volume[76206]: DEBUG oslo_concurrency.processutils [None req-6dd84f9e-91b5-4421-85be-b2658bb39695 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.257s {{(pid=76206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:37:35 devstack cinder-volume[76206]: DEBUG oslo_concurrency.processutils [None req-6dd84f9e-91b5-4421-85be-b2658bb39695 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:37:35 devstack sudo[78972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 06 11:37:35 devstack sudo[78972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:37:35 devstack sudo[78972]: pam_unix(sudo:session): session closed for user root Nov 06 11:37:35 devstack cinder-volume[76206]: DEBUG oslo_concurrency.processutils [None req-6dd84f9e-91b5-4421-85be-b2658bb39695 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.251s {{(pid=76206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:37:35 devstack cinder-volume[76206]: DEBUG oslo_concurrency.processutils [None req-6dd84f9e-91b5-4421-85be-b2658bb39695 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:37:35 devstack sudo[78975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 06 11:37:35 devstack sudo[78975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:37:36 devstack sudo[78975]: pam_unix(sudo:session): session closed for user root Nov 06 11:37:36 devstack cinder-volume[76206]: DEBUG oslo_concurrency.processutils [None req-6dd84f9e-91b5-4421-85be-b2658bb39695 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.243s {{(pid=76206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:37:36 devstack cinder-volume[76206]: DEBUG cinder.manager [None req-6dd84f9e-91b5-4421-85be-b2658bb39695 None None] Notifying Schedulers of capabilities ... {{(pid=76206) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 11:37:36 devstack cinder-volume[76206]: DEBUG oslo_service.periodic_task [None req-6dd84f9e-91b5-4421-85be-b2658bb39695 None None] Running periodic task VolumeManager._thread_info {{(pid=76206) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 11:37:36 devstack cinder-volume[76206]: DEBUG cinder.volume.manager [None req-6dd84f9e-91b5-4421-85be-b2658bb39695 None None] thread count: 6 {{(pid=76206) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 06 11:37:36 devstack cinder-volume[76206]: DEBUG cinder.volume.manager [None req-6dd84f9e-91b5-4421-85be-b2658bb39695 None None] thread info: [<_MainThread(MainThread, started 123601980461184)>, , , , , ] {{(pid=76206) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 06 11:38:35 devstack cinder-volume[76206]: DEBUG oslo_service.periodic_task [None req-6dd84f9e-91b5-4421-85be-b2658bb39695 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76206) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 11:38:35 devstack cinder-volume[76206]: DEBUG cinder.volume.drivers.lvm [None req-6dd84f9e-91b5-4421-85be-b2658bb39695 None None] Updating volume stats {{(pid=76206) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Nov 06 11:38:35 devstack cinder-volume[76206]: DEBUG oslo_concurrency.processutils [None req-6dd84f9e-91b5-4421-85be-b2658bb39695 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:38:35 devstack sudo[82282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Nov 06 11:38:35 devstack sudo[82282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:38:35 devstack sudo[82282]: pam_unix(sudo:session): session closed for user root Nov 06 11:38:35 devstack cinder-volume[76206]: DEBUG oslo_concurrency.processutils [None req-6dd84f9e-91b5-4421-85be-b2658bb39695 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.278s {{(pid=76206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:38:35 devstack cinder-volume[76206]: DEBUG oslo_concurrency.processutils [None req-6dd84f9e-91b5-4421-85be-b2658bb39695 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:38:35 devstack sudo[82286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 06 11:38:35 devstack sudo[82286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:38:35 devstack sudo[82286]: pam_unix(sudo:session): session closed for user root Nov 06 11:38:35 devstack cinder-volume[76206]: DEBUG oslo_concurrency.processutils [None req-6dd84f9e-91b5-4421-85be-b2658bb39695 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.275s {{(pid=76206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:38:35 devstack cinder-volume[76206]: DEBUG oslo_concurrency.processutils [None req-6dd84f9e-91b5-4421-85be-b2658bb39695 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:38:35 devstack sudo[82289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 06 11:38:35 devstack sudo[82289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:38:35 devstack sudo[82289]: pam_unix(sudo:session): session closed for user root Nov 06 11:38:35 devstack cinder-volume[76206]: DEBUG oslo_concurrency.processutils [None req-6dd84f9e-91b5-4421-85be-b2658bb39695 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.237s {{(pid=76206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:38:35 devstack cinder-volume[76206]: DEBUG oslo_concurrency.processutils [None req-6dd84f9e-91b5-4421-85be-b2658bb39695 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:38:35 devstack sudo[82296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 06 11:38:35 devstack sudo[82296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:38:36 devstack sudo[82296]: pam_unix(sudo:session): session closed for user root Nov 06 11:38:36 devstack cinder-volume[76206]: DEBUG oslo_concurrency.processutils [None req-6dd84f9e-91b5-4421-85be-b2658bb39695 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.244s {{(pid=76206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:38:36 devstack cinder-volume[76206]: DEBUG cinder.manager [None req-6dd84f9e-91b5-4421-85be-b2658bb39695 None None] Notifying Schedulers of capabilities ... {{(pid=76206) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 11:38:36 devstack cinder-volume[76206]: DEBUG oslo_service.periodic_task [None req-6dd84f9e-91b5-4421-85be-b2658bb39695 None None] Running periodic task VolumeManager._thread_info {{(pid=76206) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 11:38:36 devstack cinder-volume[76206]: DEBUG cinder.volume.manager [None req-6dd84f9e-91b5-4421-85be-b2658bb39695 None None] thread count: 6 {{(pid=76206) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 06 11:38:36 devstack cinder-volume[76206]: DEBUG cinder.volume.manager [None req-6dd84f9e-91b5-4421-85be-b2658bb39695 None None] thread info: [<_MainThread(MainThread, started 123601980461184)>, , , , , ] {{(pid=76206) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 06 11:38:53 devstack cinder-volume[76206]: DEBUG dbcounter [-] [76206] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=76206) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 11:40:35 devstack cinder-volume[76206]: DEBUG oslo_service.periodic_task [None req-6dd84f9e-91b5-4421-85be-b2658bb39695 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76206) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 11:40:35 devstack cinder-volume[76206]: DEBUG cinder.volume.drivers.lvm [None req-6dd84f9e-91b5-4421-85be-b2658bb39695 None None] Updating volume stats {{(pid=76206) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Nov 06 11:40:35 devstack cinder-volume[76206]: DEBUG oslo_concurrency.processutils [None req-6dd84f9e-91b5-4421-85be-b2658bb39695 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:40:35 devstack sudo[85695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Nov 06 11:40:35 devstack sudo[85695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:40:35 devstack sudo[85695]: pam_unix(sudo:session): session closed for user root Nov 06 11:40:35 devstack cinder-volume[76206]: DEBUG oslo_concurrency.processutils [None req-6dd84f9e-91b5-4421-85be-b2658bb39695 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.250s {{(pid=76206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:40:35 devstack cinder-volume[76206]: DEBUG oslo_concurrency.processutils [None req-6dd84f9e-91b5-4421-85be-b2658bb39695 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:40:35 devstack sudo[85700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 06 11:40:35 devstack sudo[85700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:40:35 devstack sudo[85700]: pam_unix(sudo:session): session closed for user root Nov 06 11:40:35 devstack cinder-volume[76206]: DEBUG oslo_concurrency.processutils [None req-6dd84f9e-91b5-4421-85be-b2658bb39695 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.249s {{(pid=76206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:40:35 devstack cinder-volume[76206]: DEBUG oslo_concurrency.processutils [None req-6dd84f9e-91b5-4421-85be-b2658bb39695 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:40:35 devstack sudo[85724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 06 11:40:35 devstack sudo[85724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:40:35 devstack sudo[85724]: pam_unix(sudo:session): session closed for user root Nov 06 11:40:35 devstack cinder-volume[76206]: DEBUG oslo_concurrency.processutils [None req-6dd84f9e-91b5-4421-85be-b2658bb39695 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.242s {{(pid=76206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:40:35 devstack cinder-volume[76206]: DEBUG oslo_concurrency.processutils [None req-6dd84f9e-91b5-4421-85be-b2658bb39695 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:40:35 devstack sudo[85727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 06 11:40:35 devstack sudo[85727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:40:35 devstack sudo[85727]: pam_unix(sudo:session): session closed for user root Nov 06 11:40:36 devstack cinder-volume[76206]: DEBUG oslo_concurrency.processutils [None req-6dd84f9e-91b5-4421-85be-b2658bb39695 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.244s {{(pid=76206) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:40:36 devstack cinder-volume[76206]: DEBUG cinder.manager [None req-6dd84f9e-91b5-4421-85be-b2658bb39695 None None] Notifying Schedulers of capabilities ... {{(pid=76206) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 11:40:36 devstack cinder-volume[76206]: DEBUG oslo_service.periodic_task [None req-6dd84f9e-91b5-4421-85be-b2658bb39695 None None] Running periodic task VolumeManager._thread_info {{(pid=76206) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 11:40:36 devstack cinder-volume[76206]: DEBUG cinder.volume.manager [None req-6dd84f9e-91b5-4421-85be-b2658bb39695 None None] thread count: 6 {{(pid=76206) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 06 11:40:36 devstack cinder-volume[76206]: DEBUG cinder.volume.manager [None req-6dd84f9e-91b5-4421-85be-b2658bb39695 None None] thread info: [<_MainThread(MainThread, started 123601980461184)>, , , , , ] {{(pid=76206) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 06 11:40:53 devstack cinder-volume[76206]: DEBUG dbcounter [-] [76206] Writing DB stats cinder:SELECT=1 {{(pid=76206) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 11:40:53 devstack cinder-volume[76206]: DEBUG dbcounter [-] [76206] Writing DB stats cinder:UPDATE=1 {{(pid=76206) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 11:40:56 devstack cinder-volume[76042]: INFO oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] Caught SIGTERM, stopping children Nov 06 11:40:56 devstack cinder-volume[76042]: DEBUG oslo_concurrency.lockutils [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] Acquiring lock "singleton_lock" {{(pid=76042) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Nov 06 11:40:56 devstack cinder-volume[76042]: DEBUG oslo_concurrency.lockutils [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] Acquired lock "singleton_lock" {{(pid=76042) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Nov 06 11:40:56 devstack cinder-volume[76042]: DEBUG oslo_concurrency.lockutils [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] Releasing lock "singleton_lock" {{(pid=76042) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Nov 06 11:40:56 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] Stop services. {{(pid=76042) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Nov 06 11:40:56 devstack cinder-volume[76042]: DEBUG oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] Killing children. {{(pid=76042) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Nov 06 11:40:56 devstack cinder-volume[76042]: INFO oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] Waiting on 1 children to exit Nov 06 11:40:56 devstack cinder-volume[76206]: DEBUG oslo_concurrency.lockutils [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] Acquiring lock "singleton_lock" {{(pid=76206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Nov 06 11:40:56 devstack cinder-volume[76206]: DEBUG oslo_concurrency.lockutils [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] Acquired lock "singleton_lock" {{(pid=76206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Nov 06 11:40:56 devstack cinder-volume[76206]: DEBUG oslo_concurrency.lockutils [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] Releasing lock "singleton_lock" {{(pid=76206) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Nov 06 11:40:56 devstack cinder-volume[76206]: WARNING amqp [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] Received method (60, 30) during closing channel 1. This method will be ignored Nov 06 11:40:56 devstack cinder-volume[76206]: WARNING amqp [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] Received method (60, 30) during closing channel 1. This method will be ignored Nov 06 11:40:56 devstack cinder-volume[76042]: INFO oslo_service.backend._eventlet.service [None req-5085d236-ed47-4c20-a69d-27c81a6dc24c None None] Child 76206 exited with status 0 Nov 06 11:40:57 devstack cinder-volume[86264]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Nov 06 11:40:57 devstack cinder-volume[86264]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Nov 06 11:40:57 devstack cinder-volume[86264]: we strongly recommend against using it for new projects. Nov 06 11:40:57 devstack cinder-volume[86264]: If you are already using Eventlet, we recommend migrating to a different Nov 06 11:40:57 devstack cinder-volume[86264]: framework. For more detail see Nov 06 11:40:57 devstack cinder-volume[86264]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Nov 06 11:40:57 devstack cinder-volume[86264]: import eventlet # noqa Nov 06 11:40:59 devstack cinder-volume[86264]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=86264) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Nov 06 11:40:59 devstack cinder-volume[86264]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=86264) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Nov 06 11:40:59 devstack cinder-volume[86264]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=86264) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Nov 06 11:40:59 devstack cinder-volume[86264]: INFO dbcounter [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] Registered counter for database cinder Nov 06 11:40:59 devstack cinder-volume[86264]: DEBUG oslo_db.sqlalchemy.engines [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86264) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 06 11:41:00 devstack cinder-volume[86264]: DEBUG dbcounter [-] [86264] Writer thread running {{(pid=86264) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Nov 06 11:41:00 devstack cinder-volume[86264]: INFO cinder.rpc [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Nov 06 11:41:00 devstack cinder-volume[86264]: INFO cinder.rpc [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Nov 06 11:41:00 devstack cinder-volume[86264]: DEBUG oslo_db.sqlalchemy.engines [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86264) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 06 11:41:00 devstack cinder-volume[86264]: INFO cinder.volume.manager [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] Determined volume DB was empty at startup. Nov 06 11:41:00 devstack cinder-volume[86264]: DEBUG cinder.volume.manager [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=86264) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Nov 06 11:41:00 devstack cinder-volume[86264]: INFO cinder.volume.manager [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] Service not found for updating active_backend_id, assuming default for driver init. Nov 06 11:41:00 devstack cinder-volume[86264]: WARNING stevedore.named [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 06 11:41:00 devstack cinder-volume[86264]: WARNING castellan.key_manager [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 06 11:41:00 devstack cinder-volume[86264]: WARNING cinder.keymgr.conf_key_mgr [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 06 11:41:00 devstack cinder-volume[86264]: INFO cinder.volume.manager [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] Image-volume cache disabled for host devstack@QuobyteHD. Nov 06 11:41:00 devstack cinder-volume[86264]: DEBUG oslo_db.sqlalchemy.engines [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86264) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 06 11:41:00 devstack cinder-volume[86264]: INFO oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] Starting 1 workers Nov 06 11:41:00 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] Started child 86483 {{(pid=86264) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Nov 06 11:41:00 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] Full set of CONF: {{(pid=86264) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Nov 06 11:41:00 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] ******************************************************************************** {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Nov 06 11:41:00 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] Configuration options gathered from: {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Nov 06 11:41:00 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Nov 06 11:41:00 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Nov 06 11:41:00 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] ================================================================================ {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Nov 06 11:41:00 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] allow_availability_zone_fallback = False {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 11:41:00 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] allow_compression_on_image_upload = False {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 11:41:00 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] allowed_direct_url_schemes = [] {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 11:41:00 devstack cinder-volume[86483]: INFO cinder.service [-] Starting cinder-volume node (version 29.0.1) Nov 06 11:41:00 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] api_rate_limit = True {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 11:41:00 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] auth_strategy = keystone {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 11:41:00 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] backend_availability_zone = None {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 11:41:00 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] backend_host = None {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 11:41:00 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] backend_name = None {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 11:41:00 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] backend_stats_polling_interval = 60 {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 11:41:00 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] backup_api_class = cinder.backup.api.API {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 11:41:00 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 11:41:00 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] backup_name_template = backup-%s {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 11:41:00 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] backup_use_same_host = False {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 11:41:00 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] backup_use_temp_snapshot = False {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 11:41:00 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] chap_password = **** {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 11:41:00 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] chap_username = {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 11:41:00 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 11:41:00 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] cinder_internal_tenant_project_id = ca6a1b9dba25443790332d791fad7827 {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 11:41:00 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] cinder_internal_tenant_user_id = e7ba6dd3780e4a6c97773800d63c345c {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 11:41:00 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] cluster = None {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 11:41:00 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] compression_format = gzip {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 11:41:00 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] compute_api_class = cinder.compute.nova.API {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 11:41:00 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] config_dir = [] {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 11:41:00 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 11:41:00 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] config_source = [] {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 11:41:00 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 11:41:00 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] control_exchange = openstack {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 11:41:00 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] debug = True {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 11:41:00 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] default_availability_zone = None {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 11:41:00 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] default_group_type = None {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 11:41:00 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 11:41:00 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] default_volume_type = QuobyteHD {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 11:41:00 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] disk_geometry = None {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 11:41:00 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] driver_client_cert = None {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 11:41:00 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] driver_client_cert_key = None {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 11:41:00 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] driver_data_namespace = None {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 11:41:00 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] driver_ssl_cert_path = None {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 11:41:00 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] driver_ssl_cert_verify = False {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 11:41:00 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] driver_use_ssl = False {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 11:41:00 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] enable_new_services = True {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 11:41:00 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] enable_unsupported_driver = False {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 11:41:00 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] enabled_backends = ['QuobyteHD'] {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 11:41:00 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] enforce_multipath_for_image_xfer = False {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 11:41:00 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] filter_function = None {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 11:41:00 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] glance_api_insecure = False {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 11:41:00 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] glance_api_servers = ['http://192.168.122.9/image'] {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 11:41:00 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] glance_api_ssl_compression = False {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 11:41:00 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] glance_ca_certificates_file = None {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 11:41:00 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] glance_catalog_info = image:glance:publicURL {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 11:41:00 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] glance_certfile = None {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 11:41:00 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 11:41:00 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] glance_keyfile = None {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 11:41:00 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] glance_num_retries = 3 {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 11:41:00 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] glance_request_timeout = None {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 11:41:00 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] goodness_function = None {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 11:41:00 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] graceful_shutdown_timeout = 5 {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 11:41:00 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] group_api_class = cinder.group.api.API {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 11:41:00 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] host = devstack {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 11:41:00 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] image_compress_on_upload = True {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 11:41:00 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] image_conversion_address_space_limit = 1 {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 11:41:00 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] image_conversion_cpu_limit = 60 {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 11:41:00 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 11:41:00 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] image_conversion_disable = False {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 11:41:00 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] image_introspection_address_space_limit = 1 {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 11:41:00 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] image_introspection_cpu_limit = 60 {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 11:41:00 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] image_upload_use_cinder_backend = False {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 11:41:00 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] image_upload_use_internal_tenant = False {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 11:41:00 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] image_volume_cache_enabled = False {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 11:41:00 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] image_volume_cache_max_count = 0 {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 11:41:00 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] image_volume_cache_max_size_gb = 0 {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 11:41:00 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] init_host_max_objects_retrieval = 0 {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 11:41:00 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] instance_format = [instance: %(uuid)s] {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 11:41:00 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 11:41:00 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] iscsi_target_flags = {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 11:41:00 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] iscsi_write_cache = on {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 11:41:00 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] iser_helper = tgtadm {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 11:41:00 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] iser_ip_address = 192.168.122.9 {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 11:41:00 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] iser_port = 3260 {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 11:41:00 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 11:41:00 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] log_color = False {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 11:41:00 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] log_config_append = None {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 11:41:00 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 11:41:00 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] log_dir = None {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 11:41:00 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] log_file = None {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 11:41:00 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] log_options = True {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 11:41:00 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] log_rotate_interval = 1 {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 11:41:00 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] log_rotate_interval_type = days {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 11:41:00 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] log_rotation_type = none {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 11:41:00 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 11:41:00 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 11:41:00 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 11:41:00 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 11:41:00 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 11:41:00 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] max_age = 0 {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 11:41:00 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] max_logfile_count = 30 {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 11:41:00 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] max_logfile_size_mb = 200 {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 11:41:00 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] max_over_subscription_ratio = 20.0 {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 11:41:00 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] message_reap_interval = 86400 {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 11:41:00 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] message_ttl = 2592000 {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 11:41:00 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] migration_create_volume_timeout_secs = 300 {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 11:41:00 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] monkey_patch = False {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 11:41:00 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] monkey_patch_modules = [] {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 11:41:00 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] my_ip = 192.168.122.9 {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 11:41:00 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] no_snapshot_gb_quota = False {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 11:41:00 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] num_iser_scan_tries = 3 {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 11:41:00 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] num_shell_tries = 3 {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 11:41:00 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] num_volume_device_scan_tries = 3 {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 11:41:00 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] nvmeof_conn_info_version = 1 {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 11:41:00 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] nvmet_ns_id = 10 {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 11:41:00 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] nvmet_port_id = 1 {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 11:41:00 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] osapi_max_limit = 1000 {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 11:41:00 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] osapi_volume_ext_list = [] {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 11:41:00 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 11:41:00 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] osapi_volume_listen = 0.0.0.0 {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 11:41:00 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] osapi_volume_listen_port = 8776 {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 11:41:00 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] osapi_volume_use_ssl = False {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 11:41:00 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] osapi_volume_workers = None {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 11:41:00 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] per_volume_size_limit = -1 {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 11:41:00 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] periodic_fuzzy_delay = 60 {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 11:41:00 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] periodic_interval = 60 {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 11:41:00 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] project_id_regex = [0-9a-f\-]+ {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 11:41:00 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] public_endpoint = None {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 11:41:00 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] publish_errors = False {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 11:41:00 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] quota_backup_gigabytes = 1000 {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 11:41:00 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] quota_backups = 10 {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 11:41:00 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 11:41:00 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] quota_gigabytes = 1000 {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 11:41:00 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] quota_groups = 10 {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 11:41:00 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] quota_snapshots = 10 {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 11:41:00 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] quota_volumes = 10 {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 11:41:00 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] rate_limit_burst = 0 {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 11:41:00 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] rate_limit_except_level = CRITICAL {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 11:41:00 devstack cinder-volume[86483]: INFO cinder.volume.manager [None req-947b30ad-2e2b-4b85-a2e8-94486c58246f None None] Starting volume driver QuobyteDriver (1.2.1) Nov 06 11:41:00 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] rate_limit_interval = 0 {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 11:41:00 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] reinit_driver_count = 3 {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 11:41:00 devstack cinder-volume[86483]: DEBUG cinder.volume.drivers.remotefs [None req-947b30ad-2e2b-4b85-a2e8-94486c58246f None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=86483) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Nov 06 11:41:00 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] replication_device = **** {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 11:41:00 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] report_discard_supported = False {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 11:41:00 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] report_interval = 120 {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 11:41:00 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] reservation_clean_interval = 86400 {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 11:41:00 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] reservation_expire = 86400 {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 11:41:00 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] reserved_image_namespaces = [] {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 11:41:00 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] reserved_percentage = 0 {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 11:41:00 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 11:41:00 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 11:41:00 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] rpc_response_timeout = 120 {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 11:41:00 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] run_external_periodic_tasks = True {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 11:41:00 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 11:41:00 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] scst_target_driver = iscsi {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 11:41:00 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] scst_target_iqn_name = None {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 11:41:00 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] service_down_time = 720 {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 11:41:00 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] shell_completion = None {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 11:41:00 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] snapshot_name_template = snapshot-%s {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 11:41:00 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] split_loggers = False {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 11:41:00 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] state_path = /opt/stack/data/cinder {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 11:41:00 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] storage_availability_zone = nova {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 11:41:00 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] storage_protocol = iSCSI {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 11:41:00 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] syslog_log_facility = LOG_USER {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 11:41:00 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] target_helper = lioadm {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 11:41:00 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] target_ip_address = 192.168.122.9 {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 11:41:00 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] target_port = 3260 {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 11:41:00 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 11:41:00 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] target_protocol = iscsi {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 11:41:00 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] target_secondary_ip_addresses = [] {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 11:41:00 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] trace_flags = None {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 11:41:00 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] transfer_api_class = cinder.transfer.api.API {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 11:41:00 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] transport_url = **** {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 11:41:00 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] until_refresh = 0 {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 11:41:00 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] use_chap_auth = False {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 11:41:00 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] use_default_quota_class = True {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 11:41:00 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] use_journal = False {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 11:41:00 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] use_json = False {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 11:41:00 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] use_multipath_for_image_xfer = False {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 11:41:00 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] use_stderr = False {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 11:41:00 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] use_syslog = False {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 11:41:00 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] verify_glance_signatures = enabled {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 11:41:00 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 11:41:00 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] volume_api_class = cinder.volume.api.API {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 11:41:00 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] volume_backend_name = None {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 11:41:00 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] volume_clear = zero {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 11:41:00 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] volume_clear_ionice = None {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 11:41:00 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] volume_clear_size = 0 {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 11:41:00 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 11:41:00 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] volume_copy_bps_limit = 0 {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 11:41:00 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] volume_dd_blocksize = 1M {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 11:41:00 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 11:41:00 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] volume_name_template = volume-%s {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 11:41:00 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] volume_service_inithost_offload = False {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 11:41:00 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] volume_usage_audit_period = month {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 11:41:00 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 11:41:00 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] zoning_mode = None {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 11:41:00 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] oslo_concurrency.disable_process_locking = False {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:00 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:00 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:00 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:00 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:00 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:00 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:00 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:00 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:00 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:00 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] keystone_authtoken.auth_section = None {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:00 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] keystone_authtoken.auth_type = password {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:00 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] keystone_authtoken.auth_version = None {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:00 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] keystone_authtoken.cache = None {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:00 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:00 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] keystone_authtoken.certfile = None {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:00 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] keystone_authtoken.delay_auth_decision = False {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:00 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:00 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] keystone_authtoken.http_connect_timeout = None {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:00 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:00 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] keystone_authtoken.include_service_catalog = True {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:00 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] keystone_authtoken.insecure = False {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:00 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] keystone_authtoken.interface = public {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:00 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] keystone_authtoken.keyfile = None {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:00 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] keystone_authtoken.memcache_password = **** {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:00 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:00 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:00 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:00 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:00 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:00 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:00 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:00 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:00 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:00 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:00 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:00 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:00 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:00 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:00 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] keystone_authtoken.memcache_username = None {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:00 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:00 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] keystone_authtoken.region_name = None {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:00 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:00 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] keystone_authtoken.service_token_roles_required = True {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:00 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] keystone_authtoken.service_type = None {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:00 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] keystone_authtoken.token_cache_time = 300 {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:00 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.9/identity {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:00 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] cache.backend = dogpile.cache.null {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:00 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] cache.backend_argument = **** {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:00 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] cache.backend_expiration_time = None {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:00 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] cache.config_prefix = cache.oslo {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:00 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] cache.debug_cache_backend = False {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:00 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] cache.enable_retry_client = False {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:00 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] cache.enable_socket_keepalive = False {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:00 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] cache.enabled = False {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:00 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] cache.expiration_time = 600 {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:00 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:00 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] cache.hashclient_retry_attempts = 2 {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:00 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:00 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] cache.memcache_dead_retry = 300 {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:00 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:00 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:00 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] cache.memcache_pool_maxsize = 10 {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:00 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:00 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] cache.memcache_sasl_enabled = False {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:00 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:00 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] cache.password = **** {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:00 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] cache.proxies = [] {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:00 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] cache.redis_db = 0 {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:00 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] cache.redis_sentinel_service_name = mymaster {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:00 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:00 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] cache.redis_server = localhost:6379 {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:00 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] cache.retry_attempts = 2 {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:00 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] cache.retry_delay = 0.0 {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:00 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] cache.socket_keepalive_count = 1 {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:00 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] cache.socket_keepalive_idle = 1 {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:00 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] cache.socket_keepalive_interval = 1 {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:00 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] cache.socket_timeout = 1.0 {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:00 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] cache.tls_allowed_ciphers = None {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:00 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] cache.tls_cafile = None {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:00 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] cache.tls_certfile = None {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:00 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] cache.tls_enabled = False {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:00 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] cache.tls_keyfile = None {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:00 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] cache.username = None {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:00 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] coordination.backend_url = **** {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:00 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] database.asyncio_connection = **** {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:00 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] database.asyncio_slave_connection = **** {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:00 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] database.backend = sqlalchemy {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:00 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] database.connection = **** {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:00 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] database.connection_debug = 0 {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:00 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] database.connection_parameters = {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:00 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] database.connection_recycle_time = 3600 {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:00 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] database.connection_trace = False {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:00 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] database.db_inc_retry_interval = True {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:00 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] database.db_max_retries = 20 {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:00 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] database.db_max_retry_interval = 10 {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:00 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] database.db_retry_interval = 1 {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:00 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] database.max_overflow = 50 {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:00 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] database.max_pool_size = 5 {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:00 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] database.max_retries = 10 {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:00 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:00 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] database.mysql_wsrep_sync_wait = None {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:00 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] database.pool_timeout = None {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:00 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] database.retry_interval = 10 {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:00 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] database.slave_connection = **** {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:00 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] database.sqlite_synchronous = True {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:00 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] database.synchronous_reader = True {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:00 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] database.use_db_reconnect = False {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:00 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:00 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:00 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:00 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:00 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:00 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] oslo_messaging_tracing.insecure = False {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:00 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:00 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:00 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:00 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:00 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] profiler.connection_string = messaging:// {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:00 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] profiler.enabled = False {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:00 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] profiler.es_doc_type = notification {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:00 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] profiler.es_scroll_size = 10000 {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:00 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] profiler.es_scroll_time = 2m {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:00 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] profiler.filter_error_trace = False {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:00 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] profiler.hmac_keys = **** {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:00 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] profiler.sentinel_service_name = mymaster {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:00 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] profiler.socket_timeout = 0.1 {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:00 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] profiler.trace_requests = False {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:00 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] profiler.trace_sqlalchemy = False {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:00 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] profiler_jaeger.process_tags = {} {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:00 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] profiler_jaeger.service_name_prefix = None {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:00 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] profiler_otlp.service_name_prefix = None {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:00 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] oslo_policy.enforce_new_defaults = True {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:00 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] oslo_policy.policy_default_rule = default {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:00 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:00 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] oslo_policy.policy_file = policy.yaml {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:00 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:00 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:00 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:00 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:00 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:00 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] oslo_policy.remote_timeout = 60.0 {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:00 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:00 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] privsep_osbrick.group = None {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:00 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] privsep_osbrick.helper_command = None {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:00 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:00 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:00 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:00 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] privsep_osbrick.user = None {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:00 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:00 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] cinder_sys_admin.group = None {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:00 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] cinder_sys_admin.helper_command = None {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:00 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:00 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:00 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:00 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] cinder_sys_admin.user = None {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:00 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] service_user.auth_section = None {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:00 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] service_user.auth_type = password {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:00 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] service_user.cafile = None {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:00 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] service_user.certfile = None {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:00 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] service_user.collect_timing = False {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:00 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] service_user.insecure = False {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:00 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] service_user.keyfile = None {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:00 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] service_user.send_service_user_token = True {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:00 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] service_user.split_loggers = False {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:00 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] service_user.timeout = None {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:00 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] service_user.tls_ciphers = None {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:00 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] service_user.tls_min_version = None {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:00 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] glance.auth_section = None {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:00 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] glance.auth_type = password {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:00 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:00 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] glance.certfile = None {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:00 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] glance.collect_timing = False {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:00 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] glance.insecure = False {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:00 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] glance.keyfile = None {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:00 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] glance.region_name = None {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:00 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] glance.split_loggers = False {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:00 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] glance.timeout = None {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:00 devstack cinder-volume[86483]: DEBUG cinder.volume.drivers.quobyte [None req-947b30ad-2e2b-4b85-a2e8-94486c58246f None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=86483) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:304}} Nov 06 11:41:00 devstack cinder-volume[86483]: WARNING cinder.volume.drivers.quobyte [None req-947b30ad-2e2b-4b85-a2e8-94486c58246f None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Nov 06 11:41:00 devstack cinder-volume[86483]: WARNING cinder.volume.drivers.quobyte [None req-947b30ad-2e2b-4b85-a2e8-94486c58246f None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Nov 06 11:41:00 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] glance.tls_ciphers = None {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:00 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] glance.tls_min_version = None {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:00 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] backend_defaults.backend_availability_zone = None {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:00 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:00 devstack cinder-volume[86483]: DEBUG oslo_concurrency.processutils [None req-947b30ad-2e2b-4b85-a2e8-94486c58246f None None] Running cmd (subprocess): mount.quobyte {{(pid=86483) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:41:00 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:00 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] backend_defaults.chap_password = **** {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:00 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] backend_defaults.chap_username = {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:00 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:00 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] backend_defaults.disk_geometry = None {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:00 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] backend_defaults.driver_client_cert = None {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:00 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] backend_defaults.driver_client_cert_key = None {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:00 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] backend_defaults.driver_data_namespace = None {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:00 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:00 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:00 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] backend_defaults.driver_use_ssl = False {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:00 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] backend_defaults.enable_unsupported_driver = False {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:00 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:00 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] backend_defaults.extra_capabilities = {} {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:00 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] backend_defaults.filter_function = None {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:00 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] backend_defaults.goodness_function = None {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:00 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:00 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:00 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:00 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:00 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:00 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] backend_defaults.iscsi_target_flags = {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:00 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] backend_defaults.iscsi_write_cache = on {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:00 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] backend_defaults.iser_helper = tgtadm {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:00 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] backend_defaults.iser_ip_address = 192.168.122.9 {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:00 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] backend_defaults.iser_port = 3260 {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:00 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:00 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:00 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] backend_defaults.nas_host = {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:00 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] backend_defaults.nas_login = admin {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:00 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] backend_defaults.nas_mount_options = None {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:00 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] backend_defaults.nas_password = **** {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:00 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] backend_defaults.nas_private_key = {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:00 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:00 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:00 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] backend_defaults.nas_share_path = {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:00 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] backend_defaults.nas_ssh_port = 22 {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:00 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:00 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:00 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] backend_defaults.num_shell_tries = 3 {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:00 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:00 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:00 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:00 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] backend_defaults.nvmet_port_id = 1 {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:00 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] backend_defaults.quobyte_client_cfg = None {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:00 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:00 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:00 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:00 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:00 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:00 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] backend_defaults.quobyte_volume_url = None {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:00 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] backend_defaults.replication_device = **** {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:00 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] backend_defaults.report_discard_supported = False {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:00 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] backend_defaults.reserved_percentage = 0 {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:00 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] backend_defaults.scst_target_driver = iscsi {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:00 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] backend_defaults.scst_target_iqn_name = None {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:00 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] backend_defaults.storage_protocol = iSCSI {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:00 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:00 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] backend_defaults.target_helper = tgtadm {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:00 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] backend_defaults.target_ip_address = 192.168.122.9 {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:00 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] backend_defaults.target_port = 3260 {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:00 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:00 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] backend_defaults.target_protocol = iscsi {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:00 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:00 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] backend_defaults.trace_flags = None {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:00 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] backend_defaults.unique_fqdn_network = True {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:00 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] backend_defaults.use_chap_auth = False {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:00 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:00 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] backend_defaults.volume_backend_name = None {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:00 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] backend_defaults.volume_clear = zero {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:00 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] backend_defaults.volume_clear_ionice = None {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:00 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] backend_defaults.volume_clear_size = 0 {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:00 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:00 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:00 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:00 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:00 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:00 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] oslo_reports.file_event_handler = None {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:00 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:00 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] oslo_reports.log_dir = None {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:00 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] QuobyteHD.backend_availability_zone = None {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:00 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] QuobyteHD.backend_host = None {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:00 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:00 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:00 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] QuobyteHD.chap_password = **** {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:00 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] QuobyteHD.chap_username = None {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:00 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] QuobyteHD.chiscsi_conf = None {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:00 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] QuobyteHD.disk_geometry = None {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:00 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] QuobyteHD.driver_client_cert = None {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:00 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] QuobyteHD.driver_client_cert_key = None {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:00 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] QuobyteHD.driver_data_namespace = None {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:00 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:00 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:00 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] QuobyteHD.driver_use_ssl = None {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:00 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] QuobyteHD.enable_unsupported_driver = None {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:00 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:00 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] QuobyteHD.extra_capabilities = None {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:00 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] QuobyteHD.filter_function = None {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:00 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] QuobyteHD.goodness_function = None {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:00 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:00 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:00 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:00 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:00 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:00 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] QuobyteHD.iscsi_target_flags = None {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:00 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] QuobyteHD.iscsi_write_cache = None {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:00 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] QuobyteHD.iser_helper = None {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:00 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] QuobyteHD.iser_ip_address = None {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:00 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] QuobyteHD.iser_port = None {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:00 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] QuobyteHD.iser_target_prefix = None {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:00 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:00 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] QuobyteHD.nas_host = None {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:00 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] QuobyteHD.nas_login = None {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:00 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] QuobyteHD.nas_mount_options = None {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:00 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] QuobyteHD.nas_password = **** {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:00 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] QuobyteHD.nas_private_key = None {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:00 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:00 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:00 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] QuobyteHD.nas_share_path = None {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:00 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] QuobyteHD.nas_ssh_port = None {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:00 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:00 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:00 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] QuobyteHD.num_shell_tries = None {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:00 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:00 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:00 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] QuobyteHD.nvmet_ns_id = None {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:00 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] QuobyteHD.nvmet_port_id = None {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:00 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:01 devstack quobyte-client[86484]: Reading configuration file: /etc/quobyte/client.cfg Nov 06 11:41:01 devstack quobyte-client[86484]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Nov 06 11:41:01 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:01 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:01 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:01 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:01 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:01 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:01 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] QuobyteHD.replication_device = **** {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:01 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] QuobyteHD.report_discard_supported = None {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:01 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] QuobyteHD.reserved_percentage = None {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:01 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] QuobyteHD.scst_target_driver = None {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:01 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:01 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] QuobyteHD.storage_protocol = None {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:01 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:01 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] QuobyteHD.target_helper = None {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:01 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] QuobyteHD.target_ip_address = None {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:01 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] QuobyteHD.target_port = None {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:01 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] QuobyteHD.target_prefix = None {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:01 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] QuobyteHD.target_protocol = None {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:01 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:01 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] QuobyteHD.trace_flags = None {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:01 devstack cinder-volume[86483]: DEBUG oslo_concurrency.processutils [None req-947b30ad-2e2b-4b85-a2e8-94486c58246f None None] CMD "mount.quobyte" returned: 1 in 0.117s {{(pid=86483) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:41:01 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] QuobyteHD.unique_fqdn_network = None {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:01 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] QuobyteHD.use_chap_auth = None {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:01 devstack cinder-volume[86483]: DEBUG oslo_concurrency.lockutils [None req-947b30ad-2e2b-4b85-a2e8-94486c58246f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86483) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 11:41:01 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:01 devstack cinder-volume[86483]: DEBUG oslo_concurrency.lockutils [None req-947b30ad-2e2b-4b85-a2e8-94486c58246f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86483) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 11:41:01 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:01 devstack cinder-volume[86483]: DEBUG cinder.volume.drivers.quobyte [None req-947b30ad-2e2b-4b85-a2e8-94486c58246f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f': None} {{(pid=86483) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 11:41:01 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] QuobyteHD.volume_clear = None {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:01 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] QuobyteHD.volume_clear_ionice = None {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:01 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] QuobyteHD.volume_clear_size = None {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:01 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:01 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:01 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:01 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:01 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] QuobyteHD.volumes_dir = None {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:01 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:01 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:01 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:01 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:01 devstack cinder-volume[86483]: INFO cinder.volume.drivers.quobyte [None req-947b30ad-2e2b-4b85-a2e8-94486c58246f None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f ... Nov 06 11:41:01 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:01 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:01 devstack cinder-volume[86483]: DEBUG oslo_concurrency.processutils [None req-947b30ad-2e2b-4b85-a2e8-94486c58246f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756 -c /etc/quobyte/client-cinder.cfg {{(pid=86483) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:41:01 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:01 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:01 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:01 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:01 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:01 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:01 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:01 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:01 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:01 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:01 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:01 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:01 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:01 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:01 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:01 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:01 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:01 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:01 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:01 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:01 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:01 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:01 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:01 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] oslo_messaging_rabbit.ssl = False {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:01 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:01 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:01 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:01 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:01 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:01 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] oslo_messaging_rabbit.ssl_version = {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:01 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:01 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] oslo_messaging_notifications.driver = [] {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:01 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] oslo_messaging_notifications.retry = -1 {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:01 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:01 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] oslo_messaging_notifications.transport_url = **** {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:01 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:01 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] key_manager.fixed_key = **** {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:01 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:01 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] barbican.barbican_api_version = None {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:01 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] barbican.barbican_endpoint = None {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:01 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] barbican.barbican_endpoint_type = public {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:01 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] barbican.barbican_region_name = None {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:01 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] barbican.cafile = None {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:01 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] barbican.certfile = None {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:01 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] barbican.collect_timing = False {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:01 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] barbican.insecure = False {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:01 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] barbican.keyfile = None {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:01 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] barbican.number_of_retries = 60 {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:01 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] barbican.retry_delay = 1 {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:01 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] barbican.send_service_user_token = False {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:01 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] barbican.split_loggers = False {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:01 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] barbican.timeout = None {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:01 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] barbican.tls_ciphers = None {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:01 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] barbican.tls_min_version = None {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:01 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] barbican.verify_ssl = True {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:01 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] barbican.verify_ssl_path = None {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:01 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] barbican_service_user.auth_section = None {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:01 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] barbican_service_user.auth_type = None {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:01 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] barbican_service_user.cafile = None {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:01 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] barbican_service_user.certfile = None {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:01 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] barbican_service_user.collect_timing = False {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:01 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] barbican_service_user.insecure = False {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:01 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] barbican_service_user.keyfile = None {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:01 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] barbican_service_user.split_loggers = False {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:01 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] barbican_service_user.timeout = None {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:01 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] barbican_service_user.tls_ciphers = None {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:01 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] barbican_service_user.tls_min_version = None {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:01 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] vault.approle_role_id = **** {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:01 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] vault.approle_secret_id = **** {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:01 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] vault.auth_method = approle {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:01 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] vault.auth_path = None {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:01 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] vault.kv_mountpoint = secret {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:01 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] vault.kv_path = None {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:01 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] vault.kv_version = 2 {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:01 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] vault.namespace = None {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:01 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] vault.root_token_id = **** {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:01 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] vault.ssl_ca_crt_file = None {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:01 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] vault.timeout = 60.0 {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:01 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] vault.token_file = None {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:01 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] vault.token_role = None {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:01 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] vault.use_ssl = False {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:01 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:01 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] ******************************************************************************** {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Nov 06 11:41:01 devstack sudo[86489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756 -c /etc/quobyte/client-cinder.cfg Nov 06 11:41:01 devstack sudo[86489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:41:01 devstack sudo[86489]: pam_unix(sudo:session): session closed for user root Nov 06 11:41:01 devstack cinder-volume[86483]: DEBUG oslo_concurrency.processutils [None req-947b30ad-2e2b-4b85-a2e8-94486c58246f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756 -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.422s {{(pid=86483) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:41:01 devstack cinder-volume[86483]: INFO cinder.volume.drivers.quobyte [None req-947b30ad-2e2b-4b85-a2e8-94486c58246f None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f succeeded Nov 06 11:41:01 devstack cinder-volume[86483]: DEBUG cinder.volume.drivers.quobyte [None req-947b30ad-2e2b-4b85-a2e8-94486c58246f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f'] {{(pid=86483) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 11:41:01 devstack cinder-volume[86483]: DEBUG oslo_concurrency.lockutils [None req-947b30ad-2e2b-4b85-a2e8-94486c58246f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.436s {{(pid=86483) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 11:41:01 devstack cinder-volume[86483]: DEBUG oslo_concurrency.processutils [None req-947b30ad-2e2b-4b85-a2e8-94486c58246f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756 {{(pid=86483) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:41:01 devstack sudo[86591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756 Nov 06 11:41:01 devstack sudo[86591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:41:01 devstack sudo[86591]: pam_unix(sudo:session): session closed for user root Nov 06 11:41:01 devstack cinder-volume[86483]: DEBUG oslo_concurrency.processutils [None req-947b30ad-2e2b-4b85-a2e8-94486c58246f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756" returned: 0 in 0.247s {{(pid=86483) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:41:01 devstack cinder-volume[86483]: INFO cinder.volume.driver [None req-947b30ad-2e2b-4b85-a2e8-94486c58246f None None] Driver hasn't implemented _init_vendor_properties() Nov 06 11:41:01 devstack cinder-volume[86483]: DEBUG cinder.volume.driver [None req-947b30ad-2e2b-4b85-a2e8-94486c58246f None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.401268005371, 'free_capacity_gb': 1773.401268005371, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86483) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Nov 06 11:41:01 devstack cinder-volume[86483]: DEBUG oslo_db.sqlalchemy.engines [None req-947b30ad-2e2b-4b85-a2e8-94486c58246f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86483) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 06 11:41:01 devstack cinder-volume[86483]: DEBUG dbcounter [-] [86483] Writer thread running {{(pid=86483) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Nov 06 11:41:01 devstack cinder-volume[86483]: DEBUG cinder.db.api [None req-947b30ad-2e2b-4b85-a2e8-94486c58246f None None] Building query based on filter {{(pid=86483) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Nov 06 11:41:01 devstack cinder-volume[86483]: DEBUG cinder.image.image_utils [None req-947b30ad-2e2b-4b85-a2e8-94486c58246f None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=86483) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1325}} Nov 06 11:41:01 devstack cinder-volume[86483]: INFO cinder.keymgr.migration [None req-8d147b6e-d501-4c2b-8c3b-3b32c198992f None None] Not migrating encryption keys because the ConfKeyManager is still in use. Nov 06 11:41:01 devstack cinder-volume[86483]: DEBUG oslo_concurrency.lockutils [None req-947b30ad-2e2b-4b85-a2e8-94486c58246f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86483) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 11:41:01 devstack cinder-volume[86483]: DEBUG oslo_concurrency.lockutils [None req-947b30ad-2e2b-4b85-a2e8-94486c58246f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86483) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 11:41:01 devstack cinder-volume[86483]: DEBUG cinder.volume.drivers.quobyte [None req-947b30ad-2e2b-4b85-a2e8-94486c58246f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f': None} {{(pid=86483) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 11:41:01 devstack cinder-volume[86483]: DEBUG cinder.volume.drivers.quobyte [None req-947b30ad-2e2b-4b85-a2e8-94486c58246f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f'] {{(pid=86483) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 11:41:01 devstack cinder-volume[86483]: DEBUG oslo_concurrency.lockutils [None req-947b30ad-2e2b-4b85-a2e8-94486c58246f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86483) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 11:41:01 devstack cinder-volume[86483]: DEBUG oslo_concurrency.processutils [None req-947b30ad-2e2b-4b85-a2e8-94486c58246f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756 {{(pid=86483) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:41:01 devstack sudo[86595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756 Nov 06 11:41:01 devstack sudo[86595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:41:02 devstack sudo[86595]: pam_unix(sudo:session): session closed for user root Nov 06 11:41:02 devstack cinder-volume[86483]: DEBUG oslo_concurrency.processutils [None req-947b30ad-2e2b-4b85-a2e8-94486c58246f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756" returned: 0 in 0.222s {{(pid=86483) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:41:02 devstack cinder-volume[86483]: DEBUG cinder.manager [None req-947b30ad-2e2b-4b85-a2e8-94486c58246f None None] Notifying Schedulers of capabilities ... {{(pid=86483) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 11:41:02 devstack cinder-volume[86483]: INFO cinder.volume.manager [None req-947b30ad-2e2b-4b85-a2e8-94486c58246f None None] Driver initialization completed successfully. Nov 06 11:41:02 devstack cinder-volume[86483]: INFO cinder.manager [None req-947b30ad-2e2b-4b85-a2e8-94486c58246f None None] Initiating service 3 cleanup Nov 06 11:41:02 devstack cinder-volume[86483]: INFO cinder.manager [None req-947b30ad-2e2b-4b85-a2e8-94486c58246f None None] Service 3 cleanup completed. Nov 06 11:41:02 devstack cinder-volume[86483]: DEBUG cinder.service [None req-947b30ad-2e2b-4b85-a2e8-94486c58246f None None] Creating RPC server for service cinder-volume {{(pid=86483) start /opt/stack/cinder/cinder/service.py:231}} Nov 06 11:41:02 devstack cinder-volume[86483]: DEBUG cinder.service [None req-947b30ad-2e2b-4b85-a2e8-94486c58246f None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=86483) start /opt/stack/cinder/cinder/service.py:237}} Nov 06 11:41:02 devstack cinder-volume[86483]: INFO cinder.volume.manager [None req-947b30ad-2e2b-4b85-a2e8-94486c58246f None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2.1) Nov 06 11:41:02 devstack cinder-volume[86483]: DEBUG oslo_concurrency.lockutils [None req-947b30ad-2e2b-4b85-a2e8-94486c58246f None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86483) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 11:41:02 devstack cinder-volume[86483]: DEBUG oslo_concurrency.lockutils [None req-947b30ad-2e2b-4b85-a2e8-94486c58246f None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86483) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 11:41:02 devstack cinder-volume[86483]: DEBUG cinder.volume.drivers.quobyte [None req-947b30ad-2e2b-4b85-a2e8-94486c58246f None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f': None} {{(pid=86483) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 11:41:02 devstack cinder-volume[86483]: DEBUG cinder.volume.drivers.quobyte [None req-947b30ad-2e2b-4b85-a2e8-94486c58246f None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f'] {{(pid=86483) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 11:41:02 devstack cinder-volume[86483]: DEBUG oslo_concurrency.lockutils [None req-947b30ad-2e2b-4b85-a2e8-94486c58246f None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86483) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 11:41:02 devstack cinder-volume[86483]: DEBUG oslo_concurrency.processutils [None req-947b30ad-2e2b-4b85-a2e8-94486c58246f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756 {{(pid=86483) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:41:02 devstack sudo[86598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756 Nov 06 11:41:02 devstack sudo[86598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:41:02 devstack sudo[86598]: pam_unix(sudo:session): session closed for user root Nov 06 11:41:02 devstack cinder-volume[86483]: DEBUG oslo_concurrency.processutils [None req-947b30ad-2e2b-4b85-a2e8-94486c58246f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756" returned: 0 in 0.233s {{(pid=86483) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:41:02 devstack cinder-volume[86483]: INFO cinder.volume.manager [None req-947b30ad-2e2b-4b85-a2e8-94486c58246f None None] Driver post RPC initialization completed successfully. Nov 06 11:41:07 devstack cinder-volume[86483]: DEBUG oslo_concurrency.lockutils [None req-25f769be-e172-46a4-8e22-d78aa6219b21 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86483) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 11:41:07 devstack cinder-volume[86483]: DEBUG oslo_concurrency.lockutils [None req-25f769be-e172-46a4-8e22-d78aa6219b21 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86483) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 11:41:07 devstack cinder-volume[86483]: DEBUG cinder.volume.drivers.quobyte [None req-25f769be-e172-46a4-8e22-d78aa6219b21 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f': None} {{(pid=86483) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 11:41:07 devstack cinder-volume[86483]: DEBUG cinder.volume.drivers.quobyte [None req-25f769be-e172-46a4-8e22-d78aa6219b21 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f'] {{(pid=86483) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 11:41:07 devstack cinder-volume[86483]: DEBUG oslo_concurrency.lockutils [None req-25f769be-e172-46a4-8e22-d78aa6219b21 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86483) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 11:41:07 devstack cinder-volume[86483]: DEBUG oslo_concurrency.processutils [None req-25f769be-e172-46a4-8e22-d78aa6219b21 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756 {{(pid=86483) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:41:07 devstack sudo[86717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756 Nov 06 11:41:07 devstack sudo[86717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:41:07 devstack sudo[86717]: pam_unix(sudo:session): session closed for user root Nov 06 11:41:07 devstack cinder-volume[86483]: DEBUG oslo_concurrency.processutils [None req-25f769be-e172-46a4-8e22-d78aa6219b21 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756" returned: 0 in 0.216s {{(pid=86483) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:41:07 devstack cinder-volume[86483]: DEBUG cinder.manager [None req-25f769be-e172-46a4-8e22-d78aa6219b21 None None] Notifying Schedulers of capabilities ... {{(pid=86483) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 11:41:10 devstack cinder-volume[86264]: INFO oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] Caught SIGTERM, stopping children Nov 06 11:41:10 devstack cinder-volume[86264]: DEBUG oslo_concurrency.lockutils [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] Acquiring lock "singleton_lock" {{(pid=86264) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Nov 06 11:41:10 devstack cinder-volume[86264]: DEBUG oslo_concurrency.lockutils [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] Acquired lock "singleton_lock" {{(pid=86264) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Nov 06 11:41:10 devstack cinder-volume[86264]: DEBUG oslo_concurrency.lockutils [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] Releasing lock "singleton_lock" {{(pid=86264) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Nov 06 11:41:10 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] Stop services. {{(pid=86264) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Nov 06 11:41:10 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] Killing children. {{(pid=86264) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Nov 06 11:41:10 devstack cinder-volume[86264]: INFO oslo_service.backend._eventlet.service [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] Waiting on 1 children to exit Nov 06 11:41:12 devstack cinder-volume[86483]: DEBUG dbcounter [-] [86483] Writing DB stats cinder:SELECT=3 {{(pid=86483) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 11:41:12 devstack cinder-volume[86483]: DEBUG dbcounter [-] [86483] Writing DB stats cinder:SELECT=9,cinder:INSERT=1,cinder:UPDATE=3 {{(pid=86483) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 11:41:15 devstack cinder-volume[86483]: INFO oslo_service.backend._eventlet.service [-] Parent process has died unexpectedly, exiting Nov 06 11:41:15 devstack cinder-volume[86483]: DEBUG oslo_concurrency.lockutils [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] Acquiring lock "singleton_lock" {{(pid=86483) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Nov 06 11:41:15 devstack cinder-volume[86483]: DEBUG oslo_concurrency.lockutils [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] Acquired lock "singleton_lock" {{(pid=86483) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Nov 06 11:41:15 devstack cinder-volume[86483]: DEBUG oslo_concurrency.lockutils [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] Releasing lock "singleton_lock" {{(pid=86483) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Nov 06 11:41:15 devstack cinder-volume[86483]: WARNING amqp [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] Received method (60, 30) during closing channel 1. This method will be ignored Nov 06 11:41:15 devstack cinder-volume[86483]: WARNING amqp [None req-520ec01e-55a8-4e34-a391-50dea13b59e3 None None] Received method (60, 30) during closing channel 1. This method will be ignored Nov 06 11:41:15 devstack cinder-volume[86822]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Nov 06 11:41:15 devstack cinder-volume[86822]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Nov 06 11:41:15 devstack cinder-volume[86822]: we strongly recommend against using it for new projects. Nov 06 11:41:15 devstack cinder-volume[86822]: If you are already using Eventlet, we recommend migrating to a different Nov 06 11:41:15 devstack cinder-volume[86822]: framework. For more detail see Nov 06 11:41:15 devstack cinder-volume[86822]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Nov 06 11:41:15 devstack cinder-volume[86822]: import eventlet # noqa Nov 06 11:41:18 devstack cinder-volume[86822]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=86822) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Nov 06 11:41:18 devstack cinder-volume[86822]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=86822) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Nov 06 11:41:18 devstack cinder-volume[86822]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=86822) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Nov 06 11:41:18 devstack cinder-volume[86822]: INFO dbcounter [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] Registered counter for database cinder Nov 06 11:41:18 devstack cinder-volume[86822]: DEBUG oslo_db.sqlalchemy.engines [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86822) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG dbcounter [-] [86822] Writer thread running {{(pid=86822) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Nov 06 11:41:19 devstack cinder-volume[86822]: INFO cinder.rpc [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Nov 06 11:41:19 devstack cinder-volume[86822]: INFO cinder.rpc [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_db.sqlalchemy.engines [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86822) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 06 11:41:19 devstack cinder-volume[86822]: INFO cinder.volume.manager [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] Determined volume DB was empty at startup. Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG cinder.volume.manager [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] Cinder Volume DB check: vol_db_empty=True {{(pid=86822) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Nov 06 11:41:19 devstack cinder-volume[86822]: WARNING stevedore.named [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 06 11:41:19 devstack cinder-volume[86822]: WARNING castellan.key_manager [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 06 11:41:19 devstack cinder-volume[86822]: WARNING cinder.keymgr.conf_key_mgr [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 06 11:41:19 devstack cinder-volume[86822]: INFO cinder.volume.manager [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] Image-volume cache disabled for host devstack@QuobyteHD. Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_db.sqlalchemy.engines [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86822) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 06 11:41:19 devstack cinder-volume[86822]: INFO oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] Starting 1 workers Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] Started child 87116 {{(pid=86822) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] Full set of CONF: {{(pid=86822) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] ******************************************************************************** {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] Configuration options gathered from: {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] ================================================================================ {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] allow_availability_zone_fallback = False {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] allow_compression_on_image_upload = False {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] allowed_direct_url_schemes = [] {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] api_rate_limit = True {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] auth_strategy = keystone {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] backend_availability_zone = None {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 11:41:19 devstack cinder-volume[87116]: INFO cinder.service [-] Starting cinder-volume node (version 29.0.1) Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] backend_host = None {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] backend_name = None {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] backend_stats_polling_interval = 60 {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] backup_api_class = cinder.backup.api.API {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] backup_name_template = backup-%s {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] backup_use_same_host = False {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] backup_use_temp_snapshot = False {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] chap_password = **** {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] chap_username = {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] cinder_internal_tenant_project_id = ca6a1b9dba25443790332d791fad7827 {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] cinder_internal_tenant_user_id = e7ba6dd3780e4a6c97773800d63c345c {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] cluster = None {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] compression_format = gzip {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] compute_api_class = cinder.compute.nova.API {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] config_dir = [] {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] config_source = [] {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] control_exchange = openstack {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] debug = True {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] default_availability_zone = None {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] default_group_type = None {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] default_volume_type = QuobyteHD {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] disk_geometry = None {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] driver_client_cert = None {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] driver_client_cert_key = None {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] driver_data_namespace = None {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] driver_ssl_cert_path = None {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] driver_ssl_cert_verify = False {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] driver_use_ssl = False {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] enable_new_services = True {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] enable_unsupported_driver = False {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] enabled_backends = ['QuobyteHD'] {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] enforce_multipath_for_image_xfer = False {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] filter_function = None {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] glance_api_insecure = False {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] glance_api_servers = ['http://192.168.122.9/image'] {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] glance_api_ssl_compression = False {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] glance_ca_certificates_file = None {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] glance_catalog_info = image:glance:publicURL {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] glance_certfile = None {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] glance_keyfile = None {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] glance_num_retries = 3 {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] glance_request_timeout = None {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] goodness_function = None {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] graceful_shutdown_timeout = 5 {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] group_api_class = cinder.group.api.API {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] host = devstack {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] image_compress_on_upload = True {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] image_conversion_address_space_limit = 1 {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] image_conversion_cpu_limit = 60 {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] image_conversion_disable = False {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] image_introspection_address_space_limit = 1 {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] image_introspection_cpu_limit = 60 {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] image_upload_use_cinder_backend = False {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] image_upload_use_internal_tenant = False {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] image_volume_cache_enabled = False {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] image_volume_cache_max_count = 0 {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] image_volume_cache_max_size_gb = 0 {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] init_host_max_objects_retrieval = 0 {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] instance_format = [instance: %(uuid)s] {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] iscsi_target_flags = {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] iscsi_write_cache = on {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] iser_helper = tgtadm {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] iser_ip_address = 192.168.122.9 {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] iser_port = 3260 {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 11:41:19 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-9ddfc058-c4ea-4622-ac3e-b09c9c99596e None None] Starting volume driver QuobyteDriver (1.2.1) Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] log_color = False {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 11:41:19 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-9ddfc058-c4ea-4622-ac3e-b09c9c99596e None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=87116) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] log_config_append = None {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] log_dir = None {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] log_file = None {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] log_options = True {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] log_rotate_interval = 1 {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] log_rotate_interval_type = days {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] log_rotation_type = none {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] max_age = 0 {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] max_logfile_count = 30 {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] max_logfile_size_mb = 200 {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] max_over_subscription_ratio = 20.0 {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] message_reap_interval = 86400 {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] message_ttl = 2592000 {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] migration_create_volume_timeout_secs = 300 {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] monkey_patch = False {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] monkey_patch_modules = [] {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] my_ip = 192.168.122.9 {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] no_snapshot_gb_quota = False {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] num_iser_scan_tries = 3 {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] num_shell_tries = 3 {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] num_volume_device_scan_tries = 3 {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] nvmeof_conn_info_version = 1 {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] nvmet_ns_id = 10 {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] nvmet_port_id = 1 {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] osapi_max_limit = 1000 {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] osapi_volume_ext_list = [] {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] osapi_volume_listen = 0.0.0.0 {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] osapi_volume_listen_port = 8776 {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] osapi_volume_use_ssl = False {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] osapi_volume_workers = None {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] per_volume_size_limit = -1 {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] periodic_fuzzy_delay = 60 {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] periodic_interval = 60 {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] project_id_regex = [0-9a-f\-]+ {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] public_endpoint = None {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] publish_errors = False {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] quota_backup_gigabytes = 1000 {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] quota_backups = 10 {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] quota_gigabytes = 1000 {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] quota_groups = 10 {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] quota_snapshots = 10 {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] quota_volumes = 10 {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] rate_limit_burst = 0 {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] rate_limit_except_level = CRITICAL {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] rate_limit_interval = 0 {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] reinit_driver_count = 3 {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] replication_device = **** {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] report_discard_supported = False {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] report_interval = 120 {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] reservation_clean_interval = 86400 {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] reservation_expire = 86400 {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] reserved_image_namespaces = [] {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] reserved_percentage = 0 {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] rpc_response_timeout = 120 {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] run_external_periodic_tasks = True {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] scst_target_driver = iscsi {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] scst_target_iqn_name = None {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] service_down_time = 720 {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] shell_completion = None {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] snapshot_name_template = snapshot-%s {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] split_loggers = False {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] state_path = /opt/stack/data/cinder {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] storage_availability_zone = nova {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] storage_protocol = iSCSI {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] syslog_log_facility = LOG_USER {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] target_helper = lioadm {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] target_ip_address = 192.168.122.9 {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] target_port = 3260 {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] target_protocol = iscsi {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] target_secondary_ip_addresses = [] {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] trace_flags = None {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] transfer_api_class = cinder.transfer.api.API {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] transport_url = **** {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] until_refresh = 0 {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] use_chap_auth = False {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] use_default_quota_class = True {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] use_journal = False {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] use_json = False {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] use_multipath_for_image_xfer = False {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] use_stderr = False {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] use_syslog = False {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] verify_glance_signatures = enabled {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] volume_api_class = cinder.volume.api.API {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] volume_backend_name = None {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] volume_clear = zero {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] volume_clear_ionice = None {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] volume_clear_size = 0 {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] volume_copy_bps_limit = 0 {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] volume_dd_blocksize = 1M {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] volume_name_template = volume-%s {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] volume_service_inithost_offload = False {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] volume_usage_audit_period = month {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] zoning_mode = None {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] oslo_concurrency.disable_process_locking = False {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] os_brick.lightos_discovery_client_address = localhost {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] os_brick.wait_mpath_device_interval = 1 {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] keystone_authtoken.auth_section = None {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] keystone_authtoken.auth_type = password {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] keystone_authtoken.auth_version = None {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] keystone_authtoken.cache = None {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] keystone_authtoken.certfile = None {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] keystone_authtoken.delay_auth_decision = False {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] keystone_authtoken.http_connect_timeout = None {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] keystone_authtoken.include_service_catalog = True {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] keystone_authtoken.insecure = False {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] keystone_authtoken.interface = public {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] keystone_authtoken.keyfile = None {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] keystone_authtoken.memcache_password = **** {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] keystone_authtoken.memcache_secret_key = **** {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] keystone_authtoken.memcache_security_strategy = None {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:19 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-9ddfc058-c4ea-4622-ac3e-b09c9c99596e None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=87116) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:304}} Nov 06 11:41:19 devstack cinder-volume[87116]: WARNING cinder.volume.drivers.quobyte [None req-9ddfc058-c4ea-4622-ac3e-b09c9c99596e None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Nov 06 11:41:19 devstack cinder-volume[87116]: WARNING cinder.volume.drivers.quobyte [None req-9ddfc058-c4ea-4622-ac3e-b09c9c99596e None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] keystone_authtoken.memcache_username = None {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] keystone_authtoken.region_name = None {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:19 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-9ddfc058-c4ea-4622-ac3e-b09c9c99596e None None] Running cmd (subprocess): mount.quobyte {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] keystone_authtoken.service_token_roles_required = True {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] keystone_authtoken.service_type = None {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] keystone_authtoken.token_cache_time = 300 {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.9/identity {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] cache.backend = dogpile.cache.null {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] cache.backend_argument = **** {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] cache.backend_expiration_time = None {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] cache.config_prefix = cache.oslo {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] cache.debug_cache_backend = False {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] cache.enable_retry_client = False {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] cache.enable_socket_keepalive = False {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] cache.enabled = False {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] cache.expiration_time = 600 {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] cache.hashclient_dead_timeout = 60.0 {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] cache.hashclient_retry_attempts = 2 {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] cache.hashclient_retry_timeout = 1.0 {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] cache.memcache_dead_retry = 300 {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] cache.memcache_pool_maxsize = 10 {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] cache.memcache_pool_unused_timeout = 60 {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] cache.memcache_sasl_enabled = False {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] cache.memcache_servers = ['localhost:11211'] {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] cache.password = **** {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] cache.proxies = [] {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] cache.redis_db = 0 {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] cache.redis_sentinel_service_name = mymaster {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] cache.redis_server = localhost:6379 {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] cache.retry_attempts = 2 {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] cache.retry_delay = 0.0 {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] cache.socket_keepalive_count = 1 {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] cache.socket_keepalive_idle = 1 {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] cache.socket_keepalive_interval = 1 {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] cache.socket_timeout = 1.0 {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] cache.tls_allowed_ciphers = None {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] cache.tls_cafile = None {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] cache.tls_certfile = None {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] cache.tls_enabled = False {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] cache.tls_keyfile = None {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] cache.username = None {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] coordination.backend_url = **** {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] database.asyncio_connection = **** {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] database.asyncio_slave_connection = **** {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] database.backend = sqlalchemy {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] database.connection = **** {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] database.connection_debug = 0 {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] database.connection_parameters = {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] database.connection_recycle_time = 3600 {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] database.connection_trace = False {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] database.db_inc_retry_interval = True {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] database.db_max_retries = 20 {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] database.db_max_retry_interval = 10 {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] database.db_retry_interval = 1 {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] database.max_overflow = 50 {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] database.max_pool_size = 5 {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] database.max_retries = 10 {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] database.mysql_sql_mode = TRADITIONAL {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] database.mysql_wsrep_sync_wait = None {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] database.pool_timeout = None {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] database.retry_interval = 10 {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] database.slave_connection = **** {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] database.sqlite_synchronous = True {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] database.synchronous_reader = True {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] database.use_db_reconnect = False {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] oslo_messaging_metrics.metrics_process_name = {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] oslo_messaging_tracing.insecure = False {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] profiler.connection_string = messaging:// {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] profiler.enabled = False {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] profiler.es_doc_type = notification {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] profiler.es_scroll_size = 10000 {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] profiler.es_scroll_time = 2m {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] profiler.filter_error_trace = False {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] profiler.hmac_keys = **** {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] profiler.sentinel_service_name = mymaster {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] profiler.socket_timeout = 0.1 {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] profiler.trace_requests = False {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] profiler.trace_sqlalchemy = False {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] profiler_jaeger.process_tags = {} {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] profiler_jaeger.service_name_prefix = None {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] profiler_otlp.service_name_prefix = None {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] oslo_policy.enforce_new_defaults = True {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] oslo_policy.policy_default_rule = default {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] oslo_policy.policy_file = policy.yaml {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] oslo_policy.remote_timeout = 60.0 {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] privsep_osbrick.capabilities = [21, 2] {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] privsep_osbrick.group = None {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] privsep_osbrick.helper_command = None {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] privsep_osbrick.log_daemon_traceback = False {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] privsep_osbrick.thread_pool_size = 4 {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] privsep_osbrick.user = None {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] cinder_sys_admin.group = None {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] cinder_sys_admin.helper_command = None {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] cinder_sys_admin.user = None {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] service_user.auth_section = None {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] service_user.auth_type = password {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] service_user.cafile = None {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] service_user.certfile = None {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] service_user.collect_timing = False {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] service_user.insecure = False {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] service_user.keyfile = None {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] service_user.send_service_user_token = True {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] service_user.split_loggers = False {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] service_user.timeout = None {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] service_user.tls_ciphers = None {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] service_user.tls_min_version = None {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] glance.auth_section = None {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] glance.auth_type = password {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] glance.certfile = None {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] glance.collect_timing = False {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] glance.insecure = False {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] glance.keyfile = None {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] glance.region_name = None {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] glance.split_loggers = False {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] glance.timeout = None {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] glance.tls_ciphers = None {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] glance.tls_min_version = None {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] backend_defaults.backend_availability_zone = None {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] backend_defaults.chap_password = **** {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] backend_defaults.chap_username = {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] backend_defaults.disk_geometry = None {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] backend_defaults.driver_client_cert = None {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] backend_defaults.driver_client_cert_key = None {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] backend_defaults.driver_data_namespace = None {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] backend_defaults.driver_ssl_cert_path = None {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] backend_defaults.driver_use_ssl = False {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] backend_defaults.enable_unsupported_driver = False {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] backend_defaults.extra_capabilities = {} {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] backend_defaults.filter_function = None {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] backend_defaults.goodness_function = None {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] backend_defaults.image_volume_cache_enabled = False {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] backend_defaults.iscsi_target_flags = {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] backend_defaults.iscsi_write_cache = on {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] backend_defaults.iser_helper = tgtadm {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] backend_defaults.iser_ip_address = 192.168.122.9 {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] backend_defaults.iser_port = 3260 {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] backend_defaults.nas_host = {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] backend_defaults.nas_login = admin {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] backend_defaults.nas_mount_options = None {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] backend_defaults.nas_password = **** {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] backend_defaults.nas_private_key = {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] backend_defaults.nas_secure_file_operations = auto {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] backend_defaults.nas_share_path = {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] backend_defaults.nas_ssh_port = 22 {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] backend_defaults.nas_volume_prov_type = thin {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] backend_defaults.num_shell_tries = 3 {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] backend_defaults.nvmet_ns_id = 10 {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] backend_defaults.nvmet_port_id = 1 {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] backend_defaults.quobyte_client_cfg = None {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] backend_defaults.quobyte_volume_url = None {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] backend_defaults.replication_device = **** {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] backend_defaults.report_discard_supported = False {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] backend_defaults.reserved_percentage = 0 {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] backend_defaults.scst_target_driver = iscsi {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] backend_defaults.scst_target_iqn_name = None {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] backend_defaults.storage_protocol = iSCSI {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] backend_defaults.target_helper = tgtadm {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] backend_defaults.target_ip_address = 192.168.122.9 {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] backend_defaults.target_port = 3260 {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] backend_defaults.target_protocol = iscsi {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] backend_defaults.trace_flags = None {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] backend_defaults.unique_fqdn_network = True {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] backend_defaults.use_chap_auth = False {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] backend_defaults.volume_backend_name = None {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] backend_defaults.volume_clear = zero {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] backend_defaults.volume_clear_ionice = None {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] backend_defaults.volume_clear_size = 0 {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] oslo_reports.file_event_handler = None {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] oslo_reports.file_event_handler_interval = 1 {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] oslo_reports.log_dir = None {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] QuobyteHD.backend_availability_zone = None {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] QuobyteHD.backend_host = None {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] QuobyteHD.chap_password = **** {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] QuobyteHD.chap_username = None {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] QuobyteHD.chiscsi_conf = None {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] QuobyteHD.disk_geometry = None {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] QuobyteHD.driver_client_cert = None {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] QuobyteHD.driver_client_cert_key = None {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] QuobyteHD.driver_data_namespace = None {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] QuobyteHD.driver_use_ssl = None {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] QuobyteHD.enable_unsupported_driver = None {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] QuobyteHD.extra_capabilities = None {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] QuobyteHD.filter_function = None {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] QuobyteHD.goodness_function = None {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:19 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-9ddfc058-c4ea-4622-ac3e-b09c9c99596e None None] CMD "mount.quobyte" returned: 1 in 0.121s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:41:19 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-9ddfc058-c4ea-4622-ac3e-b09c9c99596e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] QuobyteHD.iscsi_target_flags = None {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] QuobyteHD.iscsi_write_cache = None {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] QuobyteHD.iser_helper = None {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] QuobyteHD.iser_ip_address = None {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] QuobyteHD.iser_port = None {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:19 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-9ddfc058-c4ea-4622-ac3e-b09c9c99596e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 11:41:19 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-9ddfc058-c4ea-4622-ac3e-b09c9c99596e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] QuobyteHD.iser_target_prefix = None {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] QuobyteHD.nas_host = None {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] QuobyteHD.nas_login = None {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] QuobyteHD.nas_mount_options = None {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] QuobyteHD.nas_password = **** {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] QuobyteHD.nas_private_key = None {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] QuobyteHD.nas_secure_file_operations = false {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] QuobyteHD.nas_share_path = None {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] QuobyteHD.nas_ssh_port = None {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] QuobyteHD.nas_volume_prov_type = None {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] QuobyteHD.num_iser_scan_tries = None {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] QuobyteHD.num_shell_tries = None {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] QuobyteHD.nvmet_ns_id = None {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] QuobyteHD.nvmet_port_id = None {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] QuobyteHD.replication_device = **** {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] QuobyteHD.report_discard_supported = None {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] QuobyteHD.reserved_percentage = None {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] QuobyteHD.scst_target_driver = None {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] QuobyteHD.scst_target_iqn_name = None {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] QuobyteHD.storage_protocol = None {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] QuobyteHD.target_helper = None {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] QuobyteHD.target_ip_address = None {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] QuobyteHD.target_port = None {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] QuobyteHD.target_prefix = None {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] QuobyteHD.target_protocol = None {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] QuobyteHD.trace_flags = None {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:19 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-9ddfc058-c4ea-4622-ac3e-b09c9c99596e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] QuobyteHD.unique_fqdn_network = None {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:19 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-9ddfc058-c4ea-4622-ac3e-b09c9c99596e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] QuobyteHD.use_chap_auth = None {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:19 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-9ddfc058-c4ea-4622-ac3e-b09c9c99596e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] QuobyteHD.volume_clear = None {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] QuobyteHD.volume_clear_ionice = None {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] QuobyteHD.volume_clear_size = None {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] QuobyteHD.volume_dd_blocksize = None {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] QuobyteHD.volumes_dir = None {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] oslo_messaging_rabbit.hostname = devstack {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] oslo_messaging_rabbit.ssl = False {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] oslo_messaging_rabbit.ssl_version = {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] oslo_messaging_notifications.driver = [] {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] oslo_messaging_notifications.retry = -1 {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] oslo_messaging_notifications.transport_url = **** {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] key_manager.fixed_key = **** {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] barbican.barbican_api_version = None {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:19 devstack sudo[87153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756 Nov 06 11:41:19 devstack sudo[87153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] barbican.barbican_endpoint = None {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] barbican.barbican_endpoint_type = public {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] barbican.barbican_region_name = None {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] barbican.cafile = None {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] barbican.certfile = None {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] barbican.collect_timing = False {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] barbican.insecure = False {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] barbican.keyfile = None {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] barbican.number_of_retries = 60 {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] barbican.retry_delay = 1 {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] barbican.send_service_user_token = False {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] barbican.split_loggers = False {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] barbican.timeout = None {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] barbican.tls_ciphers = None {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] barbican.tls_min_version = None {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] barbican.verify_ssl = True {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] barbican.verify_ssl_path = None {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] barbican_service_user.auth_section = None {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] barbican_service_user.auth_type = None {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] barbican_service_user.cafile = None {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] barbican_service_user.certfile = None {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] barbican_service_user.collect_timing = False {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] barbican_service_user.insecure = False {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] barbican_service_user.keyfile = None {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] barbican_service_user.split_loggers = False {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] barbican_service_user.timeout = None {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] barbican_service_user.tls_ciphers = None {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] barbican_service_user.tls_min_version = None {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] vault.approle_role_id = **** {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] vault.approle_secret_id = **** {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] vault.auth_method = approle {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] vault.auth_path = None {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] vault.kv_mountpoint = secret {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] vault.kv_path = None {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] vault.kv_version = 2 {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] vault.namespace = None {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] vault.root_token_id = **** {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] vault.ssl_ca_crt_file = None {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] vault.timeout = 60.0 {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] vault.token_file = None {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] vault.token_role = None {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] vault.use_ssl = False {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 06 11:41:19 devstack cinder-volume[86822]: DEBUG oslo_service.backend._eventlet.service [None req-eafdeff4-4c93-4bee-b9e0-d93d5f22b87a None None] ******************************************************************************** {{(pid=86822) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Nov 06 11:41:19 devstack sudo[87153]: pam_unix(sudo:session): session closed for user root Nov 06 11:41:20 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-9ddfc058-c4ea-4622-ac3e-b09c9c99596e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756" returned: 0 in 0.297s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:41:20 devstack cinder-volume[87116]: INFO cinder.volume.driver [None req-9ddfc058-c4ea-4622-ac3e-b09c9c99596e None None] Driver hasn't implemented _init_vendor_properties() Nov 06 11:41:20 devstack cinder-volume[87116]: DEBUG cinder.volume.driver [None req-9ddfc058-c4ea-4622-ac3e-b09c9c99596e None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.401268005371, 'free_capacity_gb': 1773.401268005371, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87116) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Nov 06 11:41:20 devstack cinder-volume[87116]: DEBUG oslo_db.sqlalchemy.engines [None req-9ddfc058-c4ea-4622-ac3e-b09c9c99596e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87116) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 06 11:41:20 devstack cinder-volume[87116]: DEBUG dbcounter [-] [87116] Writer thread running {{(pid=87116) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Nov 06 11:41:20 devstack cinder-volume[87116]: DEBUG cinder.db.api [None req-9ddfc058-c4ea-4622-ac3e-b09c9c99596e None None] Building query based on filter {{(pid=87116) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Nov 06 11:41:20 devstack cinder-volume[87116]: DEBUG cinder.image.image_utils [None req-9ddfc058-c4ea-4622-ac3e-b09c9c99596e None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=87116) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1325}} Nov 06 11:41:20 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-9ddfc058-c4ea-4622-ac3e-b09c9c99596e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 11:41:20 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-9ddfc058-c4ea-4622-ac3e-b09c9c99596e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 11:41:20 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-9ddfc058-c4ea-4622-ac3e-b09c9c99596e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 11:41:20 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-9ddfc058-c4ea-4622-ac3e-b09c9c99596e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 11:41:20 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-9ddfc058-c4ea-4622-ac3e-b09c9c99596e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 11:41:20 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-9ddfc058-c4ea-4622-ac3e-b09c9c99596e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:41:20 devstack cinder-volume[87116]: INFO cinder.keymgr.migration [None req-b75dcdb0-2946-4300-9b6b-ab0abb525811 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Nov 06 11:41:20 devstack sudo[87168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756 Nov 06 11:41:20 devstack sudo[87168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:41:20 devstack sudo[87168]: pam_unix(sudo:session): session closed for user root Nov 06 11:41:20 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-9ddfc058-c4ea-4622-ac3e-b09c9c99596e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756" returned: 0 in 0.222s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:41:20 devstack cinder-volume[87116]: DEBUG cinder.manager [None req-9ddfc058-c4ea-4622-ac3e-b09c9c99596e None None] Notifying Schedulers of capabilities ... {{(pid=87116) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 11:41:20 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-9ddfc058-c4ea-4622-ac3e-b09c9c99596e None None] Driver initialization completed successfully. Nov 06 11:41:20 devstack cinder-volume[87116]: INFO cinder.manager [None req-9ddfc058-c4ea-4622-ac3e-b09c9c99596e None None] Initiating service 3 cleanup Nov 06 11:41:20 devstack cinder-volume[87116]: INFO cinder.manager [None req-9ddfc058-c4ea-4622-ac3e-b09c9c99596e None None] Service 3 cleanup completed. Nov 06 11:41:20 devstack cinder-volume[87116]: DEBUG cinder.service [None req-9ddfc058-c4ea-4622-ac3e-b09c9c99596e None None] Creating RPC server for service cinder-volume {{(pid=87116) start /opt/stack/cinder/cinder/service.py:231}} Nov 06 11:41:20 devstack cinder-volume[87116]: DEBUG cinder.service [None req-9ddfc058-c4ea-4622-ac3e-b09c9c99596e None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=87116) start /opt/stack/cinder/cinder/service.py:237}} Nov 06 11:41:20 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-9ddfc058-c4ea-4622-ac3e-b09c9c99596e None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2.1) Nov 06 11:41:20 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-9ddfc058-c4ea-4622-ac3e-b09c9c99596e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 11:41:20 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-9ddfc058-c4ea-4622-ac3e-b09c9c99596e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 11:41:20 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-9ddfc058-c4ea-4622-ac3e-b09c9c99596e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 11:41:20 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-9ddfc058-c4ea-4622-ac3e-b09c9c99596e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 11:41:20 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-9ddfc058-c4ea-4622-ac3e-b09c9c99596e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 11:41:20 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-9ddfc058-c4ea-4622-ac3e-b09c9c99596e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:41:20 devstack sudo[87180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756 Nov 06 11:41:20 devstack sudo[87180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:41:20 devstack sudo[87180]: pam_unix(sudo:session): session closed for user root Nov 06 11:41:20 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-9ddfc058-c4ea-4622-ac3e-b09c9c99596e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756" returned: 0 in 0.234s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:41:20 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-9ddfc058-c4ea-4622-ac3e-b09c9c99596e None None] Driver post RPC initialization completed successfully. Nov 06 11:41:29 devstack cinder-volume[86822]: DEBUG dbcounter [-] [86822] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=86822) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 11:41:30 devstack cinder-volume[87116]: DEBUG dbcounter [-] [87116] Writing DB stats cinder:SELECT=2 {{(pid=87116) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 11:41:30 devstack cinder-volume[87116]: DEBUG dbcounter [-] [87116] Writing DB stats cinder:SELECT=8,cinder:UPDATE=1 {{(pid=87116) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 11:41:39 devstack cinder-volume[87116]: DEBUG oslo_service.periodic_task [None req-4fab4816-ec2b-4b19-b2ff-8548f2084354 None None] Running periodic task VolumeManager._thread_info {{(pid=87116) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 11:41:39 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-4fab4816-ec2b-4b19-b2ff-8548f2084354 None None] thread count: 6 {{(pid=87116) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 06 11:41:39 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-4fab4816-ec2b-4b19-b2ff-8548f2084354 None None] thread info: [<_MainThread(MainThread, started 131399520669824)>, , , , , ] {{(pid=87116) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 06 11:42:18 devstack cinder-volume[87116]: DEBUG cinder.volume.flows.manager.create_volume [None req-a983a4cd-8f65-4f0e-a27e-eadca7cc8af0 tempest-TaggedAttachmentsTest-905079736 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87116) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 11:42:18 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-a983a4cd-8f65-4f0e-a27e-eadca7cc8af0 tempest-TaggedAttachmentsTest-905079736 None] Flow 'volume_create_manager' (562fb13d-decd-428b-8f60-a961e94fa662) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 11:42:18 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-a983a4cd-8f65-4f0e-a27e-eadca7cc8af0 tempest-TaggedAttachmentsTest-905079736 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6d081221-3818-4d81-8380-9d53e5305946) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:42:18 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-a983a4cd-8f65-4f0e-a27e-eadca7cc8af0 tempest-TaggedAttachmentsTest-905079736 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6d081221-3818-4d81-8380-9d53e5305946) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T10:42:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-1576244345',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d42ddfe7-a222-4a05-b1ae-234ed426001b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4b9fdbd7f183419189f155cdcca0beae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T10:42:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T10:42:19Z,use_quota=True,user_id='2b06c8edb23c40d2b9a6a67b82fd6399',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(34d3b144-d9b7-480a-a2e3-01e45f3d54c1),volume_type_id=34d3b144-d9b7-480a-a2e3-01e45f3d54c1)' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:42:19 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-a983a4cd-8f65-4f0e-a27e-eadca7cc8af0 tempest-TaggedAttachmentsTest-905079736 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e5858e61-1d77-4b49-9e63-18e424f03bd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:42:19 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-a983a4cd-8f65-4f0e-a27e-eadca7cc8af0 tempest-TaggedAttachmentsTest-905079736 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e5858e61-1d77-4b49-9e63-18e424f03bd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:42:19 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-a983a4cd-8f65-4f0e-a27e-eadca7cc8af0 tempest-TaggedAttachmentsTest-905079736 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (45526a74-b37b-478f-b214-819e92c075e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:42:19 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-a983a4cd-8f65-4f0e-a27e-eadca7cc8af0 tempest-TaggedAttachmentsTest-905079736 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (45526a74-b37b-478f-b214-819e92c075e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd42ddfe7-a222-4a05-b1ae-234ed426001b', 'volume_name': 'volume-d42ddfe7-a222-4a05-b1ae-234ed426001b', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:42:19 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-a983a4cd-8f65-4f0e-a27e-eadca7cc8af0 tempest-TaggedAttachmentsTest-905079736 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ac844c94-909c-4633-a58c-55734685bead) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:42:19 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-a983a4cd-8f65-4f0e-a27e-eadca7cc8af0 tempest-TaggedAttachmentsTest-905079736 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ac844c94-909c-4633-a58c-55734685bead) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:42:19 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-a983a4cd-8f65-4f0e-a27e-eadca7cc8af0 tempest-TaggedAttachmentsTest-905079736 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d0339a00-abf3-4c12-8253-fb0abfcb4889) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:42:19 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-a983a4cd-8f65-4f0e-a27e-eadca7cc8af0 tempest-TaggedAttachmentsTest-905079736 None] Volume d42ddfe7-a222-4a05-b1ae-234ed426001b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d42ddfe7-a222-4a05-b1ae-234ed426001b', 'volume_size': 1} Nov 06 11:42:19 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-a983a4cd-8f65-4f0e-a27e-eadca7cc8af0 tempest-TaggedAttachmentsTest-905079736 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 11:42:19 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-a983a4cd-8f65-4f0e-a27e-eadca7cc8af0 tempest-TaggedAttachmentsTest-905079736 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 11:42:19 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-a983a4cd-8f65-4f0e-a27e-eadca7cc8af0 tempest-TaggedAttachmentsTest-905079736 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T10:42:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-1576244345',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d42ddfe7-a222-4a05-b1ae-234ed426001b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4b9fdbd7f183419189f155cdcca0beae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T10:42:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T10:42:19Z,use_quota=True,user_id='2b06c8edb23c40d2b9a6a67b82fd6399',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(34d3b144-d9b7-480a-a2e3-01e45f3d54c1),volume_type_id=34d3b144-d9b7-480a-a2e3-01e45f3d54c1)}" {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 11:42:19 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-a983a4cd-8f65-4f0e-a27e-eadca7cc8af0 tempest-TaggedAttachmentsTest-905079736 None] Creating volume d42ddfe7-a222-4a05-b1ae-234ed426001b {{(pid=87116) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 11:42:19 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-a983a4cd-8f65-4f0e-a27e-eadca7cc8af0 tempest-TaggedAttachmentsTest-905079736 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 11:42:19 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-a983a4cd-8f65-4f0e-a27e-eadca7cc8af0 tempest-TaggedAttachmentsTest-905079736 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 11:42:19 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-a983a4cd-8f65-4f0e-a27e-eadca7cc8af0 tempest-TaggedAttachmentsTest-905079736 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 11:42:19 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-a983a4cd-8f65-4f0e-a27e-eadca7cc8af0 tempest-TaggedAttachmentsTest-905079736 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 11:42:19 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-a983a4cd-8f65-4f0e-a27e-eadca7cc8af0 tempest-TaggedAttachmentsTest-905079736 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 11:42:19 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-a983a4cd-8f65-4f0e-a27e-eadca7cc8af0 tempest-TaggedAttachmentsTest-905079736 None] Selected osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f as target Quobyte volume. {{(pid=87116) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 11:42:19 devstack cinder-volume[87116]: INFO cinder.volume.drivers.remotefs [None req-a983a4cd-8f65-4f0e-a27e-eadca7cc8af0 tempest-TaggedAttachmentsTest-905079736 None] casted to osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f Nov 06 11:42:19 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-a983a4cd-8f65-4f0e-a27e-eadca7cc8af0 tempest-TaggedAttachmentsTest-905079736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-d42ddfe7-a222-4a05-b1ae-234ed426001b 1073741824 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:42:19 devstack sudo[87494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-d42ddfe7-a222-4a05-b1ae-234ed426001b 1073741824 Nov 06 11:42:19 devstack sudo[87494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:42:19 devstack sudo[87494]: pam_unix(sudo:session): session closed for user root Nov 06 11:42:19 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-a983a4cd-8f65-4f0e-a27e-eadca7cc8af0 tempest-TaggedAttachmentsTest-905079736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-d42ddfe7-a222-4a05-b1ae-234ed426001b 1073741824" returned: 0 in 0.803s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:42:19 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-a983a4cd-8f65-4f0e-a27e-eadca7cc8af0 tempest-TaggedAttachmentsTest-905079736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-d42ddfe7-a222-4a05-b1ae-234ed426001b {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:42:19 devstack sudo[87819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-d42ddfe7-a222-4a05-b1ae-234ed426001b Nov 06 11:42:19 devstack sudo[87819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:42:20 devstack sudo[87819]: pam_unix(sudo:session): session closed for user root Nov 06 11:42:20 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-a983a4cd-8f65-4f0e-a27e-eadca7cc8af0 tempest-TaggedAttachmentsTest-905079736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-d42ddfe7-a222-4a05-b1ae-234ed426001b" returned: 0 in 0.417s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:42:20 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-a983a4cd-8f65-4f0e-a27e-eadca7cc8af0 tempest-TaggedAttachmentsTest-905079736 None] <== create_volume: return (1302ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f'} {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 11:42:20 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-a983a4cd-8f65-4f0e-a27e-eadca7cc8af0 tempest-TaggedAttachmentsTest-905079736 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.307s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 11:42:20 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-a983a4cd-8f65-4f0e-a27e-eadca7cc8af0 tempest-TaggedAttachmentsTest-905079736 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d0339a00-abf3-4c12-8253-fb0abfcb4889) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d42ddfe7-a222-4a05-b1ae-234ed426001b', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:42:20 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-a983a4cd-8f65-4f0e-a27e-eadca7cc8af0 tempest-TaggedAttachmentsTest-905079736 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (df256433-f958-480f-a6e3-23eac7fc1610) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:42:20 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-a983a4cd-8f65-4f0e-a27e-eadca7cc8af0 tempest-TaggedAttachmentsTest-905079736 None] Volume volume-d42ddfe7-a222-4a05-b1ae-234ed426001b (d42ddfe7-a222-4a05-b1ae-234ed426001b): created successfully Nov 06 11:42:20 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-a983a4cd-8f65-4f0e-a27e-eadca7cc8af0 tempest-TaggedAttachmentsTest-905079736 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (df256433-f958-480f-a6e3-23eac7fc1610) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:42:20 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-a983a4cd-8f65-4f0e-a27e-eadca7cc8af0 tempest-TaggedAttachmentsTest-905079736 None] Flow 'volume_create_manager' (562fb13d-decd-428b-8f60-a961e94fa662) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 11:42:20 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-a983a4cd-8f65-4f0e-a27e-eadca7cc8af0 tempest-TaggedAttachmentsTest-905079736 None] Created volume successfully. Nov 06 11:42:30 devstack cinder-volume[87116]: DEBUG dbcounter [-] [87116] Writing DB stats cinder:UPDATE=4,cinder:SELECT=1,cinder:INSERT=1 {{(pid=87116) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 11:42:30 devstack cinder-volume[87116]: DEBUG dbcounter [-] [87116] Writing DB stats cinder:SELECT=3,cinder:UPDATE=2,cinder:DELETE=1 {{(pid=87116) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 11:42:39 devstack cinder-volume[87116]: DEBUG oslo_service.periodic_task [None req-4fab4816-ec2b-4b19-b2ff-8548f2084354 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87116) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 11:42:39 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-4fab4816-ec2b-4b19-b2ff-8548f2084354 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 11:42:39 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-4fab4816-ec2b-4b19-b2ff-8548f2084354 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 11:42:39 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-4fab4816-ec2b-4b19-b2ff-8548f2084354 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 11:42:39 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-4fab4816-ec2b-4b19-b2ff-8548f2084354 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 11:42:39 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-4fab4816-ec2b-4b19-b2ff-8548f2084354 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.029s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 11:42:39 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-4fab4816-ec2b-4b19-b2ff-8548f2084354 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:42:39 devstack sudo[88121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756 Nov 06 11:42:39 devstack sudo[88121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:42:40 devstack sudo[88121]: pam_unix(sudo:session): session closed for user root Nov 06 11:42:40 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-4fab4816-ec2b-4b19-b2ff-8548f2084354 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756" returned: 0 in 0.861s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:42:40 devstack cinder-volume[87116]: DEBUG cinder.manager [None req-4fab4816-ec2b-4b19-b2ff-8548f2084354 None None] Notifying Schedulers of capabilities ... {{(pid=87116) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 11:42:40 devstack cinder-volume[87116]: DEBUG oslo_service.periodic_task [None req-4fab4816-ec2b-4b19-b2ff-8548f2084354 None None] Running periodic task VolumeManager._thread_info {{(pid=87116) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 11:42:40 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-4fab4816-ec2b-4b19-b2ff-8548f2084354 None None] thread count: 6 {{(pid=87116) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 06 11:42:40 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-4fab4816-ec2b-4b19-b2ff-8548f2084354 None None] thread info: [<_MainThread(MainThread, started 131399520669824)>, , , , , ] {{(pid=87116) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 06 11:42:58 devstack cinder-volume[87116]: DEBUG cinder.volume.flows.manager.create_volume [None req-537bc3b5-3cff-4dca-9c3e-77ecb06a5f8d tempest-VolumesAdminNegativeTest-1818608021 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87116) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 11:42:58 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-537bc3b5-3cff-4dca-9c3e-77ecb06a5f8d tempest-VolumesAdminNegativeTest-1818608021 None] Flow 'volume_create_manager' (bcf991eb-4928-4669-bae8-bb78ec2c6952) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 11:42:58 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-537bc3b5-3cff-4dca-9c3e-77ecb06a5f8d tempest-VolumesAdminNegativeTest-1818608021 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b7f36792-e4bf-4489-9b60-2046dd7d9160) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:42:58 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-537bc3b5-3cff-4dca-9c3e-77ecb06a5f8d tempest-VolumesAdminNegativeTest-1818608021 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b7f36792-e4bf-4489-9b60-2046dd7d9160) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T10:42:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1133499381',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e2524e1b-1700-487a-8595-8a075f2d1400,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='786470ef390b4514a2bae359ec9a738c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T10:42:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T10:42:58Z,use_quota=True,user_id='8f8fcb0b8fcd4b97a9796c15c7d6cd87',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(34d3b144-d9b7-480a-a2e3-01e45f3d54c1),volume_type_id=34d3b144-d9b7-480a-a2e3-01e45f3d54c1)' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:42:58 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-537bc3b5-3cff-4dca-9c3e-77ecb06a5f8d tempest-VolumesAdminNegativeTest-1818608021 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bcbf75a2-45c8-4249-89ee-00ffe9296703) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:42:58 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-537bc3b5-3cff-4dca-9c3e-77ecb06a5f8d tempest-VolumesAdminNegativeTest-1818608021 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bcbf75a2-45c8-4249-89ee-00ffe9296703) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:42:58 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-537bc3b5-3cff-4dca-9c3e-77ecb06a5f8d tempest-VolumesAdminNegativeTest-1818608021 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (83c175be-d573-4e53-8b96-0961d1e16591) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:42:58 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-537bc3b5-3cff-4dca-9c3e-77ecb06a5f8d tempest-VolumesAdminNegativeTest-1818608021 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (83c175be-d573-4e53-8b96-0961d1e16591) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e2524e1b-1700-487a-8595-8a075f2d1400', 'volume_name': 'volume-e2524e1b-1700-487a-8595-8a075f2d1400', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:42:58 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-537bc3b5-3cff-4dca-9c3e-77ecb06a5f8d tempest-VolumesAdminNegativeTest-1818608021 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0a45a9a1-7f42-4d8b-b5f4-f5439bf59a8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:42:58 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-537bc3b5-3cff-4dca-9c3e-77ecb06a5f8d tempest-VolumesAdminNegativeTest-1818608021 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0a45a9a1-7f42-4d8b-b5f4-f5439bf59a8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:42:58 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-537bc3b5-3cff-4dca-9c3e-77ecb06a5f8d tempest-VolumesAdminNegativeTest-1818608021 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (53895f8c-c2f2-4400-afb7-3e0bebc83e3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:42:58 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-537bc3b5-3cff-4dca-9c3e-77ecb06a5f8d tempest-VolumesAdminNegativeTest-1818608021 None] Volume e2524e1b-1700-487a-8595-8a075f2d1400: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e2524e1b-1700-487a-8595-8a075f2d1400', 'volume_size': 1} Nov 06 11:42:58 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-537bc3b5-3cff-4dca-9c3e-77ecb06a5f8d tempest-VolumesAdminNegativeTest-1818608021 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 11:42:58 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-537bc3b5-3cff-4dca-9c3e-77ecb06a5f8d tempest-VolumesAdminNegativeTest-1818608021 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 11:42:58 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-537bc3b5-3cff-4dca-9c3e-77ecb06a5f8d tempest-VolumesAdminNegativeTest-1818608021 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T10:42:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1133499381',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e2524e1b-1700-487a-8595-8a075f2d1400,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='786470ef390b4514a2bae359ec9a738c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T10:42:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T10:42:58Z,use_quota=True,user_id='8f8fcb0b8fcd4b97a9796c15c7d6cd87',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(34d3b144-d9b7-480a-a2e3-01e45f3d54c1),volume_type_id=34d3b144-d9b7-480a-a2e3-01e45f3d54c1)}" {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 11:42:58 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-537bc3b5-3cff-4dca-9c3e-77ecb06a5f8d tempest-VolumesAdminNegativeTest-1818608021 None] Creating volume e2524e1b-1700-487a-8595-8a075f2d1400 {{(pid=87116) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 11:42:58 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-537bc3b5-3cff-4dca-9c3e-77ecb06a5f8d tempest-VolumesAdminNegativeTest-1818608021 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 11:42:58 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-537bc3b5-3cff-4dca-9c3e-77ecb06a5f8d tempest-VolumesAdminNegativeTest-1818608021 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 11:42:58 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-537bc3b5-3cff-4dca-9c3e-77ecb06a5f8d tempest-VolumesAdminNegativeTest-1818608021 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 11:42:58 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-537bc3b5-3cff-4dca-9c3e-77ecb06a5f8d tempest-VolumesAdminNegativeTest-1818608021 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 11:42:58 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-537bc3b5-3cff-4dca-9c3e-77ecb06a5f8d tempest-VolumesAdminNegativeTest-1818608021 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 11:42:58 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-537bc3b5-3cff-4dca-9c3e-77ecb06a5f8d tempest-VolumesAdminNegativeTest-1818608021 None] Selected osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f as target Quobyte volume. {{(pid=87116) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 11:42:58 devstack cinder-volume[87116]: INFO cinder.volume.drivers.remotefs [None req-537bc3b5-3cff-4dca-9c3e-77ecb06a5f8d tempest-VolumesAdminNegativeTest-1818608021 None] casted to osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f Nov 06 11:42:58 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-537bc3b5-3cff-4dca-9c3e-77ecb06a5f8d tempest-VolumesAdminNegativeTest-1818608021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-e2524e1b-1700-487a-8595-8a075f2d1400 1073741824 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:42:58 devstack sudo[88363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-e2524e1b-1700-487a-8595-8a075f2d1400 1073741824 Nov 06 11:42:58 devstack sudo[88363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:42:59 devstack sudo[88363]: pam_unix(sudo:session): session closed for user root Nov 06 11:42:59 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-537bc3b5-3cff-4dca-9c3e-77ecb06a5f8d tempest-VolumesAdminNegativeTest-1818608021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-e2524e1b-1700-487a-8595-8a075f2d1400 1073741824" returned: 0 in 1.162s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:42:59 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-537bc3b5-3cff-4dca-9c3e-77ecb06a5f8d tempest-VolumesAdminNegativeTest-1818608021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-e2524e1b-1700-487a-8595-8a075f2d1400 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:43:00 devstack sudo[88371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-e2524e1b-1700-487a-8595-8a075f2d1400 Nov 06 11:43:00 devstack sudo[88371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:43:00 devstack sudo[88371]: pam_unix(sudo:session): session closed for user root Nov 06 11:43:00 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-537bc3b5-3cff-4dca-9c3e-77ecb06a5f8d tempest-VolumesAdminNegativeTest-1818608021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-e2524e1b-1700-487a-8595-8a075f2d1400" returned: 0 in 0.820s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:43:00 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-537bc3b5-3cff-4dca-9c3e-77ecb06a5f8d tempest-VolumesAdminNegativeTest-1818608021 None] <== create_volume: return (2114ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f'} {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 11:43:00 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-537bc3b5-3cff-4dca-9c3e-77ecb06a5f8d tempest-VolumesAdminNegativeTest-1818608021 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.124s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 11:43:00 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-537bc3b5-3cff-4dca-9c3e-77ecb06a5f8d tempest-VolumesAdminNegativeTest-1818608021 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (53895f8c-c2f2-4400-afb7-3e0bebc83e3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e2524e1b-1700-487a-8595-8a075f2d1400', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:43:00 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-537bc3b5-3cff-4dca-9c3e-77ecb06a5f8d tempest-VolumesAdminNegativeTest-1818608021 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b72b68fa-7094-4b76-a8b4-f5188787f0ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:43:00 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-537bc3b5-3cff-4dca-9c3e-77ecb06a5f8d tempest-VolumesAdminNegativeTest-1818608021 None] Volume volume-e2524e1b-1700-487a-8595-8a075f2d1400 (e2524e1b-1700-487a-8595-8a075f2d1400): created successfully Nov 06 11:43:00 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-537bc3b5-3cff-4dca-9c3e-77ecb06a5f8d tempest-VolumesAdminNegativeTest-1818608021 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b72b68fa-7094-4b76-a8b4-f5188787f0ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:43:00 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-537bc3b5-3cff-4dca-9c3e-77ecb06a5f8d tempest-VolumesAdminNegativeTest-1818608021 None] Flow 'volume_create_manager' (bcf991eb-4928-4669-bae8-bb78ec2c6952) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 11:43:01 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-537bc3b5-3cff-4dca-9c3e-77ecb06a5f8d tempest-VolumesAdminNegativeTest-1818608021 None] Created volume successfully. Nov 06 11:43:01 devstack cinder-volume[87116]: DEBUG cinder.volume.flows.manager.create_volume [None req-db3e02c8-a8f1-45a0-b47f-c60c94fabf32 tempest-ServerRescueNegativeTestJSON-498462273 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87116) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 11:43:01 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-db3e02c8-a8f1-45a0-b47f-c60c94fabf32 tempest-ServerRescueNegativeTestJSON-498462273 None] Flow 'volume_create_manager' (f2cdbc93-89b6-4a0d-92ff-0abc746620f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 11:43:01 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-db3e02c8-a8f1-45a0-b47f-c60c94fabf32 tempest-ServerRescueNegativeTestJSON-498462273 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fbc3471e-350d-404c-a09f-f06e1f9900cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:43:01 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-db3e02c8-a8f1-45a0-b47f-c60c94fabf32 tempest-ServerRescueNegativeTestJSON-498462273 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fbc3471e-350d-404c-a09f-f06e1f9900cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T10:43:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1314422397',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8ee7dda7-8f62-42f8-929c-2312aef84c66,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f3073b67a3024dca90555559c580e16f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T10:43:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T10:43:02Z,use_quota=True,user_id='c7877153e59c4b76b8451a4e896bdd9b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(34d3b144-d9b7-480a-a2e3-01e45f3d54c1),volume_type_id=34d3b144-d9b7-480a-a2e3-01e45f3d54c1)' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:43:01 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-db3e02c8-a8f1-45a0-b47f-c60c94fabf32 tempest-ServerRescueNegativeTestJSON-498462273 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (57934e20-d67b-447c-bcd0-b07a06f3ba5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:43:01 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-db3e02c8-a8f1-45a0-b47f-c60c94fabf32 tempest-ServerRescueNegativeTestJSON-498462273 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (57934e20-d67b-447c-bcd0-b07a06f3ba5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:43:01 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-db3e02c8-a8f1-45a0-b47f-c60c94fabf32 tempest-ServerRescueNegativeTestJSON-498462273 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b1524d7e-c7d0-45d4-9bb8-92475e571734) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:43:01 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-db3e02c8-a8f1-45a0-b47f-c60c94fabf32 tempest-ServerRescueNegativeTestJSON-498462273 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b1524d7e-c7d0-45d4-9bb8-92475e571734) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8ee7dda7-8f62-42f8-929c-2312aef84c66', 'volume_name': 'volume-8ee7dda7-8f62-42f8-929c-2312aef84c66', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:43:01 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-db3e02c8-a8f1-45a0-b47f-c60c94fabf32 tempest-ServerRescueNegativeTestJSON-498462273 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bcd3e13f-ae37-4105-991f-b7f9976c6693) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:43:01 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-db3e02c8-a8f1-45a0-b47f-c60c94fabf32 tempest-ServerRescueNegativeTestJSON-498462273 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bcd3e13f-ae37-4105-991f-b7f9976c6693) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:43:01 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-db3e02c8-a8f1-45a0-b47f-c60c94fabf32 tempest-ServerRescueNegativeTestJSON-498462273 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0f903553-7e24-40c2-b252-c1e76d13a627) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:43:01 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-db3e02c8-a8f1-45a0-b47f-c60c94fabf32 tempest-ServerRescueNegativeTestJSON-498462273 None] Volume 8ee7dda7-8f62-42f8-929c-2312aef84c66: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8ee7dda7-8f62-42f8-929c-2312aef84c66', 'volume_size': 1} Nov 06 11:43:01 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-db3e02c8-a8f1-45a0-b47f-c60c94fabf32 tempest-ServerRescueNegativeTestJSON-498462273 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 11:43:01 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-db3e02c8-a8f1-45a0-b47f-c60c94fabf32 tempest-ServerRescueNegativeTestJSON-498462273 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 11:43:01 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-db3e02c8-a8f1-45a0-b47f-c60c94fabf32 tempest-ServerRescueNegativeTestJSON-498462273 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T10:43:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1314422397',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8ee7dda7-8f62-42f8-929c-2312aef84c66,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f3073b67a3024dca90555559c580e16f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T10:43:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T10:43:02Z,use_quota=True,user_id='c7877153e59c4b76b8451a4e896bdd9b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(34d3b144-d9b7-480a-a2e3-01e45f3d54c1),volume_type_id=34d3b144-d9b7-480a-a2e3-01e45f3d54c1)}" {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 11:43:01 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-db3e02c8-a8f1-45a0-b47f-c60c94fabf32 tempest-ServerRescueNegativeTestJSON-498462273 None] Creating volume 8ee7dda7-8f62-42f8-929c-2312aef84c66 {{(pid=87116) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 11:43:01 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-db3e02c8-a8f1-45a0-b47f-c60c94fabf32 tempest-ServerRescueNegativeTestJSON-498462273 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 11:43:01 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-db3e02c8-a8f1-45a0-b47f-c60c94fabf32 tempest-ServerRescueNegativeTestJSON-498462273 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 11:43:01 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-db3e02c8-a8f1-45a0-b47f-c60c94fabf32 tempest-ServerRescueNegativeTestJSON-498462273 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 11:43:01 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-db3e02c8-a8f1-45a0-b47f-c60c94fabf32 tempest-ServerRescueNegativeTestJSON-498462273 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 11:43:01 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-db3e02c8-a8f1-45a0-b47f-c60c94fabf32 tempest-ServerRescueNegativeTestJSON-498462273 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 11:43:01 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-db3e02c8-a8f1-45a0-b47f-c60c94fabf32 tempest-ServerRescueNegativeTestJSON-498462273 None] Selected osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f as target Quobyte volume. {{(pid=87116) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 11:43:01 devstack cinder-volume[87116]: INFO cinder.volume.drivers.remotefs [None req-db3e02c8-a8f1-45a0-b47f-c60c94fabf32 tempest-ServerRescueNegativeTestJSON-498462273 None] casted to osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f Nov 06 11:43:01 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-db3e02c8-a8f1-45a0-b47f-c60c94fabf32 tempest-ServerRescueNegativeTestJSON-498462273 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-8ee7dda7-8f62-42f8-929c-2312aef84c66 1073741824 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:43:01 devstack sudo[88405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-8ee7dda7-8f62-42f8-929c-2312aef84c66 1073741824 Nov 06 11:43:01 devstack sudo[88405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:43:02 devstack sudo[88405]: pam_unix(sudo:session): session closed for user root Nov 06 11:43:02 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-db3e02c8-a8f1-45a0-b47f-c60c94fabf32 tempest-ServerRescueNegativeTestJSON-498462273 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-8ee7dda7-8f62-42f8-929c-2312aef84c66 1073741824" returned: 0 in 1.092s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:43:03 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-db3e02c8-a8f1-45a0-b47f-c60c94fabf32 tempest-ServerRescueNegativeTestJSON-498462273 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-8ee7dda7-8f62-42f8-929c-2312aef84c66 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:43:03 devstack sudo[88413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-8ee7dda7-8f62-42f8-929c-2312aef84c66 Nov 06 11:43:03 devstack sudo[88413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:43:03 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-b47da61b-e743-4df0-b401-1d73a483766e tempest-VolumesAdminNegativeTest-1818608021 None] Acquiring lock "cinder-e2524e1b-1700-487a-8595-8a075f2d1400-delete_volume" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 11:43:03 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-b47da61b-e743-4df0-b401-1d73a483766e tempest-VolumesAdminNegativeTest-1818608021 None] Lock "cinder-e2524e1b-1700-487a-8595-8a075f2d1400-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 11:43:03 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-b47da61b-e743-4df0-b401-1d73a483766e tempest-VolumesAdminNegativeTest-1818608021 None] Acquiring lock "cinder-quobyte-e2524e1b-1700-487a-8595-8a075f2d1400" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 11:43:03 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-b47da61b-e743-4df0-b401-1d73a483766e tempest-VolumesAdminNegativeTest-1818608021 None] Lock "cinder-quobyte-e2524e1b-1700-487a-8595-8a075f2d1400" acquired by "delete_volume" :: waited 0.037s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 11:43:03 devstack cinder-volume[87116]: INFO oslo.privsep.daemon [None req-b47da61b-e743-4df0-b401-1d73a483766e tempest-VolumesAdminNegativeTest-1818608021 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmpry3h97ri/privsep.sock'] Nov 06 11:43:03 devstack sudo[88415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmpry3h97ri/privsep.sock Nov 06 11:43:03 devstack sudo[88415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:43:03 devstack sudo[88413]: pam_unix(sudo:session): session closed for user root Nov 06 11:43:03 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-db3e02c8-a8f1-45a0-b47f-c60c94fabf32 tempest-ServerRescueNegativeTestJSON-498462273 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-8ee7dda7-8f62-42f8-929c-2312aef84c66" returned: 0 in 0.674s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:43:03 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-db3e02c8-a8f1-45a0-b47f-c60c94fabf32 tempest-ServerRescueNegativeTestJSON-498462273 None] <== create_volume: return (1961ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f'} {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 11:43:03 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-db3e02c8-a8f1-45a0-b47f-c60c94fabf32 tempest-ServerRescueNegativeTestJSON-498462273 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.965s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 11:43:03 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-db3e02c8-a8f1-45a0-b47f-c60c94fabf32 tempest-ServerRescueNegativeTestJSON-498462273 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0f903553-7e24-40c2-b252-c1e76d13a627) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8ee7dda7-8f62-42f8-929c-2312aef84c66', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:43:03 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-db3e02c8-a8f1-45a0-b47f-c60c94fabf32 tempest-ServerRescueNegativeTestJSON-498462273 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c8f79b7b-29c9-4557-8fc1-31dfaecbf1e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:43:03 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-db3e02c8-a8f1-45a0-b47f-c60c94fabf32 tempest-ServerRescueNegativeTestJSON-498462273 None] Volume volume-8ee7dda7-8f62-42f8-929c-2312aef84c66 (8ee7dda7-8f62-42f8-929c-2312aef84c66): created successfully Nov 06 11:43:03 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-db3e02c8-a8f1-45a0-b47f-c60c94fabf32 tempest-ServerRescueNegativeTestJSON-498462273 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c8f79b7b-29c9-4557-8fc1-31dfaecbf1e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:43:03 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-db3e02c8-a8f1-45a0-b47f-c60c94fabf32 tempest-ServerRescueNegativeTestJSON-498462273 None] Flow 'volume_create_manager' (f2cdbc93-89b6-4a0d-92ff-0abc746620f9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 11:43:03 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-db3e02c8-a8f1-45a0-b47f-c60c94fabf32 tempest-ServerRescueNegativeTestJSON-498462273 None] Created volume successfully. Nov 06 11:43:05 devstack cinder-volume[87116]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:105: EventletDeprecationWarning: Nov 06 11:43:05 devstack cinder-volume[87116]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Nov 06 11:43:05 devstack cinder-volume[87116]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Nov 06 11:43:05 devstack cinder-volume[87116]: WARNING oslo.privsep.daemon [-] privsep log: Nov 06 11:43:05 devstack cinder-volume[87116]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Nov 06 11:43:05 devstack cinder-volume[87116]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Nov 06 11:43:05 devstack cinder-volume[87116]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Nov 06 11:43:05 devstack cinder-volume[87116]: WARNING oslo.privsep.daemon [-] privsep log: Nov 06 11:43:05 devstack cinder-volume[87116]: WARNING oslo.privsep.daemon [-] privsep log: import eventlet Nov 06 11:43:06 devstack sudo[88415]: pam_unix(sudo:session): session closed for user root Nov 06 11:43:06 devstack cinder-volume[87116]: INFO oslo.privsep.daemon [None req-b47da61b-e743-4df0-b401-1d73a483766e tempest-VolumesAdminNegativeTest-1818608021 None] Spawned new privsep daemon via rootwrap Nov 06 11:43:06 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [None req-b47da61b-e743-4df0-b401-1d73a483766e tempest-VolumesAdminNegativeTest-1818608021 None] Accepted privsep connection to /tmp/tmpry3h97ri/privsep.sock {{(pid=87116) __init__ /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:425}} Nov 06 11:43:06 devstack cinder-volume[87116]: INFO oslo.privsep.daemon [-] privsep daemon starting Nov 06 11:43:06 devstack cinder-volume[87116]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 Nov 06 11:43:06 devstack cinder-volume[87116]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none Nov 06 11:43:06 devstack cinder-volume[87116]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 88420 Nov 06 11:43:06 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9daa434-e98c-4a65-854f-90cd1d5ad047]: (2,) {{(pid=88420) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 11:43:06 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[9721cac0-85ed-45f1-82f4-49e9eb74c8d4]: (4, 'qcow2') {{(pid=88420) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 11:43:06 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-b47da61b-e743-4df0-b401-1d73a483766e tempest-VolumesAdminNegativeTest-1818608021 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-e2524e1b-1700-487a-8595-8a075f2d1400 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:43:06 devstack sudo[88425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-e2524e1b-1700-487a-8595-8a075f2d1400 Nov 06 11:43:06 devstack sudo[88425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:43:07 devstack sudo[88425]: pam_unix(sudo:session): session closed for user root Nov 06 11:43:07 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-b47da61b-e743-4df0-b401-1d73a483766e tempest-VolumesAdminNegativeTest-1818608021 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-e2524e1b-1700-487a-8595-8a075f2d1400" returned: 0 in 0.983s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:43:07 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-b47da61b-e743-4df0-b401-1d73a483766e tempest-VolumesAdminNegativeTest-1818608021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-e2524e1b-1700-487a-8595-8a075f2d1400 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:43:07 devstack sudo[88430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-e2524e1b-1700-487a-8595-8a075f2d1400 Nov 06 11:43:07 devstack sudo[88430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:43:07 devstack sudo[88430]: pam_unix(sudo:session): session closed for user root Nov 06 11:43:07 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-b47da61b-e743-4df0-b401-1d73a483766e tempest-VolumesAdminNegativeTest-1818608021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-e2524e1b-1700-487a-8595-8a075f2d1400" returned: 0 in 0.508s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:43:07 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-b47da61b-e743-4df0-b401-1d73a483766e tempest-VolumesAdminNegativeTest-1818608021 None] Lock "cinder-quobyte-e2524e1b-1700-487a-8595-8a075f2d1400" released by "delete_volume" :: held 4.291s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 11:43:07 devstack cinder-volume[87116]: WARNING cinder.quota [None req-b47da61b-e743-4df0-b401-1d73a483766e tempest-VolumesAdminNegativeTest-1818608021 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Nov 06 11:43:07 devstack cinder-volume[87116]: WARNING cinder.quota [None req-b47da61b-e743-4df0-b401-1d73a483766e tempest-VolumesAdminNegativeTest-1818608021 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Nov 06 11:43:08 devstack cinder-volume[87116]: DEBUG cinder.quota [None req-b47da61b-e743-4df0-b401-1d73a483766e tempest-VolumesAdminNegativeTest-1818608021 None] Created reservations ['5a455354-2d68-4137-b1e4-0c634fb41ff4', '75bac14b-57ff-4015-a01e-64e72b758b19', '0c1e9576-847e-439e-89ad-b71cab73f4d5', '21cd0c52-b2c7-4bf8-a2eb-e7085e061ce5'] {{(pid=87116) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 11:43:08 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-b47da61b-e743-4df0-b401-1d73a483766e tempest-VolumesAdminNegativeTest-1818608021 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 11:43:08 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-b47da61b-e743-4df0-b401-1d73a483766e tempest-VolumesAdminNegativeTest-1818608021 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 11:43:08 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-b47da61b-e743-4df0-b401-1d73a483766e tempest-VolumesAdminNegativeTest-1818608021 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 11:43:08 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-b47da61b-e743-4df0-b401-1d73a483766e tempest-VolumesAdminNegativeTest-1818608021 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 11:43:08 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-b47da61b-e743-4df0-b401-1d73a483766e tempest-VolumesAdminNegativeTest-1818608021 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 11:43:08 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-b47da61b-e743-4df0-b401-1d73a483766e tempest-VolumesAdminNegativeTest-1818608021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:43:08 devstack sudo[88438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756 Nov 06 11:43:08 devstack sudo[88438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:43:08 devstack sudo[88438]: pam_unix(sudo:session): session closed for user root Nov 06 11:43:08 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-b47da61b-e743-4df0-b401-1d73a483766e tempest-VolumesAdminNegativeTest-1818608021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756" returned: 0 in 0.391s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:43:08 devstack cinder-volume[87116]: DEBUG cinder.manager [None req-b47da61b-e743-4df0-b401-1d73a483766e tempest-VolumesAdminNegativeTest-1818608021 None] Notifying Schedulers of capabilities ... {{(pid=87116) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 11:43:08 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-b47da61b-e743-4df0-b401-1d73a483766e tempest-VolumesAdminNegativeTest-1818608021 None] Deleted volume successfully. Nov 06 11:43:08 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-b47da61b-e743-4df0-b401-1d73a483766e tempest-VolumesAdminNegativeTest-1818608021 None] Lock "cinder-e2524e1b-1700-487a-8595-8a075f2d1400-delete_volume" released by "delete_volume" :: held 5.520s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 11:43:18 devstack cinder-volume[87116]: DEBUG dbcounter [-] [87116] Writing DB stats cinder:UPDATE=20,cinder:SELECT=6,cinder:INSERT=3,cinder:DELETE=2 {{(pid=87116) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 11:43:18 devstack cinder-volume[87116]: DEBUG dbcounter [-] [87116] Writing DB stats cinder:SELECT=12,cinder:UPDATE=8,cinder:INSERT=3,cinder:DELETE=1 {{(pid=87116) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 11:43:29 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-be49f39a-e716-4067-acfd-20ed73174b44 tempest-ServerRescueNegativeTestJSON-498462273 None] Acquiring lock "cinder-8ee7dda7-8f62-42f8-929c-2312aef84c66-delete_volume" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 11:43:29 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-be49f39a-e716-4067-acfd-20ed73174b44 tempest-ServerRescueNegativeTestJSON-498462273 None] Lock "cinder-8ee7dda7-8f62-42f8-929c-2312aef84c66-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 11:43:29 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-be49f39a-e716-4067-acfd-20ed73174b44 tempest-ServerRescueNegativeTestJSON-498462273 None] Acquiring lock "cinder-quobyte-8ee7dda7-8f62-42f8-929c-2312aef84c66" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 11:43:29 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-be49f39a-e716-4067-acfd-20ed73174b44 tempest-ServerRescueNegativeTestJSON-498462273 None] Lock "cinder-quobyte-8ee7dda7-8f62-42f8-929c-2312aef84c66" acquired by "delete_volume" :: waited 0.028s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 11:43:29 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[470dd0a2-55ee-42d1-a362-c816dfe7bd16]: (4, 'qcow2') {{(pid=88420) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 11:43:29 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-be49f39a-e716-4067-acfd-20ed73174b44 tempest-ServerRescueNegativeTestJSON-498462273 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-8ee7dda7-8f62-42f8-929c-2312aef84c66 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:43:29 devstack sudo[88669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-8ee7dda7-8f62-42f8-929c-2312aef84c66 Nov 06 11:43:29 devstack sudo[88669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:43:30 devstack sudo[88669]: pam_unix(sudo:session): session closed for user root Nov 06 11:43:30 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-be49f39a-e716-4067-acfd-20ed73174b44 tempest-ServerRescueNegativeTestJSON-498462273 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-8ee7dda7-8f62-42f8-929c-2312aef84c66" returned: 0 in 0.654s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:43:30 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-be49f39a-e716-4067-acfd-20ed73174b44 tempest-ServerRescueNegativeTestJSON-498462273 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-8ee7dda7-8f62-42f8-929c-2312aef84c66 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:43:30 devstack sudo[88676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-8ee7dda7-8f62-42f8-929c-2312aef84c66 Nov 06 11:43:30 devstack sudo[88676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:43:30 devstack sudo[88676]: pam_unix(sudo:session): session closed for user root Nov 06 11:43:30 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-be49f39a-e716-4067-acfd-20ed73174b44 tempest-ServerRescueNegativeTestJSON-498462273 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-8ee7dda7-8f62-42f8-929c-2312aef84c66" returned: 0 in 0.517s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:43:30 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-be49f39a-e716-4067-acfd-20ed73174b44 tempest-ServerRescueNegativeTestJSON-498462273 None] Lock "cinder-quobyte-8ee7dda7-8f62-42f8-929c-2312aef84c66" released by "delete_volume" :: held 1.264s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 11:43:30 devstack cinder-volume[87116]: DEBUG cinder.quota [None req-be49f39a-e716-4067-acfd-20ed73174b44 tempest-ServerRescueNegativeTestJSON-498462273 None] Created reservations ['cf254054-427b-4740-ac88-84f0d56c73b5', 'ce7dd4be-68fa-43cf-9eae-24c4ea90039d', 'e9191109-5d43-4283-ba64-8795306b2d0c', '5a72621e-d0d5-47b3-86c3-e036c47fb177'] {{(pid=87116) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 11:43:30 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-be49f39a-e716-4067-acfd-20ed73174b44 tempest-ServerRescueNegativeTestJSON-498462273 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 11:43:30 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-be49f39a-e716-4067-acfd-20ed73174b44 tempest-ServerRescueNegativeTestJSON-498462273 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 11:43:30 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-be49f39a-e716-4067-acfd-20ed73174b44 tempest-ServerRescueNegativeTestJSON-498462273 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 11:43:30 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-be49f39a-e716-4067-acfd-20ed73174b44 tempest-ServerRescueNegativeTestJSON-498462273 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 11:43:30 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-be49f39a-e716-4067-acfd-20ed73174b44 tempest-ServerRescueNegativeTestJSON-498462273 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.031s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 11:43:30 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-be49f39a-e716-4067-acfd-20ed73174b44 tempest-ServerRescueNegativeTestJSON-498462273 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:43:31 devstack sudo[88681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756 Nov 06 11:43:31 devstack sudo[88681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:43:31 devstack sudo[88681]: pam_unix(sudo:session): session closed for user root Nov 06 11:43:31 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-be49f39a-e716-4067-acfd-20ed73174b44 tempest-ServerRescueNegativeTestJSON-498462273 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756" returned: 0 in 0.706s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:43:31 devstack cinder-volume[87116]: DEBUG cinder.manager [None req-be49f39a-e716-4067-acfd-20ed73174b44 tempest-ServerRescueNegativeTestJSON-498462273 None] Notifying Schedulers of capabilities ... {{(pid=87116) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 11:43:31 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-be49f39a-e716-4067-acfd-20ed73174b44 tempest-ServerRescueNegativeTestJSON-498462273 None] Deleted volume successfully. Nov 06 11:43:31 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-be49f39a-e716-4067-acfd-20ed73174b44 tempest-ServerRescueNegativeTestJSON-498462273 None] Lock "cinder-8ee7dda7-8f62-42f8-929c-2312aef84c66-delete_volume" released by "delete_volume" :: held 2.368s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 11:43:39 devstack cinder-volume[87116]: DEBUG oslo_service.periodic_task [None req-4fab4816-ec2b-4b19-b2ff-8548f2084354 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87116) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 11:43:39 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-4fab4816-ec2b-4b19-b2ff-8548f2084354 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 11:43:39 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-4fab4816-ec2b-4b19-b2ff-8548f2084354 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 11:43:39 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-4fab4816-ec2b-4b19-b2ff-8548f2084354 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 11:43:39 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-4fab4816-ec2b-4b19-b2ff-8548f2084354 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 11:43:39 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-4fab4816-ec2b-4b19-b2ff-8548f2084354 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 11:43:39 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-4fab4816-ec2b-4b19-b2ff-8548f2084354 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:43:39 devstack sudo[88842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756 Nov 06 11:43:39 devstack sudo[88842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:43:40 devstack sudo[88842]: pam_unix(sudo:session): session closed for user root Nov 06 11:43:40 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-4fab4816-ec2b-4b19-b2ff-8548f2084354 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756" returned: 0 in 0.388s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:43:40 devstack cinder-volume[87116]: DEBUG cinder.manager [None req-4fab4816-ec2b-4b19-b2ff-8548f2084354 None None] Notifying Schedulers of capabilities ... {{(pid=87116) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 11:43:40 devstack cinder-volume[87116]: DEBUG cinder.volume.flows.manager.create_volume [None req-c933b423-6b0e-4d91-9469-2bec775e1b63 tempest-DeleteServersTestJSON-1199544413 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87116) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 11:43:40 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-c933b423-6b0e-4d91-9469-2bec775e1b63 tempest-DeleteServersTestJSON-1199544413 None] Flow 'volume_create_manager' (c85e7463-60b5-4337-9343-e9037bb405b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 11:43:40 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-c933b423-6b0e-4d91-9469-2bec775e1b63 tempest-DeleteServersTestJSON-1199544413 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f3d66af2-da84-4bae-902a-fefb80a6e25f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:43:40 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-c933b423-6b0e-4d91-9469-2bec775e1b63 tempest-DeleteServersTestJSON-1199544413 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f3d66af2-da84-4bae-902a-fefb80a6e25f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T10:43:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1103228545',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=41b1369a-87e2-4e88-955c-9032b1a000d9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ebe9f970194475faccb07fda326c039',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T10:43:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T10:43:40Z,use_quota=True,user_id='3ba771a406cd4ef6b7530ab5982cb87f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(34d3b144-d9b7-480a-a2e3-01e45f3d54c1),volume_type_id=34d3b144-d9b7-480a-a2e3-01e45f3d54c1)' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:43:40 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-c933b423-6b0e-4d91-9469-2bec775e1b63 tempest-DeleteServersTestJSON-1199544413 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3c414e58-0bb5-4f83-8860-446ddf34fac1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:43:40 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-c933b423-6b0e-4d91-9469-2bec775e1b63 tempest-DeleteServersTestJSON-1199544413 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3c414e58-0bb5-4f83-8860-446ddf34fac1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:43:40 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-c933b423-6b0e-4d91-9469-2bec775e1b63 tempest-DeleteServersTestJSON-1199544413 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (59917a18-59fe-421a-a836-0e2fa22a86b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:43:40 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-c933b423-6b0e-4d91-9469-2bec775e1b63 tempest-DeleteServersTestJSON-1199544413 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (59917a18-59fe-421a-a836-0e2fa22a86b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '41b1369a-87e2-4e88-955c-9032b1a000d9', 'volume_name': 'volume-41b1369a-87e2-4e88-955c-9032b1a000d9', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:43:40 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-c933b423-6b0e-4d91-9469-2bec775e1b63 tempest-DeleteServersTestJSON-1199544413 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ff25dfc2-a516-42fd-90c4-293bbaa72a62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:43:40 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-c933b423-6b0e-4d91-9469-2bec775e1b63 tempest-DeleteServersTestJSON-1199544413 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ff25dfc2-a516-42fd-90c4-293bbaa72a62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:43:40 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-c933b423-6b0e-4d91-9469-2bec775e1b63 tempest-DeleteServersTestJSON-1199544413 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b2bde14b-dfb6-44ab-a80f-af64582adce1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:43:40 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-c933b423-6b0e-4d91-9469-2bec775e1b63 tempest-DeleteServersTestJSON-1199544413 None] Volume 41b1369a-87e2-4e88-955c-9032b1a000d9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-41b1369a-87e2-4e88-955c-9032b1a000d9', 'volume_size': 1} Nov 06 11:43:40 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-c933b423-6b0e-4d91-9469-2bec775e1b63 tempest-DeleteServersTestJSON-1199544413 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 11:43:40 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-c933b423-6b0e-4d91-9469-2bec775e1b63 tempest-DeleteServersTestJSON-1199544413 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 11:43:40 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-c933b423-6b0e-4d91-9469-2bec775e1b63 tempest-DeleteServersTestJSON-1199544413 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T10:43:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1103228545',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=41b1369a-87e2-4e88-955c-9032b1a000d9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4ebe9f970194475faccb07fda326c039',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T10:43:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T10:43:40Z,use_quota=True,user_id='3ba771a406cd4ef6b7530ab5982cb87f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(34d3b144-d9b7-480a-a2e3-01e45f3d54c1),volume_type_id=34d3b144-d9b7-480a-a2e3-01e45f3d54c1)}" {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 11:43:40 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-c933b423-6b0e-4d91-9469-2bec775e1b63 tempest-DeleteServersTestJSON-1199544413 None] Creating volume 41b1369a-87e2-4e88-955c-9032b1a000d9 {{(pid=87116) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 11:43:40 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-c933b423-6b0e-4d91-9469-2bec775e1b63 tempest-DeleteServersTestJSON-1199544413 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 11:43:40 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-c933b423-6b0e-4d91-9469-2bec775e1b63 tempest-DeleteServersTestJSON-1199544413 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 11:43:40 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-c933b423-6b0e-4d91-9469-2bec775e1b63 tempest-DeleteServersTestJSON-1199544413 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 11:43:40 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-c933b423-6b0e-4d91-9469-2bec775e1b63 tempest-DeleteServersTestJSON-1199544413 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 11:43:40 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-c933b423-6b0e-4d91-9469-2bec775e1b63 tempest-DeleteServersTestJSON-1199544413 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 11:43:40 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-c933b423-6b0e-4d91-9469-2bec775e1b63 tempest-DeleteServersTestJSON-1199544413 None] Selected osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f as target Quobyte volume. {{(pid=87116) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 11:43:40 devstack cinder-volume[87116]: INFO cinder.volume.drivers.remotefs [None req-c933b423-6b0e-4d91-9469-2bec775e1b63 tempest-DeleteServersTestJSON-1199544413 None] casted to osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f Nov 06 11:43:40 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-c933b423-6b0e-4d91-9469-2bec775e1b63 tempest-DeleteServersTestJSON-1199544413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-41b1369a-87e2-4e88-955c-9032b1a000d9 1073741824 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:43:40 devstack sudo[88847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-41b1369a-87e2-4e88-955c-9032b1a000d9 1073741824 Nov 06 11:43:40 devstack sudo[88847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:43:41 devstack sudo[88847]: pam_unix(sudo:session): session closed for user root Nov 06 11:43:41 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-c933b423-6b0e-4d91-9469-2bec775e1b63 tempest-DeleteServersTestJSON-1199544413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-41b1369a-87e2-4e88-955c-9032b1a000d9 1073741824" returned: 0 in 0.560s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:43:41 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-c933b423-6b0e-4d91-9469-2bec775e1b63 tempest-DeleteServersTestJSON-1199544413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-41b1369a-87e2-4e88-955c-9032b1a000d9 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:43:41 devstack sudo[88854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-41b1369a-87e2-4e88-955c-9032b1a000d9 Nov 06 11:43:41 devstack sudo[88854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:43:41 devstack sudo[88854]: pam_unix(sudo:session): session closed for user root Nov 06 11:43:41 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-c933b423-6b0e-4d91-9469-2bec775e1b63 tempest-DeleteServersTestJSON-1199544413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-41b1369a-87e2-4e88-955c-9032b1a000d9" returned: 0 in 0.434s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:43:41 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-c933b423-6b0e-4d91-9469-2bec775e1b63 tempest-DeleteServersTestJSON-1199544413 None] <== create_volume: return (1050ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f'} {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 11:43:41 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-c933b423-6b0e-4d91-9469-2bec775e1b63 tempest-DeleteServersTestJSON-1199544413 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.053s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 11:43:41 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-c933b423-6b0e-4d91-9469-2bec775e1b63 tempest-DeleteServersTestJSON-1199544413 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b2bde14b-dfb6-44ab-a80f-af64582adce1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-41b1369a-87e2-4e88-955c-9032b1a000d9', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:43:41 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-c933b423-6b0e-4d91-9469-2bec775e1b63 tempest-DeleteServersTestJSON-1199544413 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a49b6b1f-47f9-4d49-9310-af3f6e52dd95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:43:41 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-c933b423-6b0e-4d91-9469-2bec775e1b63 tempest-DeleteServersTestJSON-1199544413 None] Volume volume-41b1369a-87e2-4e88-955c-9032b1a000d9 (41b1369a-87e2-4e88-955c-9032b1a000d9): created successfully Nov 06 11:43:41 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-c933b423-6b0e-4d91-9469-2bec775e1b63 tempest-DeleteServersTestJSON-1199544413 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a49b6b1f-47f9-4d49-9310-af3f6e52dd95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:43:41 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-c933b423-6b0e-4d91-9469-2bec775e1b63 tempest-DeleteServersTestJSON-1199544413 None] Flow 'volume_create_manager' (c85e7463-60b5-4337-9343-e9037bb405b3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 11:43:41 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-c933b423-6b0e-4d91-9469-2bec775e1b63 tempest-DeleteServersTestJSON-1199544413 None] Created volume successfully. Nov 06 11:43:46 devstack cinder-volume[87116]: WARNING py.warnings [req-20d8a045-f37f-4fac-bb01-915d95b10a0b req-7983c5fe-5a59-4da5-ada8-6eefd8f72856 tempest-DeleteServersTestJSON-1199544413 None] /opt/stack/cinder/cinder/db/api.py:2468: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volumes_1", "volume_attachment" and FROM element "volumes". Apply join condition(s) between each element to resolve. Nov 06 11:43:46 devstack cinder-volume[87116]: .first() Nov 06 11:43:46 devstack cinder-volume[87116]: Nov 06 11:43:46 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [req-20d8a045-f37f-4fac-bb01-915d95b10a0b req-7983c5fe-5a59-4da5-ada8-6eefd8f72856 tempest-DeleteServersTestJSON-1199544413 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 11:43:46 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [req-20d8a045-f37f-4fac-bb01-915d95b10a0b req-7983c5fe-5a59-4da5-ada8-6eefd8f72856 tempest-DeleteServersTestJSON-1199544413 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 11:43:46 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [req-20d8a045-f37f-4fac-bb01-915d95b10a0b req-7983c5fe-5a59-4da5-ada8-6eefd8f72856 tempest-DeleteServersTestJSON-1199544413 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.026s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 11:43:47 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [req-20d8a045-f37f-4fac-bb01-915d95b10a0b req-7983c5fe-5a59-4da5-ada8-6eefd8f72856 tempest-DeleteServersTestJSON-1199544413 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f', 'name': 'volume-41b1369a-87e2-4e88-955c-9032b1a000d9', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '0648f821-2d17-421c-880b-ea52970a6d2a', 'enforce_multipath': True} {{(pid=87116) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 06 11:43:47 devstack cinder-volume[87116]: INFO cinder.volume.manager [req-20d8a045-f37f-4fac-bb01-915d95b10a0b req-7983c5fe-5a59-4da5-ada8-6eefd8f72856 tempest-DeleteServersTestJSON-1199544413 None] attachment_update completed successfully. Nov 06 11:43:53 devstack cinder-volume[87116]: INFO cinder.volume.manager [req-0ba02dde-f215-4a8b-a02b-7df9297e3dea req-f9e995f6-4e58-4f7a-b16b-4da176de61e2 tempest-DeleteServersTestJSON-1199544413 None] Terminate volume connection completed successfully. Nov 06 11:43:53 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [req-0ba02dde-f215-4a8b-a02b-7df9297e3dea req-f9e995f6-4e58-4f7a-b16b-4da176de61e2 tempest-DeleteServersTestJSON-1199544413 None] Deleting attachment 0648f821-2d17-421c-880b-ea52970a6d2a. {{(pid=87116) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 06 11:43:53 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [req-00a0add9-9313-4438-927b-bf4c0cf8743d req-094c6cac-dd57-47fb-a19d-2071bcc700c0 tempest-TaggedAttachmentsTest-905079736 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 11:43:53 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [req-00a0add9-9313-4438-927b-bf4c0cf8743d req-094c6cac-dd57-47fb-a19d-2071bcc700c0 tempest-TaggedAttachmentsTest-905079736 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 11:43:53 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [req-00a0add9-9313-4438-927b-bf4c0cf8743d req-094c6cac-dd57-47fb-a19d-2071bcc700c0 tempest-TaggedAttachmentsTest-905079736 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.017s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 11:43:53 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [req-00a0add9-9313-4438-927b-bf4c0cf8743d req-094c6cac-dd57-47fb-a19d-2071bcc700c0 tempest-TaggedAttachmentsTest-905079736 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f', 'name': 'volume-d42ddfe7-a222-4a05-b1ae-234ed426001b', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '7c255237-c1a7-4aa7-ab7d-6cc2632a01d0', 'enforce_multipath': True} {{(pid=87116) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 06 11:43:53 devstack cinder-volume[87116]: INFO cinder.volume.manager [req-00a0add9-9313-4438-927b-bf4c0cf8743d req-094c6cac-dd57-47fb-a19d-2071bcc700c0 tempest-TaggedAttachmentsTest-905079736 None] attachment_update completed successfully. Nov 06 11:43:54 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-4c0c7bdd-b1d8-4959-a79e-f3d06ed45be8 tempest-DeleteServersTestJSON-1199544413 None] Acquiring lock "cinder-41b1369a-87e2-4e88-955c-9032b1a000d9-delete_volume" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 11:43:54 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-4c0c7bdd-b1d8-4959-a79e-f3d06ed45be8 tempest-DeleteServersTestJSON-1199544413 None] Lock "cinder-41b1369a-87e2-4e88-955c-9032b1a000d9-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 11:43:54 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-4c0c7bdd-b1d8-4959-a79e-f3d06ed45be8 tempest-DeleteServersTestJSON-1199544413 None] Acquiring lock "cinder-quobyte-41b1369a-87e2-4e88-955c-9032b1a000d9" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 11:43:54 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-4c0c7bdd-b1d8-4959-a79e-f3d06ed45be8 tempest-DeleteServersTestJSON-1199544413 None] Lock "cinder-quobyte-41b1369a-87e2-4e88-955c-9032b1a000d9" acquired by "delete_volume" :: waited 0.035s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 11:43:55 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[718bf836-b64e-4f90-bc66-2f0549ffc54c]: (4, 'qcow2') {{(pid=88420) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 11:43:55 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-4c0c7bdd-b1d8-4959-a79e-f3d06ed45be8 tempest-DeleteServersTestJSON-1199544413 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-41b1369a-87e2-4e88-955c-9032b1a000d9 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:43:55 devstack sudo[89842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-41b1369a-87e2-4e88-955c-9032b1a000d9 Nov 06 11:43:55 devstack sudo[89842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:43:55 devstack sudo[89842]: pam_unix(sudo:session): session closed for user root Nov 06 11:43:55 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-4c0c7bdd-b1d8-4959-a79e-f3d06ed45be8 tempest-DeleteServersTestJSON-1199544413 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-41b1369a-87e2-4e88-955c-9032b1a000d9" returned: 0 in 0.514s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:43:55 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-4c0c7bdd-b1d8-4959-a79e-f3d06ed45be8 tempest-DeleteServersTestJSON-1199544413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-41b1369a-87e2-4e88-955c-9032b1a000d9 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:43:55 devstack sudo[89847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-41b1369a-87e2-4e88-955c-9032b1a000d9 Nov 06 11:43:55 devstack sudo[89847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:43:55 devstack sudo[89847]: pam_unix(sudo:session): session closed for user root Nov 06 11:43:55 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-4c0c7bdd-b1d8-4959-a79e-f3d06ed45be8 tempest-DeleteServersTestJSON-1199544413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-41b1369a-87e2-4e88-955c-9032b1a000d9" returned: 0 in 0.306s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:43:55 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-4c0c7bdd-b1d8-4959-a79e-f3d06ed45be8 tempest-DeleteServersTestJSON-1199544413 None] Lock "cinder-quobyte-41b1369a-87e2-4e88-955c-9032b1a000d9" released by "delete_volume" :: held 0.898s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 11:43:55 devstack cinder-volume[87116]: DEBUG cinder.quota [None req-4c0c7bdd-b1d8-4959-a79e-f3d06ed45be8 tempest-DeleteServersTestJSON-1199544413 None] Created reservations ['78c0ea93-2428-41b8-991f-d2af9adf67fe', '4578a16e-ebbf-4511-9083-7ccf0ce2cc4d', '7a7dae58-0488-4ed2-a1eb-a3d0b9c7eff6', '6790cde6-883a-426d-bb6a-f96594573af1'] {{(pid=87116) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 11:43:56 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-4c0c7bdd-b1d8-4959-a79e-f3d06ed45be8 tempest-DeleteServersTestJSON-1199544413 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 11:43:56 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-4c0c7bdd-b1d8-4959-a79e-f3d06ed45be8 tempest-DeleteServersTestJSON-1199544413 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 11:43:56 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-4c0c7bdd-b1d8-4959-a79e-f3d06ed45be8 tempest-DeleteServersTestJSON-1199544413 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 11:43:56 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-4c0c7bdd-b1d8-4959-a79e-f3d06ed45be8 tempest-DeleteServersTestJSON-1199544413 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 11:43:56 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-4c0c7bdd-b1d8-4959-a79e-f3d06ed45be8 tempest-DeleteServersTestJSON-1199544413 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 11:43:56 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-4c0c7bdd-b1d8-4959-a79e-f3d06ed45be8 tempest-DeleteServersTestJSON-1199544413 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:43:56 devstack sudo[89854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756 Nov 06 11:43:56 devstack sudo[89854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:43:56 devstack sudo[89854]: pam_unix(sudo:session): session closed for user root Nov 06 11:43:56 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-4c0c7bdd-b1d8-4959-a79e-f3d06ed45be8 tempest-DeleteServersTestJSON-1199544413 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756" returned: 0 in 0.359s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:43:56 devstack cinder-volume[87116]: DEBUG cinder.manager [None req-4c0c7bdd-b1d8-4959-a79e-f3d06ed45be8 tempest-DeleteServersTestJSON-1199544413 None] Notifying Schedulers of capabilities ... {{(pid=87116) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 11:43:56 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-4c0c7bdd-b1d8-4959-a79e-f3d06ed45be8 tempest-DeleteServersTestJSON-1199544413 None] Deleted volume successfully. Nov 06 11:43:56 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-4c0c7bdd-b1d8-4959-a79e-f3d06ed45be8 tempest-DeleteServersTestJSON-1199544413 None] Lock "cinder-41b1369a-87e2-4e88-955c-9032b1a000d9-delete_volume" released by "delete_volume" :: held 1.586s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 11:43:59 devstack cinder-volume[87116]: INFO cinder.volume.manager [req-8260a807-f96b-47a4-857b-974aca3bc0bc req-404fdba2-ff8d-4874-ba68-e7d2f9dcb50d tempest-TaggedAttachmentsTest-905079736 None] Terminate volume connection completed successfully. Nov 06 11:43:59 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [req-8260a807-f96b-47a4-857b-974aca3bc0bc req-404fdba2-ff8d-4874-ba68-e7d2f9dcb50d tempest-TaggedAttachmentsTest-905079736 None] Deleting attachment 7c255237-c1a7-4aa7-ab7d-6cc2632a01d0. {{(pid=87116) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 06 11:44:06 devstack cinder-volume[87116]: DEBUG dbcounter [-] [87116] Writing DB stats cinder:SELECT=30,cinder:INSERT=3,cinder:UPDATE=20,cinder:DELETE=1 {{(pid=87116) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 11:44:09 devstack cinder-volume[87116]: DEBUG dbcounter [-] [87116] Writing DB stats cinder:UPDATE=25,cinder:SELECT=25,cinder:INSERT=6,cinder:DELETE=2 {{(pid=87116) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 11:44:15 devstack cinder-volume[87116]: DEBUG cinder.volume.flows.manager.create_volume [None req-232ea1e6-e975-4cee-bfd5-6b47c7c9a8b9 tempest-VolumesTestJSON-2108836349 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87116) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 11:44:15 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-232ea1e6-e975-4cee-bfd5-6b47c7c9a8b9 tempest-VolumesTestJSON-2108836349 None] Flow 'volume_create_manager' (09513684-abe7-40f6-b6cf-d816bf798272) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 11:44:15 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-232ea1e6-e975-4cee-bfd5-6b47c7c9a8b9 tempest-VolumesTestJSON-2108836349 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (16d54e87-ebb2-403c-a852-7f38e640dc37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:44:15 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-232ea1e6-e975-4cee-bfd5-6b47c7c9a8b9 tempest-VolumesTestJSON-2108836349 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (16d54e87-ebb2-403c-a852-7f38e640dc37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T10:44:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1602040503',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=85fb2a86-dc94-4b95-bfda-24ba861aa2e5,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='76c5e3905a104ae8981851370370db1e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T10:44:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T10:44:16Z,use_quota=True,user_id='1662cfa20b154c3eb2f2bf1e1da712b0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(34d3b144-d9b7-480a-a2e3-01e45f3d54c1),volume_type_id=34d3b144-d9b7-480a-a2e3-01e45f3d54c1)' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:44:15 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-232ea1e6-e975-4cee-bfd5-6b47c7c9a8b9 tempest-VolumesTestJSON-2108836349 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (40f92ca3-a72f-49b0-ab2d-b76607806a82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:44:15 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-232ea1e6-e975-4cee-bfd5-6b47c7c9a8b9 tempest-VolumesTestJSON-2108836349 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (40f92ca3-a72f-49b0-ab2d-b76607806a82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:44:15 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-232ea1e6-e975-4cee-bfd5-6b47c7c9a8b9 tempest-VolumesTestJSON-2108836349 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3e4f91d2-8bcf-46b0-97ba-514702671a34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:44:15 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-232ea1e6-e975-4cee-bfd5-6b47c7c9a8b9 tempest-VolumesTestJSON-2108836349 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3e4f91d2-8bcf-46b0-97ba-514702671a34) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '85fb2a86-dc94-4b95-bfda-24ba861aa2e5', 'volume_name': 'volume-85fb2a86-dc94-4b95-bfda-24ba861aa2e5', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:44:15 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-232ea1e6-e975-4cee-bfd5-6b47c7c9a8b9 tempest-VolumesTestJSON-2108836349 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (edac565a-4c10-41ea-beec-f52b0a17b540) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:44:15 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-232ea1e6-e975-4cee-bfd5-6b47c7c9a8b9 tempest-VolumesTestJSON-2108836349 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (edac565a-4c10-41ea-beec-f52b0a17b540) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:44:15 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-232ea1e6-e975-4cee-bfd5-6b47c7c9a8b9 tempest-VolumesTestJSON-2108836349 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e1673d2d-795f-4d09-977f-77c95a31be1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:44:15 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-232ea1e6-e975-4cee-bfd5-6b47c7c9a8b9 tempest-VolumesTestJSON-2108836349 None] Volume 85fb2a86-dc94-4b95-bfda-24ba861aa2e5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-85fb2a86-dc94-4b95-bfda-24ba861aa2e5', 'volume_size': 1} Nov 06 11:44:15 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-232ea1e6-e975-4cee-bfd5-6b47c7c9a8b9 tempest-VolumesTestJSON-2108836349 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 11:44:15 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-232ea1e6-e975-4cee-bfd5-6b47c7c9a8b9 tempest-VolumesTestJSON-2108836349 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 11:44:15 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-232ea1e6-e975-4cee-bfd5-6b47c7c9a8b9 tempest-VolumesTestJSON-2108836349 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T10:44:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1602040503',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=85fb2a86-dc94-4b95-bfda-24ba861aa2e5,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='76c5e3905a104ae8981851370370db1e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T10:44:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T10:44:16Z,use_quota=True,user_id='1662cfa20b154c3eb2f2bf1e1da712b0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(34d3b144-d9b7-480a-a2e3-01e45f3d54c1),volume_type_id=34d3b144-d9b7-480a-a2e3-01e45f3d54c1)}" {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 11:44:15 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-232ea1e6-e975-4cee-bfd5-6b47c7c9a8b9 tempest-VolumesTestJSON-2108836349 None] Creating volume 85fb2a86-dc94-4b95-bfda-24ba861aa2e5 {{(pid=87116) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 11:44:15 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-232ea1e6-e975-4cee-bfd5-6b47c7c9a8b9 tempest-VolumesTestJSON-2108836349 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 11:44:15 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-232ea1e6-e975-4cee-bfd5-6b47c7c9a8b9 tempest-VolumesTestJSON-2108836349 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 11:44:15 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-232ea1e6-e975-4cee-bfd5-6b47c7c9a8b9 tempest-VolumesTestJSON-2108836349 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 11:44:15 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-232ea1e6-e975-4cee-bfd5-6b47c7c9a8b9 tempest-VolumesTestJSON-2108836349 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 11:44:15 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-232ea1e6-e975-4cee-bfd5-6b47c7c9a8b9 tempest-VolumesTestJSON-2108836349 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 11:44:15 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-232ea1e6-e975-4cee-bfd5-6b47c7c9a8b9 tempest-VolumesTestJSON-2108836349 None] Selected osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f as target Quobyte volume. {{(pid=87116) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 11:44:15 devstack cinder-volume[87116]: INFO cinder.volume.drivers.remotefs [None req-232ea1e6-e975-4cee-bfd5-6b47c7c9a8b9 tempest-VolumesTestJSON-2108836349 None] casted to osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f Nov 06 11:44:15 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-232ea1e6-e975-4cee-bfd5-6b47c7c9a8b9 tempest-VolumesTestJSON-2108836349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-85fb2a86-dc94-4b95-bfda-24ba861aa2e5 1073741824 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:44:15 devstack sudo[89968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-85fb2a86-dc94-4b95-bfda-24ba861aa2e5 1073741824 Nov 06 11:44:16 devstack sudo[89968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:44:16 devstack sudo[89968]: pam_unix(sudo:session): session closed for user root Nov 06 11:44:16 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-232ea1e6-e975-4cee-bfd5-6b47c7c9a8b9 tempest-VolumesTestJSON-2108836349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-85fb2a86-dc94-4b95-bfda-24ba861aa2e5 1073741824" returned: 0 in 0.709s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:44:16 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-232ea1e6-e975-4cee-bfd5-6b47c7c9a8b9 tempest-VolumesTestJSON-2108836349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-85fb2a86-dc94-4b95-bfda-24ba861aa2e5 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:44:16 devstack sudo[89979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-85fb2a86-dc94-4b95-bfda-24ba861aa2e5 Nov 06 11:44:16 devstack sudo[89979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:44:16 devstack sudo[89979]: pam_unix(sudo:session): session closed for user root Nov 06 11:44:16 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-232ea1e6-e975-4cee-bfd5-6b47c7c9a8b9 tempest-VolumesTestJSON-2108836349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-85fb2a86-dc94-4b95-bfda-24ba861aa2e5" returned: 0 in 0.273s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:44:16 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-232ea1e6-e975-4cee-bfd5-6b47c7c9a8b9 tempest-VolumesTestJSON-2108836349 None] <== create_volume: return (1037ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f'} {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 11:44:16 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-232ea1e6-e975-4cee-bfd5-6b47c7c9a8b9 tempest-VolumesTestJSON-2108836349 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.040s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 11:44:16 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-232ea1e6-e975-4cee-bfd5-6b47c7c9a8b9 tempest-VolumesTestJSON-2108836349 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e1673d2d-795f-4d09-977f-77c95a31be1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-85fb2a86-dc94-4b95-bfda-24ba861aa2e5', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:44:16 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-232ea1e6-e975-4cee-bfd5-6b47c7c9a8b9 tempest-VolumesTestJSON-2108836349 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7942cc67-9bda-41a6-ae57-302b3e79d96f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:44:17 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-232ea1e6-e975-4cee-bfd5-6b47c7c9a8b9 tempest-VolumesTestJSON-2108836349 None] Volume volume-85fb2a86-dc94-4b95-bfda-24ba861aa2e5 (85fb2a86-dc94-4b95-bfda-24ba861aa2e5): created successfully Nov 06 11:44:17 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-232ea1e6-e975-4cee-bfd5-6b47c7c9a8b9 tempest-VolumesTestJSON-2108836349 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7942cc67-9bda-41a6-ae57-302b3e79d96f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:44:17 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-232ea1e6-e975-4cee-bfd5-6b47c7c9a8b9 tempest-VolumesTestJSON-2108836349 None] Flow 'volume_create_manager' (09513684-abe7-40f6-b6cf-d816bf798272) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 11:44:17 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-232ea1e6-e975-4cee-bfd5-6b47c7c9a8b9 tempest-VolumesTestJSON-2108836349 None] Created volume successfully. Nov 06 11:44:19 devstack cinder-volume[87116]: DEBUG cinder.volume.flows.manager.create_volume [None req-49fe676c-ecd6-4c10-89e6-41e0f97f121f tempest-VolumesTestJSON-2108836349 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87116) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 11:44:19 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-49fe676c-ecd6-4c10-89e6-41e0f97f121f tempest-VolumesTestJSON-2108836349 None] Flow 'volume_create_manager' (674dbcea-f69c-43e8-b3c3-5714e41cca9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 11:44:19 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-49fe676c-ecd6-4c10-89e6-41e0f97f121f tempest-VolumesTestJSON-2108836349 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7191d608-da1f-46ab-a2c4-661e4ffd397d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:44:19 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-49fe676c-ecd6-4c10-89e6-41e0f97f121f tempest-VolumesTestJSON-2108836349 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7191d608-da1f-46ab-a2c4-661e4ffd397d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T10:44:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-970007119',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=74470c0f-b2f5-431a-84d0-60131d8c6931,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='76c5e3905a104ae8981851370370db1e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T10:44:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T10:44:19Z,use_quota=True,user_id='1662cfa20b154c3eb2f2bf1e1da712b0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(34d3b144-d9b7-480a-a2e3-01e45f3d54c1),volume_type_id=34d3b144-d9b7-480a-a2e3-01e45f3d54c1)' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:44:19 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-49fe676c-ecd6-4c10-89e6-41e0f97f121f tempest-VolumesTestJSON-2108836349 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4324f321-166d-42bb-8126-2838fa66d837) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:44:19 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-49fe676c-ecd6-4c10-89e6-41e0f97f121f tempest-VolumesTestJSON-2108836349 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4324f321-166d-42bb-8126-2838fa66d837) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:44:19 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-49fe676c-ecd6-4c10-89e6-41e0f97f121f tempest-VolumesTestJSON-2108836349 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (76f5cb80-1ad8-4f62-b555-554657292adc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:44:19 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-49fe676c-ecd6-4c10-89e6-41e0f97f121f tempest-VolumesTestJSON-2108836349 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (76f5cb80-1ad8-4f62-b555-554657292adc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '74470c0f-b2f5-431a-84d0-60131d8c6931', 'volume_name': 'volume-74470c0f-b2f5-431a-84d0-60131d8c6931', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:44:19 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-49fe676c-ecd6-4c10-89e6-41e0f97f121f tempest-VolumesTestJSON-2108836349 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (baeb5872-14c0-4451-902e-08f0839a0cd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:44:19 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-49fe676c-ecd6-4c10-89e6-41e0f97f121f tempest-VolumesTestJSON-2108836349 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (baeb5872-14c0-4451-902e-08f0839a0cd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:44:19 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-49fe676c-ecd6-4c10-89e6-41e0f97f121f tempest-VolumesTestJSON-2108836349 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d09adce1-2217-4a91-94dc-3fe38caad53d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:44:19 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-49fe676c-ecd6-4c10-89e6-41e0f97f121f tempest-VolumesTestJSON-2108836349 None] Volume 74470c0f-b2f5-431a-84d0-60131d8c6931: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-74470c0f-b2f5-431a-84d0-60131d8c6931', 'volume_size': 1} Nov 06 11:44:19 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-49fe676c-ecd6-4c10-89e6-41e0f97f121f tempest-VolumesTestJSON-2108836349 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 11:44:19 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-49fe676c-ecd6-4c10-89e6-41e0f97f121f tempest-VolumesTestJSON-2108836349 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 11:44:19 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-49fe676c-ecd6-4c10-89e6-41e0f97f121f tempest-VolumesTestJSON-2108836349 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T10:44:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-970007119',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=74470c0f-b2f5-431a-84d0-60131d8c6931,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='76c5e3905a104ae8981851370370db1e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T10:44:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T10:44:19Z,use_quota=True,user_id='1662cfa20b154c3eb2f2bf1e1da712b0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(34d3b144-d9b7-480a-a2e3-01e45f3d54c1),volume_type_id=34d3b144-d9b7-480a-a2e3-01e45f3d54c1)}" {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 11:44:19 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-49fe676c-ecd6-4c10-89e6-41e0f97f121f tempest-VolumesTestJSON-2108836349 None] Creating volume 74470c0f-b2f5-431a-84d0-60131d8c6931 {{(pid=87116) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 11:44:19 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-49fe676c-ecd6-4c10-89e6-41e0f97f121f tempest-VolumesTestJSON-2108836349 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 11:44:19 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-49fe676c-ecd6-4c10-89e6-41e0f97f121f tempest-VolumesTestJSON-2108836349 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 11:44:19 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-49fe676c-ecd6-4c10-89e6-41e0f97f121f tempest-VolumesTestJSON-2108836349 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 11:44:19 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-49fe676c-ecd6-4c10-89e6-41e0f97f121f tempest-VolumesTestJSON-2108836349 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 11:44:19 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-49fe676c-ecd6-4c10-89e6-41e0f97f121f tempest-VolumesTestJSON-2108836349 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 11:44:19 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-49fe676c-ecd6-4c10-89e6-41e0f97f121f tempest-VolumesTestJSON-2108836349 None] Selected osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f as target Quobyte volume. {{(pid=87116) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 11:44:19 devstack cinder-volume[87116]: INFO cinder.volume.drivers.remotefs [None req-49fe676c-ecd6-4c10-89e6-41e0f97f121f tempest-VolumesTestJSON-2108836349 None] casted to osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f Nov 06 11:44:19 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-49fe676c-ecd6-4c10-89e6-41e0f97f121f tempest-VolumesTestJSON-2108836349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-74470c0f-b2f5-431a-84d0-60131d8c6931 1073741824 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:44:19 devstack sudo[90053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-74470c0f-b2f5-431a-84d0-60131d8c6931 1073741824 Nov 06 11:44:19 devstack sudo[90053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:44:20 devstack sudo[90053]: pam_unix(sudo:session): session closed for user root Nov 06 11:44:20 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-49fe676c-ecd6-4c10-89e6-41e0f97f121f tempest-VolumesTestJSON-2108836349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-74470c0f-b2f5-431a-84d0-60131d8c6931 1073741824" returned: 0 in 0.882s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:44:20 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-49fe676c-ecd6-4c10-89e6-41e0f97f121f tempest-VolumesTestJSON-2108836349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-74470c0f-b2f5-431a-84d0-60131d8c6931 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:44:20 devstack sudo[90074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-74470c0f-b2f5-431a-84d0-60131d8c6931 Nov 06 11:44:20 devstack sudo[90074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:44:20 devstack sudo[90074]: pam_unix(sudo:session): session closed for user root Nov 06 11:44:20 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-49fe676c-ecd6-4c10-89e6-41e0f97f121f tempest-VolumesTestJSON-2108836349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-74470c0f-b2f5-431a-84d0-60131d8c6931" returned: 0 in 0.552s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:44:20 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-49fe676c-ecd6-4c10-89e6-41e0f97f121f tempest-VolumesTestJSON-2108836349 None] <== create_volume: return (1502ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f'} {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 11:44:20 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-49fe676c-ecd6-4c10-89e6-41e0f97f121f tempest-VolumesTestJSON-2108836349 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.507s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 11:44:20 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-49fe676c-ecd6-4c10-89e6-41e0f97f121f tempest-VolumesTestJSON-2108836349 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d09adce1-2217-4a91-94dc-3fe38caad53d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-74470c0f-b2f5-431a-84d0-60131d8c6931', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:44:20 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-49fe676c-ecd6-4c10-89e6-41e0f97f121f tempest-VolumesTestJSON-2108836349 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ac79d4c8-da30-4142-92f3-3fad3af1d47a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:44:20 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-49fe676c-ecd6-4c10-89e6-41e0f97f121f tempest-VolumesTestJSON-2108836349 None] Volume volume-74470c0f-b2f5-431a-84d0-60131d8c6931 (74470c0f-b2f5-431a-84d0-60131d8c6931): created successfully Nov 06 11:44:20 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-49fe676c-ecd6-4c10-89e6-41e0f97f121f tempest-VolumesTestJSON-2108836349 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ac79d4c8-da30-4142-92f3-3fad3af1d47a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:44:20 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-49fe676c-ecd6-4c10-89e6-41e0f97f121f tempest-VolumesTestJSON-2108836349 None] Flow 'volume_create_manager' (674dbcea-f69c-43e8-b3c3-5714e41cca9a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 11:44:20 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-49fe676c-ecd6-4c10-89e6-41e0f97f121f tempest-VolumesTestJSON-2108836349 None] Created volume successfully. Nov 06 11:44:22 devstack cinder-volume[87116]: DEBUG cinder.volume.flows.manager.create_volume [None req-08d98cb8-5aec-47d5-a52b-158b7141b154 tempest-VolumesTestJSON-2108836349 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87116) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 11:44:22 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-08d98cb8-5aec-47d5-a52b-158b7141b154 tempest-VolumesTestJSON-2108836349 None] Flow 'volume_create_manager' (91b964a6-1cc9-46a5-96e6-d361f3864b46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 11:44:22 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-08d98cb8-5aec-47d5-a52b-158b7141b154 tempest-VolumesTestJSON-2108836349 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3d1bb21f-63ad-4eb1-af18-854dfd418350) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:44:22 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-08d98cb8-5aec-47d5-a52b-158b7141b154 tempest-VolumesTestJSON-2108836349 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3d1bb21f-63ad-4eb1-af18-854dfd418350) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T10:44:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1525125086',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=941333cd-5aa8-48fe-9179-91d71f2d38ef,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='76c5e3905a104ae8981851370370db1e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T10:44:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T10:44:22Z,use_quota=True,user_id='1662cfa20b154c3eb2f2bf1e1da712b0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(34d3b144-d9b7-480a-a2e3-01e45f3d54c1),volume_type_id=34d3b144-d9b7-480a-a2e3-01e45f3d54c1)' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:44:22 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-08d98cb8-5aec-47d5-a52b-158b7141b154 tempest-VolumesTestJSON-2108836349 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (283f45a6-5495-4e65-9df9-8a4734ebe8ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:44:22 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-08d98cb8-5aec-47d5-a52b-158b7141b154 tempest-VolumesTestJSON-2108836349 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (283f45a6-5495-4e65-9df9-8a4734ebe8ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:44:22 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-08d98cb8-5aec-47d5-a52b-158b7141b154 tempest-VolumesTestJSON-2108836349 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a678e5e4-3cb8-43fe-b939-92e64c80cd6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:44:22 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-08d98cb8-5aec-47d5-a52b-158b7141b154 tempest-VolumesTestJSON-2108836349 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a678e5e4-3cb8-43fe-b939-92e64c80cd6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '941333cd-5aa8-48fe-9179-91d71f2d38ef', 'volume_name': 'volume-941333cd-5aa8-48fe-9179-91d71f2d38ef', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:44:22 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-08d98cb8-5aec-47d5-a52b-158b7141b154 tempest-VolumesTestJSON-2108836349 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0b3d866d-d11d-4855-a1a3-bea4412ca12e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:44:22 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-08d98cb8-5aec-47d5-a52b-158b7141b154 tempest-VolumesTestJSON-2108836349 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0b3d866d-d11d-4855-a1a3-bea4412ca12e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:44:22 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-08d98cb8-5aec-47d5-a52b-158b7141b154 tempest-VolumesTestJSON-2108836349 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6d9f2bc4-9c16-4ad8-87fa-4af31038760b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:44:22 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-08d98cb8-5aec-47d5-a52b-158b7141b154 tempest-VolumesTestJSON-2108836349 None] Volume 941333cd-5aa8-48fe-9179-91d71f2d38ef: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-941333cd-5aa8-48fe-9179-91d71f2d38ef', 'volume_size': 1} Nov 06 11:44:22 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-08d98cb8-5aec-47d5-a52b-158b7141b154 tempest-VolumesTestJSON-2108836349 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 11:44:22 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-08d98cb8-5aec-47d5-a52b-158b7141b154 tempest-VolumesTestJSON-2108836349 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 11:44:22 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-08d98cb8-5aec-47d5-a52b-158b7141b154 tempest-VolumesTestJSON-2108836349 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T10:44:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1525125086',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=941333cd-5aa8-48fe-9179-91d71f2d38ef,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='76c5e3905a104ae8981851370370db1e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T10:44:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T10:44:22Z,use_quota=True,user_id='1662cfa20b154c3eb2f2bf1e1da712b0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(34d3b144-d9b7-480a-a2e3-01e45f3d54c1),volume_type_id=34d3b144-d9b7-480a-a2e3-01e45f3d54c1)}" {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 11:44:22 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-08d98cb8-5aec-47d5-a52b-158b7141b154 tempest-VolumesTestJSON-2108836349 None] Creating volume 941333cd-5aa8-48fe-9179-91d71f2d38ef {{(pid=87116) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 11:44:22 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-08d98cb8-5aec-47d5-a52b-158b7141b154 tempest-VolumesTestJSON-2108836349 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 11:44:22 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-08d98cb8-5aec-47d5-a52b-158b7141b154 tempest-VolumesTestJSON-2108836349 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 11:44:22 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-08d98cb8-5aec-47d5-a52b-158b7141b154 tempest-VolumesTestJSON-2108836349 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 11:44:22 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-08d98cb8-5aec-47d5-a52b-158b7141b154 tempest-VolumesTestJSON-2108836349 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 11:44:22 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-08d98cb8-5aec-47d5-a52b-158b7141b154 tempest-VolumesTestJSON-2108836349 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 11:44:22 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-08d98cb8-5aec-47d5-a52b-158b7141b154 tempest-VolumesTestJSON-2108836349 None] Selected osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f as target Quobyte volume. {{(pid=87116) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 11:44:22 devstack cinder-volume[87116]: INFO cinder.volume.drivers.remotefs [None req-08d98cb8-5aec-47d5-a52b-158b7141b154 tempest-VolumesTestJSON-2108836349 None] casted to osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f Nov 06 11:44:22 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-08d98cb8-5aec-47d5-a52b-158b7141b154 tempest-VolumesTestJSON-2108836349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-941333cd-5aa8-48fe-9179-91d71f2d38ef 1073741824 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:44:22 devstack sudo[90098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-941333cd-5aa8-48fe-9179-91d71f2d38ef 1073741824 Nov 06 11:44:22 devstack sudo[90098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:44:23 devstack sudo[90098]: pam_unix(sudo:session): session closed for user root Nov 06 11:44:23 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-08d98cb8-5aec-47d5-a52b-158b7141b154 tempest-VolumesTestJSON-2108836349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-941333cd-5aa8-48fe-9179-91d71f2d38ef 1073741824" returned: 0 in 1.261s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:44:23 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-08d98cb8-5aec-47d5-a52b-158b7141b154 tempest-VolumesTestJSON-2108836349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-941333cd-5aa8-48fe-9179-91d71f2d38ef {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:44:23 devstack sudo[90155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-941333cd-5aa8-48fe-9179-91d71f2d38ef Nov 06 11:44:23 devstack sudo[90155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:44:24 devstack sudo[90155]: pam_unix(sudo:session): session closed for user root Nov 06 11:44:24 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-08d98cb8-5aec-47d5-a52b-158b7141b154 tempest-VolumesTestJSON-2108836349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-941333cd-5aa8-48fe-9179-91d71f2d38ef" returned: 0 in 0.664s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:44:24 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-08d98cb8-5aec-47d5-a52b-158b7141b154 tempest-VolumesTestJSON-2108836349 None] <== create_volume: return (2037ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f'} {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 11:44:24 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-08d98cb8-5aec-47d5-a52b-158b7141b154 tempest-VolumesTestJSON-2108836349 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.043s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 11:44:24 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-08d98cb8-5aec-47d5-a52b-158b7141b154 tempest-VolumesTestJSON-2108836349 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6d9f2bc4-9c16-4ad8-87fa-4af31038760b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-941333cd-5aa8-48fe-9179-91d71f2d38ef', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:44:24 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-08d98cb8-5aec-47d5-a52b-158b7141b154 tempest-VolumesTestJSON-2108836349 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b7b2a1db-6c98-4472-bf9d-c1e787fa1be1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:44:24 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-08d98cb8-5aec-47d5-a52b-158b7141b154 tempest-VolumesTestJSON-2108836349 None] Volume volume-941333cd-5aa8-48fe-9179-91d71f2d38ef (941333cd-5aa8-48fe-9179-91d71f2d38ef): created successfully Nov 06 11:44:24 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-08d98cb8-5aec-47d5-a52b-158b7141b154 tempest-VolumesTestJSON-2108836349 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b7b2a1db-6c98-4472-bf9d-c1e787fa1be1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:44:24 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-08d98cb8-5aec-47d5-a52b-158b7141b154 tempest-VolumesTestJSON-2108836349 None] Flow 'volume_create_manager' (91b964a6-1cc9-46a5-96e6-d361f3864b46) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 11:44:24 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-08d98cb8-5aec-47d5-a52b-158b7141b154 tempest-VolumesTestJSON-2108836349 None] Created volume successfully. Nov 06 11:44:25 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-a7e26385-05d0-4c53-992a-2ecabe561777 tempest-TaggedAttachmentsTest-905079736 None] Acquiring lock "cinder-d42ddfe7-a222-4a05-b1ae-234ed426001b-delete_volume" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 11:44:25 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-a7e26385-05d0-4c53-992a-2ecabe561777 tempest-TaggedAttachmentsTest-905079736 None] Lock "cinder-d42ddfe7-a222-4a05-b1ae-234ed426001b-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 11:44:25 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-a7e26385-05d0-4c53-992a-2ecabe561777 tempest-TaggedAttachmentsTest-905079736 None] Acquiring lock "cinder-quobyte-d42ddfe7-a222-4a05-b1ae-234ed426001b" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 11:44:25 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-a7e26385-05d0-4c53-992a-2ecabe561777 tempest-TaggedAttachmentsTest-905079736 None] Lock "cinder-quobyte-d42ddfe7-a222-4a05-b1ae-234ed426001b" acquired by "delete_volume" :: waited 0.096s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 11:44:26 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cb2d846-9a44-4aee-8269-18a0b9fc25aa]: (4, 'qcow2') {{(pid=88420) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 11:44:26 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-a7e26385-05d0-4c53-992a-2ecabe561777 tempest-TaggedAttachmentsTest-905079736 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-d42ddfe7-a222-4a05-b1ae-234ed426001b {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:44:26 devstack sudo[90208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-d42ddfe7-a222-4a05-b1ae-234ed426001b Nov 06 11:44:26 devstack sudo[90208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:44:26 devstack sudo[90208]: pam_unix(sudo:session): session closed for user root Nov 06 11:44:26 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-a7e26385-05d0-4c53-992a-2ecabe561777 tempest-TaggedAttachmentsTest-905079736 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-d42ddfe7-a222-4a05-b1ae-234ed426001b" returned: 0 in 0.891s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:44:26 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-a7e26385-05d0-4c53-992a-2ecabe561777 tempest-TaggedAttachmentsTest-905079736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-d42ddfe7-a222-4a05-b1ae-234ed426001b {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:44:26 devstack sudo[90215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-d42ddfe7-a222-4a05-b1ae-234ed426001b Nov 06 11:44:26 devstack sudo[90215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:44:27 devstack sudo[90215]: pam_unix(sudo:session): session closed for user root Nov 06 11:44:27 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-a7e26385-05d0-4c53-992a-2ecabe561777 tempest-TaggedAttachmentsTest-905079736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-d42ddfe7-a222-4a05-b1ae-234ed426001b" returned: 0 in 0.421s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:44:27 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-a7e26385-05d0-4c53-992a-2ecabe561777 tempest-TaggedAttachmentsTest-905079736 None] Lock "cinder-quobyte-d42ddfe7-a222-4a05-b1ae-234ed426001b" released by "delete_volume" :: held 1.477s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 11:44:27 devstack cinder-volume[87116]: DEBUG cinder.quota [None req-a7e26385-05d0-4c53-992a-2ecabe561777 tempest-TaggedAttachmentsTest-905079736 None] Created reservations ['5216567f-249b-4e67-9933-dfe88ec80b60', 'd7ec1c51-2af7-40f6-a1c0-4d597899f05e', '4c72ad9e-47b2-422f-b72e-f56c66d16a36', '93428d62-0ca3-40e9-a986-a6dd13ebf811'] {{(pid=87116) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 11:44:27 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-a7e26385-05d0-4c53-992a-2ecabe561777 tempest-TaggedAttachmentsTest-905079736 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 11:44:27 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-a7e26385-05d0-4c53-992a-2ecabe561777 tempest-TaggedAttachmentsTest-905079736 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 11:44:27 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-a7e26385-05d0-4c53-992a-2ecabe561777 tempest-TaggedAttachmentsTest-905079736 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 11:44:27 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-a7e26385-05d0-4c53-992a-2ecabe561777 tempest-TaggedAttachmentsTest-905079736 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 11:44:27 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-a7e26385-05d0-4c53-992a-2ecabe561777 tempest-TaggedAttachmentsTest-905079736 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 11:44:27 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-a7e26385-05d0-4c53-992a-2ecabe561777 tempest-TaggedAttachmentsTest-905079736 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:44:27 devstack sudo[90220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756 Nov 06 11:44:27 devstack sudo[90220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:44:28 devstack sudo[90220]: pam_unix(sudo:session): session closed for user root Nov 06 11:44:28 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-a7e26385-05d0-4c53-992a-2ecabe561777 tempest-TaggedAttachmentsTest-905079736 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756" returned: 0 in 0.383s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:44:28 devstack cinder-volume[87116]: DEBUG cinder.manager [None req-a7e26385-05d0-4c53-992a-2ecabe561777 tempest-TaggedAttachmentsTest-905079736 None] Notifying Schedulers of capabilities ... {{(pid=87116) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 11:44:28 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-a7e26385-05d0-4c53-992a-2ecabe561777 tempest-TaggedAttachmentsTest-905079736 None] Deleted volume successfully. Nov 06 11:44:28 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-a7e26385-05d0-4c53-992a-2ecabe561777 tempest-TaggedAttachmentsTest-905079736 None] Lock "cinder-d42ddfe7-a222-4a05-b1ae-234ed426001b-delete_volume" released by "delete_volume" :: held 2.433s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 11:44:28 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-714c622c-c7f0-4116-a58f-033f130d04a3 tempest-VolumesTestJSON-2108836349 None] Acquiring lock "cinder-941333cd-5aa8-48fe-9179-91d71f2d38ef-delete_volume" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 11:44:28 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-714c622c-c7f0-4116-a58f-033f130d04a3 tempest-VolumesTestJSON-2108836349 None] Lock "cinder-941333cd-5aa8-48fe-9179-91d71f2d38ef-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 11:44:28 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-714c622c-c7f0-4116-a58f-033f130d04a3 tempest-VolumesTestJSON-2108836349 None] Acquiring lock "cinder-quobyte-941333cd-5aa8-48fe-9179-91d71f2d38ef" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 11:44:28 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-714c622c-c7f0-4116-a58f-033f130d04a3 tempest-VolumesTestJSON-2108836349 None] Lock "cinder-quobyte-941333cd-5aa8-48fe-9179-91d71f2d38ef" acquired by "delete_volume" :: waited 0.033s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 11:44:28 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[d28e8304-0dce-49dc-9c8b-4a3748d6976f]: (4, 'qcow2') {{(pid=88420) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 11:44:28 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-714c622c-c7f0-4116-a58f-033f130d04a3 tempest-VolumesTestJSON-2108836349 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-941333cd-5aa8-48fe-9179-91d71f2d38ef {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:44:28 devstack sudo[90223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-941333cd-5aa8-48fe-9179-91d71f2d38ef Nov 06 11:44:28 devstack sudo[90223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:44:29 devstack sudo[90223]: pam_unix(sudo:session): session closed for user root Nov 06 11:44:29 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-714c622c-c7f0-4116-a58f-033f130d04a3 tempest-VolumesTestJSON-2108836349 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-941333cd-5aa8-48fe-9179-91d71f2d38ef" returned: 0 in 0.930s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:44:29 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-714c622c-c7f0-4116-a58f-033f130d04a3 tempest-VolumesTestJSON-2108836349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-941333cd-5aa8-48fe-9179-91d71f2d38ef {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:44:29 devstack sudo[90230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-941333cd-5aa8-48fe-9179-91d71f2d38ef Nov 06 11:44:29 devstack sudo[90230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:44:30 devstack sudo[90230]: pam_unix(sudo:session): session closed for user root Nov 06 11:44:30 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-714c622c-c7f0-4116-a58f-033f130d04a3 tempest-VolumesTestJSON-2108836349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-941333cd-5aa8-48fe-9179-91d71f2d38ef" returned: 0 in 0.663s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:44:30 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-714c622c-c7f0-4116-a58f-033f130d04a3 tempest-VolumesTestJSON-2108836349 None] Lock "cinder-quobyte-941333cd-5aa8-48fe-9179-91d71f2d38ef" released by "delete_volume" :: held 1.718s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 11:44:30 devstack cinder-volume[87116]: DEBUG cinder.quota [None req-714c622c-c7f0-4116-a58f-033f130d04a3 tempest-VolumesTestJSON-2108836349 None] Created reservations ['ed61761a-bb4a-46a8-b616-4f38684a92d6', '1407210a-4327-48b6-b192-a47a2c0a6ebb', 'f4b5beee-6a31-4ade-8923-bb6b49b1666c', '04909952-90ed-4960-a835-241243206460'] {{(pid=87116) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 11:44:30 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-714c622c-c7f0-4116-a58f-033f130d04a3 tempest-VolumesTestJSON-2108836349 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 11:44:30 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-714c622c-c7f0-4116-a58f-033f130d04a3 tempest-VolumesTestJSON-2108836349 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 11:44:30 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-714c622c-c7f0-4116-a58f-033f130d04a3 tempest-VolumesTestJSON-2108836349 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 11:44:30 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-714c622c-c7f0-4116-a58f-033f130d04a3 tempest-VolumesTestJSON-2108836349 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 11:44:30 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-714c622c-c7f0-4116-a58f-033f130d04a3 tempest-VolumesTestJSON-2108836349 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 11:44:30 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-714c622c-c7f0-4116-a58f-033f130d04a3 tempest-VolumesTestJSON-2108836349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:44:30 devstack sudo[90235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756 Nov 06 11:44:30 devstack sudo[90235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:44:30 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-d99d17cb-9bcd-4e61-81d2-9401dc721007 tempest-VolumesTestJSON-2108836349 None] Acquiring lock "cinder-74470c0f-b2f5-431a-84d0-60131d8c6931-delete_volume" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 11:44:30 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-d99d17cb-9bcd-4e61-81d2-9401dc721007 tempest-VolumesTestJSON-2108836349 None] Lock "cinder-74470c0f-b2f5-431a-84d0-60131d8c6931-delete_volume" acquired by "delete_volume" :: waited 0.061s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 11:44:30 devstack sudo[90235]: pam_unix(sudo:session): session closed for user root Nov 06 11:44:30 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-714c622c-c7f0-4116-a58f-033f130d04a3 tempest-VolumesTestJSON-2108836349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756" returned: 0 in 0.550s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:44:30 devstack cinder-volume[87116]: DEBUG cinder.manager [None req-714c622c-c7f0-4116-a58f-033f130d04a3 tempest-VolumesTestJSON-2108836349 None] Notifying Schedulers of capabilities ... {{(pid=87116) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 11:44:31 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-d99d17cb-9bcd-4e61-81d2-9401dc721007 tempest-VolumesTestJSON-2108836349 None] Acquiring lock "cinder-quobyte-74470c0f-b2f5-431a-84d0-60131d8c6931" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 11:44:31 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-714c622c-c7f0-4116-a58f-033f130d04a3 tempest-VolumesTestJSON-2108836349 None] Deleted volume successfully. Nov 06 11:44:31 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-d99d17cb-9bcd-4e61-81d2-9401dc721007 tempest-VolumesTestJSON-2108836349 None] Lock "cinder-quobyte-74470c0f-b2f5-431a-84d0-60131d8c6931" acquired by "delete_volume" :: waited 0.041s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 11:44:31 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-714c622c-c7f0-4116-a58f-033f130d04a3 tempest-VolumesTestJSON-2108836349 None] Lock "cinder-941333cd-5aa8-48fe-9179-91d71f2d38ef-delete_volume" released by "delete_volume" :: held 2.792s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 11:44:31 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[28d3b816-88a1-40b4-95c8-b404997e591a]: (4, 'qcow2') {{(pid=88420) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 11:44:31 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-d99d17cb-9bcd-4e61-81d2-9401dc721007 tempest-VolumesTestJSON-2108836349 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-74470c0f-b2f5-431a-84d0-60131d8c6931 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:44:31 devstack sudo[90238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-74470c0f-b2f5-431a-84d0-60131d8c6931 Nov 06 11:44:31 devstack sudo[90238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:44:31 devstack sudo[90238]: pam_unix(sudo:session): session closed for user root Nov 06 11:44:31 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-d99d17cb-9bcd-4e61-81d2-9401dc721007 tempest-VolumesTestJSON-2108836349 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-74470c0f-b2f5-431a-84d0-60131d8c6931" returned: 0 in 0.604s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:44:31 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-d99d17cb-9bcd-4e61-81d2-9401dc721007 tempest-VolumesTestJSON-2108836349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-74470c0f-b2f5-431a-84d0-60131d8c6931 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:44:31 devstack sudo[90246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-74470c0f-b2f5-431a-84d0-60131d8c6931 Nov 06 11:44:31 devstack sudo[90246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:44:32 devstack sudo[90246]: pam_unix(sudo:session): session closed for user root Nov 06 11:44:32 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-d99d17cb-9bcd-4e61-81d2-9401dc721007 tempest-VolumesTestJSON-2108836349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-74470c0f-b2f5-431a-84d0-60131d8c6931" returned: 0 in 0.461s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:44:32 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-d99d17cb-9bcd-4e61-81d2-9401dc721007 tempest-VolumesTestJSON-2108836349 None] Lock "cinder-quobyte-74470c0f-b2f5-431a-84d0-60131d8c6931" released by "delete_volume" :: held 1.138s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 11:44:32 devstack cinder-volume[87116]: DEBUG cinder.quota [None req-d99d17cb-9bcd-4e61-81d2-9401dc721007 tempest-VolumesTestJSON-2108836349 None] Created reservations ['7a248e8a-562d-4a04-945f-09cca7cfea9f', 'cf31370a-b550-4073-b5a7-c303d3c5db39', '2ff3a448-cf16-4d67-ac92-78cca4388b99', 'fb271ee0-f2fd-45f7-9e8b-91f7752eaef4'] {{(pid=87116) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 11:44:32 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-d99d17cb-9bcd-4e61-81d2-9401dc721007 tempest-VolumesTestJSON-2108836349 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 11:44:32 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-d99d17cb-9bcd-4e61-81d2-9401dc721007 tempest-VolumesTestJSON-2108836349 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 11:44:32 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-d99d17cb-9bcd-4e61-81d2-9401dc721007 tempest-VolumesTestJSON-2108836349 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 11:44:32 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-d99d17cb-9bcd-4e61-81d2-9401dc721007 tempest-VolumesTestJSON-2108836349 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 11:44:32 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-d99d17cb-9bcd-4e61-81d2-9401dc721007 tempest-VolumesTestJSON-2108836349 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 11:44:32 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-d99d17cb-9bcd-4e61-81d2-9401dc721007 tempest-VolumesTestJSON-2108836349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:44:32 devstack sudo[90250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756 Nov 06 11:44:32 devstack sudo[90250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:44:32 devstack sudo[90250]: pam_unix(sudo:session): session closed for user root Nov 06 11:44:32 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-d99d17cb-9bcd-4e61-81d2-9401dc721007 tempest-VolumesTestJSON-2108836349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756" returned: 0 in 0.380s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:44:32 devstack cinder-volume[87116]: DEBUG cinder.manager [None req-d99d17cb-9bcd-4e61-81d2-9401dc721007 tempest-VolumesTestJSON-2108836349 None] Notifying Schedulers of capabilities ... {{(pid=87116) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 11:44:32 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-d99d17cb-9bcd-4e61-81d2-9401dc721007 tempest-VolumesTestJSON-2108836349 None] Deleted volume successfully. Nov 06 11:44:32 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-d99d17cb-9bcd-4e61-81d2-9401dc721007 tempest-VolumesTestJSON-2108836349 None] Lock "cinder-74470c0f-b2f5-431a-84d0-60131d8c6931-delete_volume" released by "delete_volume" :: held 2.040s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 11:44:33 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-6868bd8a-0d02-4d99-aa94-6d1000b90d13 tempest-VolumesTestJSON-2108836349 None] Acquiring lock "cinder-85fb2a86-dc94-4b95-bfda-24ba861aa2e5-delete_volume" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 11:44:33 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-6868bd8a-0d02-4d99-aa94-6d1000b90d13 tempest-VolumesTestJSON-2108836349 None] Lock "cinder-85fb2a86-dc94-4b95-bfda-24ba861aa2e5-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 11:44:33 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-6868bd8a-0d02-4d99-aa94-6d1000b90d13 tempest-VolumesTestJSON-2108836349 None] Acquiring lock "cinder-quobyte-85fb2a86-dc94-4b95-bfda-24ba861aa2e5" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 11:44:33 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-6868bd8a-0d02-4d99-aa94-6d1000b90d13 tempest-VolumesTestJSON-2108836349 None] Lock "cinder-quobyte-85fb2a86-dc94-4b95-bfda-24ba861aa2e5" acquired by "delete_volume" :: waited 0.020s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 11:44:33 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9fec691-0ca0-40f5-bb51-2ecd7f92bc4c]: (4, 'qcow2') {{(pid=88420) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 11:44:33 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-6868bd8a-0d02-4d99-aa94-6d1000b90d13 tempest-VolumesTestJSON-2108836349 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-85fb2a86-dc94-4b95-bfda-24ba861aa2e5 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:44:33 devstack sudo[90254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-85fb2a86-dc94-4b95-bfda-24ba861aa2e5 Nov 06 11:44:33 devstack sudo[90254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:44:33 devstack sudo[90254]: pam_unix(sudo:session): session closed for user root Nov 06 11:44:33 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-6868bd8a-0d02-4d99-aa94-6d1000b90d13 tempest-VolumesTestJSON-2108836349 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-85fb2a86-dc94-4b95-bfda-24ba861aa2e5" returned: 0 in 0.396s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:44:33 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-6868bd8a-0d02-4d99-aa94-6d1000b90d13 tempest-VolumesTestJSON-2108836349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-85fb2a86-dc94-4b95-bfda-24ba861aa2e5 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:44:33 devstack sudo[90260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-85fb2a86-dc94-4b95-bfda-24ba861aa2e5 Nov 06 11:44:33 devstack sudo[90260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:44:34 devstack sudo[90260]: pam_unix(sudo:session): session closed for user root Nov 06 11:44:34 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-6868bd8a-0d02-4d99-aa94-6d1000b90d13 tempest-VolumesTestJSON-2108836349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-85fb2a86-dc94-4b95-bfda-24ba861aa2e5" returned: 0 in 0.531s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:44:34 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-6868bd8a-0d02-4d99-aa94-6d1000b90d13 tempest-VolumesTestJSON-2108836349 None] Lock "cinder-quobyte-85fb2a86-dc94-4b95-bfda-24ba861aa2e5" released by "delete_volume" :: held 0.974s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 11:44:34 devstack cinder-volume[87116]: DEBUG cinder.quota [None req-6868bd8a-0d02-4d99-aa94-6d1000b90d13 tempest-VolumesTestJSON-2108836349 None] Created reservations ['210c8d2b-06e5-4f9a-aec0-6abc0e916213', '543b164d-f641-4f8e-97db-41db54da93e9', 'f12bf4bf-9f67-4290-9483-9354d05a6f1a', '596c61a3-1dc7-4dbc-89a7-d0c8fab25f43'] {{(pid=87116) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 11:44:34 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-6868bd8a-0d02-4d99-aa94-6d1000b90d13 tempest-VolumesTestJSON-2108836349 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 11:44:34 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-6868bd8a-0d02-4d99-aa94-6d1000b90d13 tempest-VolumesTestJSON-2108836349 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 11:44:34 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-6868bd8a-0d02-4d99-aa94-6d1000b90d13 tempest-VolumesTestJSON-2108836349 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 11:44:34 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-6868bd8a-0d02-4d99-aa94-6d1000b90d13 tempest-VolumesTestJSON-2108836349 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 11:44:34 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-6868bd8a-0d02-4d99-aa94-6d1000b90d13 tempest-VolumesTestJSON-2108836349 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 11:44:34 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-6868bd8a-0d02-4d99-aa94-6d1000b90d13 tempest-VolumesTestJSON-2108836349 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:44:34 devstack sudo[90292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756 Nov 06 11:44:34 devstack sudo[90292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:44:34 devstack sudo[90292]: pam_unix(sudo:session): session closed for user root Nov 06 11:44:34 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-6868bd8a-0d02-4d99-aa94-6d1000b90d13 tempest-VolumesTestJSON-2108836349 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756" returned: 0 in 0.262s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:44:34 devstack cinder-volume[87116]: DEBUG cinder.manager [None req-6868bd8a-0d02-4d99-aa94-6d1000b90d13 tempest-VolumesTestJSON-2108836349 None] Notifying Schedulers of capabilities ... {{(pid=87116) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 11:44:34 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-6868bd8a-0d02-4d99-aa94-6d1000b90d13 tempest-VolumesTestJSON-2108836349 None] Deleted volume successfully. Nov 06 11:44:34 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-6868bd8a-0d02-4d99-aa94-6d1000b90d13 tempest-VolumesTestJSON-2108836349 None] Lock "cinder-85fb2a86-dc94-4b95-bfda-24ba861aa2e5-delete_volume" released by "delete_volume" :: held 1.622s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 11:44:39 devstack cinder-volume[87116]: DEBUG oslo_service.periodic_task [None req-4fab4816-ec2b-4b19-b2ff-8548f2084354 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87116) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 11:44:39 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-4fab4816-ec2b-4b19-b2ff-8548f2084354 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 11:44:39 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-4fab4816-ec2b-4b19-b2ff-8548f2084354 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 11:44:39 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-4fab4816-ec2b-4b19-b2ff-8548f2084354 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 11:44:39 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-4fab4816-ec2b-4b19-b2ff-8548f2084354 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 11:44:39 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-4fab4816-ec2b-4b19-b2ff-8548f2084354 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 11:44:39 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-4fab4816-ec2b-4b19-b2ff-8548f2084354 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:44:39 devstack sudo[90325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756 Nov 06 11:44:39 devstack sudo[90325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:44:40 devstack sudo[90325]: pam_unix(sudo:session): session closed for user root Nov 06 11:44:40 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-4fab4816-ec2b-4b19-b2ff-8548f2084354 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756" returned: 0 in 0.429s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:44:40 devstack cinder-volume[87116]: DEBUG cinder.manager [None req-4fab4816-ec2b-4b19-b2ff-8548f2084354 None None] Notifying Schedulers of capabilities ... {{(pid=87116) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 11:44:40 devstack cinder-volume[87116]: DEBUG oslo_service.periodic_task [None req-4fab4816-ec2b-4b19-b2ff-8548f2084354 None None] Running periodic task VolumeManager._thread_info {{(pid=87116) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 11:44:40 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-4fab4816-ec2b-4b19-b2ff-8548f2084354 None None] thread count: 8 {{(pid=87116) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 06 11:44:40 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-4fab4816-ec2b-4b19-b2ff-8548f2084354 None None] thread info: [<_MainThread(MainThread, started 131399520669824)>, , , , , , , ] {{(pid=87116) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 06 11:44:40 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-887de585-de56-4abb-a075-986a6538d493 tempest-GroupSnapshotsTest-699199185 None] Group tempest-GroupSnapshotsTest-Group-644256130: creating Nov 06 11:44:40 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-887de585-de56-4abb-a075-986a6538d493 tempest-GroupSnapshotsTest-699199185 None] Group tempest-GroupSnapshotsTest-Group-644256130: created successfully Nov 06 11:44:40 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-887de585-de56-4abb-a075-986a6538d493 tempest-GroupSnapshotsTest-699199185 None] Create group completed successfully. Nov 06 11:44:42 devstack cinder-volume[87116]: DEBUG cinder.volume.flows.manager.create_volume [None req-6e536e04-7069-4fc3-84e1-92702616ae43 tempest-GroupSnapshotsTest-699199185 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87116) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 11:44:42 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-6e536e04-7069-4fc3-84e1-92702616ae43 tempest-GroupSnapshotsTest-699199185 None] Flow 'volume_create_manager' (40d71695-3da9-4fdc-b15c-9eb1340dd571) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 11:44:42 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-6e536e04-7069-4fc3-84e1-92702616ae43 tempest-GroupSnapshotsTest-699199185 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1464b11a-469f-4ab9-992a-36037b123512) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:44:42 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-6e536e04-7069-4fc3-84e1-92702616ae43 tempest-GroupSnapshotsTest-699199185 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1464b11a-469f-4ab9-992a-36037b123512) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T10:44:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1971079705',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=39c4d6c5-e0b4-454f-bf1b-c776f1c357fb,host='devstack@QuobyteHD#QuobyteHD',id=61c77826-6240-47eb-bf20-5b48820e6dd6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ee185cb8d999442cbf24aef8f910d50c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T10:44:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T10:44:42Z,use_quota=True,user_id='8c4b1f0ecaba4aa4baef4335dae669d4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dc25b090-3497-4e85-b61c-94336fd60753),volume_type_id=dc25b090-3497-4e85-b61c-94336fd60753)' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:44:42 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-6e536e04-7069-4fc3-84e1-92702616ae43 tempest-GroupSnapshotsTest-699199185 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (062ca3c0-eed2-4908-b600-33bb40629ef0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:44:42 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-6e536e04-7069-4fc3-84e1-92702616ae43 tempest-GroupSnapshotsTest-699199185 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (062ca3c0-eed2-4908-b600-33bb40629ef0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:44:42 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-6e536e04-7069-4fc3-84e1-92702616ae43 tempest-GroupSnapshotsTest-699199185 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e115ce34-ee76-428d-bbc9-95ef50530c5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:44:42 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-6e536e04-7069-4fc3-84e1-92702616ae43 tempest-GroupSnapshotsTest-699199185 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e115ce34-ee76-428d-bbc9-95ef50530c5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '61c77826-6240-47eb-bf20-5b48820e6dd6', 'volume_name': 'volume-61c77826-6240-47eb-bf20-5b48820e6dd6', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:44:42 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-6e536e04-7069-4fc3-84e1-92702616ae43 tempest-GroupSnapshotsTest-699199185 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2030e7d1-98a7-4cfd-9f03-625eb9f58f4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:44:42 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-6e536e04-7069-4fc3-84e1-92702616ae43 tempest-GroupSnapshotsTest-699199185 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2030e7d1-98a7-4cfd-9f03-625eb9f58f4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:44:42 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-6e536e04-7069-4fc3-84e1-92702616ae43 tempest-GroupSnapshotsTest-699199185 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (081ac9f4-c2b3-47e1-b647-5d05e63e9ae2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:44:42 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-6e536e04-7069-4fc3-84e1-92702616ae43 tempest-GroupSnapshotsTest-699199185 None] Volume 61c77826-6240-47eb-bf20-5b48820e6dd6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-61c77826-6240-47eb-bf20-5b48820e6dd6', 'volume_size': 1} Nov 06 11:44:42 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-6e536e04-7069-4fc3-84e1-92702616ae43 tempest-GroupSnapshotsTest-699199185 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 11:44:42 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-6e536e04-7069-4fc3-84e1-92702616ae43 tempest-GroupSnapshotsTest-699199185 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 11:44:42 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-6e536e04-7069-4fc3-84e1-92702616ae43 tempest-GroupSnapshotsTest-699199185 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=39c4d6c5-e0b4-454f-bf1b-c776f1c357fb,created_at=2026-11-06T10:44:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1971079705',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=39c4d6c5-e0b4-454f-bf1b-c776f1c357fb,host='devstack@QuobyteHD#QuobyteHD',id=61c77826-6240-47eb-bf20-5b48820e6dd6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ee185cb8d999442cbf24aef8f910d50c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T10:44:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T10:44:42Z,use_quota=True,user_id='8c4b1f0ecaba4aa4baef4335dae669d4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(dc25b090-3497-4e85-b61c-94336fd60753),volume_type_id=dc25b090-3497-4e85-b61c-94336fd60753)}" {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 11:44:42 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-6e536e04-7069-4fc3-84e1-92702616ae43 tempest-GroupSnapshotsTest-699199185 None] Creating volume 61c77826-6240-47eb-bf20-5b48820e6dd6 {{(pid=87116) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 11:44:42 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-6e536e04-7069-4fc3-84e1-92702616ae43 tempest-GroupSnapshotsTest-699199185 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 11:44:42 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-6e536e04-7069-4fc3-84e1-92702616ae43 tempest-GroupSnapshotsTest-699199185 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 11:44:42 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-6e536e04-7069-4fc3-84e1-92702616ae43 tempest-GroupSnapshotsTest-699199185 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 11:44:42 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-6e536e04-7069-4fc3-84e1-92702616ae43 tempest-GroupSnapshotsTest-699199185 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 11:44:42 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-6e536e04-7069-4fc3-84e1-92702616ae43 tempest-GroupSnapshotsTest-699199185 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 11:44:42 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-6e536e04-7069-4fc3-84e1-92702616ae43 tempest-GroupSnapshotsTest-699199185 None] Selected osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f as target Quobyte volume. {{(pid=87116) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 11:44:42 devstack cinder-volume[87116]: INFO cinder.volume.drivers.remotefs [None req-6e536e04-7069-4fc3-84e1-92702616ae43 tempest-GroupSnapshotsTest-699199185 None] casted to osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f Nov 06 11:44:42 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-6e536e04-7069-4fc3-84e1-92702616ae43 tempest-GroupSnapshotsTest-699199185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-61c77826-6240-47eb-bf20-5b48820e6dd6 1073741824 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:44:42 devstack sudo[90330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-61c77826-6240-47eb-bf20-5b48820e6dd6 1073741824 Nov 06 11:44:42 devstack sudo[90330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:44:43 devstack sudo[90330]: pam_unix(sudo:session): session closed for user root Nov 06 11:44:43 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-6e536e04-7069-4fc3-84e1-92702616ae43 tempest-GroupSnapshotsTest-699199185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-61c77826-6240-47eb-bf20-5b48820e6dd6 1073741824" returned: 0 in 0.517s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:44:43 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-6e536e04-7069-4fc3-84e1-92702616ae43 tempest-GroupSnapshotsTest-699199185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-61c77826-6240-47eb-bf20-5b48820e6dd6 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:44:43 devstack sudo[90336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-61c77826-6240-47eb-bf20-5b48820e6dd6 Nov 06 11:44:43 devstack sudo[90336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:44:43 devstack sudo[90336]: pam_unix(sudo:session): session closed for user root Nov 06 11:44:43 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-6e536e04-7069-4fc3-84e1-92702616ae43 tempest-GroupSnapshotsTest-699199185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-61c77826-6240-47eb-bf20-5b48820e6dd6" returned: 0 in 0.300s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:44:43 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-6e536e04-7069-4fc3-84e1-92702616ae43 tempest-GroupSnapshotsTest-699199185 None] <== create_volume: return (871ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f'} {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 11:44:43 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-6e536e04-7069-4fc3-84e1-92702616ae43 tempest-GroupSnapshotsTest-699199185 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.874s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 11:44:43 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-6e536e04-7069-4fc3-84e1-92702616ae43 tempest-GroupSnapshotsTest-699199185 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (081ac9f4-c2b3-47e1-b647-5d05e63e9ae2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-61c77826-6240-47eb-bf20-5b48820e6dd6', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:44:43 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-6e536e04-7069-4fc3-84e1-92702616ae43 tempest-GroupSnapshotsTest-699199185 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (13905a97-8bc1-419e-b1ab-015f7c64ccd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:44:43 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-6e536e04-7069-4fc3-84e1-92702616ae43 tempest-GroupSnapshotsTest-699199185 None] Volume volume-61c77826-6240-47eb-bf20-5b48820e6dd6 (61c77826-6240-47eb-bf20-5b48820e6dd6): created successfully Nov 06 11:44:43 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-6e536e04-7069-4fc3-84e1-92702616ae43 tempest-GroupSnapshotsTest-699199185 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (13905a97-8bc1-419e-b1ab-015f7c64ccd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:44:43 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-6e536e04-7069-4fc3-84e1-92702616ae43 tempest-GroupSnapshotsTest-699199185 None] Flow 'volume_create_manager' (40d71695-3da9-4fdc-b15c-9eb1340dd571) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 11:44:43 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-6e536e04-7069-4fc3-84e1-92702616ae43 tempest-GroupSnapshotsTest-699199185 None] Created volume successfully. Nov 06 11:44:44 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-01281375-6cf5-4fed-a8ad-c12649027aaa tempest-GroupSnapshotsTest-699199185 None] GroupSnapshot 300aaaff-6f4d-4bd7-88bb-e7cdadac7846: creating. Nov 06 11:44:44 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-01281375-6cf5-4fed-a8ad-c12649027aaa tempest-GroupSnapshotsTest-699199185 None] Group snapshot 300aaaff-6f4d-4bd7-88bb-e7cdadac7846: creating. {{(pid=87116) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Nov 06 11:44:44 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-01281375-6cf5-4fed-a8ad-c12649027aaa tempest-GroupSnapshotsTest-699199185 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 11:44:44 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-01281375-6cf5-4fed-a8ad-c12649027aaa tempest-GroupSnapshotsTest-699199185 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 11:44:44 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-01281375-6cf5-4fed-a8ad-c12649027aaa tempest-GroupSnapshotsTest-699199185 None] Creating offline snapshot d80e3489-9940-4446-945b-e581574370bc of volume 61c77826-6240-47eb-bf20-5b48820e6dd6 {{(pid=87116) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 06 11:44:44 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[688ee392-4dc4-475e-884e-efc74c92cd85]: (4, 'qcow2') {{(pid=88420) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 11:44:44 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-01281375-6cf5-4fed-a8ad-c12649027aaa tempest-GroupSnapshotsTest-699199185 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-61c77826-6240-47eb-bf20-5b48820e6dd6 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:44:44 devstack sudo[90340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-61c77826-6240-47eb-bf20-5b48820e6dd6 Nov 06 11:44:44 devstack sudo[90340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:44:44 devstack sudo[90340]: pam_unix(sudo:session): session closed for user root Nov 06 11:44:44 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-01281375-6cf5-4fed-a8ad-c12649027aaa tempest-GroupSnapshotsTest-699199185 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-61c77826-6240-47eb-bf20-5b48820e6dd6" returned: 0 in 0.389s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:44:44 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-01281375-6cf5-4fed-a8ad-c12649027aaa tempest-GroupSnapshotsTest-699199185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-61c77826-6240-47eb-bf20-5b48820e6dd6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-61c77826-6240-47eb-bf20-5b48820e6dd6.d80e3489-9940-4446-945b-e581574370bc 1G {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:44:44 devstack sudo[90345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-61c77826-6240-47eb-bf20-5b48820e6dd6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-61c77826-6240-47eb-bf20-5b48820e6dd6.d80e3489-9940-4446-945b-e581574370bc 1G Nov 06 11:44:44 devstack sudo[90345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:44:44 devstack sudo[90345]: pam_unix(sudo:session): session closed for user root Nov 06 11:44:44 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-01281375-6cf5-4fed-a8ad-c12649027aaa tempest-GroupSnapshotsTest-699199185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-61c77826-6240-47eb-bf20-5b48820e6dd6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-61c77826-6240-47eb-bf20-5b48820e6dd6.d80e3489-9940-4446-945b-e581574370bc 1G" returned: 0 in 0.416s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:44:44 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-01281375-6cf5-4fed-a8ad-c12649027aaa tempest-GroupSnapshotsTest-699199185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-61c77826-6240-47eb-bf20-5b48820e6dd6 -F qcow2 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-61c77826-6240-47eb-bf20-5b48820e6dd6.d80e3489-9940-4446-945b-e581574370bc {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:44:44 devstack sudo[90351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-61c77826-6240-47eb-bf20-5b48820e6dd6 -F qcow2 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-61c77826-6240-47eb-bf20-5b48820e6dd6.d80e3489-9940-4446-945b-e581574370bc Nov 06 11:44:44 devstack sudo[90351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:44:45 devstack sudo[90351]: pam_unix(sudo:session): session closed for user root Nov 06 11:44:45 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-01281375-6cf5-4fed-a8ad-c12649027aaa tempest-GroupSnapshotsTest-699199185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-61c77826-6240-47eb-bf20-5b48820e6dd6 -F qcow2 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-61c77826-6240-47eb-bf20-5b48820e6dd6.d80e3489-9940-4446-945b-e581574370bc" returned: 0 in 0.303s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:44:45 devstack cinder-volume[87116]: WARNING cinder.volume.drivers.remotefs [None req-01281375-6cf5-4fed-a8ad-c12649027aaa tempest-GroupSnapshotsTest-699199185 None] /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-61c77826-6240-47eb-bf20-5b48820e6dd6.d80e3489-9940-4446-945b-e581574370bc is being set with open permissions: ugo+rw: NotImplementedError Nov 06 11:44:45 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-01281375-6cf5-4fed-a8ad-c12649027aaa tempest-GroupSnapshotsTest-699199185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-61c77826-6240-47eb-bf20-5b48820e6dd6.d80e3489-9940-4446-945b-e581574370bc {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:44:45 devstack sudo[90356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-61c77826-6240-47eb-bf20-5b48820e6dd6.d80e3489-9940-4446-945b-e581574370bc Nov 06 11:44:45 devstack sudo[90356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:44:45 devstack sudo[90356]: pam_unix(sudo:session): session closed for user root Nov 06 11:44:45 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-01281375-6cf5-4fed-a8ad-c12649027aaa tempest-GroupSnapshotsTest-699199185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-61c77826-6240-47eb-bf20-5b48820e6dd6.d80e3489-9940-4446-945b-e581574370bc" returned: 0 in 0.245s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:44:45 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-01281375-6cf5-4fed-a8ad-c12649027aaa tempest-GroupSnapshotsTest-699199185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-61c77826-6240-47eb-bf20-5b48820e6dd6.info {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:44:45 devstack sudo[90359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-61c77826-6240-47eb-bf20-5b48820e6dd6.info Nov 06 11:44:45 devstack sudo[90359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:44:45 devstack sudo[90359]: pam_unix(sudo:session): session closed for user root Nov 06 11:44:45 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-01281375-6cf5-4fed-a8ad-c12649027aaa tempest-GroupSnapshotsTest-699199185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-61c77826-6240-47eb-bf20-5b48820e6dd6.info" returned: 0 in 0.277s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:44:45 devstack cinder-volume[87116]: WARNING cinder.volume.drivers.remotefs [None req-01281375-6cf5-4fed-a8ad-c12649027aaa tempest-GroupSnapshotsTest-699199185 None] /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-61c77826-6240-47eb-bf20-5b48820e6dd6.info is being set with open permissions: ugo+rw: NotImplementedError Nov 06 11:44:45 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-01281375-6cf5-4fed-a8ad-c12649027aaa tempest-GroupSnapshotsTest-699199185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-61c77826-6240-47eb-bf20-5b48820e6dd6.info {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:44:45 devstack sudo[90362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-61c77826-6240-47eb-bf20-5b48820e6dd6.info Nov 06 11:44:45 devstack sudo[90362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:44:46 devstack sudo[90362]: pam_unix(sudo:session): session closed for user root Nov 06 11:44:46 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-01281375-6cf5-4fed-a8ad-c12649027aaa tempest-GroupSnapshotsTest-699199185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-61c77826-6240-47eb-bf20-5b48820e6dd6.info" returned: 0 in 0.269s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:44:46 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-01281375-6cf5-4fed-a8ad-c12649027aaa tempest-GroupSnapshotsTest-699199185 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.997s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 11:44:46 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-01281375-6cf5-4fed-a8ad-c12649027aaa tempest-GroupSnapshotsTest-699199185 None] group_snapshot 300aaaff-6f4d-4bd7-88bb-e7cdadac7846: created successfully Nov 06 11:44:48 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-eb4c88fa-f0cd-4587-891d-c75dd93c3f9e tempest-GroupSnapshotsTest-699199185 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 11:44:48 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-eb4c88fa-f0cd-4587-891d-c75dd93c3f9e tempest-GroupSnapshotsTest-699199185 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 11:44:48 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-eb4c88fa-f0cd-4587-891d-c75dd93c3f9e tempest-GroupSnapshotsTest-699199185 None] Acquiring lock "cinder-quobyte-d80e3489-9940-4446-945b-e581574370bc-3791742b-787a-453a-9692-c3ea99795b88" by "_create_volume_from_snapshot" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 11:44:48 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-eb4c88fa-f0cd-4587-891d-c75dd93c3f9e tempest-GroupSnapshotsTest-699199185 None] Lock "cinder-quobyte-d80e3489-9940-4446-945b-e581574370bc-3791742b-787a-453a-9692-c3ea99795b88" acquired by "_create_volume_from_snapshot" :: waited 0.032s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 11:44:48 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-eb4c88fa-f0cd-4587-891d-c75dd93c3f9e tempest-GroupSnapshotsTest-699199185 None] Creating volume 3791742b-787a-453a-9692-c3ea99795b88 from snapshot d80e3489-9940-4446-945b-e581574370bc {{(pid=87116) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Nov 06 11:44:48 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-eb4c88fa-f0cd-4587-891d-c75dd93c3f9e tempest-GroupSnapshotsTest-699199185 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 11:44:48 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-eb4c88fa-f0cd-4587-891d-c75dd93c3f9e tempest-GroupSnapshotsTest-699199185 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 11:44:48 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-eb4c88fa-f0cd-4587-891d-c75dd93c3f9e tempest-GroupSnapshotsTest-699199185 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 11:44:48 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-eb4c88fa-f0cd-4587-891d-c75dd93c3f9e tempest-GroupSnapshotsTest-699199185 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 11:44:48 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-eb4c88fa-f0cd-4587-891d-c75dd93c3f9e tempest-GroupSnapshotsTest-699199185 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 11:44:48 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-eb4c88fa-f0cd-4587-891d-c75dd93c3f9e tempest-GroupSnapshotsTest-699199185 None] Selected osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f as target Quobyte volume. {{(pid=87116) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 11:44:48 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-eb4c88fa-f0cd-4587-891d-c75dd93c3f9e tempest-GroupSnapshotsTest-699199185 None] Acquiring lock "cinder-quobyte-3791742b-787a-453a-9692-c3ea99795b88" by "_copy_volume_from_snapshot" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 11:44:48 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-eb4c88fa-f0cd-4587-891d-c75dd93c3f9e tempest-GroupSnapshotsTest-699199185 None] Lock "cinder-quobyte-3791742b-787a-453a-9692-c3ea99795b88" acquired by "_copy_volume_from_snapshot" :: waited 0.025s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 11:44:48 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-eb4c88fa-f0cd-4587-891d-c75dd93c3f9e tempest-GroupSnapshotsTest-699199185 None] snapshot: d80e3489-9940-4446-945b-e581574370bc, volume: 3791742b-787a-453a-9692-c3ea99795b88, {{(pid=87116) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 06 11:44:48 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-eb4c88fa-f0cd-4587-891d-c75dd93c3f9e tempest-GroupSnapshotsTest-699199185 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 11:44:48 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-eb4c88fa-f0cd-4587-891d-c75dd93c3f9e tempest-GroupSnapshotsTest-699199185 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 11:44:48 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-eb4c88fa-f0cd-4587-891d-c75dd93c3f9e tempest-GroupSnapshotsTest-699199185 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 11:44:48 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-eb4c88fa-f0cd-4587-891d-c75dd93c3f9e tempest-GroupSnapshotsTest-699199185 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 11:44:48 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-eb4c88fa-f0cd-4587-891d-c75dd93c3f9e tempest-GroupSnapshotsTest-699199185 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 11:44:48 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[49731acc-a93b-449f-ba13-bf87d9a84531]: (4, 'qcow2') {{(pid=88420) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 11:44:48 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-eb4c88fa-f0cd-4587-891d-c75dd93c3f9e tempest-GroupSnapshotsTest-699199185 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-61c77826-6240-47eb-bf20-5b48820e6dd6.d80e3489-9940-4446-945b-e581574370bc {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:44:48 devstack sudo[90367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-61c77826-6240-47eb-bf20-5b48820e6dd6.d80e3489-9940-4446-945b-e581574370bc Nov 06 11:44:48 devstack sudo[90367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:44:49 devstack sudo[90367]: pam_unix(sudo:session): session closed for user root Nov 06 11:44:49 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-eb4c88fa-f0cd-4587-891d-c75dd93c3f9e tempest-GroupSnapshotsTest-699199185 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-61c77826-6240-47eb-bf20-5b48820e6dd6.d80e3489-9940-4446-945b-e581574370bc" returned: 0 in 0.526s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:44:49 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-eb4c88fa-f0cd-4587-891d-c75dd93c3f9e tempest-GroupSnapshotsTest-699199185 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-61c77826-6240-47eb-bf20-5b48820e6dd6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87116) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 11:44:49 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fa9aa41-e217-4102-b894-ae6d11e5965d]: (4, 'qcow2') {{(pid=88420) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 11:44:49 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-eb4c88fa-f0cd-4587-891d-c75dd93c3f9e tempest-GroupSnapshotsTest-699199185 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-61c77826-6240-47eb-bf20-5b48820e6dd6 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:44:49 devstack sudo[90372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-61c77826-6240-47eb-bf20-5b48820e6dd6 Nov 06 11:44:49 devstack sudo[90372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:44:49 devstack cinder-volume[87116]: DEBUG cinder.volume.flows.manager.create_volume [None req-57296e27-29a9-447a-b637-b5e16fd8f0fc tempest-ServerActionsTestOtherA-64126338 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87116) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 11:44:49 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-57296e27-29a9-447a-b637-b5e16fd8f0fc tempest-ServerActionsTestOtherA-64126338 None] Flow 'volume_create_manager' (01ad5763-f802-4025-9e6e-391de757239e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 11:44:49 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-57296e27-29a9-447a-b637-b5e16fd8f0fc tempest-ServerActionsTestOtherA-64126338 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (92d2f603-206a-4c5a-b3d4-f49715de810c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:44:49 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-57296e27-29a9-447a-b637-b5e16fd8f0fc tempest-ServerActionsTestOtherA-64126338 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (92d2f603-206a-4c5a-b3d4-f49715de810c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T10:44:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-1111823183',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=836b7423-57f1-436b-a893-c14fa60ee13d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c90798bc4e7b416db316dcd3e2763fdb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T10:44:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T10:44:50Z,use_quota=True,user_id='59c9bb435a0646af84a9849e5e2ab320',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(34d3b144-d9b7-480a-a2e3-01e45f3d54c1),volume_type_id=34d3b144-d9b7-480a-a2e3-01e45f3d54c1)' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:44:49 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-57296e27-29a9-447a-b637-b5e16fd8f0fc tempest-ServerActionsTestOtherA-64126338 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c07ebee6-dc63-4fe5-9591-ea1b5e2f50e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:44:49 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-57296e27-29a9-447a-b637-b5e16fd8f0fc tempest-ServerActionsTestOtherA-64126338 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c07ebee6-dc63-4fe5-9591-ea1b5e2f50e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:44:49 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-57296e27-29a9-447a-b637-b5e16fd8f0fc tempest-ServerActionsTestOtherA-64126338 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (808592bd-f5cf-499c-b066-8dc0a5b35339) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:44:49 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-57296e27-29a9-447a-b637-b5e16fd8f0fc tempest-ServerActionsTestOtherA-64126338 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (808592bd-f5cf-499c-b066-8dc0a5b35339) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '836b7423-57f1-436b-a893-c14fa60ee13d', 'volume_name': 'volume-836b7423-57f1-436b-a893-c14fa60ee13d', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:44:49 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-57296e27-29a9-447a-b637-b5e16fd8f0fc tempest-ServerActionsTestOtherA-64126338 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (28fa4f30-c572-46bc-8351-b28a58c7540f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:44:49 devstack sudo[90372]: pam_unix(sudo:session): session closed for user root Nov 06 11:44:49 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-57296e27-29a9-447a-b637-b5e16fd8f0fc tempest-ServerActionsTestOtherA-64126338 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (28fa4f30-c572-46bc-8351-b28a58c7540f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:44:49 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-57296e27-29a9-447a-b637-b5e16fd8f0fc tempest-ServerActionsTestOtherA-64126338 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3dcf6d9a-f6b5-469e-9f6e-0b511521d015) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:44:49 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-57296e27-29a9-447a-b637-b5e16fd8f0fc tempest-ServerActionsTestOtherA-64126338 None] Volume 836b7423-57f1-436b-a893-c14fa60ee13d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-836b7423-57f1-436b-a893-c14fa60ee13d', 'volume_size': 1} Nov 06 11:44:49 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-57296e27-29a9-447a-b637-b5e16fd8f0fc tempest-ServerActionsTestOtherA-64126338 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 11:44:49 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-eb4c88fa-f0cd-4587-891d-c75dd93c3f9e tempest-GroupSnapshotsTest-699199185 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-61c77826-6240-47eb-bf20-5b48820e6dd6" returned: 0 in 0.840s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:44:49 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-eb4c88fa-f0cd-4587-891d-c75dd93c3f9e tempest-GroupSnapshotsTest-699199185 None] will copy from snapshot at /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-61c77826-6240-47eb-bf20-5b48820e6dd6 {{(pid=87116) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 06 11:44:49 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-eb4c88fa-f0cd-4587-891d-c75dd93c3f9e tempest-GroupSnapshotsTest-699199185 None] Creating direct copy from snapshot {{(pid=87116) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 06 11:44:49 devstack cinder-volume[87116]: DEBUG cinder.utils [None req-eb4c88fa-f0cd-4587-891d-c75dd93c3f9e tempest-GroupSnapshotsTest-699199185 None] Path /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-3791742b-787a-453a-9692-c3ea99795b88 not found in is_blk_device check {{(pid=87116) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 06 11:44:49 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-eb4c88fa-f0cd-4587-891d-c75dd93c3f9e tempest-GroupSnapshotsTest-699199185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-61c77826-6240-47eb-bf20-5b48820e6dd6 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-3791742b-787a-453a-9692-c3ea99795b88 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:44:49 devstack sudo[90377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-61c77826-6240-47eb-bf20-5b48820e6dd6 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-3791742b-787a-453a-9692-c3ea99795b88 Nov 06 11:44:49 devstack sudo[90377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:44:53 devstack cinder-volume[87116]: DEBUG cinder.volume.flows.manager.create_volume [None req-93f90158-a298-48d9-84cd-ffa46bbbce02 tempest-AttachVolumeShelveTestJSON-1508542063 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87116) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 11:44:53 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-93f90158-a298-48d9-84cd-ffa46bbbce02 tempest-AttachVolumeShelveTestJSON-1508542063 None] Flow 'volume_create_manager' (0ad93bac-3a61-4f14-bc0b-1817147ce3ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 11:44:53 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-93f90158-a298-48d9-84cd-ffa46bbbce02 tempest-AttachVolumeShelveTestJSON-1508542063 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (31ae4237-e646-4e06-ad29-070b04e46c1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:44:54 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-93f90158-a298-48d9-84cd-ffa46bbbce02 tempest-AttachVolumeShelveTestJSON-1508542063 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (31ae4237-e646-4e06-ad29-070b04e46c1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T10:44:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-640702741',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=86442665-990d-4290-a4ef-b71510b118bf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f58824dd53024ad0b88440afc1fee3d2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T10:44:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T10:44:54Z,use_quota=True,user_id='6c783ffc7b184519aed590346b62a1a4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(34d3b144-d9b7-480a-a2e3-01e45f3d54c1),volume_type_id=34d3b144-d9b7-480a-a2e3-01e45f3d54c1)' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:44:54 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-93f90158-a298-48d9-84cd-ffa46bbbce02 tempest-AttachVolumeShelveTestJSON-1508542063 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3d61f622-25f3-4fb9-89e6-9c4fda844f91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:44:54 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-93f90158-a298-48d9-84cd-ffa46bbbce02 tempest-AttachVolumeShelveTestJSON-1508542063 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3d61f622-25f3-4fb9-89e6-9c4fda844f91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:44:54 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-93f90158-a298-48d9-84cd-ffa46bbbce02 tempest-AttachVolumeShelveTestJSON-1508542063 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (71cf3eac-c643-4dfe-9956-5cfa1ba3f5d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:44:54 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-93f90158-a298-48d9-84cd-ffa46bbbce02 tempest-AttachVolumeShelveTestJSON-1508542063 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (71cf3eac-c643-4dfe-9956-5cfa1ba3f5d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '86442665-990d-4290-a4ef-b71510b118bf', 'volume_name': 'volume-86442665-990d-4290-a4ef-b71510b118bf', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:44:54 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-93f90158-a298-48d9-84cd-ffa46bbbce02 tempest-AttachVolumeShelveTestJSON-1508542063 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (85e16f44-e1de-4f9f-b3bf-b8654f06d725) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:44:54 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-93f90158-a298-48d9-84cd-ffa46bbbce02 tempest-AttachVolumeShelveTestJSON-1508542063 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (85e16f44-e1de-4f9f-b3bf-b8654f06d725) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:44:54 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-93f90158-a298-48d9-84cd-ffa46bbbce02 tempest-AttachVolumeShelveTestJSON-1508542063 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1a126b86-7f53-4387-aa82-43debeabe49d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:44:54 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-93f90158-a298-48d9-84cd-ffa46bbbce02 tempest-AttachVolumeShelveTestJSON-1508542063 None] Volume 86442665-990d-4290-a4ef-b71510b118bf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-86442665-990d-4290-a4ef-b71510b118bf', 'volume_size': 1} Nov 06 11:44:54 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-93f90158-a298-48d9-84cd-ffa46bbbce02 tempest-AttachVolumeShelveTestJSON-1508542063 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 11:44:59 devstack sudo[90377]: pam_unix(sudo:session): session closed for user root Nov 06 11:44:59 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-eb4c88fa-f0cd-4587-891d-c75dd93c3f9e tempest-GroupSnapshotsTest-699199185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-61c77826-6240-47eb-bf20-5b48820e6dd6 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-3791742b-787a-453a-9692-c3ea99795b88" returned: 0 in 9.088s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:44:59 devstack cinder-volume[87116]: DEBUG cinder.image.image_utils [None req-eb4c88fa-f0cd-4587-891d-c75dd93c3f9e tempest-GroupSnapshotsTest-699199185 None] Image conversion details: src /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-61c77826-6240-47eb-bf20-5b48820e6dd6, size 1024.00 MB, duration 9.09 sec, destination /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-3791742b-787a-453a-9692-c3ea99795b88 {{(pid=87116) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 06 11:44:59 devstack cinder-volume[87116]: INFO cinder.image.image_utils [None req-eb4c88fa-f0cd-4587-891d-c75dd93c3f9e tempest-GroupSnapshotsTest-699199185 None] Converted 1024.00 MB image at 112.66 MB/s Nov 06 11:44:59 devstack cinder-volume[87116]: WARNING cinder.volume.drivers.remotefs [None req-eb4c88fa-f0cd-4587-891d-c75dd93c3f9e tempest-GroupSnapshotsTest-699199185 None] /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-3791742b-787a-453a-9692-c3ea99795b88 is being set with open permissions: ugo+rw: NotImplementedError Nov 06 11:44:59 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-eb4c88fa-f0cd-4587-891d-c75dd93c3f9e tempest-GroupSnapshotsTest-699199185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-3791742b-787a-453a-9692-c3ea99795b88 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:44:59 devstack sudo[90407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-3791742b-787a-453a-9692-c3ea99795b88 Nov 06 11:44:59 devstack sudo[90407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:44:59 devstack sudo[90407]: pam_unix(sudo:session): session closed for user root Nov 06 11:44:59 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-eb4c88fa-f0cd-4587-891d-c75dd93c3f9e tempest-GroupSnapshotsTest-699199185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-3791742b-787a-453a-9692-c3ea99795b88" returned: 0 in 0.299s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:44:59 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-eb4c88fa-f0cd-4587-891d-c75dd93c3f9e tempest-GroupSnapshotsTest-699199185 None] Lock "cinder-quobyte-3791742b-787a-453a-9692-c3ea99795b88" released by "_copy_volume_from_snapshot" :: held 10.895s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 11:44:59 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-eb4c88fa-f0cd-4587-891d-c75dd93c3f9e tempest-GroupSnapshotsTest-699199185 None] Lock "cinder-quobyte-d80e3489-9940-4446-945b-e581574370bc-3791742b-787a-453a-9692-c3ea99795b88" released by "_create_volume_from_snapshot" :: held 10.983s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 11:44:59 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-eb4c88fa-f0cd-4587-891d-c75dd93c3f9e tempest-GroupSnapshotsTest-699199185 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 11.017s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 11:44:59 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-57296e27-29a9-447a-b637-b5e16fd8f0fc tempest-ServerActionsTestOtherA-64126338 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.468s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 11:44:59 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-57296e27-29a9-447a-b637-b5e16fd8f0fc tempest-ServerActionsTestOtherA-64126338 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T10:44:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-1111823183',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=836b7423-57f1-436b-a893-c14fa60ee13d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c90798bc4e7b416db316dcd3e2763fdb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T10:44:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T10:44:50Z,use_quota=True,user_id='59c9bb435a0646af84a9849e5e2ab320',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(34d3b144-d9b7-480a-a2e3-01e45f3d54c1),volume_type_id=34d3b144-d9b7-480a-a2e3-01e45f3d54c1)}" {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 11:44:59 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-57296e27-29a9-447a-b637-b5e16fd8f0fc tempest-ServerActionsTestOtherA-64126338 None] Creating volume 836b7423-57f1-436b-a893-c14fa60ee13d {{(pid=87116) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 11:44:59 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-57296e27-29a9-447a-b637-b5e16fd8f0fc tempest-ServerActionsTestOtherA-64126338 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 11:44:59 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-57296e27-29a9-447a-b637-b5e16fd8f0fc tempest-ServerActionsTestOtherA-64126338 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 11:44:59 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-57296e27-29a9-447a-b637-b5e16fd8f0fc tempest-ServerActionsTestOtherA-64126338 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 11:44:59 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-57296e27-29a9-447a-b637-b5e16fd8f0fc tempest-ServerActionsTestOtherA-64126338 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 11:44:59 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-57296e27-29a9-447a-b637-b5e16fd8f0fc tempest-ServerActionsTestOtherA-64126338 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 11:44:59 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-57296e27-29a9-447a-b637-b5e16fd8f0fc tempest-ServerActionsTestOtherA-64126338 None] Selected osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f as target Quobyte volume. {{(pid=87116) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 11:44:59 devstack cinder-volume[87116]: INFO cinder.volume.drivers.remotefs [None req-57296e27-29a9-447a-b637-b5e16fd8f0fc tempest-ServerActionsTestOtherA-64126338 None] casted to osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f Nov 06 11:44:59 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-57296e27-29a9-447a-b637-b5e16fd8f0fc tempest-ServerActionsTestOtherA-64126338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-836b7423-57f1-436b-a893-c14fa60ee13d 1073741824 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:44:59 devstack sudo[90413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-836b7423-57f1-436b-a893-c14fa60ee13d 1073741824 Nov 06 11:44:59 devstack sudo[90413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:44:59 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-eb4c88fa-f0cd-4587-891d-c75dd93c3f9e tempest-GroupSnapshotsTest-699199185 None] Create group from source-snapshot-300aaaff-6f4d-4bd7-88bb-e7cdadac7846 completed successfully. Nov 06 11:44:59 devstack sudo[90413]: pam_unix(sudo:session): session closed for user root Nov 06 11:44:59 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-57296e27-29a9-447a-b637-b5e16fd8f0fc tempest-ServerActionsTestOtherA-64126338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-836b7423-57f1-436b-a893-c14fa60ee13d 1073741824" returned: 0 in 0.514s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:45:00 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-57296e27-29a9-447a-b637-b5e16fd8f0fc tempest-ServerActionsTestOtherA-64126338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-836b7423-57f1-436b-a893-c14fa60ee13d {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:45:00 devstack sudo[90419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-836b7423-57f1-436b-a893-c14fa60ee13d Nov 06 11:45:00 devstack sudo[90419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:45:00 devstack sudo[90419]: pam_unix(sudo:session): session closed for user root Nov 06 11:45:00 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-57296e27-29a9-447a-b637-b5e16fd8f0fc tempest-ServerActionsTestOtherA-64126338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-836b7423-57f1-436b-a893-c14fa60ee13d" returned: 0 in 0.316s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:45:00 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-57296e27-29a9-447a-b637-b5e16fd8f0fc tempest-ServerActionsTestOtherA-64126338 None] <== create_volume: return (943ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f'} {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 11:45:00 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-57296e27-29a9-447a-b637-b5e16fd8f0fc tempest-ServerActionsTestOtherA-64126338 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.946s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 11:45:00 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-93f90158-a298-48d9-84cd-ffa46bbbce02 tempest-AttachVolumeShelveTestJSON-1508542063 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.232s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 11:45:00 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-93f90158-a298-48d9-84cd-ffa46bbbce02 tempest-AttachVolumeShelveTestJSON-1508542063 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T10:44:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-640702741',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=86442665-990d-4290-a4ef-b71510b118bf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f58824dd53024ad0b88440afc1fee3d2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T10:44:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T10:44:54Z,use_quota=True,user_id='6c783ffc7b184519aed590346b62a1a4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(34d3b144-d9b7-480a-a2e3-01e45f3d54c1),volume_type_id=34d3b144-d9b7-480a-a2e3-01e45f3d54c1)}" {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 11:45:00 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-93f90158-a298-48d9-84cd-ffa46bbbce02 tempest-AttachVolumeShelveTestJSON-1508542063 None] Creating volume 86442665-990d-4290-a4ef-b71510b118bf {{(pid=87116) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 11:45:00 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-93f90158-a298-48d9-84cd-ffa46bbbce02 tempest-AttachVolumeShelveTestJSON-1508542063 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 11:45:00 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-93f90158-a298-48d9-84cd-ffa46bbbce02 tempest-AttachVolumeShelveTestJSON-1508542063 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 11:45:00 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-93f90158-a298-48d9-84cd-ffa46bbbce02 tempest-AttachVolumeShelveTestJSON-1508542063 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 11:45:00 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-93f90158-a298-48d9-84cd-ffa46bbbce02 tempest-AttachVolumeShelveTestJSON-1508542063 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 11:45:00 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-93f90158-a298-48d9-84cd-ffa46bbbce02 tempest-AttachVolumeShelveTestJSON-1508542063 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 11:45:00 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-93f90158-a298-48d9-84cd-ffa46bbbce02 tempest-AttachVolumeShelveTestJSON-1508542063 None] Selected osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f as target Quobyte volume. {{(pid=87116) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 11:45:00 devstack cinder-volume[87116]: INFO cinder.volume.drivers.remotefs [None req-93f90158-a298-48d9-84cd-ffa46bbbce02 tempest-AttachVolumeShelveTestJSON-1508542063 None] casted to osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f Nov 06 11:45:00 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-93f90158-a298-48d9-84cd-ffa46bbbce02 tempest-AttachVolumeShelveTestJSON-1508542063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-86442665-990d-4290-a4ef-b71510b118bf 1073741824 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:45:00 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-57296e27-29a9-447a-b637-b5e16fd8f0fc tempest-ServerActionsTestOtherA-64126338 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3dcf6d9a-f6b5-469e-9f6e-0b511521d015) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-836b7423-57f1-436b-a893-c14fa60ee13d', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:45:00 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-57296e27-29a9-447a-b637-b5e16fd8f0fc tempest-ServerActionsTestOtherA-64126338 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (92eae08d-44a7-446f-8e47-12801351e967) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:45:00 devstack sudo[90424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-86442665-990d-4290-a4ef-b71510b118bf 1073741824 Nov 06 11:45:00 devstack sudo[90424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:45:00 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-57296e27-29a9-447a-b637-b5e16fd8f0fc tempest-ServerActionsTestOtherA-64126338 None] Volume volume-836b7423-57f1-436b-a893-c14fa60ee13d (836b7423-57f1-436b-a893-c14fa60ee13d): created successfully Nov 06 11:45:00 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-57296e27-29a9-447a-b637-b5e16fd8f0fc tempest-ServerActionsTestOtherA-64126338 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (92eae08d-44a7-446f-8e47-12801351e967) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:45:00 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-57296e27-29a9-447a-b637-b5e16fd8f0fc tempest-ServerActionsTestOtherA-64126338 None] Flow 'volume_create_manager' (01ad5763-f802-4025-9e6e-391de757239e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 11:45:00 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-57296e27-29a9-447a-b637-b5e16fd8f0fc tempest-ServerActionsTestOtherA-64126338 None] Created volume successfully. Nov 06 11:45:00 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-0531d42e-aac3-4daa-a5ff-b6b0be7a67ce tempest-GroupSnapshotsTest-699199185 None] Acquiring lock "cinder-quobyte-3791742b-787a-453a-9692-c3ea99795b88" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 11:45:00 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-0531d42e-aac3-4daa-a5ff-b6b0be7a67ce tempest-GroupSnapshotsTest-699199185 None] Lock "cinder-quobyte-3791742b-787a-453a-9692-c3ea99795b88" acquired by "delete_volume" :: waited 0.025s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 11:45:00 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[a408ca3e-fa39-48e2-87ae-9c80dc8d5864]: (4, 'qcow2') {{(pid=88420) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 11:45:00 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-0531d42e-aac3-4daa-a5ff-b6b0be7a67ce tempest-GroupSnapshotsTest-699199185 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-3791742b-787a-453a-9692-c3ea99795b88 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:45:00 devstack sudo[90429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-3791742b-787a-453a-9692-c3ea99795b88 Nov 06 11:45:00 devstack sudo[90429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:45:01 devstack sudo[90424]: pam_unix(sudo:session): session closed for user root Nov 06 11:45:01 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-93f90158-a298-48d9-84cd-ffa46bbbce02 tempest-AttachVolumeShelveTestJSON-1508542063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-86442665-990d-4290-a4ef-b71510b118bf 1073741824" returned: 0 in 0.787s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:45:01 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-93f90158-a298-48d9-84cd-ffa46bbbce02 tempest-AttachVolumeShelveTestJSON-1508542063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-86442665-990d-4290-a4ef-b71510b118bf {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:45:01 devstack sudo[90435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-86442665-990d-4290-a4ef-b71510b118bf Nov 06 11:45:01 devstack sudo[90435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:45:01 devstack sudo[90429]: pam_unix(sudo:session): session closed for user root Nov 06 11:45:01 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-0531d42e-aac3-4daa-a5ff-b6b0be7a67ce tempest-GroupSnapshotsTest-699199185 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-3791742b-787a-453a-9692-c3ea99795b88" returned: 0 in 0.588s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:45:01 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-0531d42e-aac3-4daa-a5ff-b6b0be7a67ce tempest-GroupSnapshotsTest-699199185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-3791742b-787a-453a-9692-c3ea99795b88 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:45:01 devstack sudo[90441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-3791742b-787a-453a-9692-c3ea99795b88 Nov 06 11:45:01 devstack sudo[90441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:45:01 devstack sudo[90435]: pam_unix(sudo:session): session closed for user root Nov 06 11:45:01 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-93f90158-a298-48d9-84cd-ffa46bbbce02 tempest-AttachVolumeShelveTestJSON-1508542063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-86442665-990d-4290-a4ef-b71510b118bf" returned: 0 in 0.526s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:45:01 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-93f90158-a298-48d9-84cd-ffa46bbbce02 tempest-AttachVolumeShelveTestJSON-1508542063 None] <== create_volume: return (1372ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f'} {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 11:45:01 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-93f90158-a298-48d9-84cd-ffa46bbbce02 tempest-AttachVolumeShelveTestJSON-1508542063 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.375s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 11:45:01 devstack sudo[90441]: pam_unix(sudo:session): session closed for user root Nov 06 11:45:01 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-0531d42e-aac3-4daa-a5ff-b6b0be7a67ce tempest-GroupSnapshotsTest-699199185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-3791742b-787a-453a-9692-c3ea99795b88" returned: 0 in 0.357s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:45:01 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-0531d42e-aac3-4daa-a5ff-b6b0be7a67ce tempest-GroupSnapshotsTest-699199185 None] Lock "cinder-quobyte-3791742b-787a-453a-9692-c3ea99795b88" released by "delete_volume" :: held 1.018s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 11:45:02 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-93f90158-a298-48d9-84cd-ffa46bbbce02 tempest-AttachVolumeShelveTestJSON-1508542063 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1a126b86-7f53-4387-aa82-43debeabe49d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-86442665-990d-4290-a4ef-b71510b118bf', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:45:02 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-93f90158-a298-48d9-84cd-ffa46bbbce02 tempest-AttachVolumeShelveTestJSON-1508542063 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5c310a3d-ab1e-40f0-8e4e-fb5809c93dba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:45:02 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-93f90158-a298-48d9-84cd-ffa46bbbce02 tempest-AttachVolumeShelveTestJSON-1508542063 None] Volume volume-86442665-990d-4290-a4ef-b71510b118bf (86442665-990d-4290-a4ef-b71510b118bf): created successfully Nov 06 11:45:02 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-93f90158-a298-48d9-84cd-ffa46bbbce02 tempest-AttachVolumeShelveTestJSON-1508542063 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5c310a3d-ab1e-40f0-8e4e-fb5809c93dba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:45:02 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-93f90158-a298-48d9-84cd-ffa46bbbce02 tempest-AttachVolumeShelveTestJSON-1508542063 None] Flow 'volume_create_manager' (0ad93bac-3a61-4f14-bc0b-1817147ce3ce) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 11:45:02 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-93f90158-a298-48d9-84cd-ffa46bbbce02 tempest-AttachVolumeShelveTestJSON-1508542063 None] Created volume successfully. Nov 06 11:45:02 devstack cinder-volume[87116]: DEBUG cinder.quota [None req-0531d42e-aac3-4daa-a5ff-b6b0be7a67ce tempest-GroupSnapshotsTest-699199185 None] Created reservations ['28afc45c-e018-4f58-b3c5-96a11eafa2b7'] {{(pid=87116) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 11:45:02 devstack cinder-volume[87116]: WARNING cinder.quota [None req-0531d42e-aac3-4daa-a5ff-b6b0be7a67ce tempest-GroupSnapshotsTest-699199185 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-134496645 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-134496645, it is now deprecated. Please use the default quota class for default quota. Nov 06 11:45:02 devstack cinder-volume[87116]: WARNING cinder.quota [None req-0531d42e-aac3-4daa-a5ff-b6b0be7a67ce tempest-GroupSnapshotsTest-699199185 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-134496645 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-134496645, it is now deprecated. Please use the default quota class for default quota. Nov 06 11:45:02 devstack cinder-volume[87116]: DEBUG cinder.quota [None req-0531d42e-aac3-4daa-a5ff-b6b0be7a67ce tempest-GroupSnapshotsTest-699199185 None] Created reservations ['2f7c298a-9ae5-43d6-b52c-b287c0e68177', '310cf7c6-26bc-4cb7-bb2a-231c9833a69c', '65849544-edcb-4a9d-8422-604cfdd26e5f', 'a53babdf-b1d5-4fd3-b015-e1412691203e'] {{(pid=87116) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 11:45:02 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-0531d42e-aac3-4daa-a5ff-b6b0be7a67ce tempest-GroupSnapshotsTest-699199185 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 11:45:02 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-0531d42e-aac3-4daa-a5ff-b6b0be7a67ce tempest-GroupSnapshotsTest-699199185 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 11:45:02 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-0531d42e-aac3-4daa-a5ff-b6b0be7a67ce tempest-GroupSnapshotsTest-699199185 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 11:45:02 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-0531d42e-aac3-4daa-a5ff-b6b0be7a67ce tempest-GroupSnapshotsTest-699199185 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 11:45:02 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-0531d42e-aac3-4daa-a5ff-b6b0be7a67ce tempest-GroupSnapshotsTest-699199185 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 11:45:02 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-0531d42e-aac3-4daa-a5ff-b6b0be7a67ce tempest-GroupSnapshotsTest-699199185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:45:02 devstack sudo[90468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756 Nov 06 11:45:02 devstack sudo[90468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:45:02 devstack sudo[90468]: pam_unix(sudo:session): session closed for user root Nov 06 11:45:02 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-0531d42e-aac3-4daa-a5ff-b6b0be7a67ce tempest-GroupSnapshotsTest-699199185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756" returned: 0 in 0.289s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:45:02 devstack cinder-volume[87116]: DEBUG cinder.manager [None req-0531d42e-aac3-4daa-a5ff-b6b0be7a67ce tempest-GroupSnapshotsTest-699199185 None] Notifying Schedulers of capabilities ... {{(pid=87116) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 11:45:02 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-0531d42e-aac3-4daa-a5ff-b6b0be7a67ce tempest-GroupSnapshotsTest-699199185 None] Delete group completed successfully. Nov 06 11:45:03 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-7065d2e0-40a8-4a67-8b8a-ec2735970b68 tempest-GroupSnapshotsTest-699199185 None] group_snapshot 300aaaff-6f4d-4bd7-88bb-e7cdadac7846: deleting Nov 06 11:45:03 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-7065d2e0-40a8-4a67-8b8a-ec2735970b68 tempest-GroupSnapshotsTest-699199185 None] group_snapshot 300aaaff-6f4d-4bd7-88bb-e7cdadac7846: deleting {{(pid=87116) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Nov 06 11:45:03 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-7065d2e0-40a8-4a67-8b8a-ec2735970b68 tempest-GroupSnapshotsTest-699199185 None] Acquiring lock "cinder-quobyte-61c77826-6240-47eb-bf20-5b48820e6dd6" by "delete_snapshot" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 11:45:03 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-7065d2e0-40a8-4a67-8b8a-ec2735970b68 tempest-GroupSnapshotsTest-699199185 None] Lock "cinder-quobyte-61c77826-6240-47eb-bf20-5b48820e6dd6" acquired by "delete_snapshot" :: waited 0.047s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 11:45:03 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-7065d2e0-40a8-4a67-8b8a-ec2735970b68 tempest-GroupSnapshotsTest-699199185 None] Acquiring lock "cinder-quobyte-d80e3489-9940-4446-945b-e581574370bc" by "_delete_snapshot" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 11:45:03 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-7065d2e0-40a8-4a67-8b8a-ec2735970b68 tempest-GroupSnapshotsTest-699199185 None] Lock "cinder-quobyte-d80e3489-9940-4446-945b-e581574370bc" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 11:45:03 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-7065d2e0-40a8-4a67-8b8a-ec2735970b68 tempest-GroupSnapshotsTest-699199185 None] Deleting offline snapshot d80e3489-9940-4446-945b-e581574370bc of volume 61c77826-6240-47eb-bf20-5b48820e6dd6 {{(pid=87116) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 06 11:45:03 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-7065d2e0-40a8-4a67-8b8a-ec2735970b68 tempest-GroupSnapshotsTest-699199185 None] snapshot_file for this snap is: volume-61c77826-6240-47eb-bf20-5b48820e6dd6.d80e3489-9940-4446-945b-e581574370bc {{(pid=87116) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 06 11:45:03 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f098187-c7c1-471c-a320-95c4de748be4]: (4, 'qcow2') {{(pid=88420) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 11:45:03 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-7065d2e0-40a8-4a67-8b8a-ec2735970b68 tempest-GroupSnapshotsTest-699199185 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-61c77826-6240-47eb-bf20-5b48820e6dd6.d80e3489-9940-4446-945b-e581574370bc {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:45:03 devstack sudo[90479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-61c77826-6240-47eb-bf20-5b48820e6dd6.d80e3489-9940-4446-945b-e581574370bc Nov 06 11:45:03 devstack sudo[90479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:45:04 devstack sudo[90479]: pam_unix(sudo:session): session closed for user root Nov 06 11:45:04 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-7065d2e0-40a8-4a67-8b8a-ec2735970b68 tempest-GroupSnapshotsTest-699199185 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-61c77826-6240-47eb-bf20-5b48820e6dd6.d80e3489-9940-4446-945b-e581574370bc" returned: 0 in 0.455s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:45:04 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-7065d2e0-40a8-4a67-8b8a-ec2735970b68 tempest-GroupSnapshotsTest-699199185 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-61c77826-6240-47eb-bf20-5b48820e6dd6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87116) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 11:45:04 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[651a6d4e-809b-47b2-abce-66a7a1ab4632]: (4, 'qcow2') {{(pid=88420) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 11:45:04 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-7065d2e0-40a8-4a67-8b8a-ec2735970b68 tempest-GroupSnapshotsTest-699199185 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-61c77826-6240-47eb-bf20-5b48820e6dd6 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:45:04 devstack sudo[90500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-61c77826-6240-47eb-bf20-5b48820e6dd6 Nov 06 11:45:04 devstack sudo[90500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:45:04 devstack sudo[90500]: pam_unix(sudo:session): session closed for user root Nov 06 11:45:04 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-7065d2e0-40a8-4a67-8b8a-ec2735970b68 tempest-GroupSnapshotsTest-699199185 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-61c77826-6240-47eb-bf20-5b48820e6dd6" returned: 0 in 0.818s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:45:04 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-7065d2e0-40a8-4a67-8b8a-ec2735970b68 tempest-GroupSnapshotsTest-699199185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-61c77826-6240-47eb-bf20-5b48820e6dd6.d80e3489-9940-4446-945b-e581574370bc {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:45:04 devstack sudo[90517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-61c77826-6240-47eb-bf20-5b48820e6dd6.d80e3489-9940-4446-945b-e581574370bc Nov 06 11:45:05 devstack sudo[90517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:45:05 devstack sudo[90517]: pam_unix(sudo:session): session closed for user root Nov 06 11:45:05 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-7065d2e0-40a8-4a67-8b8a-ec2735970b68 tempest-GroupSnapshotsTest-699199185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-61c77826-6240-47eb-bf20-5b48820e6dd6.d80e3489-9940-4446-945b-e581574370bc" returned: 0 in 0.481s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:45:05 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-7065d2e0-40a8-4a67-8b8a-ec2735970b68 tempest-GroupSnapshotsTest-699199185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-61c77826-6240-47eb-bf20-5b48820e6dd6.d80e3489-9940-4446-945b-e581574370bc {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:45:05 devstack sudo[90532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-61c77826-6240-47eb-bf20-5b48820e6dd6.d80e3489-9940-4446-945b-e581574370bc Nov 06 11:45:05 devstack sudo[90532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:45:05 devstack sudo[90532]: pam_unix(sudo:session): session closed for user root Nov 06 11:45:05 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-7065d2e0-40a8-4a67-8b8a-ec2735970b68 tempest-GroupSnapshotsTest-699199185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-61c77826-6240-47eb-bf20-5b48820e6dd6.d80e3489-9940-4446-945b-e581574370bc" returned: 0 in 0.321s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:45:05 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-7065d2e0-40a8-4a67-8b8a-ec2735970b68 tempest-GroupSnapshotsTest-699199185 None] Lock "cinder-quobyte-d80e3489-9940-4446-945b-e581574370bc" released by "_delete_snapshot" :: held 2.269s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 11:45:05 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-7065d2e0-40a8-4a67-8b8a-ec2735970b68 tempest-GroupSnapshotsTest-699199185 None] Lock "cinder-quobyte-61c77826-6240-47eb-bf20-5b48820e6dd6" released by "delete_snapshot" :: held 2.311s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 11:45:05 devstack cinder-volume[87116]: WARNING cinder.quota [None req-7065d2e0-40a8-4a67-8b8a-ec2735970b68 tempest-GroupSnapshotsTest-699199185 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-134496645 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-134496645, it is now deprecated. Please use the default quota class for default quota. Nov 06 11:45:06 devstack cinder-volume[87116]: DEBUG cinder.quota [None req-7065d2e0-40a8-4a67-8b8a-ec2735970b68 tempest-GroupSnapshotsTest-699199185 None] Created reservations ['306f95b9-b297-46e1-bfad-f6258016a911', '4408ce7a-a67d-4ad7-9bc7-166701cb4748', 'd06955fe-a8ca-4d6d-b117-5c7b694827e3', '0168a89c-13ad-4953-8ad1-d6ff97038e6c'] {{(pid=87116) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 11:45:06 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-7065d2e0-40a8-4a67-8b8a-ec2735970b68 tempest-GroupSnapshotsTest-699199185 None] group_snapshot 300aaaff-6f4d-4bd7-88bb-e7cdadac7846: deleted successfully Nov 06 11:45:07 devstack cinder-volume[87116]: DEBUG dbcounter [-] [87116] Writing DB stats cinder:SELECT=61,cinder:INSERT=18,cinder:UPDATE=73,cinder:DELETE=2 {{(pid=87116) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 11:45:07 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-b40ac060-65bd-4325-af4b-f3d4df0805a8 tempest-GroupSnapshotsTest-699199185 None] Acquiring lock "cinder-quobyte-61c77826-6240-47eb-bf20-5b48820e6dd6" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 11:45:07 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-b40ac060-65bd-4325-af4b-f3d4df0805a8 tempest-GroupSnapshotsTest-699199185 None] Lock "cinder-quobyte-61c77826-6240-47eb-bf20-5b48820e6dd6" acquired by "delete_volume" :: waited 0.038s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 11:45:07 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[028e0088-b08a-4172-9209-01924598cae3]: (4, 'qcow2') {{(pid=88420) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 11:45:07 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-b40ac060-65bd-4325-af4b-f3d4df0805a8 tempest-GroupSnapshotsTest-699199185 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-61c77826-6240-47eb-bf20-5b48820e6dd6 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:45:07 devstack sudo[90578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-61c77826-6240-47eb-bf20-5b48820e6dd6 Nov 06 11:45:07 devstack sudo[90578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:45:08 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-b40ac060-65bd-4325-af4b-f3d4df0805a8 tempest-GroupSnapshotsTest-699199185 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-61c77826-6240-47eb-bf20-5b48820e6dd6" returned: 0 in 0.738s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:45:08 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-b40ac060-65bd-4325-af4b-f3d4df0805a8 tempest-GroupSnapshotsTest-699199185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-61c77826-6240-47eb-bf20-5b48820e6dd6 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:45:08 devstack sudo[90578]: pam_unix(sudo:session): session closed for user root Nov 06 11:45:08 devstack sudo[90586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-61c77826-6240-47eb-bf20-5b48820e6dd6 Nov 06 11:45:08 devstack sudo[90586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:45:08 devstack sudo[90586]: pam_unix(sudo:session): session closed for user root Nov 06 11:45:08 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-b40ac060-65bd-4325-af4b-f3d4df0805a8 tempest-GroupSnapshotsTest-699199185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-61c77826-6240-47eb-bf20-5b48820e6dd6" returned: 0 in 0.544s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:45:08 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-b40ac060-65bd-4325-af4b-f3d4df0805a8 tempest-GroupSnapshotsTest-699199185 None] Lock "cinder-quobyte-61c77826-6240-47eb-bf20-5b48820e6dd6" released by "delete_volume" :: held 1.472s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 11:45:09 devstack cinder-volume[87116]: DEBUG cinder.quota [None req-b40ac060-65bd-4325-af4b-f3d4df0805a8 tempest-GroupSnapshotsTest-699199185 None] Created reservations ['86c5c72b-700a-4539-92c1-fbe67b457d2f'] {{(pid=87116) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 11:45:09 devstack cinder-volume[87116]: WARNING cinder.db.api [None req-b40ac060-65bd-4325-af4b-f3d4df0805a8 tempest-GroupSnapshotsTest-699199185 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-134496645'] Nov 06 11:45:09 devstack cinder-volume[87116]: DEBUG cinder.quota [None req-b40ac060-65bd-4325-af4b-f3d4df0805a8 tempest-GroupSnapshotsTest-699199185 None] Created reservations ['9df20162-b596-4dc4-a5d0-52fe7ed04aaa', '95c34933-8981-4ddf-9f75-21a4bec026a3', 'b05e343b-f38e-4f99-bdfb-fd572d058ce0', 'a9c0af95-f25a-4f38-acaa-04ba09c1d849'] {{(pid=87116) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 11:45:09 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-b40ac060-65bd-4325-af4b-f3d4df0805a8 tempest-GroupSnapshotsTest-699199185 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 11:45:09 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-b40ac060-65bd-4325-af4b-f3d4df0805a8 tempest-GroupSnapshotsTest-699199185 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 11:45:09 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-b40ac060-65bd-4325-af4b-f3d4df0805a8 tempest-GroupSnapshotsTest-699199185 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 11:45:09 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-b40ac060-65bd-4325-af4b-f3d4df0805a8 tempest-GroupSnapshotsTest-699199185 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 11:45:09 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-b40ac060-65bd-4325-af4b-f3d4df0805a8 tempest-GroupSnapshotsTest-699199185 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 11:45:09 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-b40ac060-65bd-4325-af4b-f3d4df0805a8 tempest-GroupSnapshotsTest-699199185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:45:09 devstack sudo[90648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756 Nov 06 11:45:09 devstack sudo[90648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:45:10 devstack sudo[90648]: pam_unix(sudo:session): session closed for user root Nov 06 11:45:10 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-b40ac060-65bd-4325-af4b-f3d4df0805a8 tempest-GroupSnapshotsTest-699199185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756" returned: 0 in 0.822s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:45:10 devstack cinder-volume[87116]: DEBUG cinder.manager [None req-b40ac060-65bd-4325-af4b-f3d4df0805a8 tempest-GroupSnapshotsTest-699199185 None] Notifying Schedulers of capabilities ... {{(pid=87116) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 11:45:10 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-b40ac060-65bd-4325-af4b-f3d4df0805a8 tempest-GroupSnapshotsTest-699199185 None] Delete group completed successfully. Nov 06 11:45:11 devstack cinder-volume[87116]: DEBUG dbcounter [-] [87116] Writing DB stats cinder:SELECT=70,cinder:UPDATE=83,cinder:DELETE=8,cinder:INSERT=15 {{(pid=87116) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 11:45:11 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-cfe15a02-5537-43dd-97a3-61530ab78034 tempest-GroupSnapshotsTest-699199185 None] Group tempest-GroupSnapshotsTest-Group-1923256265: creating Nov 06 11:45:11 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-cfe15a02-5537-43dd-97a3-61530ab78034 tempest-GroupSnapshotsTest-699199185 None] Group tempest-GroupSnapshotsTest-Group-1923256265: created successfully Nov 06 11:45:11 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-cfe15a02-5537-43dd-97a3-61530ab78034 tempest-GroupSnapshotsTest-699199185 None] Create group completed successfully. Nov 06 11:45:14 devstack cinder-volume[87116]: DEBUG cinder.volume.flows.manager.create_volume [None req-0d0c2223-0334-4fcb-b88f-3a276375958d tempest-GroupSnapshotsTest-699199185 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87116) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 11:45:14 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-0d0c2223-0334-4fcb-b88f-3a276375958d tempest-GroupSnapshotsTest-699199185 None] Flow 'volume_create_manager' (e2c293fc-7e34-4f9e-b02a-51c70056e1a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 11:45:14 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-0d0c2223-0334-4fcb-b88f-3a276375958d tempest-GroupSnapshotsTest-699199185 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c62c9229-eead-4889-b05b-853cb03c6fcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:45:14 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-0d0c2223-0334-4fcb-b88f-3a276375958d tempest-GroupSnapshotsTest-699199185 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c62c9229-eead-4889-b05b-853cb03c6fcf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T10:45:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-261670556',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=bb39e042-d6b7-4601-b089-5010761d7bff,host='devstack@QuobyteHD#QuobyteHD',id=3354e986-8f3f-4a1d-bc85-6d0e635129b7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ee185cb8d999442cbf24aef8f910d50c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T10:45:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T10:45:14Z,use_quota=True,user_id='8c4b1f0ecaba4aa4baef4335dae669d4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db60c6b7-1a6c-4921-aa98-befc3dd41d42),volume_type_id=db60c6b7-1a6c-4921-aa98-befc3dd41d42)' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:45:14 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-0d0c2223-0334-4fcb-b88f-3a276375958d tempest-GroupSnapshotsTest-699199185 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d5665615-4fdc-455c-ba01-359d47d6a34a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:45:14 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-0d0c2223-0334-4fcb-b88f-3a276375958d tempest-GroupSnapshotsTest-699199185 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d5665615-4fdc-455c-ba01-359d47d6a34a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:45:14 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-0d0c2223-0334-4fcb-b88f-3a276375958d tempest-GroupSnapshotsTest-699199185 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dbee2c1d-75bf-47ad-8471-bb9461c7d2f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:45:14 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-0d0c2223-0334-4fcb-b88f-3a276375958d tempest-GroupSnapshotsTest-699199185 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dbee2c1d-75bf-47ad-8471-bb9461c7d2f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3354e986-8f3f-4a1d-bc85-6d0e635129b7', 'volume_name': 'volume-3354e986-8f3f-4a1d-bc85-6d0e635129b7', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:45:14 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-0d0c2223-0334-4fcb-b88f-3a276375958d tempest-GroupSnapshotsTest-699199185 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (058dbdc3-d0ca-4974-94d1-fea66aa54195) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:45:14 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-0d0c2223-0334-4fcb-b88f-3a276375958d tempest-GroupSnapshotsTest-699199185 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (058dbdc3-d0ca-4974-94d1-fea66aa54195) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:45:14 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-0d0c2223-0334-4fcb-b88f-3a276375958d tempest-GroupSnapshotsTest-699199185 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (82a50fc8-ec0a-4458-9bc0-61d88aca2132) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:45:14 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-0d0c2223-0334-4fcb-b88f-3a276375958d tempest-GroupSnapshotsTest-699199185 None] Volume 3354e986-8f3f-4a1d-bc85-6d0e635129b7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3354e986-8f3f-4a1d-bc85-6d0e635129b7', 'volume_size': 1} Nov 06 11:45:14 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-0d0c2223-0334-4fcb-b88f-3a276375958d tempest-GroupSnapshotsTest-699199185 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 11:45:14 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-0d0c2223-0334-4fcb-b88f-3a276375958d tempest-GroupSnapshotsTest-699199185 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 11:45:14 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-0d0c2223-0334-4fcb-b88f-3a276375958d tempest-GroupSnapshotsTest-699199185 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=bb39e042-d6b7-4601-b089-5010761d7bff,created_at=2026-11-06T10:45:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-261670556',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=bb39e042-d6b7-4601-b089-5010761d7bff,host='devstack@QuobyteHD#QuobyteHD',id=3354e986-8f3f-4a1d-bc85-6d0e635129b7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ee185cb8d999442cbf24aef8f910d50c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T10:45:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T10:45:14Z,use_quota=True,user_id='8c4b1f0ecaba4aa4baef4335dae669d4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db60c6b7-1a6c-4921-aa98-befc3dd41d42),volume_type_id=db60c6b7-1a6c-4921-aa98-befc3dd41d42)}" {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 11:45:14 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-0d0c2223-0334-4fcb-b88f-3a276375958d tempest-GroupSnapshotsTest-699199185 None] Creating volume 3354e986-8f3f-4a1d-bc85-6d0e635129b7 {{(pid=87116) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 11:45:14 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-0d0c2223-0334-4fcb-b88f-3a276375958d tempest-GroupSnapshotsTest-699199185 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 11:45:14 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-0d0c2223-0334-4fcb-b88f-3a276375958d tempest-GroupSnapshotsTest-699199185 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 11:45:14 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-0d0c2223-0334-4fcb-b88f-3a276375958d tempest-GroupSnapshotsTest-699199185 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 11:45:14 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-0d0c2223-0334-4fcb-b88f-3a276375958d tempest-GroupSnapshotsTest-699199185 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 11:45:14 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-0d0c2223-0334-4fcb-b88f-3a276375958d tempest-GroupSnapshotsTest-699199185 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 11:45:14 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-0d0c2223-0334-4fcb-b88f-3a276375958d tempest-GroupSnapshotsTest-699199185 None] Selected osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f as target Quobyte volume. {{(pid=87116) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 11:45:14 devstack cinder-volume[87116]: INFO cinder.volume.drivers.remotefs [None req-0d0c2223-0334-4fcb-b88f-3a276375958d tempest-GroupSnapshotsTest-699199185 None] casted to osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f Nov 06 11:45:14 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-0d0c2223-0334-4fcb-b88f-3a276375958d tempest-GroupSnapshotsTest-699199185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-3354e986-8f3f-4a1d-bc85-6d0e635129b7 1073741824 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:45:14 devstack sudo[90668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-3354e986-8f3f-4a1d-bc85-6d0e635129b7 1073741824 Nov 06 11:45:14 devstack sudo[90668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:45:15 devstack sudo[90668]: pam_unix(sudo:session): session closed for user root Nov 06 11:45:15 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-0d0c2223-0334-4fcb-b88f-3a276375958d tempest-GroupSnapshotsTest-699199185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-3354e986-8f3f-4a1d-bc85-6d0e635129b7 1073741824" returned: 0 in 0.928s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:45:15 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-0d0c2223-0334-4fcb-b88f-3a276375958d tempest-GroupSnapshotsTest-699199185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-3354e986-8f3f-4a1d-bc85-6d0e635129b7 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:45:15 devstack sudo[90674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-3354e986-8f3f-4a1d-bc85-6d0e635129b7 Nov 06 11:45:15 devstack sudo[90674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:45:15 devstack sudo[90674]: pam_unix(sudo:session): session closed for user root Nov 06 11:45:15 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-0d0c2223-0334-4fcb-b88f-3a276375958d tempest-GroupSnapshotsTest-699199185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-3354e986-8f3f-4a1d-bc85-6d0e635129b7" returned: 0 in 0.503s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:45:15 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-0d0c2223-0334-4fcb-b88f-3a276375958d tempest-GroupSnapshotsTest-699199185 None] <== create_volume: return (1586ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f'} {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 11:45:15 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-0d0c2223-0334-4fcb-b88f-3a276375958d tempest-GroupSnapshotsTest-699199185 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.594s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 11:45:16 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-0d0c2223-0334-4fcb-b88f-3a276375958d tempest-GroupSnapshotsTest-699199185 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (82a50fc8-ec0a-4458-9bc0-61d88aca2132) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3354e986-8f3f-4a1d-bc85-6d0e635129b7', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:45:16 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-0d0c2223-0334-4fcb-b88f-3a276375958d tempest-GroupSnapshotsTest-699199185 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d35899bf-6f50-4ae4-aaae-59b7bba3de15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:45:16 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-0d0c2223-0334-4fcb-b88f-3a276375958d tempest-GroupSnapshotsTest-699199185 None] Volume volume-3354e986-8f3f-4a1d-bc85-6d0e635129b7 (3354e986-8f3f-4a1d-bc85-6d0e635129b7): created successfully Nov 06 11:45:16 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-0d0c2223-0334-4fcb-b88f-3a276375958d tempest-GroupSnapshotsTest-699199185 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d35899bf-6f50-4ae4-aaae-59b7bba3de15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:45:16 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-0d0c2223-0334-4fcb-b88f-3a276375958d tempest-GroupSnapshotsTest-699199185 None] Flow 'volume_create_manager' (e2c293fc-7e34-4f9e-b02a-51c70056e1a0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 11:45:16 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-0d0c2223-0334-4fcb-b88f-3a276375958d tempest-GroupSnapshotsTest-699199185 None] Created volume successfully. Nov 06 11:45:18 devstack cinder-volume[87116]: DEBUG cinder.volume.flows.manager.create_volume [None req-5a626971-bf91-497f-864f-1ff413c70e99 tempest-GroupSnapshotsTest-699199185 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87116) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 11:45:18 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-5a626971-bf91-497f-864f-1ff413c70e99 tempest-GroupSnapshotsTest-699199185 None] Flow 'volume_create_manager' (c8bc051f-5684-4a00-8c3a-ab06fc4bbcc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 11:45:18 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-5a626971-bf91-497f-864f-1ff413c70e99 tempest-GroupSnapshotsTest-699199185 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7e9ee7b1-acc8-4486-ba32-b97a0113d081) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:45:18 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-5a626971-bf91-497f-864f-1ff413c70e99 tempest-GroupSnapshotsTest-699199185 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7e9ee7b1-acc8-4486-ba32-b97a0113d081) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T10:45:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1720688799',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=bb39e042-d6b7-4601-b089-5010761d7bff,host='devstack@QuobyteHD#QuobyteHD',id=03ebea23-55b7-4cda-9e44-eeb8c22482f9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ee185cb8d999442cbf24aef8f910d50c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T10:45:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T10:45:19Z,use_quota=True,user_id='8c4b1f0ecaba4aa4baef4335dae669d4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db60c6b7-1a6c-4921-aa98-befc3dd41d42),volume_type_id=db60c6b7-1a6c-4921-aa98-befc3dd41d42)' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:45:18 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-5a626971-bf91-497f-864f-1ff413c70e99 tempest-GroupSnapshotsTest-699199185 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f3d484e1-50ea-40ed-afcb-03511b0a7c11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:45:18 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-5a626971-bf91-497f-864f-1ff413c70e99 tempest-GroupSnapshotsTest-699199185 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f3d484e1-50ea-40ed-afcb-03511b0a7c11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:45:18 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-5a626971-bf91-497f-864f-1ff413c70e99 tempest-GroupSnapshotsTest-699199185 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (31f6645f-1e9b-4c3d-bd3a-4aebd61afc86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:45:18 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-5a626971-bf91-497f-864f-1ff413c70e99 tempest-GroupSnapshotsTest-699199185 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (31f6645f-1e9b-4c3d-bd3a-4aebd61afc86) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '03ebea23-55b7-4cda-9e44-eeb8c22482f9', 'volume_name': 'volume-03ebea23-55b7-4cda-9e44-eeb8c22482f9', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:45:18 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-5a626971-bf91-497f-864f-1ff413c70e99 tempest-GroupSnapshotsTest-699199185 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7591ba36-ed91-4e35-b3e9-5cc2e4c66ddb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:45:18 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-5a626971-bf91-497f-864f-1ff413c70e99 tempest-GroupSnapshotsTest-699199185 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7591ba36-ed91-4e35-b3e9-5cc2e4c66ddb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:45:18 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-5a626971-bf91-497f-864f-1ff413c70e99 tempest-GroupSnapshotsTest-699199185 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (606b0c0f-acc7-4dff-8ee2-124ed52b183f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:45:18 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-5a626971-bf91-497f-864f-1ff413c70e99 tempest-GroupSnapshotsTest-699199185 None] Volume 03ebea23-55b7-4cda-9e44-eeb8c22482f9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-03ebea23-55b7-4cda-9e44-eeb8c22482f9', 'volume_size': 1} Nov 06 11:45:18 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-5a626971-bf91-497f-864f-1ff413c70e99 tempest-GroupSnapshotsTest-699199185 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 11:45:18 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-5a626971-bf91-497f-864f-1ff413c70e99 tempest-GroupSnapshotsTest-699199185 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 11:45:18 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-5a626971-bf91-497f-864f-1ff413c70e99 tempest-GroupSnapshotsTest-699199185 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=bb39e042-d6b7-4601-b089-5010761d7bff,created_at=2026-11-06T10:45:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1720688799',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=bb39e042-d6b7-4601-b089-5010761d7bff,host='devstack@QuobyteHD#QuobyteHD',id=03ebea23-55b7-4cda-9e44-eeb8c22482f9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ee185cb8d999442cbf24aef8f910d50c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T10:45:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T10:45:19Z,use_quota=True,user_id='8c4b1f0ecaba4aa4baef4335dae669d4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(db60c6b7-1a6c-4921-aa98-befc3dd41d42),volume_type_id=db60c6b7-1a6c-4921-aa98-befc3dd41d42)}" {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 11:45:18 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-5a626971-bf91-497f-864f-1ff413c70e99 tempest-GroupSnapshotsTest-699199185 None] Creating volume 03ebea23-55b7-4cda-9e44-eeb8c22482f9 {{(pid=87116) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 11:45:18 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-5a626971-bf91-497f-864f-1ff413c70e99 tempest-GroupSnapshotsTest-699199185 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 11:45:18 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-5a626971-bf91-497f-864f-1ff413c70e99 tempest-GroupSnapshotsTest-699199185 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 11:45:18 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-5a626971-bf91-497f-864f-1ff413c70e99 tempest-GroupSnapshotsTest-699199185 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 11:45:18 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-5a626971-bf91-497f-864f-1ff413c70e99 tempest-GroupSnapshotsTest-699199185 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 11:45:18 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-5a626971-bf91-497f-864f-1ff413c70e99 tempest-GroupSnapshotsTest-699199185 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 11:45:18 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-5a626971-bf91-497f-864f-1ff413c70e99 tempest-GroupSnapshotsTest-699199185 None] Selected osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f as target Quobyte volume. {{(pid=87116) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 11:45:18 devstack cinder-volume[87116]: INFO cinder.volume.drivers.remotefs [None req-5a626971-bf91-497f-864f-1ff413c70e99 tempest-GroupSnapshotsTest-699199185 None] casted to osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f Nov 06 11:45:18 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-5a626971-bf91-497f-864f-1ff413c70e99 tempest-GroupSnapshotsTest-699199185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-03ebea23-55b7-4cda-9e44-eeb8c22482f9 1073741824 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:45:18 devstack sudo[90704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-03ebea23-55b7-4cda-9e44-eeb8c22482f9 1073741824 Nov 06 11:45:18 devstack sudo[90704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:45:20 devstack sudo[90704]: pam_unix(sudo:session): session closed for user root Nov 06 11:45:20 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-5a626971-bf91-497f-864f-1ff413c70e99 tempest-GroupSnapshotsTest-699199185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-03ebea23-55b7-4cda-9e44-eeb8c22482f9 1073741824" returned: 0 in 1.333s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:45:20 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-5a626971-bf91-497f-864f-1ff413c70e99 tempest-GroupSnapshotsTest-699199185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-03ebea23-55b7-4cda-9e44-eeb8c22482f9 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:45:20 devstack sudo[90718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-03ebea23-55b7-4cda-9e44-eeb8c22482f9 Nov 06 11:45:20 devstack sudo[90718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:45:20 devstack sudo[90718]: pam_unix(sudo:session): session closed for user root Nov 06 11:45:20 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-5a626971-bf91-497f-864f-1ff413c70e99 tempest-GroupSnapshotsTest-699199185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-03ebea23-55b7-4cda-9e44-eeb8c22482f9" returned: 0 in 0.413s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:45:20 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-5a626971-bf91-497f-864f-1ff413c70e99 tempest-GroupSnapshotsTest-699199185 None] <== create_volume: return (1856ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f'} {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 11:45:20 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-5a626971-bf91-497f-864f-1ff413c70e99 tempest-GroupSnapshotsTest-699199185 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.858s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 11:45:20 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-5a626971-bf91-497f-864f-1ff413c70e99 tempest-GroupSnapshotsTest-699199185 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (606b0c0f-acc7-4dff-8ee2-124ed52b183f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-03ebea23-55b7-4cda-9e44-eeb8c22482f9', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:45:20 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-5a626971-bf91-497f-864f-1ff413c70e99 tempest-GroupSnapshotsTest-699199185 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5cb81805-3c4b-4b58-b37d-c8b998940e16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:45:20 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-5a626971-bf91-497f-864f-1ff413c70e99 tempest-GroupSnapshotsTest-699199185 None] Volume volume-03ebea23-55b7-4cda-9e44-eeb8c22482f9 (03ebea23-55b7-4cda-9e44-eeb8c22482f9): created successfully Nov 06 11:45:20 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-5a626971-bf91-497f-864f-1ff413c70e99 tempest-GroupSnapshotsTest-699199185 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5cb81805-3c4b-4b58-b37d-c8b998940e16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:45:20 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-5a626971-bf91-497f-864f-1ff413c70e99 tempest-GroupSnapshotsTest-699199185 None] Flow 'volume_create_manager' (c8bc051f-5684-4a00-8c3a-ab06fc4bbcc0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 11:45:20 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-5a626971-bf91-497f-864f-1ff413c70e99 tempest-GroupSnapshotsTest-699199185 None] Created volume successfully. Nov 06 11:45:20 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [req-b566d58c-0005-4b3e-a560-e4e153e1dbf5 req-156f0dfe-5bd6-47d1-802b-c147d66b4dae tempest-AttachVolumeShelveTestJSON-1508542063 None] No connector for attachment 1adc7494-8f30-451d-8309-fc1743ef2ae0; skipping storage backend terminate_connection call. {{(pid=87116) _connection_terminate /opt/stack/cinder/cinder/volume/manager.py:5010}} Nov 06 11:45:20 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [req-b566d58c-0005-4b3e-a560-e4e153e1dbf5 req-156f0dfe-5bd6-47d1-802b-c147d66b4dae tempest-AttachVolumeShelveTestJSON-1508542063 None] Deleting attachment 1adc7494-8f30-451d-8309-fc1743ef2ae0. {{(pid=87116) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 06 11:45:22 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-90c99187-bbc5-4720-9ba5-176b2c0f8e08 tempest-GroupSnapshotsTest-699199185 None] Update group completed successfully. Nov 06 11:45:23 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-3ef78f2a-bb71-4f87-bb94-7095bd3a48fb tempest-GroupSnapshotsTest-699199185 None] Update group completed successfully. Nov 06 11:45:24 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-f55df253-355c-4b6f-966c-f061884fc022 tempest-GroupSnapshotsTest-699199185 None] Update group completed successfully. Nov 06 11:45:26 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-2614fc46-9d00-4abb-98a0-f3379a1dd9f8 tempest-GroupSnapshotsTest-699199185 None] Update group completed successfully. Nov 06 11:45:27 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-989ccd12-04bd-446e-9822-29c030bd606c tempest-GroupSnapshotsTest-699199185 None] GroupSnapshot f58af3c1-c15d-4818-b21d-fda227dc7ba3: creating. Nov 06 11:45:27 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-989ccd12-04bd-446e-9822-29c030bd606c tempest-GroupSnapshotsTest-699199185 None] Group snapshot f58af3c1-c15d-4818-b21d-fda227dc7ba3: creating. {{(pid=87116) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Nov 06 11:45:27 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-989ccd12-04bd-446e-9822-29c030bd606c tempest-GroupSnapshotsTest-699199185 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 11:45:27 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-989ccd12-04bd-446e-9822-29c030bd606c tempest-GroupSnapshotsTest-699199185 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 11:45:27 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-989ccd12-04bd-446e-9822-29c030bd606c tempest-GroupSnapshotsTest-699199185 None] Creating offline snapshot 684f8111-18a8-492d-9b37-2316b0a708d7 of volume 3354e986-8f3f-4a1d-bc85-6d0e635129b7 {{(pid=87116) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 06 11:45:27 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe8669f3-2fc4-4ee5-b2c9-650e21edb6d7]: (4, 'qcow2') {{(pid=88420) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 11:45:27 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-989ccd12-04bd-446e-9822-29c030bd606c tempest-GroupSnapshotsTest-699199185 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-3354e986-8f3f-4a1d-bc85-6d0e635129b7 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:45:28 devstack sudo[90905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-3354e986-8f3f-4a1d-bc85-6d0e635129b7 Nov 06 11:45:28 devstack sudo[90905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:45:28 devstack sudo[90905]: pam_unix(sudo:session): session closed for user root Nov 06 11:45:28 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-989ccd12-04bd-446e-9822-29c030bd606c tempest-GroupSnapshotsTest-699199185 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-3354e986-8f3f-4a1d-bc85-6d0e635129b7" returned: 0 in 0.578s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:45:28 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-989ccd12-04bd-446e-9822-29c030bd606c tempest-GroupSnapshotsTest-699199185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-3354e986-8f3f-4a1d-bc85-6d0e635129b7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-3354e986-8f3f-4a1d-bc85-6d0e635129b7.684f8111-18a8-492d-9b37-2316b0a708d7 1G {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:45:28 devstack sudo[90912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-3354e986-8f3f-4a1d-bc85-6d0e635129b7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-3354e986-8f3f-4a1d-bc85-6d0e635129b7.684f8111-18a8-492d-9b37-2316b0a708d7 1G Nov 06 11:45:28 devstack sudo[90912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:45:29 devstack sudo[90912]: pam_unix(sudo:session): session closed for user root Nov 06 11:45:29 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-989ccd12-04bd-446e-9822-29c030bd606c tempest-GroupSnapshotsTest-699199185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-3354e986-8f3f-4a1d-bc85-6d0e635129b7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-3354e986-8f3f-4a1d-bc85-6d0e635129b7.684f8111-18a8-492d-9b37-2316b0a708d7 1G" returned: 0 in 0.782s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:45:29 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-989ccd12-04bd-446e-9822-29c030bd606c tempest-GroupSnapshotsTest-699199185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3354e986-8f3f-4a1d-bc85-6d0e635129b7 -F qcow2 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-3354e986-8f3f-4a1d-bc85-6d0e635129b7.684f8111-18a8-492d-9b37-2316b0a708d7 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:45:29 devstack sudo[90940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3354e986-8f3f-4a1d-bc85-6d0e635129b7 -F qcow2 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-3354e986-8f3f-4a1d-bc85-6d0e635129b7.684f8111-18a8-492d-9b37-2316b0a708d7 Nov 06 11:45:29 devstack sudo[90940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:45:29 devstack sudo[90940]: pam_unix(sudo:session): session closed for user root Nov 06 11:45:29 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-989ccd12-04bd-446e-9822-29c030bd606c tempest-GroupSnapshotsTest-699199185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3354e986-8f3f-4a1d-bc85-6d0e635129b7 -F qcow2 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-3354e986-8f3f-4a1d-bc85-6d0e635129b7.684f8111-18a8-492d-9b37-2316b0a708d7" returned: 0 in 0.533s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:45:29 devstack cinder-volume[87116]: WARNING cinder.volume.drivers.remotefs [None req-989ccd12-04bd-446e-9822-29c030bd606c tempest-GroupSnapshotsTest-699199185 None] /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-3354e986-8f3f-4a1d-bc85-6d0e635129b7.684f8111-18a8-492d-9b37-2316b0a708d7 is being set with open permissions: ugo+rw: NotImplementedError Nov 06 11:45:29 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-989ccd12-04bd-446e-9822-29c030bd606c tempest-GroupSnapshotsTest-699199185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-3354e986-8f3f-4a1d-bc85-6d0e635129b7.684f8111-18a8-492d-9b37-2316b0a708d7 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:45:29 devstack sudo[90945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-3354e986-8f3f-4a1d-bc85-6d0e635129b7.684f8111-18a8-492d-9b37-2316b0a708d7 Nov 06 11:45:29 devstack sudo[90945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:45:30 devstack sudo[90945]: pam_unix(sudo:session): session closed for user root Nov 06 11:45:30 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-989ccd12-04bd-446e-9822-29c030bd606c tempest-GroupSnapshotsTest-699199185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-3354e986-8f3f-4a1d-bc85-6d0e635129b7.684f8111-18a8-492d-9b37-2316b0a708d7" returned: 0 in 0.410s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:45:30 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-989ccd12-04bd-446e-9822-29c030bd606c tempest-GroupSnapshotsTest-699199185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-3354e986-8f3f-4a1d-bc85-6d0e635129b7.info {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:45:30 devstack sudo[90950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-3354e986-8f3f-4a1d-bc85-6d0e635129b7.info Nov 06 11:45:30 devstack sudo[90950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:45:30 devstack sudo[90950]: pam_unix(sudo:session): session closed for user root Nov 06 11:45:30 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-989ccd12-04bd-446e-9822-29c030bd606c tempest-GroupSnapshotsTest-699199185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-3354e986-8f3f-4a1d-bc85-6d0e635129b7.info" returned: 0 in 0.306s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:45:30 devstack cinder-volume[87116]: WARNING cinder.volume.drivers.remotefs [None req-989ccd12-04bd-446e-9822-29c030bd606c tempest-GroupSnapshotsTest-699199185 None] /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-3354e986-8f3f-4a1d-bc85-6d0e635129b7.info is being set with open permissions: ugo+rw: NotImplementedError Nov 06 11:45:30 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-989ccd12-04bd-446e-9822-29c030bd606c tempest-GroupSnapshotsTest-699199185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-3354e986-8f3f-4a1d-bc85-6d0e635129b7.info {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:45:30 devstack sudo[90963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-3354e986-8f3f-4a1d-bc85-6d0e635129b7.info Nov 06 11:45:30 devstack sudo[90963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:45:30 devstack sudo[90963]: pam_unix(sudo:session): session closed for user root Nov 06 11:45:30 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-989ccd12-04bd-446e-9822-29c030bd606c tempest-GroupSnapshotsTest-699199185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-3354e986-8f3f-4a1d-bc85-6d0e635129b7.info" returned: 0 in 0.276s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:45:30 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-989ccd12-04bd-446e-9822-29c030bd606c tempest-GroupSnapshotsTest-699199185 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.029s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 11:45:30 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-989ccd12-04bd-446e-9822-29c030bd606c tempest-GroupSnapshotsTest-699199185 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 11:45:30 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-989ccd12-04bd-446e-9822-29c030bd606c tempest-GroupSnapshotsTest-699199185 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 11:45:30 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-989ccd12-04bd-446e-9822-29c030bd606c tempest-GroupSnapshotsTest-699199185 None] Creating offline snapshot 96d946fc-6807-46f9-932d-6b45cfe7d285 of volume 03ebea23-55b7-4cda-9e44-eeb8c22482f9 {{(pid=87116) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 06 11:45:31 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[b96d0b97-40f7-4726-b6a7-09c2e3c0ecb5]: (4, 'qcow2') {{(pid=88420) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 11:45:31 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-989ccd12-04bd-446e-9822-29c030bd606c tempest-GroupSnapshotsTest-699199185 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-03ebea23-55b7-4cda-9e44-eeb8c22482f9 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:45:31 devstack sudo[90971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-03ebea23-55b7-4cda-9e44-eeb8c22482f9 Nov 06 11:45:31 devstack sudo[90971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:45:31 devstack sudo[90971]: pam_unix(sudo:session): session closed for user root Nov 06 11:45:31 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-989ccd12-04bd-446e-9822-29c030bd606c tempest-GroupSnapshotsTest-699199185 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-03ebea23-55b7-4cda-9e44-eeb8c22482f9" returned: 0 in 0.460s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:45:31 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-989ccd12-04bd-446e-9822-29c030bd606c tempest-GroupSnapshotsTest-699199185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-03ebea23-55b7-4cda-9e44-eeb8c22482f9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-03ebea23-55b7-4cda-9e44-eeb8c22482f9.96d946fc-6807-46f9-932d-6b45cfe7d285 1G {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:45:31 devstack sudo[90986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-03ebea23-55b7-4cda-9e44-eeb8c22482f9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-03ebea23-55b7-4cda-9e44-eeb8c22482f9.96d946fc-6807-46f9-932d-6b45cfe7d285 1G Nov 06 11:45:31 devstack sudo[90986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:45:31 devstack sudo[90986]: pam_unix(sudo:session): session closed for user root Nov 06 11:45:31 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-989ccd12-04bd-446e-9822-29c030bd606c tempest-GroupSnapshotsTest-699199185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-03ebea23-55b7-4cda-9e44-eeb8c22482f9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-03ebea23-55b7-4cda-9e44-eeb8c22482f9.96d946fc-6807-46f9-932d-6b45cfe7d285 1G" returned: 0 in 0.464s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:45:31 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-989ccd12-04bd-446e-9822-29c030bd606c tempest-GroupSnapshotsTest-699199185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-03ebea23-55b7-4cda-9e44-eeb8c22482f9 -F qcow2 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-03ebea23-55b7-4cda-9e44-eeb8c22482f9.96d946fc-6807-46f9-932d-6b45cfe7d285 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:45:31 devstack sudo[91002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-03ebea23-55b7-4cda-9e44-eeb8c22482f9 -F qcow2 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-03ebea23-55b7-4cda-9e44-eeb8c22482f9.96d946fc-6807-46f9-932d-6b45cfe7d285 Nov 06 11:45:31 devstack sudo[91002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:45:32 devstack sudo[91002]: pam_unix(sudo:session): session closed for user root Nov 06 11:45:32 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-989ccd12-04bd-446e-9822-29c030bd606c tempest-GroupSnapshotsTest-699199185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-03ebea23-55b7-4cda-9e44-eeb8c22482f9 -F qcow2 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-03ebea23-55b7-4cda-9e44-eeb8c22482f9.96d946fc-6807-46f9-932d-6b45cfe7d285" returned: 0 in 0.335s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:45:32 devstack cinder-volume[87116]: WARNING cinder.volume.drivers.remotefs [None req-989ccd12-04bd-446e-9822-29c030bd606c tempest-GroupSnapshotsTest-699199185 None] /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-03ebea23-55b7-4cda-9e44-eeb8c22482f9.96d946fc-6807-46f9-932d-6b45cfe7d285 is being set with open permissions: ugo+rw: NotImplementedError Nov 06 11:45:32 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-989ccd12-04bd-446e-9822-29c030bd606c tempest-GroupSnapshotsTest-699199185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-03ebea23-55b7-4cda-9e44-eeb8c22482f9.96d946fc-6807-46f9-932d-6b45cfe7d285 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:45:32 devstack sudo[91008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-03ebea23-55b7-4cda-9e44-eeb8c22482f9.96d946fc-6807-46f9-932d-6b45cfe7d285 Nov 06 11:45:32 devstack sudo[91008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:45:32 devstack sudo[91008]: pam_unix(sudo:session): session closed for user root Nov 06 11:45:32 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-989ccd12-04bd-446e-9822-29c030bd606c tempest-GroupSnapshotsTest-699199185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-03ebea23-55b7-4cda-9e44-eeb8c22482f9.96d946fc-6807-46f9-932d-6b45cfe7d285" returned: 0 in 0.299s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:45:32 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-989ccd12-04bd-446e-9822-29c030bd606c tempest-GroupSnapshotsTest-699199185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-03ebea23-55b7-4cda-9e44-eeb8c22482f9.info {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:45:32 devstack sudo[91013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-03ebea23-55b7-4cda-9e44-eeb8c22482f9.info Nov 06 11:45:32 devstack sudo[91013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:45:32 devstack sudo[91013]: pam_unix(sudo:session): session closed for user root Nov 06 11:45:32 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-989ccd12-04bd-446e-9822-29c030bd606c tempest-GroupSnapshotsTest-699199185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-03ebea23-55b7-4cda-9e44-eeb8c22482f9.info" returned: 0 in 0.321s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:45:32 devstack cinder-volume[87116]: WARNING cinder.volume.drivers.remotefs [None req-989ccd12-04bd-446e-9822-29c030bd606c tempest-GroupSnapshotsTest-699199185 None] /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-03ebea23-55b7-4cda-9e44-eeb8c22482f9.info is being set with open permissions: ugo+rw: NotImplementedError Nov 06 11:45:32 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-989ccd12-04bd-446e-9822-29c030bd606c tempest-GroupSnapshotsTest-699199185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-03ebea23-55b7-4cda-9e44-eeb8c22482f9.info {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:45:33 devstack sudo[91016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-03ebea23-55b7-4cda-9e44-eeb8c22482f9.info Nov 06 11:45:33 devstack sudo[91016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:45:33 devstack sudo[91016]: pam_unix(sudo:session): session closed for user root Nov 06 11:45:33 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-989ccd12-04bd-446e-9822-29c030bd606c tempest-GroupSnapshotsTest-699199185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-03ebea23-55b7-4cda-9e44-eeb8c22482f9.info" returned: 0 in 0.309s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:45:33 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-989ccd12-04bd-446e-9822-29c030bd606c tempest-GroupSnapshotsTest-699199185 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.359s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 11:45:33 devstack cinder-volume[87116]: DEBUG cinder.volume.flows.manager.create_volume [None req-08175524-949d-4a34-833c-e885444eb6e4 tempest-ServersNegativeTestJSON-793423570 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87116) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 11:45:33 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-08175524-949d-4a34-833c-e885444eb6e4 tempest-ServersNegativeTestJSON-793423570 None] Flow 'volume_create_manager' (9b2029f8-efd0-442f-9c2b-baf5380af3d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 11:45:33 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-08175524-949d-4a34-833c-e885444eb6e4 tempest-ServersNegativeTestJSON-793423570 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (be0745ea-0ca2-4134-b688-32e8d6ff2106) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:45:33 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-08175524-949d-4a34-833c-e885444eb6e4 tempest-ServersNegativeTestJSON-793423570 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (be0745ea-0ca2-4134-b688-32e8d6ff2106) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T10:45:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1928286952',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b4cc2df9-5c7f-46f8-875f-6167d14d2102,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='790f9b0fd3714c61b96bc16709b00032',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T10:45:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T10:45:33Z,use_quota=True,user_id='1114e465c2344d41a7301a40a68d7813',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(34d3b144-d9b7-480a-a2e3-01e45f3d54c1),volume_type_id=34d3b144-d9b7-480a-a2e3-01e45f3d54c1)' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:45:33 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-08175524-949d-4a34-833c-e885444eb6e4 tempest-ServersNegativeTestJSON-793423570 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d8658257-9dcf-42ef-9edf-b63acc93f91a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:45:33 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-08175524-949d-4a34-833c-e885444eb6e4 tempest-ServersNegativeTestJSON-793423570 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d8658257-9dcf-42ef-9edf-b63acc93f91a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:45:33 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-08175524-949d-4a34-833c-e885444eb6e4 tempest-ServersNegativeTestJSON-793423570 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d39bf218-bfda-41b0-8756-24bc071317e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:45:33 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-08175524-949d-4a34-833c-e885444eb6e4 tempest-ServersNegativeTestJSON-793423570 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d39bf218-bfda-41b0-8756-24bc071317e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b4cc2df9-5c7f-46f8-875f-6167d14d2102', 'volume_name': 'volume-b4cc2df9-5c7f-46f8-875f-6167d14d2102', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:45:33 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-08175524-949d-4a34-833c-e885444eb6e4 tempest-ServersNegativeTestJSON-793423570 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6263a4fb-b89c-4962-9362-37c37250986c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:45:33 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-08175524-949d-4a34-833c-e885444eb6e4 tempest-ServersNegativeTestJSON-793423570 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6263a4fb-b89c-4962-9362-37c37250986c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:45:33 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-08175524-949d-4a34-833c-e885444eb6e4 tempest-ServersNegativeTestJSON-793423570 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (485b6ad7-ca7b-4668-bc00-edeb4bd6acdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:45:33 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-08175524-949d-4a34-833c-e885444eb6e4 tempest-ServersNegativeTestJSON-793423570 None] Volume b4cc2df9-5c7f-46f8-875f-6167d14d2102: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b4cc2df9-5c7f-46f8-875f-6167d14d2102', 'volume_size': 1} Nov 06 11:45:33 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-08175524-949d-4a34-833c-e885444eb6e4 tempest-ServersNegativeTestJSON-793423570 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 11:45:33 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-08175524-949d-4a34-833c-e885444eb6e4 tempest-ServersNegativeTestJSON-793423570 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 11:45:33 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-08175524-949d-4a34-833c-e885444eb6e4 tempest-ServersNegativeTestJSON-793423570 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T10:45:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1928286952',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b4cc2df9-5c7f-46f8-875f-6167d14d2102,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='790f9b0fd3714c61b96bc16709b00032',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T10:45:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T10:45:33Z,use_quota=True,user_id='1114e465c2344d41a7301a40a68d7813',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(34d3b144-d9b7-480a-a2e3-01e45f3d54c1),volume_type_id=34d3b144-d9b7-480a-a2e3-01e45f3d54c1)}" {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 11:45:33 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-08175524-949d-4a34-833c-e885444eb6e4 tempest-ServersNegativeTestJSON-793423570 None] Creating volume b4cc2df9-5c7f-46f8-875f-6167d14d2102 {{(pid=87116) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 11:45:33 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-08175524-949d-4a34-833c-e885444eb6e4 tempest-ServersNegativeTestJSON-793423570 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 11:45:33 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-08175524-949d-4a34-833c-e885444eb6e4 tempest-ServersNegativeTestJSON-793423570 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 11:45:33 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-08175524-949d-4a34-833c-e885444eb6e4 tempest-ServersNegativeTestJSON-793423570 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 11:45:33 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-08175524-949d-4a34-833c-e885444eb6e4 tempest-ServersNegativeTestJSON-793423570 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 11:45:33 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-08175524-949d-4a34-833c-e885444eb6e4 tempest-ServersNegativeTestJSON-793423570 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 11:45:33 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-08175524-949d-4a34-833c-e885444eb6e4 tempest-ServersNegativeTestJSON-793423570 None] Selected osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f as target Quobyte volume. {{(pid=87116) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 11:45:33 devstack cinder-volume[87116]: INFO cinder.volume.drivers.remotefs [None req-08175524-949d-4a34-833c-e885444eb6e4 tempest-ServersNegativeTestJSON-793423570 None] casted to osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f Nov 06 11:45:33 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-08175524-949d-4a34-833c-e885444eb6e4 tempest-ServersNegativeTestJSON-793423570 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-b4cc2df9-5c7f-46f8-875f-6167d14d2102 1073741824 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:45:33 devstack sudo[91025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-b4cc2df9-5c7f-46f8-875f-6167d14d2102 1073741824 Nov 06 11:45:33 devstack sudo[91025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:45:33 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-989ccd12-04bd-446e-9822-29c030bd606c tempest-GroupSnapshotsTest-699199185 None] group_snapshot f58af3c1-c15d-4818-b21d-fda227dc7ba3: created successfully Nov 06 11:45:34 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-8f641777-25cd-4f93-941a-0c2a2a6f6056 tempest-GroupSnapshotsTest-699199185 None] group_snapshot f58af3c1-c15d-4818-b21d-fda227dc7ba3: deleting Nov 06 11:45:34 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-8f641777-25cd-4f93-941a-0c2a2a6f6056 tempest-GroupSnapshotsTest-699199185 None] group_snapshot f58af3c1-c15d-4818-b21d-fda227dc7ba3: deleting {{(pid=87116) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Nov 06 11:45:35 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-8f641777-25cd-4f93-941a-0c2a2a6f6056 tempest-GroupSnapshotsTest-699199185 None] Acquiring lock "cinder-quobyte-3354e986-8f3f-4a1d-bc85-6d0e635129b7" by "delete_snapshot" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 11:45:35 devstack sudo[91025]: pam_unix(sudo:session): session closed for user root Nov 06 11:45:35 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-08175524-949d-4a34-833c-e885444eb6e4 tempest-ServersNegativeTestJSON-793423570 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-b4cc2df9-5c7f-46f8-875f-6167d14d2102 1073741824" returned: 0 in 1.598s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:45:35 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-8f641777-25cd-4f93-941a-0c2a2a6f6056 tempest-GroupSnapshotsTest-699199185 None] Lock "cinder-quobyte-3354e986-8f3f-4a1d-bc85-6d0e635129b7" acquired by "delete_snapshot" :: waited 0.063s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 11:45:35 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-8f641777-25cd-4f93-941a-0c2a2a6f6056 tempest-GroupSnapshotsTest-699199185 None] Acquiring lock "cinder-quobyte-684f8111-18a8-492d-9b37-2316b0a708d7" by "_delete_snapshot" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 11:45:35 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-8f641777-25cd-4f93-941a-0c2a2a6f6056 tempest-GroupSnapshotsTest-699199185 None] Lock "cinder-quobyte-684f8111-18a8-492d-9b37-2316b0a708d7" acquired by "_delete_snapshot" :: waited 0.066s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 11:45:35 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-8f641777-25cd-4f93-941a-0c2a2a6f6056 tempest-GroupSnapshotsTest-699199185 None] Deleting offline snapshot 684f8111-18a8-492d-9b37-2316b0a708d7 of volume 3354e986-8f3f-4a1d-bc85-6d0e635129b7 {{(pid=87116) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 06 11:45:35 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-8f641777-25cd-4f93-941a-0c2a2a6f6056 tempest-GroupSnapshotsTest-699199185 None] snapshot_file for this snap is: volume-3354e986-8f3f-4a1d-bc85-6d0e635129b7.684f8111-18a8-492d-9b37-2316b0a708d7 {{(pid=87116) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 06 11:45:35 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[772b7c62-cddc-45ee-a5f0-76ad65eb25f1]: (4, 'qcow2') {{(pid=88420) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 11:45:35 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-8f641777-25cd-4f93-941a-0c2a2a6f6056 tempest-GroupSnapshotsTest-699199185 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-3354e986-8f3f-4a1d-bc85-6d0e635129b7.684f8111-18a8-492d-9b37-2316b0a708d7 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:45:35 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-08175524-949d-4a34-833c-e885444eb6e4 tempest-ServersNegativeTestJSON-793423570 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-b4cc2df9-5c7f-46f8-875f-6167d14d2102 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:45:35 devstack sudo[91101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-b4cc2df9-5c7f-46f8-875f-6167d14d2102 Nov 06 11:45:35 devstack sudo[91101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:45:35 devstack sudo[91100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-3354e986-8f3f-4a1d-bc85-6d0e635129b7.684f8111-18a8-492d-9b37-2316b0a708d7 Nov 06 11:45:35 devstack sudo[91100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:45:35 devstack sudo[91101]: pam_unix(sudo:session): session closed for user root Nov 06 11:45:35 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-08175524-949d-4a34-833c-e885444eb6e4 tempest-ServersNegativeTestJSON-793423570 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-b4cc2df9-5c7f-46f8-875f-6167d14d2102" returned: 0 in 0.340s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:45:35 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-08175524-949d-4a34-833c-e885444eb6e4 tempest-ServersNegativeTestJSON-793423570 None] <== create_volume: return (2155ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f'} {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 11:45:35 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-08175524-949d-4a34-833c-e885444eb6e4 tempest-ServersNegativeTestJSON-793423570 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.158s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 11:45:35 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-08175524-949d-4a34-833c-e885444eb6e4 tempest-ServersNegativeTestJSON-793423570 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (485b6ad7-ca7b-4668-bc00-edeb4bd6acdc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b4cc2df9-5c7f-46f8-875f-6167d14d2102', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:45:35 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-08175524-949d-4a34-833c-e885444eb6e4 tempest-ServersNegativeTestJSON-793423570 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cc094f40-cacd-462d-9b22-af044b6fcc80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:45:35 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-08175524-949d-4a34-833c-e885444eb6e4 tempest-ServersNegativeTestJSON-793423570 None] Volume volume-b4cc2df9-5c7f-46f8-875f-6167d14d2102 (b4cc2df9-5c7f-46f8-875f-6167d14d2102): created successfully Nov 06 11:45:35 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-08175524-949d-4a34-833c-e885444eb6e4 tempest-ServersNegativeTestJSON-793423570 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cc094f40-cacd-462d-9b22-af044b6fcc80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:45:35 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-08175524-949d-4a34-833c-e885444eb6e4 tempest-ServersNegativeTestJSON-793423570 None] Flow 'volume_create_manager' (9b2029f8-efd0-442f-9c2b-baf5380af3d3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 11:45:35 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-08175524-949d-4a34-833c-e885444eb6e4 tempest-ServersNegativeTestJSON-793423570 None] Created volume successfully. Nov 06 11:45:36 devstack sudo[91100]: pam_unix(sudo:session): session closed for user root Nov 06 11:45:36 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-8f641777-25cd-4f93-941a-0c2a2a6f6056 tempest-GroupSnapshotsTest-699199185 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-3354e986-8f3f-4a1d-bc85-6d0e635129b7.684f8111-18a8-492d-9b37-2316b0a708d7" returned: 0 in 0.855s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:45:36 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-8f641777-25cd-4f93-941a-0c2a2a6f6056 tempest-GroupSnapshotsTest-699199185 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3354e986-8f3f-4a1d-bc85-6d0e635129b7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87116) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 11:45:36 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[452676a8-4b23-4654-b5b8-7bad539b5163]: (4, 'qcow2') {{(pid=88420) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 11:45:36 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-8f641777-25cd-4f93-941a-0c2a2a6f6056 tempest-GroupSnapshotsTest-699199185 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-3354e986-8f3f-4a1d-bc85-6d0e635129b7 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:45:36 devstack sudo[91114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-3354e986-8f3f-4a1d-bc85-6d0e635129b7 Nov 06 11:45:36 devstack sudo[91114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:45:36 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [req-b35d598f-555b-4189-8aa0-338ce616f99a req-e7abe90a-a7f7-4d5f-8b86-c1cc02930b0e tempest-ServerActionsTestOtherA-64126338 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 11:45:36 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [req-b35d598f-555b-4189-8aa0-338ce616f99a req-e7abe90a-a7f7-4d5f-8b86-c1cc02930b0e tempest-ServerActionsTestOtherA-64126338 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 11:45:36 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [req-b35d598f-555b-4189-8aa0-338ce616f99a req-e7abe90a-a7f7-4d5f-8b86-c1cc02930b0e tempest-ServerActionsTestOtherA-64126338 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.022s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 11:45:36 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [req-b35d598f-555b-4189-8aa0-338ce616f99a req-e7abe90a-a7f7-4d5f-8b86-c1cc02930b0e tempest-ServerActionsTestOtherA-64126338 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f', 'name': 'volume-836b7423-57f1-436b-a893-c14fa60ee13d', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '1fe75186-48c3-4924-b399-dc038cb91294', 'enforce_multipath': True} {{(pid=87116) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 06 11:45:36 devstack sudo[91114]: pam_unix(sudo:session): session closed for user root Nov 06 11:45:36 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-8f641777-25cd-4f93-941a-0c2a2a6f6056 tempest-GroupSnapshotsTest-699199185 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-3354e986-8f3f-4a1d-bc85-6d0e635129b7" returned: 0 in 0.755s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:45:36 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-8f641777-25cd-4f93-941a-0c2a2a6f6056 tempest-GroupSnapshotsTest-699199185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-3354e986-8f3f-4a1d-bc85-6d0e635129b7.684f8111-18a8-492d-9b37-2316b0a708d7 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:45:37 devstack cinder-volume[87116]: INFO cinder.volume.manager [req-b35d598f-555b-4189-8aa0-338ce616f99a req-e7abe90a-a7f7-4d5f-8b86-c1cc02930b0e tempest-ServerActionsTestOtherA-64126338 None] attachment_update completed successfully. Nov 06 11:45:37 devstack sudo[91134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-3354e986-8f3f-4a1d-bc85-6d0e635129b7.684f8111-18a8-492d-9b37-2316b0a708d7 Nov 06 11:45:37 devstack sudo[91134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:45:37 devstack sudo[91134]: pam_unix(sudo:session): session closed for user root Nov 06 11:45:37 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-8f641777-25cd-4f93-941a-0c2a2a6f6056 tempest-GroupSnapshotsTest-699199185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-3354e986-8f3f-4a1d-bc85-6d0e635129b7.684f8111-18a8-492d-9b37-2316b0a708d7" returned: 0 in 0.566s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:45:37 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-8f641777-25cd-4f93-941a-0c2a2a6f6056 tempest-GroupSnapshotsTest-699199185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-3354e986-8f3f-4a1d-bc85-6d0e635129b7.684f8111-18a8-492d-9b37-2316b0a708d7 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:45:37 devstack sudo[91554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-3354e986-8f3f-4a1d-bc85-6d0e635129b7.684f8111-18a8-492d-9b37-2316b0a708d7 Nov 06 11:45:37 devstack sudo[91554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:45:38 devstack sudo[91554]: pam_unix(sudo:session): session closed for user root Nov 06 11:45:38 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-8f641777-25cd-4f93-941a-0c2a2a6f6056 tempest-GroupSnapshotsTest-699199185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-3354e986-8f3f-4a1d-bc85-6d0e635129b7.684f8111-18a8-492d-9b37-2316b0a708d7" returned: 0 in 0.508s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:45:38 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-8f641777-25cd-4f93-941a-0c2a2a6f6056 tempest-GroupSnapshotsTest-699199185 None] Lock "cinder-quobyte-684f8111-18a8-492d-9b37-2316b0a708d7" released by "_delete_snapshot" :: held 2.910s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 11:45:38 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-8f641777-25cd-4f93-941a-0c2a2a6f6056 tempest-GroupSnapshotsTest-699199185 None] Lock "cinder-quobyte-3354e986-8f3f-4a1d-bc85-6d0e635129b7" released by "delete_snapshot" :: held 2.989s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 11:45:38 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-8f641777-25cd-4f93-941a-0c2a2a6f6056 tempest-GroupSnapshotsTest-699199185 None] Acquiring lock "cinder-quobyte-03ebea23-55b7-4cda-9e44-eeb8c22482f9" by "delete_snapshot" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 11:45:38 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-8f641777-25cd-4f93-941a-0c2a2a6f6056 tempest-GroupSnapshotsTest-699199185 None] Lock "cinder-quobyte-03ebea23-55b7-4cda-9e44-eeb8c22482f9" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 11:45:38 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-8f641777-25cd-4f93-941a-0c2a2a6f6056 tempest-GroupSnapshotsTest-699199185 None] Acquiring lock "cinder-quobyte-96d946fc-6807-46f9-932d-6b45cfe7d285" by "_delete_snapshot" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 11:45:38 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-8f641777-25cd-4f93-941a-0c2a2a6f6056 tempest-GroupSnapshotsTest-699199185 None] Lock "cinder-quobyte-96d946fc-6807-46f9-932d-6b45cfe7d285" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 11:45:38 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-8f641777-25cd-4f93-941a-0c2a2a6f6056 tempest-GroupSnapshotsTest-699199185 None] Deleting offline snapshot 96d946fc-6807-46f9-932d-6b45cfe7d285 of volume 03ebea23-55b7-4cda-9e44-eeb8c22482f9 {{(pid=87116) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 06 11:45:38 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-8f641777-25cd-4f93-941a-0c2a2a6f6056 tempest-GroupSnapshotsTest-699199185 None] snapshot_file for this snap is: volume-03ebea23-55b7-4cda-9e44-eeb8c22482f9.96d946fc-6807-46f9-932d-6b45cfe7d285 {{(pid=87116) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 06 11:45:38 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e22e22f-d37c-494b-8f05-d792f6207dac]: (4, 'qcow2') {{(pid=88420) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 11:45:38 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-8f641777-25cd-4f93-941a-0c2a2a6f6056 tempest-GroupSnapshotsTest-699199185 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-03ebea23-55b7-4cda-9e44-eeb8c22482f9.96d946fc-6807-46f9-932d-6b45cfe7d285 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:45:38 devstack sudo[91558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-03ebea23-55b7-4cda-9e44-eeb8c22482f9.96d946fc-6807-46f9-932d-6b45cfe7d285 Nov 06 11:45:38 devstack sudo[91558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:45:38 devstack sudo[91558]: pam_unix(sudo:session): session closed for user root Nov 06 11:45:38 devstack cinder-volume[87116]: DEBUG cinder.volume.flows.manager.create_volume [None req-286497c6-2167-41d2-9b26-4f858a6a406b tempest-ServersNegativeTestJSON-793423570 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87116) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 11:45:38 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-286497c6-2167-41d2-9b26-4f858a6a406b tempest-ServersNegativeTestJSON-793423570 None] Flow 'volume_create_manager' (3bd71f4f-86ce-458e-b8ed-7a97700b6546) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 11:45:38 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-286497c6-2167-41d2-9b26-4f858a6a406b tempest-ServersNegativeTestJSON-793423570 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9a82812d-35d2-4c9e-a76a-db6968ea649d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:45:38 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-8f641777-25cd-4f93-941a-0c2a2a6f6056 tempest-GroupSnapshotsTest-699199185 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-03ebea23-55b7-4cda-9e44-eeb8c22482f9.96d946fc-6807-46f9-932d-6b45cfe7d285" returned: 0 in 0.642s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:45:38 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-8f641777-25cd-4f93-941a-0c2a2a6f6056 tempest-GroupSnapshotsTest-699199185 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-03ebea23-55b7-4cda-9e44-eeb8c22482f9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87116) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 11:45:38 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-286497c6-2167-41d2-9b26-4f858a6a406b tempest-ServersNegativeTestJSON-793423570 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9a82812d-35d2-4c9e-a76a-db6968ea649d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T10:45:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1531397394',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=04d23226-aa7d-4a1a-9e25-8d9df4fc7bd0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='790f9b0fd3714c61b96bc16709b00032',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T10:45:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T10:45:39Z,use_quota=True,user_id='1114e465c2344d41a7301a40a68d7813',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(34d3b144-d9b7-480a-a2e3-01e45f3d54c1),volume_type_id=34d3b144-d9b7-480a-a2e3-01e45f3d54c1)' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:45:38 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-286497c6-2167-41d2-9b26-4f858a6a406b tempest-ServersNegativeTestJSON-793423570 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (91687d1f-86a5-429a-b490-1a79a1ea99e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:45:38 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-286497c6-2167-41d2-9b26-4f858a6a406b tempest-ServersNegativeTestJSON-793423570 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (91687d1f-86a5-429a-b490-1a79a1ea99e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:45:38 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-286497c6-2167-41d2-9b26-4f858a6a406b tempest-ServersNegativeTestJSON-793423570 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7b839fb7-9fd8-4643-84e0-98c0b217c813) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:45:38 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-286497c6-2167-41d2-9b26-4f858a6a406b tempest-ServersNegativeTestJSON-793423570 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7b839fb7-9fd8-4643-84e0-98c0b217c813) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '04d23226-aa7d-4a1a-9e25-8d9df4fc7bd0', 'volume_name': 'volume-04d23226-aa7d-4a1a-9e25-8d9df4fc7bd0', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:45:38 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-286497c6-2167-41d2-9b26-4f858a6a406b tempest-ServersNegativeTestJSON-793423570 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f7ec6abf-b997-4f41-bdc3-68c7fb9ffb7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:45:38 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-286497c6-2167-41d2-9b26-4f858a6a406b tempest-ServersNegativeTestJSON-793423570 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f7ec6abf-b997-4f41-bdc3-68c7fb9ffb7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:45:38 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-286497c6-2167-41d2-9b26-4f858a6a406b tempest-ServersNegativeTestJSON-793423570 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4b08a006-3487-4c00-9c50-f7d1b5532685) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:45:38 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-286497c6-2167-41d2-9b26-4f858a6a406b tempest-ServersNegativeTestJSON-793423570 None] Volume 04d23226-aa7d-4a1a-9e25-8d9df4fc7bd0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-04d23226-aa7d-4a1a-9e25-8d9df4fc7bd0', 'volume_size': 1} Nov 06 11:45:38 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-286497c6-2167-41d2-9b26-4f858a6a406b tempest-ServersNegativeTestJSON-793423570 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 11:45:38 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-286497c6-2167-41d2-9b26-4f858a6a406b tempest-ServersNegativeTestJSON-793423570 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 11:45:38 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-286497c6-2167-41d2-9b26-4f858a6a406b tempest-ServersNegativeTestJSON-793423570 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T10:45:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1531397394',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=04d23226-aa7d-4a1a-9e25-8d9df4fc7bd0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='790f9b0fd3714c61b96bc16709b00032',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T10:45:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T10:45:39Z,use_quota=True,user_id='1114e465c2344d41a7301a40a68d7813',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(34d3b144-d9b7-480a-a2e3-01e45f3d54c1),volume_type_id=34d3b144-d9b7-480a-a2e3-01e45f3d54c1)}" {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 11:45:38 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-286497c6-2167-41d2-9b26-4f858a6a406b tempest-ServersNegativeTestJSON-793423570 None] Creating volume 04d23226-aa7d-4a1a-9e25-8d9df4fc7bd0 {{(pid=87116) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 11:45:38 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-286497c6-2167-41d2-9b26-4f858a6a406b tempest-ServersNegativeTestJSON-793423570 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 11:45:38 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-286497c6-2167-41d2-9b26-4f858a6a406b tempest-ServersNegativeTestJSON-793423570 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 11:45:38 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-286497c6-2167-41d2-9b26-4f858a6a406b tempest-ServersNegativeTestJSON-793423570 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 11:45:38 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-286497c6-2167-41d2-9b26-4f858a6a406b tempest-ServersNegativeTestJSON-793423570 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 11:45:38 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-286497c6-2167-41d2-9b26-4f858a6a406b tempest-ServersNegativeTestJSON-793423570 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 11:45:38 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-286497c6-2167-41d2-9b26-4f858a6a406b tempest-ServersNegativeTestJSON-793423570 None] Selected osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f as target Quobyte volume. {{(pid=87116) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 11:45:38 devstack cinder-volume[87116]: INFO cinder.volume.drivers.remotefs [None req-286497c6-2167-41d2-9b26-4f858a6a406b tempest-ServersNegativeTestJSON-793423570 None] casted to osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f Nov 06 11:45:39 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-286497c6-2167-41d2-9b26-4f858a6a406b tempest-ServersNegativeTestJSON-793423570 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-04d23226-aa7d-4a1a-9e25-8d9df4fc7bd0 1073741824 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:45:39 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9ad08fc-1318-4e6d-96f0-f47a2f931ae7]: (4, 'qcow2') {{(pid=88420) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 11:45:39 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-8f641777-25cd-4f93-941a-0c2a2a6f6056 tempest-GroupSnapshotsTest-699199185 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-03ebea23-55b7-4cda-9e44-eeb8c22482f9 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:45:39 devstack sudo[91563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-04d23226-aa7d-4a1a-9e25-8d9df4fc7bd0 1073741824 Nov 06 11:45:39 devstack sudo[91563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:45:39 devstack sudo[91564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-03ebea23-55b7-4cda-9e44-eeb8c22482f9 Nov 06 11:45:39 devstack sudo[91564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:45:39 devstack sudo[91564]: pam_unix(sudo:session): session closed for user root Nov 06 11:45:39 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-8f641777-25cd-4f93-941a-0c2a2a6f6056 tempest-GroupSnapshotsTest-699199185 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-03ebea23-55b7-4cda-9e44-eeb8c22482f9" returned: 0 in 0.463s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:45:39 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-8f641777-25cd-4f93-941a-0c2a2a6f6056 tempest-GroupSnapshotsTest-699199185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-03ebea23-55b7-4cda-9e44-eeb8c22482f9.96d946fc-6807-46f9-932d-6b45cfe7d285 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:45:39 devstack sudo[91574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-03ebea23-55b7-4cda-9e44-eeb8c22482f9.96d946fc-6807-46f9-932d-6b45cfe7d285 Nov 06 11:45:39 devstack sudo[91574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:45:39 devstack sudo[91563]: pam_unix(sudo:session): session closed for user root Nov 06 11:45:39 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-286497c6-2167-41d2-9b26-4f858a6a406b tempest-ServersNegativeTestJSON-793423570 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-04d23226-aa7d-4a1a-9e25-8d9df4fc7bd0 1073741824" returned: 0 in 0.735s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:45:39 devstack cinder-volume[87116]: DEBUG oslo_service.periodic_task [None req-4fab4816-ec2b-4b19-b2ff-8548f2084354 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87116) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 11:45:39 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-4fab4816-ec2b-4b19-b2ff-8548f2084354 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 11:45:39 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-4fab4816-ec2b-4b19-b2ff-8548f2084354 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 11:45:39 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-4fab4816-ec2b-4b19-b2ff-8548f2084354 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 11:45:39 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-4fab4816-ec2b-4b19-b2ff-8548f2084354 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 11:45:39 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-4fab4816-ec2b-4b19-b2ff-8548f2084354 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 11:45:39 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-4fab4816-ec2b-4b19-b2ff-8548f2084354 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:45:39 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-286497c6-2167-41d2-9b26-4f858a6a406b tempest-ServersNegativeTestJSON-793423570 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-04d23226-aa7d-4a1a-9e25-8d9df4fc7bd0 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:45:39 devstack sudo[91582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756 Nov 06 11:45:39 devstack sudo[91582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:45:39 devstack sudo[91584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-04d23226-aa7d-4a1a-9e25-8d9df4fc7bd0 Nov 06 11:45:39 devstack sudo[91584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:45:40 devstack sudo[91574]: pam_unix(sudo:session): session closed for user root Nov 06 11:45:40 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-8f641777-25cd-4f93-941a-0c2a2a6f6056 tempest-GroupSnapshotsTest-699199185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-03ebea23-55b7-4cda-9e44-eeb8c22482f9.96d946fc-6807-46f9-932d-6b45cfe7d285" returned: 0 in 0.574s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:45:40 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-8f641777-25cd-4f93-941a-0c2a2a6f6056 tempest-GroupSnapshotsTest-699199185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-03ebea23-55b7-4cda-9e44-eeb8c22482f9.96d946fc-6807-46f9-932d-6b45cfe7d285 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:45:40 devstack sudo[91588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-03ebea23-55b7-4cda-9e44-eeb8c22482f9.96d946fc-6807-46f9-932d-6b45cfe7d285 Nov 06 11:45:40 devstack sudo[91588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:45:40 devstack sudo[91582]: pam_unix(sudo:session): session closed for user root Nov 06 11:45:40 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-4fab4816-ec2b-4b19-b2ff-8548f2084354 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756" returned: 0 in 0.521s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:45:40 devstack cinder-volume[87116]: DEBUG cinder.manager [None req-4fab4816-ec2b-4b19-b2ff-8548f2084354 None None] Notifying Schedulers of capabilities ... {{(pid=87116) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 11:45:40 devstack cinder-volume[87116]: DEBUG oslo_service.periodic_task [None req-4fab4816-ec2b-4b19-b2ff-8548f2084354 None None] Running periodic task VolumeManager._thread_info {{(pid=87116) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 11:45:40 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-4fab4816-ec2b-4b19-b2ff-8548f2084354 None None] thread count: 8 {{(pid=87116) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 06 11:45:40 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-4fab4816-ec2b-4b19-b2ff-8548f2084354 None None] thread info: [<_MainThread(MainThread, started 131399520669824)>, , , , , , , ] {{(pid=87116) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 06 11:45:40 devstack sudo[91584]: pam_unix(sudo:session): session closed for user root Nov 06 11:45:40 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-286497c6-2167-41d2-9b26-4f858a6a406b tempest-ServersNegativeTestJSON-793423570 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-04d23226-aa7d-4a1a-9e25-8d9df4fc7bd0" returned: 0 in 0.540s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:45:40 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-286497c6-2167-41d2-9b26-4f858a6a406b tempest-ServersNegativeTestJSON-793423570 None] <== create_volume: return (1427ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f'} {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 11:45:40 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-286497c6-2167-41d2-9b26-4f858a6a406b tempest-ServersNegativeTestJSON-793423570 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.429s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 11:45:40 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-286497c6-2167-41d2-9b26-4f858a6a406b tempest-ServersNegativeTestJSON-793423570 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4b08a006-3487-4c00-9c50-f7d1b5532685) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-04d23226-aa7d-4a1a-9e25-8d9df4fc7bd0', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:45:40 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-286497c6-2167-41d2-9b26-4f858a6a406b tempest-ServersNegativeTestJSON-793423570 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c6bd93e4-34d2-40b1-bf3b-e902a9b725ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:45:40 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-286497c6-2167-41d2-9b26-4f858a6a406b tempest-ServersNegativeTestJSON-793423570 None] Volume volume-04d23226-aa7d-4a1a-9e25-8d9df4fc7bd0 (04d23226-aa7d-4a1a-9e25-8d9df4fc7bd0): created successfully Nov 06 11:45:40 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-286497c6-2167-41d2-9b26-4f858a6a406b tempest-ServersNegativeTestJSON-793423570 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c6bd93e4-34d2-40b1-bf3b-e902a9b725ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:45:40 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-286497c6-2167-41d2-9b26-4f858a6a406b tempest-ServersNegativeTestJSON-793423570 None] Flow 'volume_create_manager' (3bd71f4f-86ce-458e-b8ed-7a97700b6546) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 11:45:40 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-286497c6-2167-41d2-9b26-4f858a6a406b tempest-ServersNegativeTestJSON-793423570 None] Created volume successfully. Nov 06 11:45:40 devstack sudo[91588]: pam_unix(sudo:session): session closed for user root Nov 06 11:45:40 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-8f641777-25cd-4f93-941a-0c2a2a6f6056 tempest-GroupSnapshotsTest-699199185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-03ebea23-55b7-4cda-9e44-eeb8c22482f9.96d946fc-6807-46f9-932d-6b45cfe7d285" returned: 0 in 0.455s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:45:40 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-8f641777-25cd-4f93-941a-0c2a2a6f6056 tempest-GroupSnapshotsTest-699199185 None] Lock "cinder-quobyte-96d946fc-6807-46f9-932d-6b45cfe7d285" released by "_delete_snapshot" :: held 2.336s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 11:45:40 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-8f641777-25cd-4f93-941a-0c2a2a6f6056 tempest-GroupSnapshotsTest-699199185 None] Lock "cinder-quobyte-03ebea23-55b7-4cda-9e44-eeb8c22482f9" released by "delete_snapshot" :: held 2.371s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 11:45:40 devstack cinder-volume[87116]: WARNING cinder.quota [None req-8f641777-25cd-4f93-941a-0c2a2a6f6056 tempest-GroupSnapshotsTest-699199185 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-840138979 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-840138979, it is now deprecated. Please use the default quota class for default quota. Nov 06 11:45:40 devstack cinder-volume[87116]: WARNING cinder.quota [None req-8f641777-25cd-4f93-941a-0c2a2a6f6056 tempest-GroupSnapshotsTest-699199185 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-840138979 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-840138979, it is now deprecated. Please use the default quota class for default quota. Nov 06 11:45:40 devstack cinder-volume[87116]: DEBUG cinder.quota [None req-8f641777-25cd-4f93-941a-0c2a2a6f6056 tempest-GroupSnapshotsTest-699199185 None] Created reservations ['3c2988f2-d46e-41e8-a956-c63632cb1d4d', '38933b2c-d67f-4ce4-8c5d-537174169a50', '5062e4bb-9015-430c-9f3e-9c21e5f028f3', '86f5cbd3-10cc-4e82-86ac-3dcfb32cdfcc'] {{(pid=87116) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 11:45:40 devstack cinder-volume[87116]: DEBUG cinder.quota [None req-8f641777-25cd-4f93-941a-0c2a2a6f6056 tempest-GroupSnapshotsTest-699199185 None] Created reservations ['0dd802f8-96ee-4971-b55a-0d5fee654ca3', '44c50bcd-ada4-450b-9eed-cf14af00771f', '54e9cf3c-4501-4d87-bfa6-841a786344f6', 'cd0cc887-568d-40ff-961e-b8a3881ad11f'] {{(pid=87116) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 11:45:40 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-8f641777-25cd-4f93-941a-0c2a2a6f6056 tempest-GroupSnapshotsTest-699199185 None] group_snapshot f58af3c1-c15d-4818-b21d-fda227dc7ba3: deleted successfully Nov 06 11:45:41 devstack cinder-volume[87116]: INFO cinder.volume.manager [req-c05b2e04-cb8e-4fea-899e-259b91afe762 req-ad2ecceb-8403-4208-ae8d-a0a6b8234f64 tempest-ServerActionsTestOtherA-64126338 None] Terminate volume connection completed successfully. Nov 06 11:45:41 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [req-c05b2e04-cb8e-4fea-899e-259b91afe762 req-ad2ecceb-8403-4208-ae8d-a0a6b8234f64 tempest-ServerActionsTestOtherA-64126338 None] Deleting attachment 1fe75186-48c3-4924-b399-dc038cb91294. {{(pid=87116) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 06 11:45:41 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-d38a60ad-9891-4546-95b1-1a9b01a93d9d tempest-ServersNegativeTestJSON-793423570 None] Acquiring lock "cinder-04d23226-aa7d-4a1a-9e25-8d9df4fc7bd0-delete_volume" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 11:45:41 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-d38a60ad-9891-4546-95b1-1a9b01a93d9d tempest-ServersNegativeTestJSON-793423570 None] Lock "cinder-04d23226-aa7d-4a1a-9e25-8d9df4fc7bd0-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 11:45:41 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-d38a60ad-9891-4546-95b1-1a9b01a93d9d tempest-ServersNegativeTestJSON-793423570 None] Acquiring lock "cinder-quobyte-04d23226-aa7d-4a1a-9e25-8d9df4fc7bd0" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 11:45:41 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-d38a60ad-9891-4546-95b1-1a9b01a93d9d tempest-ServersNegativeTestJSON-793423570 None] Lock "cinder-quobyte-04d23226-aa7d-4a1a-9e25-8d9df4fc7bd0" acquired by "delete_volume" :: waited 0.069s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 11:45:41 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f151c62-ffc3-4e71-8479-c381a0505750]: (4, 'qcow2') {{(pid=88420) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 11:45:41 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-d38a60ad-9891-4546-95b1-1a9b01a93d9d tempest-ServersNegativeTestJSON-793423570 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-04d23226-aa7d-4a1a-9e25-8d9df4fc7bd0 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:45:41 devstack sudo[91636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-04d23226-aa7d-4a1a-9e25-8d9df4fc7bd0 Nov 06 11:45:41 devstack sudo[91636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:45:41 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-5ae60afa-96ff-4e67-92d5-331d45e0ad8c tempest-GroupSnapshotsTest-699199185 None] Acquiring lock "cinder-quobyte-03ebea23-55b7-4cda-9e44-eeb8c22482f9" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 11:45:42 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-5ae60afa-96ff-4e67-92d5-331d45e0ad8c tempest-GroupSnapshotsTest-699199185 None] Lock "cinder-quobyte-03ebea23-55b7-4cda-9e44-eeb8c22482f9" acquired by "delete_volume" :: waited 0.033s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 11:45:42 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[17deca19-f05f-476a-b744-6a03aca67385]: (4, 'qcow2') {{(pid=88420) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 11:45:42 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-5ae60afa-96ff-4e67-92d5-331d45e0ad8c tempest-GroupSnapshotsTest-699199185 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-03ebea23-55b7-4cda-9e44-eeb8c22482f9 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:45:42 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [req-c05b2e04-cb8e-4fea-899e-259b91afe762 req-83853051-e9f2-495b-9775-c1825a0717b2 tempest-ServerActionsTestOtherA-64126338 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 11:45:42 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [req-c05b2e04-cb8e-4fea-899e-259b91afe762 req-83853051-e9f2-495b-9775-c1825a0717b2 tempest-ServerActionsTestOtherA-64126338 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 11:45:42 devstack sudo[91636]: pam_unix(sudo:session): session closed for user root Nov 06 11:45:42 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [req-c05b2e04-cb8e-4fea-899e-259b91afe762 req-83853051-e9f2-495b-9775-c1825a0717b2 tempest-ServerActionsTestOtherA-64126338 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.026s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 11:45:42 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-d38a60ad-9891-4546-95b1-1a9b01a93d9d tempest-ServersNegativeTestJSON-793423570 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-04d23226-aa7d-4a1a-9e25-8d9df4fc7bd0" returned: 0 in 0.772s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:45:42 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-d38a60ad-9891-4546-95b1-1a9b01a93d9d tempest-ServersNegativeTestJSON-793423570 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-04d23226-aa7d-4a1a-9e25-8d9df4fc7bd0 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:45:42 devstack sudo[91655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-03ebea23-55b7-4cda-9e44-eeb8c22482f9 Nov 06 11:45:42 devstack sudo[91655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:45:42 devstack sudo[91660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-04d23226-aa7d-4a1a-9e25-8d9df4fc7bd0 Nov 06 11:45:42 devstack sudo[91660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:45:42 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [req-c05b2e04-cb8e-4fea-899e-259b91afe762 req-83853051-e9f2-495b-9775-c1825a0717b2 tempest-ServerActionsTestOtherA-64126338 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f', 'name': 'volume-836b7423-57f1-436b-a893-c14fa60ee13d', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'f8902932-563d-4081-ad57-dafc43ea7812', 'enforce_multipath': True} {{(pid=87116) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 06 11:45:42 devstack cinder-volume[87116]: INFO cinder.volume.manager [req-c05b2e04-cb8e-4fea-899e-259b91afe762 req-83853051-e9f2-495b-9775-c1825a0717b2 tempest-ServerActionsTestOtherA-64126338 None] attachment_update completed successfully. Nov 06 11:45:42 devstack sudo[91655]: pam_unix(sudo:session): session closed for user root Nov 06 11:45:42 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-5ae60afa-96ff-4e67-92d5-331d45e0ad8c tempest-GroupSnapshotsTest-699199185 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-03ebea23-55b7-4cda-9e44-eeb8c22482f9" returned: 0 in 0.614s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:45:42 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-5ae60afa-96ff-4e67-92d5-331d45e0ad8c tempest-GroupSnapshotsTest-699199185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-03ebea23-55b7-4cda-9e44-eeb8c22482f9 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:45:42 devstack sudo[91660]: pam_unix(sudo:session): session closed for user root Nov 06 11:45:42 devstack sudo[91668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-03ebea23-55b7-4cda-9e44-eeb8c22482f9 Nov 06 11:45:42 devstack sudo[91668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:45:42 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-d38a60ad-9891-4546-95b1-1a9b01a93d9d tempest-ServersNegativeTestJSON-793423570 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-04d23226-aa7d-4a1a-9e25-8d9df4fc7bd0" returned: 0 in 0.436s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:45:42 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-d38a60ad-9891-4546-95b1-1a9b01a93d9d tempest-ServersNegativeTestJSON-793423570 None] Lock "cinder-quobyte-04d23226-aa7d-4a1a-9e25-8d9df4fc7bd0" released by "delete_volume" :: held 1.325s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 11:45:42 devstack cinder-volume[87116]: DEBUG cinder.quota [None req-d38a60ad-9891-4546-95b1-1a9b01a93d9d tempest-ServersNegativeTestJSON-793423570 None] Created reservations ['d60a6dc5-5d04-4d34-a53b-2ad5d3007999', '46b7cac9-d252-48fa-9a82-20e42d2ad149', '53d42791-595f-4242-ba36-ca779dbf2864', '70cee653-5e00-422a-bfbb-f692d6eae44b'] {{(pid=87116) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 11:45:42 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-d38a60ad-9891-4546-95b1-1a9b01a93d9d tempest-ServersNegativeTestJSON-793423570 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 11:45:42 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-d38a60ad-9891-4546-95b1-1a9b01a93d9d tempest-ServersNegativeTestJSON-793423570 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 11:45:42 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-d38a60ad-9891-4546-95b1-1a9b01a93d9d tempest-ServersNegativeTestJSON-793423570 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 11:45:42 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-d38a60ad-9891-4546-95b1-1a9b01a93d9d tempest-ServersNegativeTestJSON-793423570 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 11:45:42 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-d38a60ad-9891-4546-95b1-1a9b01a93d9d tempest-ServersNegativeTestJSON-793423570 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 11:45:42 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-d38a60ad-9891-4546-95b1-1a9b01a93d9d tempest-ServersNegativeTestJSON-793423570 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:45:43 devstack sudo[91671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756 Nov 06 11:45:43 devstack sudo[91671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:45:43 devstack sudo[91668]: pam_unix(sudo:session): session closed for user root Nov 06 11:45:43 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-5ae60afa-96ff-4e67-92d5-331d45e0ad8c tempest-GroupSnapshotsTest-699199185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-03ebea23-55b7-4cda-9e44-eeb8c22482f9" returned: 0 in 0.352s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:45:43 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-5ae60afa-96ff-4e67-92d5-331d45e0ad8c tempest-GroupSnapshotsTest-699199185 None] Lock "cinder-quobyte-03ebea23-55b7-4cda-9e44-eeb8c22482f9" released by "delete_volume" :: held 1.170s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 11:45:43 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-5ae60afa-96ff-4e67-92d5-331d45e0ad8c tempest-GroupSnapshotsTest-699199185 None] Acquiring lock "cinder-quobyte-3354e986-8f3f-4a1d-bc85-6d0e635129b7" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 11:45:43 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-5ae60afa-96ff-4e67-92d5-331d45e0ad8c tempest-GroupSnapshotsTest-699199185 None] Lock "cinder-quobyte-3354e986-8f3f-4a1d-bc85-6d0e635129b7" acquired by "delete_volume" :: waited 0.032s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 11:45:43 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[81d0b18d-d4ba-464f-bda4-c04fa9d7ed40]: (4, 'qcow2') {{(pid=88420) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 11:45:43 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-5ae60afa-96ff-4e67-92d5-331d45e0ad8c tempest-GroupSnapshotsTest-699199185 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-3354e986-8f3f-4a1d-bc85-6d0e635129b7 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:45:43 devstack sudo[91671]: pam_unix(sudo:session): session closed for user root Nov 06 11:45:43 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-d38a60ad-9891-4546-95b1-1a9b01a93d9d tempest-ServersNegativeTestJSON-793423570 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756" returned: 0 in 0.448s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:45:43 devstack cinder-volume[87116]: DEBUG cinder.manager [None req-d38a60ad-9891-4546-95b1-1a9b01a93d9d tempest-ServersNegativeTestJSON-793423570 None] Notifying Schedulers of capabilities ... {{(pid=87116) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 11:45:43 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-d38a60ad-9891-4546-95b1-1a9b01a93d9d tempest-ServersNegativeTestJSON-793423570 None] Deleted volume successfully. Nov 06 11:45:43 devstack sudo[91679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-3354e986-8f3f-4a1d-bc85-6d0e635129b7 Nov 06 11:45:43 devstack sudo[91679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:45:43 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-d38a60ad-9891-4546-95b1-1a9b01a93d9d tempest-ServersNegativeTestJSON-793423570 None] Lock "cinder-04d23226-aa7d-4a1a-9e25-8d9df4fc7bd0-delete_volume" released by "delete_volume" :: held 2.181s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 11:45:43 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-dd69b236-e500-4a93-a160-3d477ae5c54d tempest-ServersNegativeTestJSON-793423570 None] Acquiring lock "cinder-b4cc2df9-5c7f-46f8-875f-6167d14d2102-delete_volume" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 11:45:43 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-dd69b236-e500-4a93-a160-3d477ae5c54d tempest-ServersNegativeTestJSON-793423570 None] Lock "cinder-b4cc2df9-5c7f-46f8-875f-6167d14d2102-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 11:45:43 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-dd69b236-e500-4a93-a160-3d477ae5c54d tempest-ServersNegativeTestJSON-793423570 None] Acquiring lock "cinder-quobyte-b4cc2df9-5c7f-46f8-875f-6167d14d2102" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 11:45:43 devstack sudo[91679]: pam_unix(sudo:session): session closed for user root Nov 06 11:45:43 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-dd69b236-e500-4a93-a160-3d477ae5c54d tempest-ServersNegativeTestJSON-793423570 None] Lock "cinder-quobyte-b4cc2df9-5c7f-46f8-875f-6167d14d2102" acquired by "delete_volume" :: waited 0.028s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 11:45:43 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-5ae60afa-96ff-4e67-92d5-331d45e0ad8c tempest-GroupSnapshotsTest-699199185 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-3354e986-8f3f-4a1d-bc85-6d0e635129b7" returned: 0 in 0.571s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:45:43 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-5ae60afa-96ff-4e67-92d5-331d45e0ad8c tempest-GroupSnapshotsTest-699199185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-3354e986-8f3f-4a1d-bc85-6d0e635129b7 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:45:43 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[84e39636-a774-4172-b966-d831db9fcae0]: (4, 'qcow2') {{(pid=88420) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 11:45:43 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-dd69b236-e500-4a93-a160-3d477ae5c54d tempest-ServersNegativeTestJSON-793423570 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-b4cc2df9-5c7f-46f8-875f-6167d14d2102 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:45:43 devstack sudo[91698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-3354e986-8f3f-4a1d-bc85-6d0e635129b7 Nov 06 11:45:43 devstack sudo[91698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:45:43 devstack sudo[91701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-b4cc2df9-5c7f-46f8-875f-6167d14d2102 Nov 06 11:45:43 devstack sudo[91701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:45:44 devstack sudo[91698]: pam_unix(sudo:session): session closed for user root Nov 06 11:45:44 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-5ae60afa-96ff-4e67-92d5-331d45e0ad8c tempest-GroupSnapshotsTest-699199185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-3354e986-8f3f-4a1d-bc85-6d0e635129b7" returned: 0 in 0.261s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:45:44 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-5ae60afa-96ff-4e67-92d5-331d45e0ad8c tempest-GroupSnapshotsTest-699199185 None] Lock "cinder-quobyte-3354e986-8f3f-4a1d-bc85-6d0e635129b7" released by "delete_volume" :: held 0.923s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 11:45:44 devstack cinder-volume[87116]: DEBUG cinder.quota [None req-5ae60afa-96ff-4e67-92d5-331d45e0ad8c tempest-GroupSnapshotsTest-699199185 None] Created reservations ['0e66a044-8249-4125-8545-ddd2f2cf894f'] {{(pid=87116) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 11:45:44 devstack cinder-volume[87116]: WARNING cinder.quota [None req-5ae60afa-96ff-4e67-92d5-331d45e0ad8c tempest-GroupSnapshotsTest-699199185 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-840138979 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-840138979, it is now deprecated. Please use the default quota class for default quota. Nov 06 11:45:44 devstack cinder-volume[87116]: DEBUG cinder.quota [None req-5ae60afa-96ff-4e67-92d5-331d45e0ad8c tempest-GroupSnapshotsTest-699199185 None] Created reservations ['99ef36a3-a43a-42b6-8a2f-a70f1b85e794', '47453451-6eb4-442c-86f1-e5d210d76b6e', '15c35def-88c5-4752-8b88-dacc990649f1', 'bcd9e3a6-6f84-4afd-b89d-0cf376f4593b'] {{(pid=87116) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 11:45:44 devstack sudo[91701]: pam_unix(sudo:session): session closed for user root Nov 06 11:45:44 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-dd69b236-e500-4a93-a160-3d477ae5c54d tempest-ServersNegativeTestJSON-793423570 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-b4cc2df9-5c7f-46f8-875f-6167d14d2102" returned: 0 in 0.514s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:45:44 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-dd69b236-e500-4a93-a160-3d477ae5c54d tempest-ServersNegativeTestJSON-793423570 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-b4cc2df9-5c7f-46f8-875f-6167d14d2102 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:45:44 devstack sudo[91806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-b4cc2df9-5c7f-46f8-875f-6167d14d2102 Nov 06 11:45:44 devstack sudo[91806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:45:44 devstack cinder-volume[87116]: DEBUG cinder.quota [None req-5ae60afa-96ff-4e67-92d5-331d45e0ad8c tempest-GroupSnapshotsTest-699199185 None] Created reservations ['978f3455-4e2f-4a41-aebf-73a7f7bd9c79', '818861b5-a5e1-4526-9575-8b85d13a8cbd', '9efdb356-b15b-4444-a933-ef02e07b18a9', '1bd885d9-92a5-43cf-b906-2a6347560e98'] {{(pid=87116) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 11:45:45 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-5ae60afa-96ff-4e67-92d5-331d45e0ad8c tempest-GroupSnapshotsTest-699199185 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 11:45:45 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-5ae60afa-96ff-4e67-92d5-331d45e0ad8c tempest-GroupSnapshotsTest-699199185 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 11:45:45 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-5ae60afa-96ff-4e67-92d5-331d45e0ad8c tempest-GroupSnapshotsTest-699199185 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 11:45:45 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-5ae60afa-96ff-4e67-92d5-331d45e0ad8c tempest-GroupSnapshotsTest-699199185 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 11:45:45 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-5ae60afa-96ff-4e67-92d5-331d45e0ad8c tempest-GroupSnapshotsTest-699199185 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.056s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 11:45:45 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-5ae60afa-96ff-4e67-92d5-331d45e0ad8c tempest-GroupSnapshotsTest-699199185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:45:45 devstack sudo[92157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756 Nov 06 11:45:45 devstack sudo[92157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:45:45 devstack sudo[91806]: pam_unix(sudo:session): session closed for user root Nov 06 11:45:45 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-dd69b236-e500-4a93-a160-3d477ae5c54d tempest-ServersNegativeTestJSON-793423570 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-b4cc2df9-5c7f-46f8-875f-6167d14d2102" returned: 0 in 0.896s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:45:45 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-dd69b236-e500-4a93-a160-3d477ae5c54d tempest-ServersNegativeTestJSON-793423570 None] Lock "cinder-quobyte-b4cc2df9-5c7f-46f8-875f-6167d14d2102" released by "delete_volume" :: held 1.479s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 11:45:45 devstack cinder-volume[87116]: DEBUG cinder.quota [None req-dd69b236-e500-4a93-a160-3d477ae5c54d tempest-ServersNegativeTestJSON-793423570 None] Created reservations ['814fa3d2-6a64-4455-bcc4-802e7bb03cf8', '4f12a244-9708-484a-8ec7-fa0c2a8012d9', '43ea7ac2-8f62-457e-9a7d-785f27a5cf9f', '5910e49e-098a-4ee8-8876-0e780dc8ed29'] {{(pid=87116) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 11:45:45 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-dd69b236-e500-4a93-a160-3d477ae5c54d tempest-ServersNegativeTestJSON-793423570 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 11:45:45 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-dd69b236-e500-4a93-a160-3d477ae5c54d tempest-ServersNegativeTestJSON-793423570 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.009s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 11:45:45 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-dd69b236-e500-4a93-a160-3d477ae5c54d tempest-ServersNegativeTestJSON-793423570 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 11:45:45 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-dd69b236-e500-4a93-a160-3d477ae5c54d tempest-ServersNegativeTestJSON-793423570 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 11:45:45 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-dd69b236-e500-4a93-a160-3d477ae5c54d tempest-ServersNegativeTestJSON-793423570 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 11:45:45 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-dd69b236-e500-4a93-a160-3d477ae5c54d tempest-ServersNegativeTestJSON-793423570 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:45:45 devstack sudo[92157]: pam_unix(sudo:session): session closed for user root Nov 06 11:45:45 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-5ae60afa-96ff-4e67-92d5-331d45e0ad8c tempest-GroupSnapshotsTest-699199185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756" returned: 0 in 0.552s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:45:45 devstack sudo[92175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756 Nov 06 11:45:45 devstack sudo[92175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:45:45 devstack cinder-volume[87116]: DEBUG cinder.manager [None req-5ae60afa-96ff-4e67-92d5-331d45e0ad8c tempest-GroupSnapshotsTest-699199185 None] Notifying Schedulers of capabilities ... {{(pid=87116) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 11:45:45 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-5ae60afa-96ff-4e67-92d5-331d45e0ad8c tempest-GroupSnapshotsTest-699199185 None] Delete group completed successfully. Nov 06 11:45:45 devstack sudo[92175]: pam_unix(sudo:session): session closed for user root Nov 06 11:45:45 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-dd69b236-e500-4a93-a160-3d477ae5c54d tempest-ServersNegativeTestJSON-793423570 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756" returned: 0 in 0.315s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:45:45 devstack cinder-volume[87116]: DEBUG cinder.manager [None req-dd69b236-e500-4a93-a160-3d477ae5c54d tempest-ServersNegativeTestJSON-793423570 None] Notifying Schedulers of capabilities ... {{(pid=87116) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 11:45:45 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-dd69b236-e500-4a93-a160-3d477ae5c54d tempest-ServersNegativeTestJSON-793423570 None] Deleted volume successfully. Nov 06 11:45:45 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-dd69b236-e500-4a93-a160-3d477ae5c54d tempest-ServersNegativeTestJSON-793423570 None] Lock "cinder-b4cc2df9-5c7f-46f8-875f-6167d14d2102-delete_volume" released by "delete_volume" :: held 2.212s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 11:45:47 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-345c5691-95f1-4bf7-a551-0c6e7695ecca tempest-GroupSnapshotsTest-699199185 None] Group tempest-GroupSnapshotsTest-Group-286478398: creating Nov 06 11:45:47 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-345c5691-95f1-4bf7-a551-0c6e7695ecca tempest-GroupSnapshotsTest-699199185 None] Group tempest-GroupSnapshotsTest-Group-286478398: created successfully Nov 06 11:45:47 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-345c5691-95f1-4bf7-a551-0c6e7695ecca tempest-GroupSnapshotsTest-699199185 None] Create group completed successfully. Nov 06 11:45:49 devstack cinder-volume[87116]: DEBUG cinder.volume.flows.manager.create_volume [None req-166f0ce4-01fa-4ade-b403-bf89b8f80e54 tempest-GroupSnapshotsTest-699199185 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87116) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 11:45:49 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-166f0ce4-01fa-4ade-b403-bf89b8f80e54 tempest-GroupSnapshotsTest-699199185 None] Flow 'volume_create_manager' (c0432912-6c3e-4910-b01b-0eff3d6a97bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 11:45:49 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-166f0ce4-01fa-4ade-b403-bf89b8f80e54 tempest-GroupSnapshotsTest-699199185 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (30c010aa-ef6a-4775-b329-ec3f43750aaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:45:49 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-166f0ce4-01fa-4ade-b403-bf89b8f80e54 tempest-GroupSnapshotsTest-699199185 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (30c010aa-ef6a-4775-b329-ec3f43750aaf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T10:45:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1946523478',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=b0fc94ce-b6a2-4cae-95ec-0b2add6b5772,host='devstack@QuobyteHD#QuobyteHD',id=db309b17-5775-474e-800b-9054ee1ce7bb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ee185cb8d999442cbf24aef8f910d50c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T10:45:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T10:45:50Z,use_quota=True,user_id='8c4b1f0ecaba4aa4baef4335dae669d4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(46193d80-89a9-4858-9f50-7e9807dfb826),volume_type_id=46193d80-89a9-4858-9f50-7e9807dfb826)' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:45:49 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-166f0ce4-01fa-4ade-b403-bf89b8f80e54 tempest-GroupSnapshotsTest-699199185 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1b96ddea-ca4b-465b-8019-3fe955c8ef4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:45:49 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-166f0ce4-01fa-4ade-b403-bf89b8f80e54 tempest-GroupSnapshotsTest-699199185 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1b96ddea-ca4b-465b-8019-3fe955c8ef4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:45:49 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-166f0ce4-01fa-4ade-b403-bf89b8f80e54 tempest-GroupSnapshotsTest-699199185 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f1d6cfe2-22bb-4941-bdee-c82dd076ef25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:45:49 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-166f0ce4-01fa-4ade-b403-bf89b8f80e54 tempest-GroupSnapshotsTest-699199185 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f1d6cfe2-22bb-4941-bdee-c82dd076ef25) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'db309b17-5775-474e-800b-9054ee1ce7bb', 'volume_name': 'volume-db309b17-5775-474e-800b-9054ee1ce7bb', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:45:49 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-166f0ce4-01fa-4ade-b403-bf89b8f80e54 tempest-GroupSnapshotsTest-699199185 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (33ef1f49-e35c-435d-b0c1-57a7454c4e96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:45:49 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-166f0ce4-01fa-4ade-b403-bf89b8f80e54 tempest-GroupSnapshotsTest-699199185 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (33ef1f49-e35c-435d-b0c1-57a7454c4e96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:45:49 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-166f0ce4-01fa-4ade-b403-bf89b8f80e54 tempest-GroupSnapshotsTest-699199185 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6b9a0d3f-7f2f-418f-9761-555163cc04a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:45:49 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-166f0ce4-01fa-4ade-b403-bf89b8f80e54 tempest-GroupSnapshotsTest-699199185 None] Volume db309b17-5775-474e-800b-9054ee1ce7bb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-db309b17-5775-474e-800b-9054ee1ce7bb', 'volume_size': 1} Nov 06 11:45:49 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-166f0ce4-01fa-4ade-b403-bf89b8f80e54 tempest-GroupSnapshotsTest-699199185 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 11:45:49 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-166f0ce4-01fa-4ade-b403-bf89b8f80e54 tempest-GroupSnapshotsTest-699199185 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 11:45:49 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-166f0ce4-01fa-4ade-b403-bf89b8f80e54 tempest-GroupSnapshotsTest-699199185 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=b0fc94ce-b6a2-4cae-95ec-0b2add6b5772,created_at=2026-11-06T10:45:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1946523478',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=b0fc94ce-b6a2-4cae-95ec-0b2add6b5772,host='devstack@QuobyteHD#QuobyteHD',id=db309b17-5775-474e-800b-9054ee1ce7bb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ee185cb8d999442cbf24aef8f910d50c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T10:45:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T10:45:50Z,use_quota=True,user_id='8c4b1f0ecaba4aa4baef4335dae669d4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(46193d80-89a9-4858-9f50-7e9807dfb826),volume_type_id=46193d80-89a9-4858-9f50-7e9807dfb826)}" {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 11:45:49 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-166f0ce4-01fa-4ade-b403-bf89b8f80e54 tempest-GroupSnapshotsTest-699199185 None] Creating volume db309b17-5775-474e-800b-9054ee1ce7bb {{(pid=87116) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 11:45:49 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-166f0ce4-01fa-4ade-b403-bf89b8f80e54 tempest-GroupSnapshotsTest-699199185 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 11:45:49 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-166f0ce4-01fa-4ade-b403-bf89b8f80e54 tempest-GroupSnapshotsTest-699199185 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 11:45:49 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-166f0ce4-01fa-4ade-b403-bf89b8f80e54 tempest-GroupSnapshotsTest-699199185 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 11:45:49 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-166f0ce4-01fa-4ade-b403-bf89b8f80e54 tempest-GroupSnapshotsTest-699199185 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 11:45:49 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-166f0ce4-01fa-4ade-b403-bf89b8f80e54 tempest-GroupSnapshotsTest-699199185 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 11:45:49 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-166f0ce4-01fa-4ade-b403-bf89b8f80e54 tempest-GroupSnapshotsTest-699199185 None] Selected osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f as target Quobyte volume. {{(pid=87116) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 11:45:49 devstack cinder-volume[87116]: INFO cinder.volume.drivers.remotefs [None req-166f0ce4-01fa-4ade-b403-bf89b8f80e54 tempest-GroupSnapshotsTest-699199185 None] casted to osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f Nov 06 11:45:49 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-166f0ce4-01fa-4ade-b403-bf89b8f80e54 tempest-GroupSnapshotsTest-699199185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-db309b17-5775-474e-800b-9054ee1ce7bb 1073741824 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:45:49 devstack sudo[92212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-db309b17-5775-474e-800b-9054ee1ce7bb 1073741824 Nov 06 11:45:49 devstack sudo[92212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:45:50 devstack sudo[92212]: pam_unix(sudo:session): session closed for user root Nov 06 11:45:50 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-166f0ce4-01fa-4ade-b403-bf89b8f80e54 tempest-GroupSnapshotsTest-699199185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-db309b17-5775-474e-800b-9054ee1ce7bb 1073741824" returned: 0 in 0.451s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:45:50 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-166f0ce4-01fa-4ade-b403-bf89b8f80e54 tempest-GroupSnapshotsTest-699199185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-db309b17-5775-474e-800b-9054ee1ce7bb {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:45:50 devstack sudo[92218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-db309b17-5775-474e-800b-9054ee1ce7bb Nov 06 11:45:50 devstack sudo[92218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:45:50 devstack sudo[92218]: pam_unix(sudo:session): session closed for user root Nov 06 11:45:50 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-166f0ce4-01fa-4ade-b403-bf89b8f80e54 tempest-GroupSnapshotsTest-699199185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-db309b17-5775-474e-800b-9054ee1ce7bb" returned: 0 in 0.254s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:45:50 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-166f0ce4-01fa-4ade-b403-bf89b8f80e54 tempest-GroupSnapshotsTest-699199185 None] <== create_volume: return (758ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f'} {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 11:45:50 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-166f0ce4-01fa-4ade-b403-bf89b8f80e54 tempest-GroupSnapshotsTest-699199185 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.760s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 11:45:50 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-166f0ce4-01fa-4ade-b403-bf89b8f80e54 tempest-GroupSnapshotsTest-699199185 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6b9a0d3f-7f2f-418f-9761-555163cc04a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-db309b17-5775-474e-800b-9054ee1ce7bb', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:45:50 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-166f0ce4-01fa-4ade-b403-bf89b8f80e54 tempest-GroupSnapshotsTest-699199185 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3d80c994-8433-433f-b180-0df029aafdcb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:45:50 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-166f0ce4-01fa-4ade-b403-bf89b8f80e54 tempest-GroupSnapshotsTest-699199185 None] Volume volume-db309b17-5775-474e-800b-9054ee1ce7bb (db309b17-5775-474e-800b-9054ee1ce7bb): created successfully Nov 06 11:45:50 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-166f0ce4-01fa-4ade-b403-bf89b8f80e54 tempest-GroupSnapshotsTest-699199185 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3d80c994-8433-433f-b180-0df029aafdcb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:45:50 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-166f0ce4-01fa-4ade-b403-bf89b8f80e54 tempest-GroupSnapshotsTest-699199185 None] Flow 'volume_create_manager' (c0432912-6c3e-4910-b01b-0eff3d6a97bb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 11:45:50 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-166f0ce4-01fa-4ade-b403-bf89b8f80e54 tempest-GroupSnapshotsTest-699199185 None] Created volume successfully. Nov 06 11:45:51 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-cf1f0769-ebb5-4407-a0db-4be5a00d1304 tempest-GroupSnapshotsTest-699199185 None] GroupSnapshot 3c4bed66-0070-4b4c-aa87-e27d74fb5387: creating. Nov 06 11:45:51 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-cf1f0769-ebb5-4407-a0db-4be5a00d1304 tempest-GroupSnapshotsTest-699199185 None] Group snapshot 3c4bed66-0070-4b4c-aa87-e27d74fb5387: creating. {{(pid=87116) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Nov 06 11:45:51 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-cf1f0769-ebb5-4407-a0db-4be5a00d1304 tempest-GroupSnapshotsTest-699199185 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 11:45:51 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-cf1f0769-ebb5-4407-a0db-4be5a00d1304 tempest-GroupSnapshotsTest-699199185 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 11:45:51 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-cf1f0769-ebb5-4407-a0db-4be5a00d1304 tempest-GroupSnapshotsTest-699199185 None] Creating offline snapshot 093a076f-8ba8-4da3-a46d-ed228cc8609c of volume db309b17-5775-474e-800b-9054ee1ce7bb {{(pid=87116) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 06 11:45:51 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca814c89-8fdc-4ac7-abc8-afb8079c7699]: (4, 'qcow2') {{(pid=88420) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 11:45:51 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-cf1f0769-ebb5-4407-a0db-4be5a00d1304 tempest-GroupSnapshotsTest-699199185 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-db309b17-5775-474e-800b-9054ee1ce7bb {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:45:51 devstack sudo[92222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-db309b17-5775-474e-800b-9054ee1ce7bb Nov 06 11:45:51 devstack sudo[92222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:45:51 devstack sudo[92222]: pam_unix(sudo:session): session closed for user root Nov 06 11:45:51 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-cf1f0769-ebb5-4407-a0db-4be5a00d1304 tempest-GroupSnapshotsTest-699199185 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-db309b17-5775-474e-800b-9054ee1ce7bb" returned: 0 in 0.389s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:45:51 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-cf1f0769-ebb5-4407-a0db-4be5a00d1304 tempest-GroupSnapshotsTest-699199185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-db309b17-5775-474e-800b-9054ee1ce7bb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-db309b17-5775-474e-800b-9054ee1ce7bb.093a076f-8ba8-4da3-a46d-ed228cc8609c 1G {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:45:51 devstack sudo[92227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-db309b17-5775-474e-800b-9054ee1ce7bb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-db309b17-5775-474e-800b-9054ee1ce7bb.093a076f-8ba8-4da3-a46d-ed228cc8609c 1G Nov 06 11:45:51 devstack sudo[92227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:45:52 devstack sudo[92227]: pam_unix(sudo:session): session closed for user root Nov 06 11:45:52 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-cf1f0769-ebb5-4407-a0db-4be5a00d1304 tempest-GroupSnapshotsTest-699199185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-db309b17-5775-474e-800b-9054ee1ce7bb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-db309b17-5775-474e-800b-9054ee1ce7bb.093a076f-8ba8-4da3-a46d-ed228cc8609c 1G" returned: 0 in 0.479s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:45:52 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-cf1f0769-ebb5-4407-a0db-4be5a00d1304 tempest-GroupSnapshotsTest-699199185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-db309b17-5775-474e-800b-9054ee1ce7bb -F qcow2 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-db309b17-5775-474e-800b-9054ee1ce7bb.093a076f-8ba8-4da3-a46d-ed228cc8609c {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:45:52 devstack sudo[92233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-db309b17-5775-474e-800b-9054ee1ce7bb -F qcow2 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-db309b17-5775-474e-800b-9054ee1ce7bb.093a076f-8ba8-4da3-a46d-ed228cc8609c Nov 06 11:45:52 devstack sudo[92233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:45:52 devstack sudo[92233]: pam_unix(sudo:session): session closed for user root Nov 06 11:45:52 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-cf1f0769-ebb5-4407-a0db-4be5a00d1304 tempest-GroupSnapshotsTest-699199185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-db309b17-5775-474e-800b-9054ee1ce7bb -F qcow2 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-db309b17-5775-474e-800b-9054ee1ce7bb.093a076f-8ba8-4da3-a46d-ed228cc8609c" returned: 0 in 0.327s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:45:52 devstack cinder-volume[87116]: WARNING cinder.volume.drivers.remotefs [None req-cf1f0769-ebb5-4407-a0db-4be5a00d1304 tempest-GroupSnapshotsTest-699199185 None] /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-db309b17-5775-474e-800b-9054ee1ce7bb.093a076f-8ba8-4da3-a46d-ed228cc8609c is being set with open permissions: ugo+rw: NotImplementedError Nov 06 11:45:52 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-cf1f0769-ebb5-4407-a0db-4be5a00d1304 tempest-GroupSnapshotsTest-699199185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-db309b17-5775-474e-800b-9054ee1ce7bb.093a076f-8ba8-4da3-a46d-ed228cc8609c {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:45:52 devstack sudo[92240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-db309b17-5775-474e-800b-9054ee1ce7bb.093a076f-8ba8-4da3-a46d-ed228cc8609c Nov 06 11:45:52 devstack sudo[92240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:45:52 devstack sudo[92240]: pam_unix(sudo:session): session closed for user root Nov 06 11:45:52 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-cf1f0769-ebb5-4407-a0db-4be5a00d1304 tempest-GroupSnapshotsTest-699199185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-db309b17-5775-474e-800b-9054ee1ce7bb.093a076f-8ba8-4da3-a46d-ed228cc8609c" returned: 0 in 0.301s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:45:52 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-cf1f0769-ebb5-4407-a0db-4be5a00d1304 tempest-GroupSnapshotsTest-699199185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-db309b17-5775-474e-800b-9054ee1ce7bb.info {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:45:52 devstack sudo[92243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-db309b17-5775-474e-800b-9054ee1ce7bb.info Nov 06 11:45:52 devstack sudo[92243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:45:53 devstack sudo[92243]: pam_unix(sudo:session): session closed for user root Nov 06 11:45:53 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-cf1f0769-ebb5-4407-a0db-4be5a00d1304 tempest-GroupSnapshotsTest-699199185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-db309b17-5775-474e-800b-9054ee1ce7bb.info" returned: 0 in 0.265s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:45:53 devstack cinder-volume[87116]: WARNING cinder.volume.drivers.remotefs [None req-cf1f0769-ebb5-4407-a0db-4be5a00d1304 tempest-GroupSnapshotsTest-699199185 None] /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-db309b17-5775-474e-800b-9054ee1ce7bb.info is being set with open permissions: ugo+rw: NotImplementedError Nov 06 11:45:53 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-cf1f0769-ebb5-4407-a0db-4be5a00d1304 tempest-GroupSnapshotsTest-699199185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-db309b17-5775-474e-800b-9054ee1ce7bb.info {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:45:53 devstack sudo[92246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-db309b17-5775-474e-800b-9054ee1ce7bb.info Nov 06 11:45:53 devstack sudo[92246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:45:53 devstack sudo[92246]: pam_unix(sudo:session): session closed for user root Nov 06 11:45:53 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-cf1f0769-ebb5-4407-a0db-4be5a00d1304 tempest-GroupSnapshotsTest-699199185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-db309b17-5775-474e-800b-9054ee1ce7bb.info" returned: 0 in 0.282s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:45:53 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-cf1f0769-ebb5-4407-a0db-4be5a00d1304 tempest-GroupSnapshotsTest-699199185 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.146s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 11:45:53 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-cf1f0769-ebb5-4407-a0db-4be5a00d1304 tempest-GroupSnapshotsTest-699199185 None] group_snapshot 3c4bed66-0070-4b4c-aa87-e27d74fb5387: created successfully Nov 06 11:45:54 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-ea024d00-eabb-4476-8059-751043ab12db tempest-GroupSnapshotsTest-699199185 None] group_snapshot 3c4bed66-0070-4b4c-aa87-e27d74fb5387: deleting Nov 06 11:45:54 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-ea024d00-eabb-4476-8059-751043ab12db tempest-GroupSnapshotsTest-699199185 None] group_snapshot 3c4bed66-0070-4b4c-aa87-e27d74fb5387: deleting {{(pid=87116) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Nov 06 11:45:54 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-ea024d00-eabb-4476-8059-751043ab12db tempest-GroupSnapshotsTest-699199185 None] Acquiring lock "cinder-quobyte-db309b17-5775-474e-800b-9054ee1ce7bb" by "delete_snapshot" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 11:45:54 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-ea024d00-eabb-4476-8059-751043ab12db tempest-GroupSnapshotsTest-699199185 None] Lock "cinder-quobyte-db309b17-5775-474e-800b-9054ee1ce7bb" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 11:45:54 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-ea024d00-eabb-4476-8059-751043ab12db tempest-GroupSnapshotsTest-699199185 None] Acquiring lock "cinder-quobyte-093a076f-8ba8-4da3-a46d-ed228cc8609c" by "_delete_snapshot" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 11:45:54 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-ea024d00-eabb-4476-8059-751043ab12db tempest-GroupSnapshotsTest-699199185 None] Lock "cinder-quobyte-093a076f-8ba8-4da3-a46d-ed228cc8609c" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 11:45:54 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-ea024d00-eabb-4476-8059-751043ab12db tempest-GroupSnapshotsTest-699199185 None] Deleting offline snapshot 093a076f-8ba8-4da3-a46d-ed228cc8609c of volume db309b17-5775-474e-800b-9054ee1ce7bb {{(pid=87116) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 06 11:45:54 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-ea024d00-eabb-4476-8059-751043ab12db tempest-GroupSnapshotsTest-699199185 None] snapshot_file for this snap is: volume-db309b17-5775-474e-800b-9054ee1ce7bb.093a076f-8ba8-4da3-a46d-ed228cc8609c {{(pid=87116) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 06 11:45:54 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[8885218f-3ea0-404d-99e7-dfb1def74d11]: (4, 'qcow2') {{(pid=88420) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 11:45:54 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-ea024d00-eabb-4476-8059-751043ab12db tempest-GroupSnapshotsTest-699199185 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-db309b17-5775-474e-800b-9054ee1ce7bb.093a076f-8ba8-4da3-a46d-ed228cc8609c {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:45:55 devstack sudo[92249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-db309b17-5775-474e-800b-9054ee1ce7bb.093a076f-8ba8-4da3-a46d-ed228cc8609c Nov 06 11:45:55 devstack sudo[92249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:45:55 devstack sudo[92249]: pam_unix(sudo:session): session closed for user root Nov 06 11:45:55 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-ea024d00-eabb-4476-8059-751043ab12db tempest-GroupSnapshotsTest-699199185 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-db309b17-5775-474e-800b-9054ee1ce7bb.093a076f-8ba8-4da3-a46d-ed228cc8609c" returned: 0 in 0.641s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:45:55 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-ea024d00-eabb-4476-8059-751043ab12db tempest-GroupSnapshotsTest-699199185 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-db309b17-5775-474e-800b-9054ee1ce7bb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87116) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 11:45:55 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[724d7be0-6948-49a5-bbce-a3b83e5bfda6]: (4, 'qcow2') {{(pid=88420) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 11:45:55 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-ea024d00-eabb-4476-8059-751043ab12db tempest-GroupSnapshotsTest-699199185 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-db309b17-5775-474e-800b-9054ee1ce7bb {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:45:55 devstack sudo[92255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-db309b17-5775-474e-800b-9054ee1ce7bb Nov 06 11:45:55 devstack sudo[92255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:45:56 devstack sudo[92255]: pam_unix(sudo:session): session closed for user root Nov 06 11:45:56 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-ea024d00-eabb-4476-8059-751043ab12db tempest-GroupSnapshotsTest-699199185 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-db309b17-5775-474e-800b-9054ee1ce7bb" returned: 0 in 0.499s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:45:56 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-ea024d00-eabb-4476-8059-751043ab12db tempest-GroupSnapshotsTest-699199185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-db309b17-5775-474e-800b-9054ee1ce7bb.093a076f-8ba8-4da3-a46d-ed228cc8609c {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:45:56 devstack sudo[92260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-db309b17-5775-474e-800b-9054ee1ce7bb.093a076f-8ba8-4da3-a46d-ed228cc8609c Nov 06 11:45:56 devstack sudo[92260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:45:56 devstack sudo[92260]: pam_unix(sudo:session): session closed for user root Nov 06 11:45:56 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-ea024d00-eabb-4476-8059-751043ab12db tempest-GroupSnapshotsTest-699199185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-db309b17-5775-474e-800b-9054ee1ce7bb.093a076f-8ba8-4da3-a46d-ed228cc8609c" returned: 0 in 0.562s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:45:56 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-ea024d00-eabb-4476-8059-751043ab12db tempest-GroupSnapshotsTest-699199185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-db309b17-5775-474e-800b-9054ee1ce7bb.093a076f-8ba8-4da3-a46d-ed228cc8609c {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:45:56 devstack sudo[92267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-db309b17-5775-474e-800b-9054ee1ce7bb.093a076f-8ba8-4da3-a46d-ed228cc8609c Nov 06 11:45:56 devstack sudo[92267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:45:56 devstack sudo[92267]: pam_unix(sudo:session): session closed for user root Nov 06 11:45:56 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-ea024d00-eabb-4476-8059-751043ab12db tempest-GroupSnapshotsTest-699199185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-db309b17-5775-474e-800b-9054ee1ce7bb.093a076f-8ba8-4da3-a46d-ed228cc8609c" returned: 0 in 0.256s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:45:56 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-ea024d00-eabb-4476-8059-751043ab12db tempest-GroupSnapshotsTest-699199185 None] Lock "cinder-quobyte-093a076f-8ba8-4da3-a46d-ed228cc8609c" released by "_delete_snapshot" :: held 2.144s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 11:45:56 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-ea024d00-eabb-4476-8059-751043ab12db tempest-GroupSnapshotsTest-699199185 None] Lock "cinder-quobyte-db309b17-5775-474e-800b-9054ee1ce7bb" released by "delete_snapshot" :: held 2.174s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 11:45:57 devstack cinder-volume[87116]: WARNING cinder.quota [None req-ea024d00-eabb-4476-8059-751043ab12db tempest-GroupSnapshotsTest-699199185 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-483650497 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-483650497, it is now deprecated. Please use the default quota class for default quota. Nov 06 11:45:57 devstack cinder-volume[87116]: WARNING cinder.quota [None req-ea024d00-eabb-4476-8059-751043ab12db tempest-GroupSnapshotsTest-699199185 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-483650497 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-483650497, it is now deprecated. Please use the default quota class for default quota. Nov 06 11:45:57 devstack cinder-volume[87116]: DEBUG cinder.quota [None req-ea024d00-eabb-4476-8059-751043ab12db tempest-GroupSnapshotsTest-699199185 None] Created reservations ['ab28e9f7-710c-409e-bb88-577b0988f507', 'cad663d1-f06d-437f-9e74-007f6a722309', 'e59e99d3-b8be-4971-9085-608e0d968d1c', 'c87cdbe2-9b0b-4dc6-9c85-67174e0ff9dd'] {{(pid=87116) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 11:45:57 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-ea024d00-eabb-4476-8059-751043ab12db tempest-GroupSnapshotsTest-699199185 None] group_snapshot 3c4bed66-0070-4b4c-aa87-e27d74fb5387: deleted successfully Nov 06 11:45:57 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-a5e5541b-8268-495d-96f5-4917fd3f1e66 tempest-GroupSnapshotsTest-699199185 None] Acquiring lock "cinder-quobyte-db309b17-5775-474e-800b-9054ee1ce7bb" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 11:45:57 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-a5e5541b-8268-495d-96f5-4917fd3f1e66 tempest-GroupSnapshotsTest-699199185 None] Lock "cinder-quobyte-db309b17-5775-474e-800b-9054ee1ce7bb" acquired by "delete_volume" :: waited 0.025s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 11:45:57 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[47e96c62-236d-4a47-9c46-ffc76dce354d]: (4, 'qcow2') {{(pid=88420) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 11:45:57 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-a5e5541b-8268-495d-96f5-4917fd3f1e66 tempest-GroupSnapshotsTest-699199185 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-db309b17-5775-474e-800b-9054ee1ce7bb {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:45:58 devstack sudo[92273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-db309b17-5775-474e-800b-9054ee1ce7bb Nov 06 11:45:58 devstack sudo[92273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:45:58 devstack sudo[92273]: pam_unix(sudo:session): session closed for user root Nov 06 11:45:58 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-a5e5541b-8268-495d-96f5-4917fd3f1e66 tempest-GroupSnapshotsTest-699199185 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-db309b17-5775-474e-800b-9054ee1ce7bb" returned: 0 in 0.805s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:45:58 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-a5e5541b-8268-495d-96f5-4917fd3f1e66 tempest-GroupSnapshotsTest-699199185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-db309b17-5775-474e-800b-9054ee1ce7bb {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:45:58 devstack sudo[92295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-db309b17-5775-474e-800b-9054ee1ce7bb Nov 06 11:45:58 devstack sudo[92295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:45:59 devstack sudo[92295]: pam_unix(sudo:session): session closed for user root Nov 06 11:45:59 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-a5e5541b-8268-495d-96f5-4917fd3f1e66 tempest-GroupSnapshotsTest-699199185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-db309b17-5775-474e-800b-9054ee1ce7bb" returned: 0 in 0.548s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:45:59 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-a5e5541b-8268-495d-96f5-4917fd3f1e66 tempest-GroupSnapshotsTest-699199185 None] Lock "cinder-quobyte-db309b17-5775-474e-800b-9054ee1ce7bb" released by "delete_volume" :: held 1.470s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 11:45:59 devstack cinder-volume[87116]: DEBUG cinder.quota [None req-a5e5541b-8268-495d-96f5-4917fd3f1e66 tempest-GroupSnapshotsTest-699199185 None] Created reservations ['e4033d3f-0f0e-4cf9-b6cc-dc37b7fe70f9'] {{(pid=87116) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 11:45:59 devstack cinder-volume[87116]: WARNING cinder.quota [None req-a5e5541b-8268-495d-96f5-4917fd3f1e66 tempest-GroupSnapshotsTest-699199185 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-483650497 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-483650497, it is now deprecated. Please use the default quota class for default quota. Nov 06 11:45:59 devstack cinder-volume[87116]: DEBUG cinder.quota [None req-a5e5541b-8268-495d-96f5-4917fd3f1e66 tempest-GroupSnapshotsTest-699199185 None] Created reservations ['b008ec93-fcd8-415c-a819-7a43af5f880f', 'f016d399-aa67-4924-af9e-701bcaccfe7d', '6b34ce12-d8ff-44e5-97b9-9976b663d3f8', '9688fa1d-4270-4488-a913-d14402535ea8'] {{(pid=87116) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 11:45:59 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-a5e5541b-8268-495d-96f5-4917fd3f1e66 tempest-GroupSnapshotsTest-699199185 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 11:45:59 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-a5e5541b-8268-495d-96f5-4917fd3f1e66 tempest-GroupSnapshotsTest-699199185 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 11:45:59 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-a5e5541b-8268-495d-96f5-4917fd3f1e66 tempest-GroupSnapshotsTest-699199185 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 11:45:59 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-a5e5541b-8268-495d-96f5-4917fd3f1e66 tempest-GroupSnapshotsTest-699199185 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 11:45:59 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-a5e5541b-8268-495d-96f5-4917fd3f1e66 tempest-GroupSnapshotsTest-699199185 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 11:45:59 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-a5e5541b-8268-495d-96f5-4917fd3f1e66 tempest-GroupSnapshotsTest-699199185 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:45:59 devstack sudo[92304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756 Nov 06 11:45:59 devstack sudo[92304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:46:00 devstack sudo[92304]: pam_unix(sudo:session): session closed for user root Nov 06 11:46:00 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-a5e5541b-8268-495d-96f5-4917fd3f1e66 tempest-GroupSnapshotsTest-699199185 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756" returned: 0 in 0.400s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:46:00 devstack cinder-volume[87116]: DEBUG cinder.manager [None req-a5e5541b-8268-495d-96f5-4917fd3f1e66 tempest-GroupSnapshotsTest-699199185 None] Notifying Schedulers of capabilities ... {{(pid=87116) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 11:46:00 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-a5e5541b-8268-495d-96f5-4917fd3f1e66 tempest-GroupSnapshotsTest-699199185 None] Delete group completed successfully. Nov 06 11:46:03 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-b4bc453c-48ab-4cf3-8f77-3e429a80508f tempest-AttachVolumeShelveTestJSON-1508542063 None] Acquiring lock "cinder-86442665-990d-4290-a4ef-b71510b118bf-delete_volume" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 11:46:03 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-b4bc453c-48ab-4cf3-8f77-3e429a80508f tempest-AttachVolumeShelveTestJSON-1508542063 None] Lock "cinder-86442665-990d-4290-a4ef-b71510b118bf-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 11:46:03 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-b4bc453c-48ab-4cf3-8f77-3e429a80508f tempest-AttachVolumeShelveTestJSON-1508542063 None] Acquiring lock "cinder-quobyte-86442665-990d-4290-a4ef-b71510b118bf" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 11:46:03 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-b4bc453c-48ab-4cf3-8f77-3e429a80508f tempest-AttachVolumeShelveTestJSON-1508542063 None] Lock "cinder-quobyte-86442665-990d-4290-a4ef-b71510b118bf" acquired by "delete_volume" :: waited 0.032s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 11:46:03 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[89d8a3f7-8e69-442f-b846-6a63284de3c7]: (4, 'qcow2') {{(pid=88420) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 11:46:03 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-b4bc453c-48ab-4cf3-8f77-3e429a80508f tempest-AttachVolumeShelveTestJSON-1508542063 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-86442665-990d-4290-a4ef-b71510b118bf {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:46:03 devstack sudo[92334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-86442665-990d-4290-a4ef-b71510b118bf Nov 06 11:46:03 devstack sudo[92334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:46:04 devstack sudo[92334]: pam_unix(sudo:session): session closed for user root Nov 06 11:46:04 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-b4bc453c-48ab-4cf3-8f77-3e429a80508f tempest-AttachVolumeShelveTestJSON-1508542063 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-86442665-990d-4290-a4ef-b71510b118bf" returned: 0 in 0.443s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:46:04 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-b4bc453c-48ab-4cf3-8f77-3e429a80508f tempest-AttachVolumeShelveTestJSON-1508542063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-86442665-990d-4290-a4ef-b71510b118bf {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:46:04 devstack sudo[92363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-86442665-990d-4290-a4ef-b71510b118bf Nov 06 11:46:04 devstack sudo[92363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:46:04 devstack sudo[92363]: pam_unix(sudo:session): session closed for user root Nov 06 11:46:04 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-b4bc453c-48ab-4cf3-8f77-3e429a80508f tempest-AttachVolumeShelveTestJSON-1508542063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-86442665-990d-4290-a4ef-b71510b118bf" returned: 0 in 0.297s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:46:04 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-b4bc453c-48ab-4cf3-8f77-3e429a80508f tempest-AttachVolumeShelveTestJSON-1508542063 None] Lock "cinder-quobyte-86442665-990d-4290-a4ef-b71510b118bf" released by "delete_volume" :: held 0.816s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 11:46:04 devstack cinder-volume[87116]: DEBUG cinder.quota [None req-b4bc453c-48ab-4cf3-8f77-3e429a80508f tempest-AttachVolumeShelveTestJSON-1508542063 None] Created reservations ['3ec26359-7c6b-4e0a-8341-ad954306df1b', '1213d7ae-8bde-4916-8c44-9e00e345fb1c', '8826515e-7b48-4b02-851b-45fecea2824c', '56bc6656-6b09-40d8-9724-839b5e64e669'] {{(pid=87116) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 11:46:04 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-b4bc453c-48ab-4cf3-8f77-3e429a80508f tempest-AttachVolumeShelveTestJSON-1508542063 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 11:46:04 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-b4bc453c-48ab-4cf3-8f77-3e429a80508f tempest-AttachVolumeShelveTestJSON-1508542063 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 11:46:04 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-b4bc453c-48ab-4cf3-8f77-3e429a80508f tempest-AttachVolumeShelveTestJSON-1508542063 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 11:46:04 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-b4bc453c-48ab-4cf3-8f77-3e429a80508f tempest-AttachVolumeShelveTestJSON-1508542063 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 11:46:04 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-b4bc453c-48ab-4cf3-8f77-3e429a80508f tempest-AttachVolumeShelveTestJSON-1508542063 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 11:46:04 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-b4bc453c-48ab-4cf3-8f77-3e429a80508f tempest-AttachVolumeShelveTestJSON-1508542063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:46:04 devstack sudo[92366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756 Nov 06 11:46:04 devstack sudo[92366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:46:05 devstack sudo[92366]: pam_unix(sudo:session): session closed for user root Nov 06 11:46:05 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-b4bc453c-48ab-4cf3-8f77-3e429a80508f tempest-AttachVolumeShelveTestJSON-1508542063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756" returned: 0 in 0.323s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:46:05 devstack cinder-volume[87116]: DEBUG cinder.manager [None req-b4bc453c-48ab-4cf3-8f77-3e429a80508f tempest-AttachVolumeShelveTestJSON-1508542063 None] Notifying Schedulers of capabilities ... {{(pid=87116) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 11:46:05 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-b4bc453c-48ab-4cf3-8f77-3e429a80508f tempest-AttachVolumeShelveTestJSON-1508542063 None] Deleted volume successfully. Nov 06 11:46:05 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-b4bc453c-48ab-4cf3-8f77-3e429a80508f tempest-AttachVolumeShelveTestJSON-1508542063 None] Lock "cinder-86442665-990d-4290-a4ef-b71510b118bf-delete_volume" released by "delete_volume" :: held 1.469s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 11:46:08 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-43b28f41-ce71-41da-b920-df6faea5699a tempest-GroupsV314Test-1023156481 None] Group tempest-GroupsV314Test-Group-662492785: creating Nov 06 11:46:08 devstack cinder-volume[87116]: DEBUG dbcounter [-] [87116] Writing DB stats cinder:UPDATE=103,cinder:SELECT=117,cinder:INSERT=31,cinder:DELETE=5 {{(pid=87116) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 11:46:08 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-43b28f41-ce71-41da-b920-df6faea5699a tempest-GroupsV314Test-1023156481 None] Group tempest-GroupsV314Test-Group-662492785: created successfully Nov 06 11:46:08 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-43b28f41-ce71-41da-b920-df6faea5699a tempest-GroupsV314Test-1023156481 None] Create group completed successfully. Nov 06 11:46:10 devstack cinder-volume[87116]: DEBUG cinder.volume.flows.manager.create_volume [None req-dcd07ca1-f7b6-40c3-ac26-eaa61e9a800a tempest-GroupsV314Test-1023156481 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87116) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 11:46:10 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-dcd07ca1-f7b6-40c3-ac26-eaa61e9a800a tempest-GroupsV314Test-1023156481 None] Flow 'volume_create_manager' (aca8e785-ae4c-461f-878b-ab7bd2b1da62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 11:46:10 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-dcd07ca1-f7b6-40c3-ac26-eaa61e9a800a tempest-GroupsV314Test-1023156481 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7172a571-4dcf-411e-9439-1697a8b6b991) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:46:10 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-dcd07ca1-f7b6-40c3-ac26-eaa61e9a800a tempest-GroupsV314Test-1023156481 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7172a571-4dcf-411e-9439-1697a8b6b991) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T10:46:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-894736452',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=3f22fa26-b4cc-4d7d-aa2c-6dcb371a2f9b,host='devstack@QuobyteHD#QuobyteHD',id=0fb1440f-95c8-434e-8038-3b65b2c3c8f1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a221d5eb83ad43a0970eb8930ac774d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T10:46:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T10:46:10Z,use_quota=True,user_id='4f297db134e242d48056b271c04603e2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(700b77ec-abe2-46a1-845f-284729e2b36c),volume_type_id=700b77ec-abe2-46a1-845f-284729e2b36c)' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:46:10 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-dcd07ca1-f7b6-40c3-ac26-eaa61e9a800a tempest-GroupsV314Test-1023156481 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3abaa335-c128-4e31-b75f-3b7bdca4c926) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:46:10 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-dcd07ca1-f7b6-40c3-ac26-eaa61e9a800a tempest-GroupsV314Test-1023156481 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3abaa335-c128-4e31-b75f-3b7bdca4c926) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:46:10 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-dcd07ca1-f7b6-40c3-ac26-eaa61e9a800a tempest-GroupsV314Test-1023156481 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0aba9815-a1f7-4931-8cd2-bce48e9a4fe2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:46:10 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-dcd07ca1-f7b6-40c3-ac26-eaa61e9a800a tempest-GroupsV314Test-1023156481 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0aba9815-a1f7-4931-8cd2-bce48e9a4fe2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0fb1440f-95c8-434e-8038-3b65b2c3c8f1', 'volume_name': 'volume-0fb1440f-95c8-434e-8038-3b65b2c3c8f1', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:46:10 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-dcd07ca1-f7b6-40c3-ac26-eaa61e9a800a tempest-GroupsV314Test-1023156481 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9fbaa17e-a9a8-4c72-8f36-644c0b4b8198) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:46:10 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-dcd07ca1-f7b6-40c3-ac26-eaa61e9a800a tempest-GroupsV314Test-1023156481 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9fbaa17e-a9a8-4c72-8f36-644c0b4b8198) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:46:10 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-dcd07ca1-f7b6-40c3-ac26-eaa61e9a800a tempest-GroupsV314Test-1023156481 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (47801552-911c-4bcc-8e75-24270dad9d03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:46:10 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-dcd07ca1-f7b6-40c3-ac26-eaa61e9a800a tempest-GroupsV314Test-1023156481 None] Volume 0fb1440f-95c8-434e-8038-3b65b2c3c8f1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0fb1440f-95c8-434e-8038-3b65b2c3c8f1', 'volume_size': 1} Nov 06 11:46:10 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-dcd07ca1-f7b6-40c3-ac26-eaa61e9a800a tempest-GroupsV314Test-1023156481 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 11:46:10 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-dcd07ca1-f7b6-40c3-ac26-eaa61e9a800a tempest-GroupsV314Test-1023156481 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 11:46:10 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-dcd07ca1-f7b6-40c3-ac26-eaa61e9a800a tempest-GroupsV314Test-1023156481 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=3f22fa26-b4cc-4d7d-aa2c-6dcb371a2f9b,created_at=2026-11-06T10:46:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-894736452',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=3f22fa26-b4cc-4d7d-aa2c-6dcb371a2f9b,host='devstack@QuobyteHD#QuobyteHD',id=0fb1440f-95c8-434e-8038-3b65b2c3c8f1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a221d5eb83ad43a0970eb8930ac774d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T10:46:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T10:46:10Z,use_quota=True,user_id='4f297db134e242d48056b271c04603e2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(700b77ec-abe2-46a1-845f-284729e2b36c),volume_type_id=700b77ec-abe2-46a1-845f-284729e2b36c)}" {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 11:46:10 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-dcd07ca1-f7b6-40c3-ac26-eaa61e9a800a tempest-GroupsV314Test-1023156481 None] Creating volume 0fb1440f-95c8-434e-8038-3b65b2c3c8f1 {{(pid=87116) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 11:46:10 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-dcd07ca1-f7b6-40c3-ac26-eaa61e9a800a tempest-GroupsV314Test-1023156481 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 11:46:10 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-dcd07ca1-f7b6-40c3-ac26-eaa61e9a800a tempest-GroupsV314Test-1023156481 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 11:46:10 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-dcd07ca1-f7b6-40c3-ac26-eaa61e9a800a tempest-GroupsV314Test-1023156481 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 11:46:10 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-dcd07ca1-f7b6-40c3-ac26-eaa61e9a800a tempest-GroupsV314Test-1023156481 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 11:46:10 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-dcd07ca1-f7b6-40c3-ac26-eaa61e9a800a tempest-GroupsV314Test-1023156481 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 11:46:10 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-dcd07ca1-f7b6-40c3-ac26-eaa61e9a800a tempest-GroupsV314Test-1023156481 None] Selected osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f as target Quobyte volume. {{(pid=87116) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 11:46:10 devstack cinder-volume[87116]: INFO cinder.volume.drivers.remotefs [None req-dcd07ca1-f7b6-40c3-ac26-eaa61e9a800a tempest-GroupsV314Test-1023156481 None] casted to osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f Nov 06 11:46:10 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-dcd07ca1-f7b6-40c3-ac26-eaa61e9a800a tempest-GroupsV314Test-1023156481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-0fb1440f-95c8-434e-8038-3b65b2c3c8f1 1073741824 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:46:10 devstack sudo[92371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-0fb1440f-95c8-434e-8038-3b65b2c3c8f1 1073741824 Nov 06 11:46:10 devstack sudo[92371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:46:11 devstack sudo[92371]: pam_unix(sudo:session): session closed for user root Nov 06 11:46:11 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-dcd07ca1-f7b6-40c3-ac26-eaa61e9a800a tempest-GroupsV314Test-1023156481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-0fb1440f-95c8-434e-8038-3b65b2c3c8f1 1073741824" returned: 0 in 0.643s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:46:11 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-dcd07ca1-f7b6-40c3-ac26-eaa61e9a800a tempest-GroupsV314Test-1023156481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-0fb1440f-95c8-434e-8038-3b65b2c3c8f1 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:46:11 devstack sudo[92376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-0fb1440f-95c8-434e-8038-3b65b2c3c8f1 Nov 06 11:46:11 devstack sudo[92376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:46:11 devstack sudo[92376]: pam_unix(sudo:session): session closed for user root Nov 06 11:46:11 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-dcd07ca1-f7b6-40c3-ac26-eaa61e9a800a tempest-GroupsV314Test-1023156481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-0fb1440f-95c8-434e-8038-3b65b2c3c8f1" returned: 0 in 0.544s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:46:11 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-dcd07ca1-f7b6-40c3-ac26-eaa61e9a800a tempest-GroupsV314Test-1023156481 None] <== create_volume: return (1259ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f'} {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 11:46:11 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-dcd07ca1-f7b6-40c3-ac26-eaa61e9a800a tempest-GroupsV314Test-1023156481 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.262s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 11:46:11 devstack cinder-volume[87116]: DEBUG dbcounter [-] [87116] Writing DB stats cinder:SELECT=105,cinder:UPDATE=113,cinder:INSERT=20,cinder:DELETE=3 {{(pid=87116) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 11:46:11 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-dcd07ca1-f7b6-40c3-ac26-eaa61e9a800a tempest-GroupsV314Test-1023156481 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (47801552-911c-4bcc-8e75-24270dad9d03) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0fb1440f-95c8-434e-8038-3b65b2c3c8f1', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:46:11 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-dcd07ca1-f7b6-40c3-ac26-eaa61e9a800a tempest-GroupsV314Test-1023156481 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c3c98012-51ae-4cdd-a961-324dd75c897e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:46:11 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-dcd07ca1-f7b6-40c3-ac26-eaa61e9a800a tempest-GroupsV314Test-1023156481 None] Volume volume-0fb1440f-95c8-434e-8038-3b65b2c3c8f1 (0fb1440f-95c8-434e-8038-3b65b2c3c8f1): created successfully Nov 06 11:46:11 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-dcd07ca1-f7b6-40c3-ac26-eaa61e9a800a tempest-GroupsV314Test-1023156481 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c3c98012-51ae-4cdd-a961-324dd75c897e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:46:11 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-dcd07ca1-f7b6-40c3-ac26-eaa61e9a800a tempest-GroupsV314Test-1023156481 None] Flow 'volume_create_manager' (aca8e785-ae4c-461f-878b-ab7bd2b1da62) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 11:46:11 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-dcd07ca1-f7b6-40c3-ac26-eaa61e9a800a tempest-GroupsV314Test-1023156481 None] Created volume successfully. Nov 06 11:46:13 devstack cinder-volume[87116]: INFO cinder.volume.manager [req-d5062725-33a7-4460-8fcf-31c7c08e614a req-56b628c1-299a-4228-87a9-fc1e3039cd9f tempest-ServerActionsTestOtherA-64126338 None] Terminate volume connection completed successfully. Nov 06 11:46:13 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [req-d5062725-33a7-4460-8fcf-31c7c08e614a req-56b628c1-299a-4228-87a9-fc1e3039cd9f tempest-ServerActionsTestOtherA-64126338 None] Deleting attachment f8902932-563d-4081-ad57-dafc43ea7812. {{(pid=87116) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 06 11:46:13 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-361e1db7-24b9-4082-99a1-de86e49306a2 tempest-GroupsV314Test-1023156481 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 11:46:13 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-361e1db7-24b9-4082-99a1-de86e49306a2 tempest-GroupsV314Test-1023156481 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 11:46:13 devstack cinder-volume[87116]: INFO cinder.volume.drivers.remotefs [None req-361e1db7-24b9-4082-99a1-de86e49306a2 tempest-GroupsV314Test-1023156481 None] Cloning volume 0fb1440f-95c8-434e-8038-3b65b2c3c8f1 to volume 1c6f17fe-f637-4aed-9a03-9bd4dab7f5e6 Nov 06 11:46:13 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-361e1db7-24b9-4082-99a1-de86e49306a2 tempest-GroupsV314Test-1023156481 None] Creating offline snapshot 889d9c81-660b-44e6-8c29-7a4b8481aed7 of volume 0fb1440f-95c8-434e-8038-3b65b2c3c8f1 {{(pid=87116) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 06 11:46:13 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[185961b2-a3c2-48dd-82fd-b7b5070df694]: (4, 'qcow2') {{(pid=88420) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 11:46:13 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-361e1db7-24b9-4082-99a1-de86e49306a2 tempest-GroupsV314Test-1023156481 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-0fb1440f-95c8-434e-8038-3b65b2c3c8f1 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:46:13 devstack sudo[92386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-0fb1440f-95c8-434e-8038-3b65b2c3c8f1 Nov 06 11:46:13 devstack sudo[92386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:46:14 devstack sudo[92386]: pam_unix(sudo:session): session closed for user root Nov 06 11:46:14 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-361e1db7-24b9-4082-99a1-de86e49306a2 tempest-GroupsV314Test-1023156481 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-0fb1440f-95c8-434e-8038-3b65b2c3c8f1" returned: 0 in 0.507s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:46:14 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-361e1db7-24b9-4082-99a1-de86e49306a2 tempest-GroupsV314Test-1023156481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-0fb1440f-95c8-434e-8038-3b65b2c3c8f1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-0fb1440f-95c8-434e-8038-3b65b2c3c8f1.889d9c81-660b-44e6-8c29-7a4b8481aed7 1G {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:46:14 devstack sudo[92392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-0fb1440f-95c8-434e-8038-3b65b2c3c8f1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-0fb1440f-95c8-434e-8038-3b65b2c3c8f1.889d9c81-660b-44e6-8c29-7a4b8481aed7 1G Nov 06 11:46:14 devstack sudo[92392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:46:14 devstack sudo[92392]: pam_unix(sudo:session): session closed for user root Nov 06 11:46:14 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-361e1db7-24b9-4082-99a1-de86e49306a2 tempest-GroupsV314Test-1023156481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-0fb1440f-95c8-434e-8038-3b65b2c3c8f1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-0fb1440f-95c8-434e-8038-3b65b2c3c8f1.889d9c81-660b-44e6-8c29-7a4b8481aed7 1G" returned: 0 in 0.668s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:46:14 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-361e1db7-24b9-4082-99a1-de86e49306a2 tempest-GroupsV314Test-1023156481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0fb1440f-95c8-434e-8038-3b65b2c3c8f1 -F qcow2 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-0fb1440f-95c8-434e-8038-3b65b2c3c8f1.889d9c81-660b-44e6-8c29-7a4b8481aed7 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:46:15 devstack sudo[92398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0fb1440f-95c8-434e-8038-3b65b2c3c8f1 -F qcow2 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-0fb1440f-95c8-434e-8038-3b65b2c3c8f1.889d9c81-660b-44e6-8c29-7a4b8481aed7 Nov 06 11:46:15 devstack sudo[92398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:46:15 devstack sudo[92398]: pam_unix(sudo:session): session closed for user root Nov 06 11:46:15 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-361e1db7-24b9-4082-99a1-de86e49306a2 tempest-GroupsV314Test-1023156481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0fb1440f-95c8-434e-8038-3b65b2c3c8f1 -F qcow2 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-0fb1440f-95c8-434e-8038-3b65b2c3c8f1.889d9c81-660b-44e6-8c29-7a4b8481aed7" returned: 0 in 0.545s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:46:15 devstack cinder-volume[87116]: WARNING cinder.volume.drivers.remotefs [None req-361e1db7-24b9-4082-99a1-de86e49306a2 tempest-GroupsV314Test-1023156481 None] /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-0fb1440f-95c8-434e-8038-3b65b2c3c8f1.889d9c81-660b-44e6-8c29-7a4b8481aed7 is being set with open permissions: ugo+rw: NotImplementedError Nov 06 11:46:15 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-361e1db7-24b9-4082-99a1-de86e49306a2 tempest-GroupsV314Test-1023156481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-0fb1440f-95c8-434e-8038-3b65b2c3c8f1.889d9c81-660b-44e6-8c29-7a4b8481aed7 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:46:15 devstack sudo[92425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-0fb1440f-95c8-434e-8038-3b65b2c3c8f1.889d9c81-660b-44e6-8c29-7a4b8481aed7 Nov 06 11:46:15 devstack sudo[92425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:46:15 devstack sudo[92425]: pam_unix(sudo:session): session closed for user root Nov 06 11:46:15 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-361e1db7-24b9-4082-99a1-de86e49306a2 tempest-GroupsV314Test-1023156481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-0fb1440f-95c8-434e-8038-3b65b2c3c8f1.889d9c81-660b-44e6-8c29-7a4b8481aed7" returned: 0 in 0.324s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:46:15 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-361e1db7-24b9-4082-99a1-de86e49306a2 tempest-GroupsV314Test-1023156481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-0fb1440f-95c8-434e-8038-3b65b2c3c8f1.info {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:46:15 devstack sudo[92430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-0fb1440f-95c8-434e-8038-3b65b2c3c8f1.info Nov 06 11:46:15 devstack sudo[92430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:46:16 devstack sudo[92430]: pam_unix(sudo:session): session closed for user root Nov 06 11:46:16 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-361e1db7-24b9-4082-99a1-de86e49306a2 tempest-GroupsV314Test-1023156481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-0fb1440f-95c8-434e-8038-3b65b2c3c8f1.info" returned: 0 in 0.370s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:46:16 devstack cinder-volume[87116]: WARNING cinder.volume.drivers.remotefs [None req-361e1db7-24b9-4082-99a1-de86e49306a2 tempest-GroupsV314Test-1023156481 None] /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-0fb1440f-95c8-434e-8038-3b65b2c3c8f1.info is being set with open permissions: ugo+rw: NotImplementedError Nov 06 11:46:16 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-361e1db7-24b9-4082-99a1-de86e49306a2 tempest-GroupsV314Test-1023156481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-0fb1440f-95c8-434e-8038-3b65b2c3c8f1.info {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:46:16 devstack sudo[92433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-0fb1440f-95c8-434e-8038-3b65b2c3c8f1.info Nov 06 11:46:16 devstack sudo[92433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:46:16 devstack sudo[92433]: pam_unix(sudo:session): session closed for user root Nov 06 11:46:16 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-361e1db7-24b9-4082-99a1-de86e49306a2 tempest-GroupsV314Test-1023156481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-0fb1440f-95c8-434e-8038-3b65b2c3c8f1.info" returned: 0 in 0.321s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:46:16 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-361e1db7-24b9-4082-99a1-de86e49306a2 tempest-GroupsV314Test-1023156481 None] Acquiring lock "cinder-quobyte-1c6f17fe-f637-4aed-9a03-9bd4dab7f5e6" by "_copy_volume_from_snapshot" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 11:46:16 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-361e1db7-24b9-4082-99a1-de86e49306a2 tempest-GroupsV314Test-1023156481 None] Lock "cinder-quobyte-1c6f17fe-f637-4aed-9a03-9bd4dab7f5e6" acquired by "_copy_volume_from_snapshot" :: waited 0.022s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 11:46:16 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-361e1db7-24b9-4082-99a1-de86e49306a2 tempest-GroupsV314Test-1023156481 None] snapshot: 889d9c81-660b-44e6-8c29-7a4b8481aed7, volume: 1c6f17fe-f637-4aed-9a03-9bd4dab7f5e6, {{(pid=87116) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 06 11:46:16 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-361e1db7-24b9-4082-99a1-de86e49306a2 tempest-GroupsV314Test-1023156481 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 11:46:16 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-361e1db7-24b9-4082-99a1-de86e49306a2 tempest-GroupsV314Test-1023156481 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 11:46:16 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-361e1db7-24b9-4082-99a1-de86e49306a2 tempest-GroupsV314Test-1023156481 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 11:46:16 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-361e1db7-24b9-4082-99a1-de86e49306a2 tempest-GroupsV314Test-1023156481 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 11:46:16 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-361e1db7-24b9-4082-99a1-de86e49306a2 tempest-GroupsV314Test-1023156481 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 11:46:16 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[277b3a3e-a47e-4a9c-881b-d4c680a69fd5]: (4, 'qcow2') {{(pid=88420) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 11:46:16 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-361e1db7-24b9-4082-99a1-de86e49306a2 tempest-GroupsV314Test-1023156481 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-0fb1440f-95c8-434e-8038-3b65b2c3c8f1.889d9c81-660b-44e6-8c29-7a4b8481aed7 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:46:16 devstack sudo[92437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-0fb1440f-95c8-434e-8038-3b65b2c3c8f1.889d9c81-660b-44e6-8c29-7a4b8481aed7 Nov 06 11:46:16 devstack sudo[92437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:46:17 devstack sudo[92437]: pam_unix(sudo:session): session closed for user root Nov 06 11:46:17 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-361e1db7-24b9-4082-99a1-de86e49306a2 tempest-GroupsV314Test-1023156481 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-0fb1440f-95c8-434e-8038-3b65b2c3c8f1.889d9c81-660b-44e6-8c29-7a4b8481aed7" returned: 0 in 0.436s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:46:17 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-361e1db7-24b9-4082-99a1-de86e49306a2 tempest-GroupsV314Test-1023156481 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0fb1440f-95c8-434e-8038-3b65b2c3c8f1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87116) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 11:46:17 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[f04543be-592a-49e4-9804-502b112e9e4e]: (4, 'qcow2') {{(pid=88420) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 11:46:17 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-361e1db7-24b9-4082-99a1-de86e49306a2 tempest-GroupsV314Test-1023156481 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-0fb1440f-95c8-434e-8038-3b65b2c3c8f1 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:46:17 devstack sudo[92443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-0fb1440f-95c8-434e-8038-3b65b2c3c8f1 Nov 06 11:46:17 devstack sudo[92443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:46:17 devstack sudo[92443]: pam_unix(sudo:session): session closed for user root Nov 06 11:46:17 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-361e1db7-24b9-4082-99a1-de86e49306a2 tempest-GroupsV314Test-1023156481 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-0fb1440f-95c8-434e-8038-3b65b2c3c8f1" returned: 0 in 0.475s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:46:17 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-361e1db7-24b9-4082-99a1-de86e49306a2 tempest-GroupsV314Test-1023156481 None] will copy from snapshot at /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-0fb1440f-95c8-434e-8038-3b65b2c3c8f1 {{(pid=87116) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 06 11:46:17 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-361e1db7-24b9-4082-99a1-de86e49306a2 tempest-GroupsV314Test-1023156481 None] Creating direct copy from snapshot {{(pid=87116) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 06 11:46:17 devstack cinder-volume[87116]: DEBUG cinder.utils [None req-361e1db7-24b9-4082-99a1-de86e49306a2 tempest-GroupsV314Test-1023156481 None] Path /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-1c6f17fe-f637-4aed-9a03-9bd4dab7f5e6 not found in is_blk_device check {{(pid=87116) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 06 11:46:17 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-361e1db7-24b9-4082-99a1-de86e49306a2 tempest-GroupsV314Test-1023156481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-0fb1440f-95c8-434e-8038-3b65b2c3c8f1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-1c6f17fe-f637-4aed-9a03-9bd4dab7f5e6 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:46:17 devstack sudo[92451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-0fb1440f-95c8-434e-8038-3b65b2c3c8f1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-1c6f17fe-f637-4aed-9a03-9bd4dab7f5e6 Nov 06 11:46:17 devstack sudo[92451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:46:25 devstack cinder-volume[87116]: DEBUG dbcounter [-] [87116] Writing DB stats cinder:DELETE=1,cinder:SELECT=6,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=87116) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 11:46:25 devstack cinder-volume[87116]: DEBUG dbcounter [-] [87116] Writing DB stats cinder:SELECT=9,cinder:UPDATE=5,cinder:INSERT=2 {{(pid=87116) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 11:46:26 devstack cinder-volume[87116]: DEBUG cinder.volume.flows.manager.create_volume [None req-9153eeec-a2f1-4549-9ac0-8a7d257f05ba tempest-ServerActionsTestOtherA-64126338 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87116) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 11:46:26 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-9153eeec-a2f1-4549-9ac0-8a7d257f05ba tempest-ServerActionsTestOtherA-64126338 None] Flow 'volume_create_manager' (74b15ecb-db4f-4527-9c67-fd84fac1c400) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 11:46:26 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-9153eeec-a2f1-4549-9ac0-8a7d257f05ba tempest-ServerActionsTestOtherA-64126338 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (62ddaaef-d03a-4030-9702-8ef80324ee3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:46:26 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-9153eeec-a2f1-4549-9ac0-8a7d257f05ba tempest-ServerActionsTestOtherA-64126338 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (62ddaaef-d03a-4030-9702-8ef80324ee3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T10:46:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-130592488',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d37614a3-9342-4021-b2a4-27556a55c322,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c90798bc4e7b416db316dcd3e2763fdb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T10:46:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T10:46:26Z,use_quota=True,user_id='59c9bb435a0646af84a9849e5e2ab320',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(34d3b144-d9b7-480a-a2e3-01e45f3d54c1),volume_type_id=34d3b144-d9b7-480a-a2e3-01e45f3d54c1)' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:46:26 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-9153eeec-a2f1-4549-9ac0-8a7d257f05ba tempest-ServerActionsTestOtherA-64126338 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f15155cf-cde8-40f0-8b64-4d2e1de7ad73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:46:26 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-9153eeec-a2f1-4549-9ac0-8a7d257f05ba tempest-ServerActionsTestOtherA-64126338 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f15155cf-cde8-40f0-8b64-4d2e1de7ad73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:46:26 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-9153eeec-a2f1-4549-9ac0-8a7d257f05ba tempest-ServerActionsTestOtherA-64126338 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d7e3caf8-0d64-467d-9332-5502a93a4168) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:46:26 devstack cinder-volume[87116]: DEBUG cinder.image.glance [None req-9153eeec-a2f1-4549-9ac0-8a7d257f05ba tempest-ServerActionsTestOtherA-64126338 None] Creating Keystone auth plugin from conf {{(pid=87116) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 06 11:46:27 devstack sudo[92451]: pam_unix(sudo:session): session closed for user root Nov 06 11:46:27 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-9153eeec-a2f1-4549-9ac0-8a7d257f05ba tempest-ServerActionsTestOtherA-64126338 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d7e3caf8-0d64-467d-9332-5502a93a4168) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'd37614a3-9342-4021-b2a4-27556a55c322', 'volume_name': 'volume-d37614a3-9342-4021-b2a4-27556a55c322', 'volume_size': 1, 'image_id': '423469e2-d15b-4cf9-87cd-88e68e947d3b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/423469e2-d15b-4cf9-87cd-88e68e947d3b', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b05f927c30c5407aad52949459346010', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '423469e2-d15b-4cf9-87cd-88e68e947d3b', 'created_at': datetime.datetime(2026, 11, 6, 10, 36, 49, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 6, 10, 36, 50, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/423469e2-d15b-4cf9-87cd-88e68e947d3b/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:46:27 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-9153eeec-a2f1-4549-9ac0-8a7d257f05ba tempest-ServerActionsTestOtherA-64126338 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5ff76201-2eb9-488f-8557-1fc978b4b12a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:46:27 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-9153eeec-a2f1-4549-9ac0-8a7d257f05ba tempest-ServerActionsTestOtherA-64126338 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5ff76201-2eb9-488f-8557-1fc978b4b12a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:46:27 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-9153eeec-a2f1-4549-9ac0-8a7d257f05ba tempest-ServerActionsTestOtherA-64126338 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a4173d2d-23c4-4909-8c68-d2e5a3312478) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:46:27 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-9153eeec-a2f1-4549-9ac0-8a7d257f05ba tempest-ServerActionsTestOtherA-64126338 None] Volume d37614a3-9342-4021-b2a4-27556a55c322: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-d37614a3-9342-4021-b2a4-27556a55c322', 'volume_size': 1, 'image_id': '423469e2-d15b-4cf9-87cd-88e68e947d3b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/423469e2-d15b-4cf9-87cd-88e68e947d3b', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b05f927c30c5407aad52949459346010', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '423469e2-d15b-4cf9-87cd-88e68e947d3b', 'created_at': datetime.datetime(2026, 11, 6, 10, 36, 49, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 6, 10, 36, 50, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/423469e2-d15b-4cf9-87cd-88e68e947d3b/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Nov 06 11:46:27 devstack cinder-volume[87116]: DEBUG cinder.volume.flows.manager.create_volume [None req-9153eeec-a2f1-4549-9ac0-8a7d257f05ba tempest-ServerActionsTestOtherA-64126338 None] Trying to clone d37614a3-9342-4021-b2a4-27556a55c322 from image 423469e2-d15b-4cf9-87cd-88e68e947d3b at location (None, [{'url': 'file:///opt/stack/data/glance/images/423469e2-d15b-4cf9-87cd-88e68e947d3b', 'metadata': {}}]). {{(pid=87116) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Nov 06 11:46:27 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-361e1db7-24b9-4082-99a1-de86e49306a2 tempest-GroupsV314Test-1023156481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-0fb1440f-95c8-434e-8038-3b65b2c3c8f1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-1c6f17fe-f637-4aed-9a03-9bd4dab7f5e6" returned: 0 in 9.968s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:46:27 devstack cinder-volume[87116]: DEBUG cinder.image.image_utils [None req-361e1db7-24b9-4082-99a1-de86e49306a2 tempest-GroupsV314Test-1023156481 None] Image conversion details: src /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-0fb1440f-95c8-434e-8038-3b65b2c3c8f1, size 1024.00 MB, duration 9.97 sec, destination /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-1c6f17fe-f637-4aed-9a03-9bd4dab7f5e6 {{(pid=87116) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 06 11:46:27 devstack cinder-volume[87116]: INFO cinder.image.image_utils [None req-361e1db7-24b9-4082-99a1-de86e49306a2 tempest-GroupsV314Test-1023156481 None] Converted 1024.00 MB image at 102.71 MB/s Nov 06 11:46:27 devstack cinder-volume[87116]: WARNING cinder.volume.drivers.remotefs [None req-361e1db7-24b9-4082-99a1-de86e49306a2 tempest-GroupsV314Test-1023156481 None] /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-1c6f17fe-f637-4aed-9a03-9bd4dab7f5e6 is being set with open permissions: ugo+rw: NotImplementedError Nov 06 11:46:27 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-361e1db7-24b9-4082-99a1-de86e49306a2 tempest-GroupsV314Test-1023156481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-1c6f17fe-f637-4aed-9a03-9bd4dab7f5e6 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:46:27 devstack sudo[92523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-1c6f17fe-f637-4aed-9a03-9bd4dab7f5e6 Nov 06 11:46:27 devstack sudo[92523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:46:28 devstack sudo[92523]: pam_unix(sudo:session): session closed for user root Nov 06 11:46:28 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-361e1db7-24b9-4082-99a1-de86e49306a2 tempest-GroupsV314Test-1023156481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-1c6f17fe-f637-4aed-9a03-9bd4dab7f5e6" returned: 0 in 0.441s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:46:28 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-361e1db7-24b9-4082-99a1-de86e49306a2 tempest-GroupsV314Test-1023156481 None] Lock "cinder-quobyte-1c6f17fe-f637-4aed-9a03-9bd4dab7f5e6" released by "_copy_volume_from_snapshot" :: held 11.449s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 11:46:28 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-361e1db7-24b9-4082-99a1-de86e49306a2 tempest-GroupsV314Test-1023156481 None] Acquiring lock "cinder-quobyte-889d9c81-660b-44e6-8c29-7a4b8481aed7" by "_delete_snapshot" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 11:46:28 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-361e1db7-24b9-4082-99a1-de86e49306a2 tempest-GroupsV314Test-1023156481 None] Lock "cinder-quobyte-889d9c81-660b-44e6-8c29-7a4b8481aed7" acquired by "_delete_snapshot" :: waited 0.035s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 11:46:28 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-361e1db7-24b9-4082-99a1-de86e49306a2 tempest-GroupsV314Test-1023156481 None] Deleting offline snapshot 889d9c81-660b-44e6-8c29-7a4b8481aed7 of volume 0fb1440f-95c8-434e-8038-3b65b2c3c8f1 {{(pid=87116) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 06 11:46:28 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-361e1db7-24b9-4082-99a1-de86e49306a2 tempest-GroupsV314Test-1023156481 None] snapshot_file for this snap is: volume-0fb1440f-95c8-434e-8038-3b65b2c3c8f1.889d9c81-660b-44e6-8c29-7a4b8481aed7 {{(pid=87116) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 06 11:46:28 devstack cinder-volume[87116]: DEBUG cinder.image.image_utils [None req-9153eeec-a2f1-4549-9ac0-8a7d257f05ba tempest-ServerActionsTestOtherA-64126338 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_423469e2-d15b-4cf9-87cd-88e68e947d3b_s9944y2ddevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87116) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Nov 06 11:46:28 devstack cinder-volume[87116]: INFO cinder.image.image_utils [None req-9153eeec-a2f1-4549-9ac0-8a7d257f05ba tempest-ServerActionsTestOtherA-64126338 None] Image download 20.69 MB at 20.69 MB/s Nov 06 11:46:28 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[74cb289f-ca76-40df-919b-5e90cd6eef16]: (4, 'qcow2') {{(pid=88420) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 11:46:28 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-361e1db7-24b9-4082-99a1-de86e49306a2 tempest-GroupsV314Test-1023156481 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-0fb1440f-95c8-434e-8038-3b65b2c3c8f1.889d9c81-660b-44e6-8c29-7a4b8481aed7 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:46:28 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[640fb04c-178a-4470-8e8c-35b5f1c9a521]: (4, 'qcow2') {{(pid=88420) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 11:46:28 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-9153eeec-a2f1-4549-9ac0-8a7d257f05ba tempest-ServerActionsTestOtherA-64126338 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_423469e2-d15b-4cf9-87cd-88e68e947d3b_s9944y2ddevstack@QuobyteHD {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:46:28 devstack sudo[92556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-0fb1440f-95c8-434e-8038-3b65b2c3c8f1.889d9c81-660b-44e6-8c29-7a4b8481aed7 Nov 06 11:46:28 devstack sudo[92556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:46:28 devstack sudo[92557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_423469e2-d15b-4cf9-87cd-88e68e947d3b_s9944y2ddevstack@QuobyteHD Nov 06 11:46:28 devstack sudo[92557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:46:28 devstack sudo[92556]: pam_unix(sudo:session): session closed for user root Nov 06 11:46:28 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-361e1db7-24b9-4082-99a1-de86e49306a2 tempest-GroupsV314Test-1023156481 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-0fb1440f-95c8-434e-8038-3b65b2c3c8f1.889d9c81-660b-44e6-8c29-7a4b8481aed7" returned: 0 in 0.443s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:46:28 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-361e1db7-24b9-4082-99a1-de86e49306a2 tempest-GroupsV314Test-1023156481 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0fb1440f-95c8-434e-8038-3b65b2c3c8f1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87116) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 11:46:28 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3a13f49-6b49-4314-a874-58f4f9ec9739]: (4, 'qcow2') {{(pid=88420) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 11:46:28 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-361e1db7-24b9-4082-99a1-de86e49306a2 tempest-GroupsV314Test-1023156481 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-0fb1440f-95c8-434e-8038-3b65b2c3c8f1 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:46:28 devstack sudo[92557]: pam_unix(sudo:session): session closed for user root Nov 06 11:46:28 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-9153eeec-a2f1-4549-9ac0-8a7d257f05ba tempest-ServerActionsTestOtherA-64126338 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_423469e2-d15b-4cf9-87cd-88e68e947d3b_s9944y2ddevstack@QuobyteHD" returned: 0 in 0.451s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:46:28 devstack cinder-volume[87116]: DEBUG cinder.image.image_utils [None req-9153eeec-a2f1-4549-9ac0-8a7d257f05ba tempest-ServerActionsTestOtherA-64126338 None] Temporary image 423469e2-d15b-4cf9-87cd-88e68e947d3b is fetched for user 59c9bb435a0646af84a9849e5e2ab320. {{(pid=87116) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Nov 06 11:46:28 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd19ca02-e49c-45c3-80d6-395f8da46194]: (4, 'qcow2') {{(pid=88420) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 11:46:28 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-9153eeec-a2f1-4549-9ac0-8a7d257f05ba tempest-ServerActionsTestOtherA-64126338 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_423469e2-d15b-4cf9-87cd-88e68e947d3b_s9944y2ddevstack@QuobyteHD {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:46:28 devstack sudo[92567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-0fb1440f-95c8-434e-8038-3b65b2c3c8f1 Nov 06 11:46:28 devstack sudo[92567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:46:29 devstack sudo[92568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_423469e2-d15b-4cf9-87cd-88e68e947d3b_s9944y2ddevstack@QuobyteHD Nov 06 11:46:29 devstack sudo[92568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:46:29 devstack sudo[92568]: pam_unix(sudo:session): session closed for user root Nov 06 11:46:29 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-9153eeec-a2f1-4549-9ac0-8a7d257f05ba tempest-ServerActionsTestOtherA-64126338 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_423469e2-d15b-4cf9-87cd-88e68e947d3b_s9944y2ddevstack@QuobyteHD" returned: 0 in 0.468s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:46:29 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-9153eeec-a2f1-4549-9ac0-8a7d257f05ba tempest-ServerActionsTestOtherA-64126338 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 11:46:29 devstack sudo[92567]: pam_unix(sudo:session): session closed for user root Nov 06 11:46:29 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-361e1db7-24b9-4082-99a1-de86e49306a2 tempest-GroupsV314Test-1023156481 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-0fb1440f-95c8-434e-8038-3b65b2c3c8f1" returned: 0 in 0.848s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:46:29 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-361e1db7-24b9-4082-99a1-de86e49306a2 tempest-GroupsV314Test-1023156481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-0fb1440f-95c8-434e-8038-3b65b2c3c8f1.889d9c81-660b-44e6-8c29-7a4b8481aed7 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:46:29 devstack sudo[92577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-0fb1440f-95c8-434e-8038-3b65b2c3c8f1.889d9c81-660b-44e6-8c29-7a4b8481aed7 Nov 06 11:46:29 devstack sudo[92577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:46:30 devstack sudo[92577]: pam_unix(sudo:session): session closed for user root Nov 06 11:46:30 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-361e1db7-24b9-4082-99a1-de86e49306a2 tempest-GroupsV314Test-1023156481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-0fb1440f-95c8-434e-8038-3b65b2c3c8f1.889d9c81-660b-44e6-8c29-7a4b8481aed7" returned: 0 in 0.405s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:46:30 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-361e1db7-24b9-4082-99a1-de86e49306a2 tempest-GroupsV314Test-1023156481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-0fb1440f-95c8-434e-8038-3b65b2c3c8f1.889d9c81-660b-44e6-8c29-7a4b8481aed7 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:46:30 devstack sudo[92583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-0fb1440f-95c8-434e-8038-3b65b2c3c8f1.889d9c81-660b-44e6-8c29-7a4b8481aed7 Nov 06 11:46:30 devstack sudo[92583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:46:30 devstack sudo[92583]: pam_unix(sudo:session): session closed for user root Nov 06 11:46:30 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-361e1db7-24b9-4082-99a1-de86e49306a2 tempest-GroupsV314Test-1023156481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-0fb1440f-95c8-434e-8038-3b65b2c3c8f1.889d9c81-660b-44e6-8c29-7a4b8481aed7" returned: 0 in 0.303s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:46:30 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-361e1db7-24b9-4082-99a1-de86e49306a2 tempest-GroupsV314Test-1023156481 None] Lock "cinder-quobyte-889d9c81-660b-44e6-8c29-7a4b8481aed7" released by "_delete_snapshot" :: held 2.177s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 11:46:30 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-361e1db7-24b9-4082-99a1-de86e49306a2 tempest-GroupsV314Test-1023156481 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 16.649s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 11:46:30 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-9153eeec-a2f1-4549-9ac0-8a7d257f05ba tempest-ServerActionsTestOtherA-64126338 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.034s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 11:46:30 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-9153eeec-a2f1-4549-9ac0-8a7d257f05ba tempest-ServerActionsTestOtherA-64126338 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T10:46:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-130592488',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d37614a3-9342-4021-b2a4-27556a55c322,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c90798bc4e7b416db316dcd3e2763fdb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T10:46:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T10:46:26Z,use_quota=True,user_id='59c9bb435a0646af84a9849e5e2ab320',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(34d3b144-d9b7-480a-a2e3-01e45f3d54c1),volume_type_id=34d3b144-d9b7-480a-a2e3-01e45f3d54c1)}" {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 11:46:30 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-9153eeec-a2f1-4549-9ac0-8a7d257f05ba tempest-ServerActionsTestOtherA-64126338 None] Creating volume d37614a3-9342-4021-b2a4-27556a55c322 {{(pid=87116) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 11:46:30 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-9153eeec-a2f1-4549-9ac0-8a7d257f05ba tempest-ServerActionsTestOtherA-64126338 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 11:46:30 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-9153eeec-a2f1-4549-9ac0-8a7d257f05ba tempest-ServerActionsTestOtherA-64126338 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 11:46:30 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-9153eeec-a2f1-4549-9ac0-8a7d257f05ba tempest-ServerActionsTestOtherA-64126338 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 11:46:30 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-9153eeec-a2f1-4549-9ac0-8a7d257f05ba tempest-ServerActionsTestOtherA-64126338 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 11:46:30 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-9153eeec-a2f1-4549-9ac0-8a7d257f05ba tempest-ServerActionsTestOtherA-64126338 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 11:46:30 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-9153eeec-a2f1-4549-9ac0-8a7d257f05ba tempest-ServerActionsTestOtherA-64126338 None] Selected osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f as target Quobyte volume. {{(pid=87116) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 11:46:30 devstack cinder-volume[87116]: INFO cinder.volume.drivers.remotefs [None req-9153eeec-a2f1-4549-9ac0-8a7d257f05ba tempest-ServerActionsTestOtherA-64126338 None] casted to osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f Nov 06 11:46:30 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-9153eeec-a2f1-4549-9ac0-8a7d257f05ba tempest-ServerActionsTestOtherA-64126338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-d37614a3-9342-4021-b2a4-27556a55c322 1073741824 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:46:30 devstack sudo[92586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-d37614a3-9342-4021-b2a4-27556a55c322 1073741824 Nov 06 11:46:30 devstack sudo[92586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:46:30 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-361e1db7-24b9-4082-99a1-de86e49306a2 tempest-GroupsV314Test-1023156481 None] Create group from source-group-3f22fa26-b4cc-4d7d-aa2c-6dcb371a2f9b completed successfully. Nov 06 11:46:30 devstack sudo[92586]: pam_unix(sudo:session): session closed for user root Nov 06 11:46:30 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-9153eeec-a2f1-4549-9ac0-8a7d257f05ba tempest-ServerActionsTestOtherA-64126338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-d37614a3-9342-4021-b2a4-27556a55c322 1073741824" returned: 0 in 0.539s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:46:30 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-9153eeec-a2f1-4549-9ac0-8a7d257f05ba tempest-ServerActionsTestOtherA-64126338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-d37614a3-9342-4021-b2a4-27556a55c322 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:46:31 devstack sudo[92593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-d37614a3-9342-4021-b2a4-27556a55c322 Nov 06 11:46:31 devstack sudo[92593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:46:31 devstack sudo[92593]: pam_unix(sudo:session): session closed for user root Nov 06 11:46:31 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-9153eeec-a2f1-4549-9ac0-8a7d257f05ba tempest-ServerActionsTestOtherA-64126338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-d37614a3-9342-4021-b2a4-27556a55c322" returned: 0 in 0.295s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:46:31 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-9153eeec-a2f1-4549-9ac0-8a7d257f05ba tempest-ServerActionsTestOtherA-64126338 None] <== create_volume: return (883ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f'} {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 11:46:31 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-9153eeec-a2f1-4549-9ac0-8a7d257f05ba tempest-ServerActionsTestOtherA-64126338 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.887s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 11:46:31 devstack cinder-volume[87116]: DEBUG cinder.volume.volume_utils [None req-9153eeec-a2f1-4549-9ac0-8a7d257f05ba tempest-ServerActionsTestOtherA-64126338 None] Attempting download of 423469e2-d15b-4cf9-87cd-88e68e947d3b ((None, [{'url': 'file:///opt/stack/data/glance/images/423469e2-d15b-4cf9-87cd-88e68e947d3b', 'metadata': {}}])) to volume d37614a3-9342-4021-b2a4-27556a55c322. {{(pid=87116) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Nov 06 11:46:31 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd336f4c-2999-47e3-957f-3e2f55c03087]: (4, 'raw') {{(pid=88420) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 11:46:31 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-9153eeec-a2f1-4549-9ac0-8a7d257f05ba tempest-ServerActionsTestOtherA-64126338 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_423469e2-d15b-4cf9-87cd-88e68e947d3b_tz5mbzqw {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:46:31 devstack sudo[92596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_423469e2-d15b-4cf9-87cd-88e68e947d3b_tz5mbzqw Nov 06 11:46:31 devstack sudo[92596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:46:32 devstack sudo[92596]: pam_unix(sudo:session): session closed for user root Nov 06 11:46:32 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-9153eeec-a2f1-4549-9ac0-8a7d257f05ba tempest-ServerActionsTestOtherA-64126338 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_423469e2-d15b-4cf9-87cd-88e68e947d3b_tz5mbzqw" returned: 0 in 0.952s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:46:32 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-9153eeec-a2f1-4549-9ac0-8a7d257f05ba tempest-ServerActionsTestOtherA-64126338 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_423469e2-d15b-4cf9-87cd-88e68e947d3b_tz5mbzqw {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:46:32 devstack sudo[92660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_423469e2-d15b-4cf9-87cd-88e68e947d3b_tz5mbzqw Nov 06 11:46:32 devstack sudo[92660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:46:32 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-3e90814e-726e-4e8a-ae32-b73e4f23e2a2 tempest-GroupsV314Test-1023156481 None] Acquiring lock "cinder-quobyte-1c6f17fe-f637-4aed-9a03-9bd4dab7f5e6" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 11:46:32 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-3e90814e-726e-4e8a-ae32-b73e4f23e2a2 tempest-GroupsV314Test-1023156481 None] Lock "cinder-quobyte-1c6f17fe-f637-4aed-9a03-9bd4dab7f5e6" acquired by "delete_volume" :: waited 0.032s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 11:46:32 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[e549b27d-2ba0-41d1-9791-0ca0d3f47b18]: (4, 'qcow2') {{(pid=88420) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 11:46:32 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-3e90814e-726e-4e8a-ae32-b73e4f23e2a2 tempest-GroupsV314Test-1023156481 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-1c6f17fe-f637-4aed-9a03-9bd4dab7f5e6 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:46:33 devstack sudo[92660]: pam_unix(sudo:session): session closed for user root Nov 06 11:46:33 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-9153eeec-a2f1-4549-9ac0-8a7d257f05ba tempest-ServerActionsTestOtherA-64126338 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_423469e2-d15b-4cf9-87cd-88e68e947d3b_tz5mbzqw" returned: 1 in 0.747s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:46:33 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-9153eeec-a2f1-4549-9ac0-8a7d257f05ba tempest-ServerActionsTestOtherA-64126338 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_423469e2-d15b-4cf9-87cd-88e68e947d3b_tz5mbzqw' failed. Not Retrying. {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 06 11:46:33 devstack sudo[92669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-1c6f17fe-f637-4aed-9a03-9bd4dab7f5e6 Nov 06 11:46:33 devstack sudo[92669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:46:33 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[28e8661d-6aee-43dd-8ffc-2362bf7e1700]: (4, 'qcow2') {{(pid=88420) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 11:46:33 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-9153eeec-a2f1-4549-9ac0-8a7d257f05ba tempest-ServerActionsTestOtherA-64126338 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_423469e2-d15b-4cf9-87cd-88e68e947d3b_s9944y2ddevstack@QuobyteHD {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:46:33 devstack sudo[92674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_423469e2-d15b-4cf9-87cd-88e68e947d3b_s9944y2ddevstack@QuobyteHD Nov 06 11:46:33 devstack sudo[92674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:46:33 devstack sudo[92669]: pam_unix(sudo:session): session closed for user root Nov 06 11:46:33 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-3e90814e-726e-4e8a-ae32-b73e4f23e2a2 tempest-GroupsV314Test-1023156481 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-1c6f17fe-f637-4aed-9a03-9bd4dab7f5e6" returned: 0 in 0.708s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:46:33 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-3e90814e-726e-4e8a-ae32-b73e4f23e2a2 tempest-GroupsV314Test-1023156481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-1c6f17fe-f637-4aed-9a03-9bd4dab7f5e6 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:46:33 devstack sudo[92682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-1c6f17fe-f637-4aed-9a03-9bd4dab7f5e6 Nov 06 11:46:33 devstack sudo[92682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:46:34 devstack sudo[92674]: pam_unix(sudo:session): session closed for user root Nov 06 11:46:34 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-9153eeec-a2f1-4549-9ac0-8a7d257f05ba tempest-ServerActionsTestOtherA-64126338 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_423469e2-d15b-4cf9-87cd-88e68e947d3b_s9944y2ddevstack@QuobyteHD" returned: 0 in 0.909s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:46:34 devstack cinder-volume[87116]: DEBUG cinder.image.image_utils [None req-9153eeec-a2f1-4549-9ac0-8a7d257f05ba tempest-ServerActionsTestOtherA-64126338 None] 423469e2-d15b-4cf9-87cd-88e68e947d3b was qcow2, converting to qcow2 {{(pid=87116) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Nov 06 11:46:34 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-9153eeec-a2f1-4549-9ac0-8a7d257f05ba tempest-ServerActionsTestOtherA-64126338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_423469e2-d15b-4cf9-87cd-88e68e947d3b_s9944y2ddevstack@QuobyteHD /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-d37614a3-9342-4021-b2a4-27556a55c322 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:46:34 devstack sudo[92682]: pam_unix(sudo:session): session closed for user root Nov 06 11:46:34 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-3e90814e-726e-4e8a-ae32-b73e4f23e2a2 tempest-GroupsV314Test-1023156481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-1c6f17fe-f637-4aed-9a03-9bd4dab7f5e6" returned: 0 in 0.530s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:46:34 devstack sudo[92690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_423469e2-d15b-4cf9-87cd-88e68e947d3b_s9944y2ddevstack@QuobyteHD /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-d37614a3-9342-4021-b2a4-27556a55c322 Nov 06 11:46:34 devstack sudo[92690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:46:34 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-3e90814e-726e-4e8a-ae32-b73e4f23e2a2 tempest-GroupsV314Test-1023156481 None] Lock "cinder-quobyte-1c6f17fe-f637-4aed-9a03-9bd4dab7f5e6" released by "delete_volume" :: held 1.397s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 11:46:34 devstack cinder-volume[87116]: DEBUG cinder.quota [None req-3e90814e-726e-4e8a-ae32-b73e4f23e2a2 tempest-GroupsV314Test-1023156481 None] Created reservations ['dcd13ad2-a21f-42b4-a0cb-e9d68790f41e'] {{(pid=87116) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 11:46:34 devstack cinder-volume[87116]: WARNING cinder.quota [None req-3e90814e-726e-4e8a-ae32-b73e4f23e2a2 tempest-GroupsV314Test-1023156481 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-1933464276 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-1933464276, it is now deprecated. Please use the default quota class for default quota. Nov 06 11:46:34 devstack cinder-volume[87116]: WARNING cinder.quota [None req-3e90814e-726e-4e8a-ae32-b73e4f23e2a2 tempest-GroupsV314Test-1023156481 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-1933464276 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-1933464276, it is now deprecated. Please use the default quota class for default quota. Nov 06 11:46:34 devstack cinder-volume[87116]: DEBUG cinder.quota [None req-3e90814e-726e-4e8a-ae32-b73e4f23e2a2 tempest-GroupsV314Test-1023156481 None] Created reservations ['365a70b5-25c1-4a2b-9b9f-8ec97c4e91d9', 'a32a307e-fe95-4718-a7d4-bb1437af3b98', '1572513f-d0eb-4a21-bbb8-c34f9f225fa7', 'f54c6f28-9c6f-411b-aba5-9abd0dad2a25'] {{(pid=87116) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 11:46:34 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-3e90814e-726e-4e8a-ae32-b73e4f23e2a2 tempest-GroupsV314Test-1023156481 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 11:46:34 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-3e90814e-726e-4e8a-ae32-b73e4f23e2a2 tempest-GroupsV314Test-1023156481 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 11:46:34 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-3e90814e-726e-4e8a-ae32-b73e4f23e2a2 tempest-GroupsV314Test-1023156481 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 11:46:34 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-3e90814e-726e-4e8a-ae32-b73e4f23e2a2 tempest-GroupsV314Test-1023156481 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 11:46:34 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-3e90814e-726e-4e8a-ae32-b73e4f23e2a2 tempest-GroupsV314Test-1023156481 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 11:46:34 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-3e90814e-726e-4e8a-ae32-b73e4f23e2a2 tempest-GroupsV314Test-1023156481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:46:34 devstack sudo[92697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756 Nov 06 11:46:34 devstack sudo[92697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:46:35 devstack sudo[92697]: pam_unix(sudo:session): session closed for user root Nov 06 11:46:35 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-3e90814e-726e-4e8a-ae32-b73e4f23e2a2 tempest-GroupsV314Test-1023156481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756" returned: 0 in 0.402s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:46:35 devstack cinder-volume[87116]: DEBUG cinder.manager [None req-3e90814e-726e-4e8a-ae32-b73e4f23e2a2 tempest-GroupsV314Test-1023156481 None] Notifying Schedulers of capabilities ... {{(pid=87116) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 11:46:35 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-3e90814e-726e-4e8a-ae32-b73e4f23e2a2 tempest-GroupsV314Test-1023156481 None] Delete group completed successfully. Nov 06 11:46:36 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-bae78bb2-3ccd-4b55-9f37-a7ddad40dcbb tempest-GroupsV314Test-1023156481 None] Acquiring lock "cinder-quobyte-0fb1440f-95c8-434e-8038-3b65b2c3c8f1" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 11:46:36 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-bae78bb2-3ccd-4b55-9f37-a7ddad40dcbb tempest-GroupsV314Test-1023156481 None] Lock "cinder-quobyte-0fb1440f-95c8-434e-8038-3b65b2c3c8f1" acquired by "delete_volume" :: waited 0.027s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 11:46:36 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3c55401-f44d-4939-9127-575d2337002e]: (4, 'qcow2') {{(pid=88420) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 11:46:36 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-bae78bb2-3ccd-4b55-9f37-a7ddad40dcbb tempest-GroupsV314Test-1023156481 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-0fb1440f-95c8-434e-8038-3b65b2c3c8f1 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:46:36 devstack sudo[92703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-0fb1440f-95c8-434e-8038-3b65b2c3c8f1 Nov 06 11:46:36 devstack sudo[92703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:46:37 devstack sudo[92703]: pam_unix(sudo:session): session closed for user root Nov 06 11:46:37 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-bae78bb2-3ccd-4b55-9f37-a7ddad40dcbb tempest-GroupsV314Test-1023156481 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-0fb1440f-95c8-434e-8038-3b65b2c3c8f1" returned: 0 in 0.664s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:46:37 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-bae78bb2-3ccd-4b55-9f37-a7ddad40dcbb tempest-GroupsV314Test-1023156481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-0fb1440f-95c8-434e-8038-3b65b2c3c8f1 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:46:37 devstack sudo[92715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-0fb1440f-95c8-434e-8038-3b65b2c3c8f1 Nov 06 11:46:37 devstack sudo[92715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:46:37 devstack sudo[92690]: pam_unix(sudo:session): session closed for user root Nov 06 11:46:37 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-9153eeec-a2f1-4549-9ac0-8a7d257f05ba tempest-ServerActionsTestOtherA-64126338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_423469e2-d15b-4cf9-87cd-88e68e947d3b_s9944y2ddevstack@QuobyteHD /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-d37614a3-9342-4021-b2a4-27556a55c322" returned: 0 in 3.389s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:46:37 devstack cinder-volume[87116]: DEBUG cinder.image.image_utils [None req-9153eeec-a2f1-4549-9ac0-8a7d257f05ba tempest-ServerActionsTestOtherA-64126338 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_423469e2-d15b-4cf9-87cd-88e68e947d3b_s9944y2ddevstack@QuobyteHD, size 112.00 MB, duration 3.40 sec, destination /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-d37614a3-9342-4021-b2a4-27556a55c322 {{(pid=87116) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 06 11:46:37 devstack cinder-volume[87116]: INFO cinder.image.image_utils [None req-9153eeec-a2f1-4549-9ac0-8a7d257f05ba tempest-ServerActionsTestOtherA-64126338 None] Converted 112.00 MB image at 32.97 MB/s Nov 06 11:46:37 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-9153eeec-a2f1-4549-9ac0-8a7d257f05ba tempest-ServerActionsTestOtherA-64126338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-d37614a3-9342-4021-b2a4-27556a55c322 1G {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:46:37 devstack sudo[92715]: pam_unix(sudo:session): session closed for user root Nov 06 11:46:37 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-bae78bb2-3ccd-4b55-9f37-a7ddad40dcbb tempest-GroupsV314Test-1023156481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-0fb1440f-95c8-434e-8038-3b65b2c3c8f1" returned: 0 in 0.443s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:46:37 devstack sudo[92718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-d37614a3-9342-4021-b2a4-27556a55c322 1G Nov 06 11:46:37 devstack sudo[92718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:46:37 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-bae78bb2-3ccd-4b55-9f37-a7ddad40dcbb tempest-GroupsV314Test-1023156481 None] Lock "cinder-quobyte-0fb1440f-95c8-434e-8038-3b65b2c3c8f1" released by "delete_volume" :: held 1.277s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 11:46:37 devstack cinder-volume[87116]: DEBUG cinder.quota [None req-bae78bb2-3ccd-4b55-9f37-a7ddad40dcbb tempest-GroupsV314Test-1023156481 None] Created reservations ['e491614d-cf2a-422f-ac57-e2fa77162b65'] {{(pid=87116) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 11:46:37 devstack cinder-volume[87116]: DEBUG cinder.quota [None req-bae78bb2-3ccd-4b55-9f37-a7ddad40dcbb tempest-GroupsV314Test-1023156481 None] Created reservations ['192030e7-676d-4a06-ab07-f0db8573dde4', 'b0411b89-dc95-4636-888e-4a8c89c0d42b', '073a32ab-e83c-4e09-ab45-2452f7a7a01f', 'ce5bc1ba-0592-4eb8-bb42-c4a0554509f4'] {{(pid=87116) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 11:46:38 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-bae78bb2-3ccd-4b55-9f37-a7ddad40dcbb tempest-GroupsV314Test-1023156481 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 11:46:38 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-bae78bb2-3ccd-4b55-9f37-a7ddad40dcbb tempest-GroupsV314Test-1023156481 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 11:46:38 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-bae78bb2-3ccd-4b55-9f37-a7ddad40dcbb tempest-GroupsV314Test-1023156481 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 11:46:38 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-bae78bb2-3ccd-4b55-9f37-a7ddad40dcbb tempest-GroupsV314Test-1023156481 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 11:46:38 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-bae78bb2-3ccd-4b55-9f37-a7ddad40dcbb tempest-GroupsV314Test-1023156481 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 11:46:38 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-bae78bb2-3ccd-4b55-9f37-a7ddad40dcbb tempest-GroupsV314Test-1023156481 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:46:38 devstack sudo[92724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756 Nov 06 11:46:38 devstack sudo[92724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:46:38 devstack sudo[92718]: pam_unix(sudo:session): session closed for user root Nov 06 11:46:38 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-9153eeec-a2f1-4549-9ac0-8a7d257f05ba tempest-ServerActionsTestOtherA-64126338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-d37614a3-9342-4021-b2a4-27556a55c322 1G" returned: 0 in 0.711s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:46:38 devstack cinder-volume[87116]: DEBUG cinder.volume.volume_utils [None req-9153eeec-a2f1-4549-9ac0-8a7d257f05ba tempest-ServerActionsTestOtherA-64126338 None] Downloaded image 423469e2-d15b-4cf9-87cd-88e68e947d3b ((None, [{'url': 'file:///opt/stack/data/glance/images/423469e2-d15b-4cf9-87cd-88e68e947d3b', 'metadata': {}}])) to volume d37614a3-9342-4021-b2a4-27556a55c322 successfully. {{(pid=87116) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Nov 06 11:46:38 devstack cinder-volume[87116]: DEBUG cinder.image.image_utils [None req-9153eeec-a2f1-4549-9ac0-8a7d257f05ba tempest-ServerActionsTestOtherA-64126338 None] Temporary image 423469e2-d15b-4cf9-87cd-88e68e947d3b for user 59c9bb435a0646af84a9849e5e2ab320 is deleted. {{(pid=87116) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Nov 06 11:46:38 devstack cinder-volume[87116]: DEBUG cinder.volume.volume_utils [None req-9153eeec-a2f1-4549-9ac0-8a7d257f05ba tempest-ServerActionsTestOtherA-64126338 None] Marking volume d37614a3-9342-4021-b2a4-27556a55c322 as bootable. {{(pid=87116) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Nov 06 11:46:38 devstack cinder-volume[87116]: DEBUG cinder.volume.flows.manager.create_volume [None req-9153eeec-a2f1-4549-9ac0-8a7d257f05ba tempest-ServerActionsTestOtherA-64126338 None] Copying metadata from image 423469e2-d15b-4cf9-87cd-88e68e947d3b to d37614a3-9342-4021-b2a4-27556a55c322. {{(pid=87116) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Nov 06 11:46:38 devstack cinder-volume[87116]: DEBUG cinder.volume.flows.manager.create_volume [None req-9153eeec-a2f1-4549-9ac0-8a7d257f05ba tempest-ServerActionsTestOtherA-64126338 None] Creating volume glance metadata for volume d37614a3-9342-4021-b2a4-27556a55c322 backed by image 423469e2-d15b-4cf9-87cd-88e68e947d3b with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '423469e2-d15b-4cf9-87cd-88e68e947d3b', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87116) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Nov 06 11:46:38 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-9153eeec-a2f1-4549-9ac0-8a7d257f05ba tempest-ServerActionsTestOtherA-64126338 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a4173d2d-23c4-4909-8c68-d2e5a3312478) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d37614a3-9342-4021-b2a4-27556a55c322', 'volume_size': 1, 'image_id': '423469e2-d15b-4cf9-87cd-88e68e947d3b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/423469e2-d15b-4cf9-87cd-88e68e947d3b', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b05f927c30c5407aad52949459346010', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '423469e2-d15b-4cf9-87cd-88e68e947d3b', 'created_at': datetime.datetime(2026, 11, 6, 10, 36, 49, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 6, 10, 36, 50, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/423469e2-d15b-4cf9-87cd-88e68e947d3b/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:46:38 devstack sudo[92724]: pam_unix(sudo:session): session closed for user root Nov 06 11:46:38 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-9153eeec-a2f1-4549-9ac0-8a7d257f05ba tempest-ServerActionsTestOtherA-64126338 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ffa23009-226f-4f57-a98b-e61feb90a1f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:46:38 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-bae78bb2-3ccd-4b55-9f37-a7ddad40dcbb tempest-GroupsV314Test-1023156481 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756" returned: 0 in 0.330s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:46:38 devstack cinder-volume[87116]: DEBUG cinder.manager [None req-bae78bb2-3ccd-4b55-9f37-a7ddad40dcbb tempest-GroupsV314Test-1023156481 None] Notifying Schedulers of capabilities ... {{(pid=87116) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 11:46:38 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-9153eeec-a2f1-4549-9ac0-8a7d257f05ba tempest-ServerActionsTestOtherA-64126338 None] Volume volume-d37614a3-9342-4021-b2a4-27556a55c322 (d37614a3-9342-4021-b2a4-27556a55c322): created successfully Nov 06 11:46:38 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-9153eeec-a2f1-4549-9ac0-8a7d257f05ba tempest-ServerActionsTestOtherA-64126338 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ffa23009-226f-4f57-a98b-e61feb90a1f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:46:38 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-9153eeec-a2f1-4549-9ac0-8a7d257f05ba tempest-ServerActionsTestOtherA-64126338 None] Flow 'volume_create_manager' (74b15ecb-db4f-4527-9c67-fd84fac1c400) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 11:46:38 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-bae78bb2-3ccd-4b55-9f37-a7ddad40dcbb tempest-GroupsV314Test-1023156481 None] Delete group completed successfully. Nov 06 11:46:38 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-9153eeec-a2f1-4549-9ac0-8a7d257f05ba tempest-ServerActionsTestOtherA-64126338 None] Created volume successfully. Nov 06 11:46:39 devstack cinder-volume[87116]: DEBUG oslo_service.periodic_task [None req-4fab4816-ec2b-4b19-b2ff-8548f2084354 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87116) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 11:46:39 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-4fab4816-ec2b-4b19-b2ff-8548f2084354 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 11:46:39 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-4fab4816-ec2b-4b19-b2ff-8548f2084354 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 11:46:39 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-4fab4816-ec2b-4b19-b2ff-8548f2084354 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 11:46:39 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-4fab4816-ec2b-4b19-b2ff-8548f2084354 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 11:46:39 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-4fab4816-ec2b-4b19-b2ff-8548f2084354 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 11:46:39 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-4fab4816-ec2b-4b19-b2ff-8548f2084354 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:46:39 devstack sudo[92729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756 Nov 06 11:46:39 devstack sudo[92729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:46:40 devstack sudo[92729]: pam_unix(sudo:session): session closed for user root Nov 06 11:46:40 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-4fab4816-ec2b-4b19-b2ff-8548f2084354 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756" returned: 0 in 0.485s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:46:40 devstack cinder-volume[87116]: DEBUG cinder.manager [None req-4fab4816-ec2b-4b19-b2ff-8548f2084354 None None] Notifying Schedulers of capabilities ... {{(pid=87116) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 11:46:40 devstack cinder-volume[87116]: DEBUG oslo_service.periodic_task [None req-4fab4816-ec2b-4b19-b2ff-8548f2084354 None None] Running periodic task VolumeManager._thread_info {{(pid=87116) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 11:46:40 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-4fab4816-ec2b-4b19-b2ff-8548f2084354 None None] thread count: 28 {{(pid=87116) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 06 11:46:40 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-4fab4816-ec2b-4b19-b2ff-8548f2084354 None None] thread info: [<_MainThread(MainThread, started 131399520669824)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87116) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 06 11:46:43 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [req-beaedf28-e836-4e3b-82f4-2af34a081750 req-586f5f85-1e35-46ca-892b-184cd79bd661 tempest-ServerActionsTestOtherA-64126338 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 11:46:43 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [req-beaedf28-e836-4e3b-82f4-2af34a081750 req-586f5f85-1e35-46ca-892b-184cd79bd661 tempest-ServerActionsTestOtherA-64126338 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 11:46:43 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [req-beaedf28-e836-4e3b-82f4-2af34a081750 req-586f5f85-1e35-46ca-892b-184cd79bd661 tempest-ServerActionsTestOtherA-64126338 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.020s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 11:46:43 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [req-beaedf28-e836-4e3b-82f4-2af34a081750 req-586f5f85-1e35-46ca-892b-184cd79bd661 tempest-ServerActionsTestOtherA-64126338 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f', 'name': 'volume-d37614a3-9342-4021-b2a4-27556a55c322', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '6b56a4bd-e175-4b3e-bcd5-e819751a684e', 'enforce_multipath': True} {{(pid=87116) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 06 11:46:43 devstack cinder-volume[87116]: INFO cinder.volume.manager [req-beaedf28-e836-4e3b-82f4-2af34a081750 req-586f5f85-1e35-46ca-892b-184cd79bd661 tempest-ServerActionsTestOtherA-64126338 None] attachment_update completed successfully. Nov 06 11:46:48 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-7e30a5af-bb50-47dd-9f27-f8974cdfb6ce tempest-GroupsV320Test-1935034507 None] Group tempest-GroupsV320Test-Group-500677026: creating Nov 06 11:46:48 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-7e30a5af-bb50-47dd-9f27-f8974cdfb6ce tempest-GroupsV320Test-1935034507 None] Group tempest-GroupsV320Test-Group-500677026: created successfully Nov 06 11:46:48 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-7e30a5af-bb50-47dd-9f27-f8974cdfb6ce tempest-GroupsV320Test-1935034507 None] Create group completed successfully. Nov 06 11:46:51 devstack cinder-volume[87116]: DEBUG cinder.quota [None req-1e3a41ba-8125-4a3e-a29c-9d030a411930 tempest-GroupsV320Test-1935034507 None] Created reservations ['6a3ae0e9-17bc-41c5-b97d-72b4294c310b'] {{(pid=87116) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 11:46:51 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-1e3a41ba-8125-4a3e-a29c-9d030a411930 tempest-GroupsV320Test-1935034507 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 11:46:51 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-1e3a41ba-8125-4a3e-a29c-9d030a411930 tempest-GroupsV320Test-1935034507 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 11:46:51 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-1e3a41ba-8125-4a3e-a29c-9d030a411930 tempest-GroupsV320Test-1935034507 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 11:46:51 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-1e3a41ba-8125-4a3e-a29c-9d030a411930 tempest-GroupsV320Test-1935034507 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 11:46:51 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-1e3a41ba-8125-4a3e-a29c-9d030a411930 tempest-GroupsV320Test-1935034507 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 11:46:51 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-1e3a41ba-8125-4a3e-a29c-9d030a411930 tempest-GroupsV320Test-1935034507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:46:51 devstack sudo[93305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756 Nov 06 11:46:51 devstack sudo[93305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:46:51 devstack sudo[93305]: pam_unix(sudo:session): session closed for user root Nov 06 11:46:51 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-1e3a41ba-8125-4a3e-a29c-9d030a411930 tempest-GroupsV320Test-1935034507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756" returned: 0 in 0.440s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:46:51 devstack cinder-volume[87116]: DEBUG cinder.manager [None req-1e3a41ba-8125-4a3e-a29c-9d030a411930 tempest-GroupsV320Test-1935034507 None] Notifying Schedulers of capabilities ... {{(pid=87116) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 11:46:51 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-1e3a41ba-8125-4a3e-a29c-9d030a411930 tempest-GroupsV320Test-1935034507 None] Delete group completed successfully. Nov 06 11:47:00 devstack cinder-volume[87116]: DEBUG cinder.volume.flows.manager.create_volume [None req-32c32fa4-e3ac-43b2-af6a-a8e41fd53698 tempest-AttachVolumeNegativeTest-771196063 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87116) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 11:47:00 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-32c32fa4-e3ac-43b2-af6a-a8e41fd53698 tempest-AttachVolumeNegativeTest-771196063 None] Flow 'volume_create_manager' (4f9d5618-b529-4505-b9fe-6b32dcd7b6b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 11:47:00 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-32c32fa4-e3ac-43b2-af6a-a8e41fd53698 tempest-AttachVolumeNegativeTest-771196063 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (efa97cac-6a5e-4d7f-9fe3-c8c79ab4b2bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:47:00 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-32c32fa4-e3ac-43b2-af6a-a8e41fd53698 tempest-AttachVolumeNegativeTest-771196063 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (efa97cac-6a5e-4d7f-9fe3-c8c79ab4b2bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T10:46:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-309248735',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1dee5bbc-4b42-432a-9220-46347ce7d7b2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b23e8157379c4aa2a39ee3c320d26405',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T10:47:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T10:47:00Z,use_quota=True,user_id='46166ce042cc4a85aa8e38a7a34c4d50',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(34d3b144-d9b7-480a-a2e3-01e45f3d54c1),volume_type_id=34d3b144-d9b7-480a-a2e3-01e45f3d54c1)' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:47:00 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-32c32fa4-e3ac-43b2-af6a-a8e41fd53698 tempest-AttachVolumeNegativeTest-771196063 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eb30eb44-76cf-4f48-8387-603f81081e20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:47:00 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-32c32fa4-e3ac-43b2-af6a-a8e41fd53698 tempest-AttachVolumeNegativeTest-771196063 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eb30eb44-76cf-4f48-8387-603f81081e20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:47:00 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-32c32fa4-e3ac-43b2-af6a-a8e41fd53698 tempest-AttachVolumeNegativeTest-771196063 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (34e62e87-9965-43a1-b630-fcee46e2d690) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:47:00 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-32c32fa4-e3ac-43b2-af6a-a8e41fd53698 tempest-AttachVolumeNegativeTest-771196063 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (34e62e87-9965-43a1-b630-fcee46e2d690) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1dee5bbc-4b42-432a-9220-46347ce7d7b2', 'volume_name': 'volume-1dee5bbc-4b42-432a-9220-46347ce7d7b2', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:47:00 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-32c32fa4-e3ac-43b2-af6a-a8e41fd53698 tempest-AttachVolumeNegativeTest-771196063 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fe066df7-7ae5-4a80-8ce8-bc36b65749ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:47:00 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-32c32fa4-e3ac-43b2-af6a-a8e41fd53698 tempest-AttachVolumeNegativeTest-771196063 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fe066df7-7ae5-4a80-8ce8-bc36b65749ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:47:00 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-32c32fa4-e3ac-43b2-af6a-a8e41fd53698 tempest-AttachVolumeNegativeTest-771196063 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (66083360-e788-4f14-8964-797e17e4b293) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:47:00 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-32c32fa4-e3ac-43b2-af6a-a8e41fd53698 tempest-AttachVolumeNegativeTest-771196063 None] Volume 1dee5bbc-4b42-432a-9220-46347ce7d7b2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1dee5bbc-4b42-432a-9220-46347ce7d7b2', 'volume_size': 1} Nov 06 11:47:00 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-32c32fa4-e3ac-43b2-af6a-a8e41fd53698 tempest-AttachVolumeNegativeTest-771196063 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 11:47:00 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-32c32fa4-e3ac-43b2-af6a-a8e41fd53698 tempest-AttachVolumeNegativeTest-771196063 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 11:47:00 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-32c32fa4-e3ac-43b2-af6a-a8e41fd53698 tempest-AttachVolumeNegativeTest-771196063 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T10:46:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-309248735',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1dee5bbc-4b42-432a-9220-46347ce7d7b2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b23e8157379c4aa2a39ee3c320d26405',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T10:47:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T10:47:00Z,use_quota=True,user_id='46166ce042cc4a85aa8e38a7a34c4d50',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(34d3b144-d9b7-480a-a2e3-01e45f3d54c1),volume_type_id=34d3b144-d9b7-480a-a2e3-01e45f3d54c1)}" {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 11:47:00 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-32c32fa4-e3ac-43b2-af6a-a8e41fd53698 tempest-AttachVolumeNegativeTest-771196063 None] Creating volume 1dee5bbc-4b42-432a-9220-46347ce7d7b2 {{(pid=87116) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 11:47:00 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-32c32fa4-e3ac-43b2-af6a-a8e41fd53698 tempest-AttachVolumeNegativeTest-771196063 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 11:47:00 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-32c32fa4-e3ac-43b2-af6a-a8e41fd53698 tempest-AttachVolumeNegativeTest-771196063 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 11:47:00 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-32c32fa4-e3ac-43b2-af6a-a8e41fd53698 tempest-AttachVolumeNegativeTest-771196063 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 11:47:00 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-32c32fa4-e3ac-43b2-af6a-a8e41fd53698 tempest-AttachVolumeNegativeTest-771196063 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 11:47:00 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-32c32fa4-e3ac-43b2-af6a-a8e41fd53698 tempest-AttachVolumeNegativeTest-771196063 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 11:47:00 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-32c32fa4-e3ac-43b2-af6a-a8e41fd53698 tempest-AttachVolumeNegativeTest-771196063 None] Selected osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f as target Quobyte volume. {{(pid=87116) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 11:47:00 devstack cinder-volume[87116]: INFO cinder.volume.drivers.remotefs [None req-32c32fa4-e3ac-43b2-af6a-a8e41fd53698 tempest-AttachVolumeNegativeTest-771196063 None] casted to osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f Nov 06 11:47:00 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-32c32fa4-e3ac-43b2-af6a-a8e41fd53698 tempest-AttachVolumeNegativeTest-771196063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-1dee5bbc-4b42-432a-9220-46347ce7d7b2 1073741824 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:47:00 devstack sudo[93321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-1dee5bbc-4b42-432a-9220-46347ce7d7b2 1073741824 Nov 06 11:47:00 devstack sudo[93321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:47:01 devstack sudo[93321]: pam_unix(sudo:session): session closed for user root Nov 06 11:47:01 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-32c32fa4-e3ac-43b2-af6a-a8e41fd53698 tempest-AttachVolumeNegativeTest-771196063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-1dee5bbc-4b42-432a-9220-46347ce7d7b2 1073741824" returned: 0 in 0.949s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:47:01 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-32c32fa4-e3ac-43b2-af6a-a8e41fd53698 tempest-AttachVolumeNegativeTest-771196063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-1dee5bbc-4b42-432a-9220-46347ce7d7b2 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:47:01 devstack sudo[93327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-1dee5bbc-4b42-432a-9220-46347ce7d7b2 Nov 06 11:47:01 devstack sudo[93327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:47:01 devstack sudo[93327]: pam_unix(sudo:session): session closed for user root Nov 06 11:47:01 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-32c32fa4-e3ac-43b2-af6a-a8e41fd53698 tempest-AttachVolumeNegativeTest-771196063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-1dee5bbc-4b42-432a-9220-46347ce7d7b2" returned: 0 in 0.596s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:47:01 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-32c32fa4-e3ac-43b2-af6a-a8e41fd53698 tempest-AttachVolumeNegativeTest-771196063 None] <== create_volume: return (1655ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f'} {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 11:47:01 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-32c32fa4-e3ac-43b2-af6a-a8e41fd53698 tempest-AttachVolumeNegativeTest-771196063 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.659s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 11:47:01 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-32c32fa4-e3ac-43b2-af6a-a8e41fd53698 tempest-AttachVolumeNegativeTest-771196063 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (66083360-e788-4f14-8964-797e17e4b293) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1dee5bbc-4b42-432a-9220-46347ce7d7b2', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:47:01 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-32c32fa4-e3ac-43b2-af6a-a8e41fd53698 tempest-AttachVolumeNegativeTest-771196063 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff094f74-a391-43e5-829f-db8a250b2f68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:47:02 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-32c32fa4-e3ac-43b2-af6a-a8e41fd53698 tempest-AttachVolumeNegativeTest-771196063 None] Volume volume-1dee5bbc-4b42-432a-9220-46347ce7d7b2 (1dee5bbc-4b42-432a-9220-46347ce7d7b2): created successfully Nov 06 11:47:02 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-32c32fa4-e3ac-43b2-af6a-a8e41fd53698 tempest-AttachVolumeNegativeTest-771196063 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff094f74-a391-43e5-829f-db8a250b2f68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:47:02 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-32c32fa4-e3ac-43b2-af6a-a8e41fd53698 tempest-AttachVolumeNegativeTest-771196063 None] Flow 'volume_create_manager' (4f9d5618-b529-4505-b9fe-6b32dcd7b6b7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 11:47:02 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-32c32fa4-e3ac-43b2-af6a-a8e41fd53698 tempest-AttachVolumeNegativeTest-771196063 None] Created volume successfully. Nov 06 11:47:03 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [req-a86a0cc2-89bb-4470-9f18-e55948607bd8 req-39141b75-80ae-4639-9536-b5f5298fa9b9 tempest-AttachVolumeNegativeTest-771196063 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 11:47:03 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [req-a86a0cc2-89bb-4470-9f18-e55948607bd8 req-39141b75-80ae-4639-9536-b5f5298fa9b9 tempest-AttachVolumeNegativeTest-771196063 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 11:47:03 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [req-a86a0cc2-89bb-4470-9f18-e55948607bd8 req-39141b75-80ae-4639-9536-b5f5298fa9b9 tempest-AttachVolumeNegativeTest-771196063 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.014s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 11:47:03 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [req-a86a0cc2-89bb-4470-9f18-e55948607bd8 req-39141b75-80ae-4639-9536-b5f5298fa9b9 tempest-AttachVolumeNegativeTest-771196063 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f', 'name': 'volume-1dee5bbc-4b42-432a-9220-46347ce7d7b2', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'c31c7a05-4d3f-495b-8905-0bcdf44f3ea6', 'enforce_multipath': True} {{(pid=87116) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 06 11:47:04 devstack cinder-volume[87116]: INFO cinder.volume.manager [req-a86a0cc2-89bb-4470-9f18-e55948607bd8 req-39141b75-80ae-4639-9536-b5f5298fa9b9 tempest-AttachVolumeNegativeTest-771196063 None] attachment_update completed successfully. Nov 06 11:47:04 devstack cinder-volume[87116]: INFO cinder.volume.manager [req-1e477914-a103-40da-8349-6458e1632326 req-683cb125-88ba-4aa3-ae60-4f1ea4b45f56 tempest-ServerActionsTestOtherA-64126338 None] Terminate volume connection completed successfully. Nov 06 11:47:04 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [req-1e477914-a103-40da-8349-6458e1632326 req-683cb125-88ba-4aa3-ae60-4f1ea4b45f56 tempest-ServerActionsTestOtherA-64126338 None] Deleting attachment 6b56a4bd-e175-4b3e-bcd5-e819751a684e. {{(pid=87116) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 06 11:47:07 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [req-1e477914-a103-40da-8349-6458e1632326 req-2799969f-59c4-4150-9962-208cf1cfeeff tempest-ServerActionsTestOtherA-64126338 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 11:47:07 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [req-1e477914-a103-40da-8349-6458e1632326 req-2799969f-59c4-4150-9962-208cf1cfeeff tempest-ServerActionsTestOtherA-64126338 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 11:47:07 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [req-1e477914-a103-40da-8349-6458e1632326 req-2799969f-59c4-4150-9962-208cf1cfeeff tempest-ServerActionsTestOtherA-64126338 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.035s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 11:47:07 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [req-1e477914-a103-40da-8349-6458e1632326 req-2799969f-59c4-4150-9962-208cf1cfeeff tempest-ServerActionsTestOtherA-64126338 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f', 'name': 'volume-d37614a3-9342-4021-b2a4-27556a55c322', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'f8416f11-2093-432c-8bb5-d1931bc3d92c', 'enforce_multipath': True} {{(pid=87116) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 06 11:47:07 devstack cinder-volume[87116]: INFO cinder.volume.manager [req-1e477914-a103-40da-8349-6458e1632326 req-2799969f-59c4-4150-9962-208cf1cfeeff tempest-ServerActionsTestOtherA-64126338 None] attachment_update completed successfully. Nov 06 11:47:17 devstack cinder-volume[87116]: DEBUG dbcounter [-] [87116] Writing DB stats cinder:SELECT=55,cinder:UPDATE=41,cinder:INSERT=14 {{(pid=87116) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 11:47:17 devstack cinder-volume[87116]: DEBUG dbcounter [-] [87116] Writing DB stats cinder:SELECT=58,cinder:UPDATE=39,cinder:INSERT=12,cinder:DELETE=2 {{(pid=87116) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 11:47:19 devstack cinder-volume[87116]: DEBUG cinder.volume.flows.manager.create_volume [None req-0f97567c-e32c-4ce7-9d77-bab4b64d7eae tempest-VolumesServicesTestJSON-2066915887 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87116) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 11:47:19 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-0f97567c-e32c-4ce7-9d77-bab4b64d7eae tempest-VolumesServicesTestJSON-2066915887 None] Flow 'volume_create_manager' (6feaf05d-18d0-4fe5-9030-99bc9e88724c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 11:47:19 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-0f97567c-e32c-4ce7-9d77-bab4b64d7eae tempest-VolumesServicesTestJSON-2066915887 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (86b92de0-1860-47f4-827d-447e1edd6a1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:47:19 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-0f97567c-e32c-4ce7-9d77-bab4b64d7eae tempest-VolumesServicesTestJSON-2066915887 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (86b92de0-1860-47f4-827d-447e1edd6a1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T10:47:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1074154208',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=21cafb5f-15a5-48f3-9428-4a2b4ffed460,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c4aa39bfd5ce4af381cfaf6689ea0443',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T10:47:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T10:47:19Z,use_quota=True,user_id='4fa95ba58ad84e138f4de45cdf533d2f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(34d3b144-d9b7-480a-a2e3-01e45f3d54c1),volume_type_id=34d3b144-d9b7-480a-a2e3-01e45f3d54c1)' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:47:19 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-0f97567c-e32c-4ce7-9d77-bab4b64d7eae tempest-VolumesServicesTestJSON-2066915887 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (52d91666-0f60-4f16-8f07-2775d8da223b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:47:19 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-0f97567c-e32c-4ce7-9d77-bab4b64d7eae tempest-VolumesServicesTestJSON-2066915887 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (52d91666-0f60-4f16-8f07-2775d8da223b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:47:19 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-0f97567c-e32c-4ce7-9d77-bab4b64d7eae tempest-VolumesServicesTestJSON-2066915887 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b0e5214f-8f49-44d4-ac26-7673cd39e766) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:47:19 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-0f97567c-e32c-4ce7-9d77-bab4b64d7eae tempest-VolumesServicesTestJSON-2066915887 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b0e5214f-8f49-44d4-ac26-7673cd39e766) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '21cafb5f-15a5-48f3-9428-4a2b4ffed460', 'volume_name': 'volume-21cafb5f-15a5-48f3-9428-4a2b4ffed460', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:47:19 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-0f97567c-e32c-4ce7-9d77-bab4b64d7eae tempest-VolumesServicesTestJSON-2066915887 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (46d1fe74-7e56-4631-94d1-ffbb56a1a6cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:47:19 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-0f97567c-e32c-4ce7-9d77-bab4b64d7eae tempest-VolumesServicesTestJSON-2066915887 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (46d1fe74-7e56-4631-94d1-ffbb56a1a6cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:47:19 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-0f97567c-e32c-4ce7-9d77-bab4b64d7eae tempest-VolumesServicesTestJSON-2066915887 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e2cd8e5b-c88f-4bb1-8106-d514ab394806) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:47:19 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-0f97567c-e32c-4ce7-9d77-bab4b64d7eae tempest-VolumesServicesTestJSON-2066915887 None] Volume 21cafb5f-15a5-48f3-9428-4a2b4ffed460: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-21cafb5f-15a5-48f3-9428-4a2b4ffed460', 'volume_size': 1} Nov 06 11:47:19 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-0f97567c-e32c-4ce7-9d77-bab4b64d7eae tempest-VolumesServicesTestJSON-2066915887 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 11:47:19 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-0f97567c-e32c-4ce7-9d77-bab4b64d7eae tempest-VolumesServicesTestJSON-2066915887 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 11:47:19 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-0f97567c-e32c-4ce7-9d77-bab4b64d7eae tempest-VolumesServicesTestJSON-2066915887 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T10:47:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1074154208',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=21cafb5f-15a5-48f3-9428-4a2b4ffed460,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c4aa39bfd5ce4af381cfaf6689ea0443',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T10:47:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T10:47:19Z,use_quota=True,user_id='4fa95ba58ad84e138f4de45cdf533d2f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(34d3b144-d9b7-480a-a2e3-01e45f3d54c1),volume_type_id=34d3b144-d9b7-480a-a2e3-01e45f3d54c1)}" {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 11:47:19 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-0f97567c-e32c-4ce7-9d77-bab4b64d7eae tempest-VolumesServicesTestJSON-2066915887 None] Creating volume 21cafb5f-15a5-48f3-9428-4a2b4ffed460 {{(pid=87116) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 11:47:19 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-0f97567c-e32c-4ce7-9d77-bab4b64d7eae tempest-VolumesServicesTestJSON-2066915887 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 11:47:19 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-0f97567c-e32c-4ce7-9d77-bab4b64d7eae tempest-VolumesServicesTestJSON-2066915887 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 11:47:19 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-0f97567c-e32c-4ce7-9d77-bab4b64d7eae tempest-VolumesServicesTestJSON-2066915887 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 11:47:19 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-0f97567c-e32c-4ce7-9d77-bab4b64d7eae tempest-VolumesServicesTestJSON-2066915887 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 11:47:19 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-0f97567c-e32c-4ce7-9d77-bab4b64d7eae tempest-VolumesServicesTestJSON-2066915887 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 11:47:19 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-0f97567c-e32c-4ce7-9d77-bab4b64d7eae tempest-VolumesServicesTestJSON-2066915887 None] Selected osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f as target Quobyte volume. {{(pid=87116) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 11:47:19 devstack cinder-volume[87116]: INFO cinder.volume.drivers.remotefs [None req-0f97567c-e32c-4ce7-9d77-bab4b64d7eae tempest-VolumesServicesTestJSON-2066915887 None] casted to osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f Nov 06 11:47:19 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-0f97567c-e32c-4ce7-9d77-bab4b64d7eae tempest-VolumesServicesTestJSON-2066915887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-21cafb5f-15a5-48f3-9428-4a2b4ffed460 1073741824 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:47:19 devstack sudo[93545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-21cafb5f-15a5-48f3-9428-4a2b4ffed460 1073741824 Nov 06 11:47:19 devstack sudo[93545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:47:19 devstack cinder-volume[87116]: DEBUG cinder.volume.flows.manager.create_volume [None req-5738eff5-0147-4d72-ad54-313c4edeeadb tempest-AttachVolumeTestJSON-2007150896 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87116) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 11:47:19 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-5738eff5-0147-4d72-ad54-313c4edeeadb tempest-AttachVolumeTestJSON-2007150896 None] Flow 'volume_create_manager' (87c39bb0-81b1-4f4a-8f70-056b83dfa2a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 11:47:19 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-5738eff5-0147-4d72-ad54-313c4edeeadb tempest-AttachVolumeTestJSON-2007150896 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3ca20145-ec7f-42de-8164-5274128697c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:47:19 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-5738eff5-0147-4d72-ad54-313c4edeeadb tempest-AttachVolumeTestJSON-2007150896 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3ca20145-ec7f-42de-8164-5274128697c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T10:47:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-385015813',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a9c48dcc-d239-4dc5-806f-1abeac6f1cfd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4fb663f167d74c87b058c8f41ad5ad85',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T10:47:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T10:47:20Z,use_quota=True,user_id='c910d76b89eb4da199f7551aeaad2695',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(34d3b144-d9b7-480a-a2e3-01e45f3d54c1),volume_type_id=34d3b144-d9b7-480a-a2e3-01e45f3d54c1)' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:47:19 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-5738eff5-0147-4d72-ad54-313c4edeeadb tempest-AttachVolumeTestJSON-2007150896 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f763268c-adb4-4db5-a746-959945282a38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:47:19 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-5738eff5-0147-4d72-ad54-313c4edeeadb tempest-AttachVolumeTestJSON-2007150896 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f763268c-adb4-4db5-a746-959945282a38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:47:19 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-5738eff5-0147-4d72-ad54-313c4edeeadb tempest-AttachVolumeTestJSON-2007150896 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ab818dfe-3dff-4a07-afb1-dab1ba84a3b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:47:19 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-5738eff5-0147-4d72-ad54-313c4edeeadb tempest-AttachVolumeTestJSON-2007150896 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ab818dfe-3dff-4a07-afb1-dab1ba84a3b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a9c48dcc-d239-4dc5-806f-1abeac6f1cfd', 'volume_name': 'volume-a9c48dcc-d239-4dc5-806f-1abeac6f1cfd', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:47:19 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-5738eff5-0147-4d72-ad54-313c4edeeadb tempest-AttachVolumeTestJSON-2007150896 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c83d069f-bf4f-460b-8f06-3be36100bb52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:47:19 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-5738eff5-0147-4d72-ad54-313c4edeeadb tempest-AttachVolumeTestJSON-2007150896 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c83d069f-bf4f-460b-8f06-3be36100bb52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:47:19 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-5738eff5-0147-4d72-ad54-313c4edeeadb tempest-AttachVolumeTestJSON-2007150896 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (055fd0ab-f246-42a4-9c77-6fdb3bd4414f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:47:19 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-5738eff5-0147-4d72-ad54-313c4edeeadb tempest-AttachVolumeTestJSON-2007150896 None] Volume a9c48dcc-d239-4dc5-806f-1abeac6f1cfd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a9c48dcc-d239-4dc5-806f-1abeac6f1cfd', 'volume_size': 1} Nov 06 11:47:19 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-5738eff5-0147-4d72-ad54-313c4edeeadb tempest-AttachVolumeTestJSON-2007150896 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 11:47:20 devstack sudo[93545]: pam_unix(sudo:session): session closed for user root Nov 06 11:47:20 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-0f97567c-e32c-4ce7-9d77-bab4b64d7eae tempest-VolumesServicesTestJSON-2066915887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-21cafb5f-15a5-48f3-9428-4a2b4ffed460 1073741824" returned: 0 in 0.882s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:47:20 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-0f97567c-e32c-4ce7-9d77-bab4b64d7eae tempest-VolumesServicesTestJSON-2066915887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-21cafb5f-15a5-48f3-9428-4a2b4ffed460 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:47:20 devstack sudo[93557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-21cafb5f-15a5-48f3-9428-4a2b4ffed460 Nov 06 11:47:20 devstack sudo[93557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:47:20 devstack sudo[93557]: pam_unix(sudo:session): session closed for user root Nov 06 11:47:20 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-0f97567c-e32c-4ce7-9d77-bab4b64d7eae tempest-VolumesServicesTestJSON-2066915887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-21cafb5f-15a5-48f3-9428-4a2b4ffed460" returned: 0 in 0.357s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:47:20 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-0f97567c-e32c-4ce7-9d77-bab4b64d7eae tempest-VolumesServicesTestJSON-2066915887 None] <== create_volume: return (1312ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f'} {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 11:47:20 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-0f97567c-e32c-4ce7-9d77-bab4b64d7eae tempest-VolumesServicesTestJSON-2066915887 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.316s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 11:47:20 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-5738eff5-0147-4d72-ad54-313c4edeeadb tempest-AttachVolumeTestJSON-2007150896 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.049s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 11:47:20 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-5738eff5-0147-4d72-ad54-313c4edeeadb tempest-AttachVolumeTestJSON-2007150896 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T10:47:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-385015813',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a9c48dcc-d239-4dc5-806f-1abeac6f1cfd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4fb663f167d74c87b058c8f41ad5ad85',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T10:47:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T10:47:20Z,use_quota=True,user_id='c910d76b89eb4da199f7551aeaad2695',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(34d3b144-d9b7-480a-a2e3-01e45f3d54c1),volume_type_id=34d3b144-d9b7-480a-a2e3-01e45f3d54c1)}" {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 11:47:20 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-5738eff5-0147-4d72-ad54-313c4edeeadb tempest-AttachVolumeTestJSON-2007150896 None] Creating volume a9c48dcc-d239-4dc5-806f-1abeac6f1cfd {{(pid=87116) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 11:47:20 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-5738eff5-0147-4d72-ad54-313c4edeeadb tempest-AttachVolumeTestJSON-2007150896 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 11:47:20 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-5738eff5-0147-4d72-ad54-313c4edeeadb tempest-AttachVolumeTestJSON-2007150896 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 11:47:20 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-5738eff5-0147-4d72-ad54-313c4edeeadb tempest-AttachVolumeTestJSON-2007150896 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 11:47:20 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-5738eff5-0147-4d72-ad54-313c4edeeadb tempest-AttachVolumeTestJSON-2007150896 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 11:47:20 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-5738eff5-0147-4d72-ad54-313c4edeeadb tempest-AttachVolumeTestJSON-2007150896 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 11:47:20 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-5738eff5-0147-4d72-ad54-313c4edeeadb tempest-AttachVolumeTestJSON-2007150896 None] Selected osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f as target Quobyte volume. {{(pid=87116) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 11:47:20 devstack cinder-volume[87116]: INFO cinder.volume.drivers.remotefs [None req-5738eff5-0147-4d72-ad54-313c4edeeadb tempest-AttachVolumeTestJSON-2007150896 None] casted to osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f Nov 06 11:47:20 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-5738eff5-0147-4d72-ad54-313c4edeeadb tempest-AttachVolumeTestJSON-2007150896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-a9c48dcc-d239-4dc5-806f-1abeac6f1cfd 1073741824 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:47:20 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-0f97567c-e32c-4ce7-9d77-bab4b64d7eae tempest-VolumesServicesTestJSON-2066915887 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e2cd8e5b-c88f-4bb1-8106-d514ab394806) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-21cafb5f-15a5-48f3-9428-4a2b4ffed460', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:47:20 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-0f97567c-e32c-4ce7-9d77-bab4b64d7eae tempest-VolumesServicesTestJSON-2066915887 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c63845e5-4a7f-4e22-a0b0-093f203e331f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:47:20 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-0f97567c-e32c-4ce7-9d77-bab4b64d7eae tempest-VolumesServicesTestJSON-2066915887 None] Volume volume-21cafb5f-15a5-48f3-9428-4a2b4ffed460 (21cafb5f-15a5-48f3-9428-4a2b4ffed460): created successfully Nov 06 11:47:21 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-0f97567c-e32c-4ce7-9d77-bab4b64d7eae tempest-VolumesServicesTestJSON-2066915887 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c63845e5-4a7f-4e22-a0b0-093f203e331f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:47:21 devstack sudo[93565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-a9c48dcc-d239-4dc5-806f-1abeac6f1cfd 1073741824 Nov 06 11:47:21 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-0f97567c-e32c-4ce7-9d77-bab4b64d7eae tempest-VolumesServicesTestJSON-2066915887 None] Flow 'volume_create_manager' (6feaf05d-18d0-4fe5-9030-99bc9e88724c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 11:47:21 devstack sudo[93565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:47:21 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-0f97567c-e32c-4ce7-9d77-bab4b64d7eae tempest-VolumesServicesTestJSON-2066915887 None] Created volume successfully. Nov 06 11:47:21 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-217b795c-8152-4763-b484-224e45520565 tempest-VolumesServicesTestJSON-2066915887 None] Acquiring lock "cinder-21cafb5f-15a5-48f3-9428-4a2b4ffed460-delete_volume" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 11:47:21 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-217b795c-8152-4763-b484-224e45520565 tempest-VolumesServicesTestJSON-2066915887 None] Lock "cinder-21cafb5f-15a5-48f3-9428-4a2b4ffed460-delete_volume" acquired by "delete_volume" :: waited 0.065s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 11:47:21 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-217b795c-8152-4763-b484-224e45520565 tempest-VolumesServicesTestJSON-2066915887 None] Acquiring lock "cinder-quobyte-21cafb5f-15a5-48f3-9428-4a2b4ffed460" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 11:47:21 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-217b795c-8152-4763-b484-224e45520565 tempest-VolumesServicesTestJSON-2066915887 None] Lock "cinder-quobyte-21cafb5f-15a5-48f3-9428-4a2b4ffed460" acquired by "delete_volume" :: waited 0.039s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 11:47:21 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[a44ab3a4-b2c4-4c06-827c-d63fd498b45a]: (4, 'qcow2') {{(pid=88420) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 11:47:21 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-217b795c-8152-4763-b484-224e45520565 tempest-VolumesServicesTestJSON-2066915887 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-21cafb5f-15a5-48f3-9428-4a2b4ffed460 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:47:21 devstack sudo[93565]: pam_unix(sudo:session): session closed for user root Nov 06 11:47:22 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-5738eff5-0147-4d72-ad54-313c4edeeadb tempest-AttachVolumeTestJSON-2007150896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-a9c48dcc-d239-4dc5-806f-1abeac6f1cfd 1073741824" returned: 0 in 1.072s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:47:22 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-5738eff5-0147-4d72-ad54-313c4edeeadb tempest-AttachVolumeTestJSON-2007150896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-a9c48dcc-d239-4dc5-806f-1abeac6f1cfd {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:47:22 devstack sudo[93591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-a9c48dcc-d239-4dc5-806f-1abeac6f1cfd Nov 06 11:47:22 devstack sudo[93591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:47:22 devstack sudo[93589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-21cafb5f-15a5-48f3-9428-4a2b4ffed460 Nov 06 11:47:22 devstack sudo[93589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:47:22 devstack sudo[93591]: pam_unix(sudo:session): session closed for user root Nov 06 11:47:22 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-5738eff5-0147-4d72-ad54-313c4edeeadb tempest-AttachVolumeTestJSON-2007150896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-a9c48dcc-d239-4dc5-806f-1abeac6f1cfd" returned: 0 in 0.583s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:47:22 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-5738eff5-0147-4d72-ad54-313c4edeeadb tempest-AttachVolumeTestJSON-2007150896 None] <== create_volume: return (1807ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f'} {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 11:47:22 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-5738eff5-0147-4d72-ad54-313c4edeeadb tempest-AttachVolumeTestJSON-2007150896 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.815s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 11:47:22 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-5738eff5-0147-4d72-ad54-313c4edeeadb tempest-AttachVolumeTestJSON-2007150896 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (055fd0ab-f246-42a4-9c77-6fdb3bd4414f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a9c48dcc-d239-4dc5-806f-1abeac6f1cfd', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:47:22 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-5738eff5-0147-4d72-ad54-313c4edeeadb tempest-AttachVolumeTestJSON-2007150896 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0a17cd35-9bc3-47d6-b3d6-de306569ce68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:47:22 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-5738eff5-0147-4d72-ad54-313c4edeeadb tempest-AttachVolumeTestJSON-2007150896 None] Volume volume-a9c48dcc-d239-4dc5-806f-1abeac6f1cfd (a9c48dcc-d239-4dc5-806f-1abeac6f1cfd): created successfully Nov 06 11:47:22 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-5738eff5-0147-4d72-ad54-313c4edeeadb tempest-AttachVolumeTestJSON-2007150896 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0a17cd35-9bc3-47d6-b3d6-de306569ce68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:47:22 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-5738eff5-0147-4d72-ad54-313c4edeeadb tempest-AttachVolumeTestJSON-2007150896 None] Flow 'volume_create_manager' (87c39bb0-81b1-4f4a-8f70-056b83dfa2a6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 11:47:22 devstack sudo[93589]: pam_unix(sudo:session): session closed for user root Nov 06 11:47:22 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-217b795c-8152-4763-b484-224e45520565 tempest-VolumesServicesTestJSON-2066915887 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-21cafb5f-15a5-48f3-9428-4a2b4ffed460" returned: 0 in 0.893s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:47:22 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-217b795c-8152-4763-b484-224e45520565 tempest-VolumesServicesTestJSON-2066915887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-21cafb5f-15a5-48f3-9428-4a2b4ffed460 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:47:22 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-5738eff5-0147-4d72-ad54-313c4edeeadb tempest-AttachVolumeTestJSON-2007150896 None] Created volume successfully. Nov 06 11:47:22 devstack sudo[93605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-21cafb5f-15a5-48f3-9428-4a2b4ffed460 Nov 06 11:47:22 devstack sudo[93605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:47:23 devstack sudo[93605]: pam_unix(sudo:session): session closed for user root Nov 06 11:47:23 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-217b795c-8152-4763-b484-224e45520565 tempest-VolumesServicesTestJSON-2066915887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-21cafb5f-15a5-48f3-9428-4a2b4ffed460" returned: 0 in 0.500s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:47:23 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-217b795c-8152-4763-b484-224e45520565 tempest-VolumesServicesTestJSON-2066915887 None] Lock "cinder-quobyte-21cafb5f-15a5-48f3-9428-4a2b4ffed460" released by "delete_volume" :: held 1.482s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 11:47:23 devstack cinder-volume[87116]: DEBUG cinder.quota [None req-217b795c-8152-4763-b484-224e45520565 tempest-VolumesServicesTestJSON-2066915887 None] Created reservations ['009dca04-31dd-485a-bdc8-8895827d011e', '82a73b19-1f27-40b8-8f3b-50efe9764362', 'dcc07724-2cf4-4bfa-ae29-84506ce40cd2', '9de5c4a8-1e9c-4a07-b955-97b2e55f2530'] {{(pid=87116) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 11:47:23 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-217b795c-8152-4763-b484-224e45520565 tempest-VolumesServicesTestJSON-2066915887 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 11:47:23 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-217b795c-8152-4763-b484-224e45520565 tempest-VolumesServicesTestJSON-2066915887 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 11:47:23 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-217b795c-8152-4763-b484-224e45520565 tempest-VolumesServicesTestJSON-2066915887 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 11:47:23 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-217b795c-8152-4763-b484-224e45520565 tempest-VolumesServicesTestJSON-2066915887 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 11:47:23 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-217b795c-8152-4763-b484-224e45520565 tempest-VolumesServicesTestJSON-2066915887 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 11:47:23 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-217b795c-8152-4763-b484-224e45520565 tempest-VolumesServicesTestJSON-2066915887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:47:23 devstack sudo[93609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756 Nov 06 11:47:23 devstack sudo[93609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:47:24 devstack sudo[93609]: pam_unix(sudo:session): session closed for user root Nov 06 11:47:24 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-217b795c-8152-4763-b484-224e45520565 tempest-VolumesServicesTestJSON-2066915887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756" returned: 0 in 0.392s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:47:24 devstack cinder-volume[87116]: DEBUG cinder.manager [None req-217b795c-8152-4763-b484-224e45520565 tempest-VolumesServicesTestJSON-2066915887 None] Notifying Schedulers of capabilities ... {{(pid=87116) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 11:47:24 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-217b795c-8152-4763-b484-224e45520565 tempest-VolumesServicesTestJSON-2066915887 None] Deleted volume successfully. Nov 06 11:47:24 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-217b795c-8152-4763-b484-224e45520565 tempest-VolumesServicesTestJSON-2066915887 None] Lock "cinder-21cafb5f-15a5-48f3-9428-4a2b4ffed460-delete_volume" released by "delete_volume" :: held 2.285s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 11:47:25 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [req-f085e762-2bce-4e8a-8021-e6605a2fc8af req-07a79ac4-31f0-4bfe-b500-644ea84bf945 tempest-AttachVolumeTestJSON-2007150896 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 11:47:25 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [req-f085e762-2bce-4e8a-8021-e6605a2fc8af req-07a79ac4-31f0-4bfe-b500-644ea84bf945 tempest-AttachVolumeTestJSON-2007150896 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 11:47:25 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [req-f085e762-2bce-4e8a-8021-e6605a2fc8af req-07a79ac4-31f0-4bfe-b500-644ea84bf945 tempest-AttachVolumeTestJSON-2007150896 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.035s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 11:47:25 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [req-f085e762-2bce-4e8a-8021-e6605a2fc8af req-07a79ac4-31f0-4bfe-b500-644ea84bf945 tempest-AttachVolumeTestJSON-2007150896 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f', 'name': 'volume-a9c48dcc-d239-4dc5-806f-1abeac6f1cfd', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '6969819f-e67d-4aa9-b84d-0d742f1e1684', 'enforce_multipath': True} {{(pid=87116) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 06 11:47:25 devstack cinder-volume[87116]: INFO cinder.volume.manager [req-f085e762-2bce-4e8a-8021-e6605a2fc8af req-07a79ac4-31f0-4bfe-b500-644ea84bf945 tempest-AttachVolumeTestJSON-2007150896 None] attachment_update completed successfully. Nov 06 11:47:34 devstack cinder-volume[87116]: DEBUG cinder.volume.flows.manager.create_volume [None req-67a1ef68-3246-4c1b-9c16-5d87bc8b09f5 tempest-VolumeSnapshotQuotasNegativeTestJSON-376272934 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87116) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 11:47:34 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-67a1ef68-3246-4c1b-9c16-5d87bc8b09f5 tempest-VolumeSnapshotQuotasNegativeTestJSON-376272934 None] Flow 'volume_create_manager' (15b38fe1-7bde-4cd3-a5e3-a0cad071a809) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 11:47:34 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-67a1ef68-3246-4c1b-9c16-5d87bc8b09f5 tempest-VolumeSnapshotQuotasNegativeTestJSON-376272934 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (043bdb83-ea90-4461-95ad-dda28632a767) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:47:34 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-67a1ef68-3246-4c1b-9c16-5d87bc8b09f5 tempest-VolumeSnapshotQuotasNegativeTestJSON-376272934 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (043bdb83-ea90-4461-95ad-dda28632a767) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T10:47:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1027650962',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=00fd5654-e231-41da-9e8b-22c3539a27ca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4647816190f64d6b97e427c522ad45cf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T10:47:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T10:47:35Z,use_quota=True,user_id='ffc5dc9fc5c04ccd95a049c9ecf3f0f7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(34d3b144-d9b7-480a-a2e3-01e45f3d54c1),volume_type_id=34d3b144-d9b7-480a-a2e3-01e45f3d54c1)' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:47:34 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-67a1ef68-3246-4c1b-9c16-5d87bc8b09f5 tempest-VolumeSnapshotQuotasNegativeTestJSON-376272934 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5b379750-5091-43d8-a84c-48e04bc7a2d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:47:34 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-67a1ef68-3246-4c1b-9c16-5d87bc8b09f5 tempest-VolumeSnapshotQuotasNegativeTestJSON-376272934 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5b379750-5091-43d8-a84c-48e04bc7a2d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:47:34 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-67a1ef68-3246-4c1b-9c16-5d87bc8b09f5 tempest-VolumeSnapshotQuotasNegativeTestJSON-376272934 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a0d0d3d8-726d-4ed4-a01c-ca61dbea1bd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:47:34 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-67a1ef68-3246-4c1b-9c16-5d87bc8b09f5 tempest-VolumeSnapshotQuotasNegativeTestJSON-376272934 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a0d0d3d8-726d-4ed4-a01c-ca61dbea1bd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '00fd5654-e231-41da-9e8b-22c3539a27ca', 'volume_name': 'volume-00fd5654-e231-41da-9e8b-22c3539a27ca', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:47:34 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-67a1ef68-3246-4c1b-9c16-5d87bc8b09f5 tempest-VolumeSnapshotQuotasNegativeTestJSON-376272934 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b899deae-8d4f-49ba-bee9-26c4bca7a34c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:47:35 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-67a1ef68-3246-4c1b-9c16-5d87bc8b09f5 tempest-VolumeSnapshotQuotasNegativeTestJSON-376272934 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b899deae-8d4f-49ba-bee9-26c4bca7a34c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:47:35 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-67a1ef68-3246-4c1b-9c16-5d87bc8b09f5 tempest-VolumeSnapshotQuotasNegativeTestJSON-376272934 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bf32af68-390a-48e6-9a66-cf75ccc594d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:47:35 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-67a1ef68-3246-4c1b-9c16-5d87bc8b09f5 tempest-VolumeSnapshotQuotasNegativeTestJSON-376272934 None] Volume 00fd5654-e231-41da-9e8b-22c3539a27ca: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-00fd5654-e231-41da-9e8b-22c3539a27ca', 'volume_size': 1} Nov 06 11:47:35 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-67a1ef68-3246-4c1b-9c16-5d87bc8b09f5 tempest-VolumeSnapshotQuotasNegativeTestJSON-376272934 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 11:47:35 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-67a1ef68-3246-4c1b-9c16-5d87bc8b09f5 tempest-VolumeSnapshotQuotasNegativeTestJSON-376272934 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 11:47:35 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-67a1ef68-3246-4c1b-9c16-5d87bc8b09f5 tempest-VolumeSnapshotQuotasNegativeTestJSON-376272934 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T10:47:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1027650962',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=00fd5654-e231-41da-9e8b-22c3539a27ca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4647816190f64d6b97e427c522ad45cf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T10:47:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T10:47:35Z,use_quota=True,user_id='ffc5dc9fc5c04ccd95a049c9ecf3f0f7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(34d3b144-d9b7-480a-a2e3-01e45f3d54c1),volume_type_id=34d3b144-d9b7-480a-a2e3-01e45f3d54c1)}" {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 11:47:35 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-67a1ef68-3246-4c1b-9c16-5d87bc8b09f5 tempest-VolumeSnapshotQuotasNegativeTestJSON-376272934 None] Creating volume 00fd5654-e231-41da-9e8b-22c3539a27ca {{(pid=87116) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 11:47:35 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-67a1ef68-3246-4c1b-9c16-5d87bc8b09f5 tempest-VolumeSnapshotQuotasNegativeTestJSON-376272934 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 11:47:35 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-67a1ef68-3246-4c1b-9c16-5d87bc8b09f5 tempest-VolumeSnapshotQuotasNegativeTestJSON-376272934 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 11:47:35 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-67a1ef68-3246-4c1b-9c16-5d87bc8b09f5 tempest-VolumeSnapshotQuotasNegativeTestJSON-376272934 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 11:47:35 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-67a1ef68-3246-4c1b-9c16-5d87bc8b09f5 tempest-VolumeSnapshotQuotasNegativeTestJSON-376272934 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 11:47:35 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-67a1ef68-3246-4c1b-9c16-5d87bc8b09f5 tempest-VolumeSnapshotQuotasNegativeTestJSON-376272934 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 11:47:35 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-67a1ef68-3246-4c1b-9c16-5d87bc8b09f5 tempest-VolumeSnapshotQuotasNegativeTestJSON-376272934 None] Selected osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f as target Quobyte volume. {{(pid=87116) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 11:47:35 devstack cinder-volume[87116]: INFO cinder.volume.drivers.remotefs [None req-67a1ef68-3246-4c1b-9c16-5d87bc8b09f5 tempest-VolumeSnapshotQuotasNegativeTestJSON-376272934 None] casted to osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f Nov 06 11:47:35 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-67a1ef68-3246-4c1b-9c16-5d87bc8b09f5 tempest-VolumeSnapshotQuotasNegativeTestJSON-376272934 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-00fd5654-e231-41da-9e8b-22c3539a27ca 1073741824 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:47:35 devstack sudo[93806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-00fd5654-e231-41da-9e8b-22c3539a27ca 1073741824 Nov 06 11:47:35 devstack sudo[93806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:47:35 devstack sudo[93806]: pam_unix(sudo:session): session closed for user root Nov 06 11:47:35 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-67a1ef68-3246-4c1b-9c16-5d87bc8b09f5 tempest-VolumeSnapshotQuotasNegativeTestJSON-376272934 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-00fd5654-e231-41da-9e8b-22c3539a27ca 1073741824" returned: 0 in 0.473s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:47:35 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-67a1ef68-3246-4c1b-9c16-5d87bc8b09f5 tempest-VolumeSnapshotQuotasNegativeTestJSON-376272934 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-00fd5654-e231-41da-9e8b-22c3539a27ca {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:47:35 devstack sudo[93811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-00fd5654-e231-41da-9e8b-22c3539a27ca Nov 06 11:47:35 devstack sudo[93811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:47:35 devstack sudo[93811]: pam_unix(sudo:session): session closed for user root Nov 06 11:47:35 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-67a1ef68-3246-4c1b-9c16-5d87bc8b09f5 tempest-VolumeSnapshotQuotasNegativeTestJSON-376272934 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-00fd5654-e231-41da-9e8b-22c3539a27ca" returned: 0 in 0.275s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:47:35 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-67a1ef68-3246-4c1b-9c16-5d87bc8b09f5 tempest-VolumeSnapshotQuotasNegativeTestJSON-376272934 None] <== create_volume: return (800ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f'} {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 11:47:35 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-67a1ef68-3246-4c1b-9c16-5d87bc8b09f5 tempest-VolumeSnapshotQuotasNegativeTestJSON-376272934 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.803s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 11:47:35 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-67a1ef68-3246-4c1b-9c16-5d87bc8b09f5 tempest-VolumeSnapshotQuotasNegativeTestJSON-376272934 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bf32af68-390a-48e6-9a66-cf75ccc594d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-00fd5654-e231-41da-9e8b-22c3539a27ca', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:47:35 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-67a1ef68-3246-4c1b-9c16-5d87bc8b09f5 tempest-VolumeSnapshotQuotasNegativeTestJSON-376272934 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (325d7754-2e96-4acd-b9a5-b07e54c6be9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:47:35 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-67a1ef68-3246-4c1b-9c16-5d87bc8b09f5 tempest-VolumeSnapshotQuotasNegativeTestJSON-376272934 None] Volume volume-00fd5654-e231-41da-9e8b-22c3539a27ca (00fd5654-e231-41da-9e8b-22c3539a27ca): created successfully Nov 06 11:47:35 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-67a1ef68-3246-4c1b-9c16-5d87bc8b09f5 tempest-VolumeSnapshotQuotasNegativeTestJSON-376272934 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (325d7754-2e96-4acd-b9a5-b07e54c6be9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:47:35 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-67a1ef68-3246-4c1b-9c16-5d87bc8b09f5 tempest-VolumeSnapshotQuotasNegativeTestJSON-376272934 None] Flow 'volume_create_manager' (15b38fe1-7bde-4cd3-a5e3-a0cad071a809) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 11:47:35 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-67a1ef68-3246-4c1b-9c16-5d87bc8b09f5 tempest-VolumeSnapshotQuotasNegativeTestJSON-376272934 None] Created volume successfully. Nov 06 11:47:37 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-cec1d69d-2702-44ab-92b5-5bbd79fe8b84 tempest-VolumeSnapshotQuotasNegativeTestJSON-376272934 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 11:47:37 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-cec1d69d-2702-44ab-92b5-5bbd79fe8b84 tempest-VolumeSnapshotQuotasNegativeTestJSON-376272934 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 11:47:37 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-cec1d69d-2702-44ab-92b5-5bbd79fe8b84 tempest-VolumeSnapshotQuotasNegativeTestJSON-376272934 None] Creating offline snapshot e44c13b3-815d-49b5-882c-653622e59e8c of volume 00fd5654-e231-41da-9e8b-22c3539a27ca {{(pid=87116) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 06 11:47:37 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[a235d73e-92db-4595-a8d5-71b4ded0468f]: (4, 'qcow2') {{(pid=88420) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 11:47:37 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-cec1d69d-2702-44ab-92b5-5bbd79fe8b84 tempest-VolumeSnapshotQuotasNegativeTestJSON-376272934 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-00fd5654-e231-41da-9e8b-22c3539a27ca {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:47:37 devstack sudo[93820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-00fd5654-e231-41da-9e8b-22c3539a27ca Nov 06 11:47:37 devstack sudo[93820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:47:37 devstack sudo[93820]: pam_unix(sudo:session): session closed for user root Nov 06 11:47:37 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-cec1d69d-2702-44ab-92b5-5bbd79fe8b84 tempest-VolumeSnapshotQuotasNegativeTestJSON-376272934 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-00fd5654-e231-41da-9e8b-22c3539a27ca" returned: 0 in 0.407s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:47:37 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-cec1d69d-2702-44ab-92b5-5bbd79fe8b84 tempest-VolumeSnapshotQuotasNegativeTestJSON-376272934 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-00fd5654-e231-41da-9e8b-22c3539a27ca,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-00fd5654-e231-41da-9e8b-22c3539a27ca.e44c13b3-815d-49b5-882c-653622e59e8c 1G {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:47:37 devstack sudo[93825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-00fd5654-e231-41da-9e8b-22c3539a27ca,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-00fd5654-e231-41da-9e8b-22c3539a27ca.e44c13b3-815d-49b5-882c-653622e59e8c 1G Nov 06 11:47:37 devstack sudo[93825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:47:37 devstack sudo[93825]: pam_unix(sudo:session): session closed for user root Nov 06 11:47:37 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-cec1d69d-2702-44ab-92b5-5bbd79fe8b84 tempest-VolumeSnapshotQuotasNegativeTestJSON-376272934 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-00fd5654-e231-41da-9e8b-22c3539a27ca,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-00fd5654-e231-41da-9e8b-22c3539a27ca.e44c13b3-815d-49b5-882c-653622e59e8c 1G" returned: 0 in 0.430s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:47:37 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-cec1d69d-2702-44ab-92b5-5bbd79fe8b84 tempest-VolumeSnapshotQuotasNegativeTestJSON-376272934 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-00fd5654-e231-41da-9e8b-22c3539a27ca -F qcow2 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-00fd5654-e231-41da-9e8b-22c3539a27ca.e44c13b3-815d-49b5-882c-653622e59e8c {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:47:37 devstack sudo[93830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-00fd5654-e231-41da-9e8b-22c3539a27ca -F qcow2 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-00fd5654-e231-41da-9e8b-22c3539a27ca.e44c13b3-815d-49b5-882c-653622e59e8c Nov 06 11:47:37 devstack sudo[93830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:47:38 devstack sudo[93830]: pam_unix(sudo:session): session closed for user root Nov 06 11:47:38 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-cec1d69d-2702-44ab-92b5-5bbd79fe8b84 tempest-VolumeSnapshotQuotasNegativeTestJSON-376272934 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-00fd5654-e231-41da-9e8b-22c3539a27ca -F qcow2 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-00fd5654-e231-41da-9e8b-22c3539a27ca.e44c13b3-815d-49b5-882c-653622e59e8c" returned: 0 in 0.337s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:47:38 devstack cinder-volume[87116]: WARNING cinder.volume.drivers.remotefs [None req-cec1d69d-2702-44ab-92b5-5bbd79fe8b84 tempest-VolumeSnapshotQuotasNegativeTestJSON-376272934 None] /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-00fd5654-e231-41da-9e8b-22c3539a27ca.e44c13b3-815d-49b5-882c-653622e59e8c is being set with open permissions: ugo+rw Nov 06 11:47:38 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-cec1d69d-2702-44ab-92b5-5bbd79fe8b84 tempest-VolumeSnapshotQuotasNegativeTestJSON-376272934 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-00fd5654-e231-41da-9e8b-22c3539a27ca.e44c13b3-815d-49b5-882c-653622e59e8c {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:47:38 devstack sudo[93839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-00fd5654-e231-41da-9e8b-22c3539a27ca.e44c13b3-815d-49b5-882c-653622e59e8c Nov 06 11:47:38 devstack sudo[93839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:47:38 devstack sudo[93839]: pam_unix(sudo:session): session closed for user root Nov 06 11:47:38 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-cec1d69d-2702-44ab-92b5-5bbd79fe8b84 tempest-VolumeSnapshotQuotasNegativeTestJSON-376272934 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-00fd5654-e231-41da-9e8b-22c3539a27ca.e44c13b3-815d-49b5-882c-653622e59e8c" returned: 0 in 0.297s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:47:38 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-cec1d69d-2702-44ab-92b5-5bbd79fe8b84 tempest-VolumeSnapshotQuotasNegativeTestJSON-376272934 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-00fd5654-e231-41da-9e8b-22c3539a27ca.info {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:47:38 devstack sudo[93842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-00fd5654-e231-41da-9e8b-22c3539a27ca.info Nov 06 11:47:38 devstack sudo[93842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:47:38 devstack sudo[93842]: pam_unix(sudo:session): session closed for user root Nov 06 11:47:38 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-cec1d69d-2702-44ab-92b5-5bbd79fe8b84 tempest-VolumeSnapshotQuotasNegativeTestJSON-376272934 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-00fd5654-e231-41da-9e8b-22c3539a27ca.info" returned: 0 in 0.276s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:47:38 devstack cinder-volume[87116]: WARNING cinder.volume.drivers.remotefs [None req-cec1d69d-2702-44ab-92b5-5bbd79fe8b84 tempest-VolumeSnapshotQuotasNegativeTestJSON-376272934 None] /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-00fd5654-e231-41da-9e8b-22c3539a27ca.info is being set with open permissions: ugo+rw Nov 06 11:47:38 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-cec1d69d-2702-44ab-92b5-5bbd79fe8b84 tempest-VolumeSnapshotQuotasNegativeTestJSON-376272934 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-00fd5654-e231-41da-9e8b-22c3539a27ca.info {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:47:38 devstack sudo[93847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-00fd5654-e231-41da-9e8b-22c3539a27ca.info Nov 06 11:47:38 devstack sudo[93847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:47:39 devstack sudo[93847]: pam_unix(sudo:session): session closed for user root Nov 06 11:47:39 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-cec1d69d-2702-44ab-92b5-5bbd79fe8b84 tempest-VolumeSnapshotQuotasNegativeTestJSON-376272934 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-00fd5654-e231-41da-9e8b-22c3539a27ca.info" returned: 0 in 0.300s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:47:39 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-cec1d69d-2702-44ab-92b5-5bbd79fe8b84 tempest-VolumeSnapshotQuotasNegativeTestJSON-376272934 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.167s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 11:47:39 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-cec1d69d-2702-44ab-92b5-5bbd79fe8b84 tempest-VolumeSnapshotQuotasNegativeTestJSON-376272934 None] Create snapshot completed successfully Nov 06 11:47:39 devstack cinder-volume[87116]: DEBUG oslo_service.periodic_task [None req-4fab4816-ec2b-4b19-b2ff-8548f2084354 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87116) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 11:47:39 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-4fab4816-ec2b-4b19-b2ff-8548f2084354 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 11:47:39 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-4fab4816-ec2b-4b19-b2ff-8548f2084354 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 11:47:39 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-4fab4816-ec2b-4b19-b2ff-8548f2084354 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 11:47:39 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-4fab4816-ec2b-4b19-b2ff-8548f2084354 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 11:47:39 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-4fab4816-ec2b-4b19-b2ff-8548f2084354 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.048s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 11:47:39 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-4fab4816-ec2b-4b19-b2ff-8548f2084354 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:47:39 devstack sudo[93861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756 Nov 06 11:47:39 devstack sudo[93861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:47:40 devstack sudo[93861]: pam_unix(sudo:session): session closed for user root Nov 06 11:47:40 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-4fab4816-ec2b-4b19-b2ff-8548f2084354 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756" returned: 0 in 0.541s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:47:40 devstack cinder-volume[87116]: DEBUG cinder.manager [None req-4fab4816-ec2b-4b19-b2ff-8548f2084354 None None] Notifying Schedulers of capabilities ... {{(pid=87116) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 11:47:40 devstack cinder-volume[87116]: DEBUG oslo_service.periodic_task [None req-4fab4816-ec2b-4b19-b2ff-8548f2084354 None None] Running periodic task VolumeManager._thread_info {{(pid=87116) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 11:47:40 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-4fab4816-ec2b-4b19-b2ff-8548f2084354 None None] thread count: 28 {{(pid=87116) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 06 11:47:40 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-4fab4816-ec2b-4b19-b2ff-8548f2084354 None None] thread info: [<_MainThread(MainThread, started 131399520669824)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87116) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 06 11:47:41 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-e99e1339-a5a7-4b59-ad8f-480a93a00944 tempest-VolumeSnapshotQuotasNegativeTestJSON-376272934 None] Acquiring lock "cinder-e44c13b3-815d-49b5-882c-653622e59e8c-delete_snapshot" by "delete_snapshot" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 11:47:41 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-e99e1339-a5a7-4b59-ad8f-480a93a00944 tempest-VolumeSnapshotQuotasNegativeTestJSON-376272934 None] Lock "cinder-e44c13b3-815d-49b5-882c-653622e59e8c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.040s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 11:47:41 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-e99e1339-a5a7-4b59-ad8f-480a93a00944 tempest-VolumeSnapshotQuotasNegativeTestJSON-376272934 None] Acquiring lock "cinder-quobyte-00fd5654-e231-41da-9e8b-22c3539a27ca" by "delete_snapshot" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 11:47:41 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-e99e1339-a5a7-4b59-ad8f-480a93a00944 tempest-VolumeSnapshotQuotasNegativeTestJSON-376272934 None] Lock "cinder-quobyte-00fd5654-e231-41da-9e8b-22c3539a27ca" acquired by "delete_snapshot" :: waited 0.036s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 11:47:41 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-e99e1339-a5a7-4b59-ad8f-480a93a00944 tempest-VolumeSnapshotQuotasNegativeTestJSON-376272934 None] Acquiring lock "cinder-quobyte-e44c13b3-815d-49b5-882c-653622e59e8c" by "_delete_snapshot" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 11:47:41 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-e99e1339-a5a7-4b59-ad8f-480a93a00944 tempest-VolumeSnapshotQuotasNegativeTestJSON-376272934 None] Lock "cinder-quobyte-e44c13b3-815d-49b5-882c-653622e59e8c" acquired by "_delete_snapshot" :: waited 0.034s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 11:47:41 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-e99e1339-a5a7-4b59-ad8f-480a93a00944 tempest-VolumeSnapshotQuotasNegativeTestJSON-376272934 None] Deleting offline snapshot e44c13b3-815d-49b5-882c-653622e59e8c of volume 00fd5654-e231-41da-9e8b-22c3539a27ca {{(pid=87116) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 06 11:47:41 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-e99e1339-a5a7-4b59-ad8f-480a93a00944 tempest-VolumeSnapshotQuotasNegativeTestJSON-376272934 None] snapshot_file for this snap is: volume-00fd5654-e231-41da-9e8b-22c3539a27ca.e44c13b3-815d-49b5-882c-653622e59e8c {{(pid=87116) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 06 11:47:41 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[f70242cd-bb22-4d30-beb9-1fa5d727e14e]: (4, 'qcow2') {{(pid=88420) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 11:47:41 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-e99e1339-a5a7-4b59-ad8f-480a93a00944 tempest-VolumeSnapshotQuotasNegativeTestJSON-376272934 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-00fd5654-e231-41da-9e8b-22c3539a27ca.e44c13b3-815d-49b5-882c-653622e59e8c {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:47:41 devstack sudo[93878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-00fd5654-e231-41da-9e8b-22c3539a27ca.e44c13b3-815d-49b5-882c-653622e59e8c Nov 06 11:47:41 devstack sudo[93878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:47:41 devstack sudo[93878]: pam_unix(sudo:session): session closed for user root Nov 06 11:47:41 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-e99e1339-a5a7-4b59-ad8f-480a93a00944 tempest-VolumeSnapshotQuotasNegativeTestJSON-376272934 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-00fd5654-e231-41da-9e8b-22c3539a27ca.e44c13b3-815d-49b5-882c-653622e59e8c" returned: 0 in 0.442s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:47:41 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-e99e1339-a5a7-4b59-ad8f-480a93a00944 tempest-VolumeSnapshotQuotasNegativeTestJSON-376272934 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-00fd5654-e231-41da-9e8b-22c3539a27ca(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87116) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 11:47:41 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae99b282-380f-4075-bfa2-879acd7d6c04]: (4, 'qcow2') {{(pid=88420) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 11:47:41 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-e99e1339-a5a7-4b59-ad8f-480a93a00944 tempest-VolumeSnapshotQuotasNegativeTestJSON-376272934 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-00fd5654-e231-41da-9e8b-22c3539a27ca {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:47:41 devstack sudo[93884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-00fd5654-e231-41da-9e8b-22c3539a27ca Nov 06 11:47:41 devstack sudo[93884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:47:42 devstack sudo[93884]: pam_unix(sudo:session): session closed for user root Nov 06 11:47:42 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-e99e1339-a5a7-4b59-ad8f-480a93a00944 tempest-VolumeSnapshotQuotasNegativeTestJSON-376272934 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-00fd5654-e231-41da-9e8b-22c3539a27ca" returned: 0 in 0.593s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:47:42 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-e99e1339-a5a7-4b59-ad8f-480a93a00944 tempest-VolumeSnapshotQuotasNegativeTestJSON-376272934 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-00fd5654-e231-41da-9e8b-22c3539a27ca.e44c13b3-815d-49b5-882c-653622e59e8c {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:47:42 devstack sudo[93892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-00fd5654-e231-41da-9e8b-22c3539a27ca.e44c13b3-815d-49b5-882c-653622e59e8c Nov 06 11:47:42 devstack sudo[93892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:47:42 devstack cinder-volume[87116]: INFO cinder.volume.manager [req-57071fa2-337f-418b-9986-389fb6a28d88 req-307ac81f-c5b5-45d1-81d0-bee686c1a7bf tempest-ServerActionsTestOtherA-64126338 None] Terminate volume connection completed successfully. Nov 06 11:47:42 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [req-57071fa2-337f-418b-9986-389fb6a28d88 req-307ac81f-c5b5-45d1-81d0-bee686c1a7bf tempest-ServerActionsTestOtherA-64126338 None] Deleting attachment f8416f11-2093-432c-8bb5-d1931bc3d92c. {{(pid=87116) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 06 11:47:42 devstack cinder-volume[87116]: DEBUG cinder.coordination [req-57071fa2-337f-418b-9986-389fb6a28d88 req-274d772d-ee6e-4bef-9f3a-b801577a16d0 tempest-ServerActionsTestOtherA-64126338 None] Acquiring lock "cinder-d37614a3-9342-4021-b2a4-27556a55c322-delete_volume" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 11:47:42 devstack cinder-volume[87116]: DEBUG cinder.coordination [req-57071fa2-337f-418b-9986-389fb6a28d88 req-274d772d-ee6e-4bef-9f3a-b801577a16d0 tempest-ServerActionsTestOtherA-64126338 None] Lock "cinder-d37614a3-9342-4021-b2a4-27556a55c322-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 11:47:42 devstack cinder-volume[87116]: DEBUG cinder.coordination [req-57071fa2-337f-418b-9986-389fb6a28d88 req-274d772d-ee6e-4bef-9f3a-b801577a16d0 tempest-ServerActionsTestOtherA-64126338 None] Acquiring lock "cinder-quobyte-d37614a3-9342-4021-b2a4-27556a55c322" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 11:47:42 devstack cinder-volume[87116]: DEBUG cinder.coordination [req-57071fa2-337f-418b-9986-389fb6a28d88 req-274d772d-ee6e-4bef-9f3a-b801577a16d0 tempest-ServerActionsTestOtherA-64126338 None] Lock "cinder-quobyte-d37614a3-9342-4021-b2a4-27556a55c322" acquired by "delete_volume" :: waited 0.026s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 11:47:42 devstack sudo[93892]: pam_unix(sudo:session): session closed for user root Nov 06 11:47:42 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-e99e1339-a5a7-4b59-ad8f-480a93a00944 tempest-VolumeSnapshotQuotasNegativeTestJSON-376272934 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-00fd5654-e231-41da-9e8b-22c3539a27ca.e44c13b3-815d-49b5-882c-653622e59e8c" returned: 0 in 0.568s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:47:42 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-e99e1339-a5a7-4b59-ad8f-480a93a00944 tempest-VolumeSnapshotQuotasNegativeTestJSON-376272934 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-00fd5654-e231-41da-9e8b-22c3539a27ca.e44c13b3-815d-49b5-882c-653622e59e8c {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:47:42 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0a1fe65-9f4d-429e-b421-bd407ee121e6]: (4, 'qcow2') {{(pid=88420) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 11:47:42 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [req-57071fa2-337f-418b-9986-389fb6a28d88 req-274d772d-ee6e-4bef-9f3a-b801577a16d0 tempest-ServerActionsTestOtherA-64126338 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-d37614a3-9342-4021-b2a4-27556a55c322 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:47:42 devstack sudo[93898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-00fd5654-e231-41da-9e8b-22c3539a27ca.e44c13b3-815d-49b5-882c-653622e59e8c Nov 06 11:47:42 devstack sudo[93898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:47:43 devstack sudo[93899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-d37614a3-9342-4021-b2a4-27556a55c322 Nov 06 11:47:43 devstack sudo[93899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:47:43 devstack sudo[93898]: pam_unix(sudo:session): session closed for user root Nov 06 11:47:43 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-e99e1339-a5a7-4b59-ad8f-480a93a00944 tempest-VolumeSnapshotQuotasNegativeTestJSON-376272934 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-00fd5654-e231-41da-9e8b-22c3539a27ca.e44c13b3-815d-49b5-882c-653622e59e8c" returned: 0 in 0.522s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:47:43 devstack sudo[93899]: pam_unix(sudo:session): session closed for user root Nov 06 11:47:43 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [req-57071fa2-337f-418b-9986-389fb6a28d88 req-274d772d-ee6e-4bef-9f3a-b801577a16d0 tempest-ServerActionsTestOtherA-64126338 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-d37614a3-9342-4021-b2a4-27556a55c322" returned: 0 in 0.589s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:47:43 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [req-57071fa2-337f-418b-9986-389fb6a28d88 req-274d772d-ee6e-4bef-9f3a-b801577a16d0 tempest-ServerActionsTestOtherA-64126338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-d37614a3-9342-4021-b2a4-27556a55c322 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:47:43 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-e99e1339-a5a7-4b59-ad8f-480a93a00944 tempest-VolumeSnapshotQuotasNegativeTestJSON-376272934 None] Lock "cinder-quobyte-e44c13b3-815d-49b5-882c-653622e59e8c" released by "_delete_snapshot" :: held 2.348s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 11:47:43 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-e99e1339-a5a7-4b59-ad8f-480a93a00944 tempest-VolumeSnapshotQuotasNegativeTestJSON-376272934 None] Lock "cinder-quobyte-00fd5654-e231-41da-9e8b-22c3539a27ca" released by "delete_snapshot" :: held 2.404s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 11:47:43 devstack sudo[93908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-d37614a3-9342-4021-b2a4-27556a55c322 Nov 06 11:47:43 devstack sudo[93908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:47:43 devstack cinder-volume[87116]: WARNING cinder.quota [None req-e99e1339-a5a7-4b59-ad8f-480a93a00944 tempest-VolumeSnapshotQuotasNegativeTestJSON-376272934 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Nov 06 11:47:43 devstack cinder-volume[87116]: DEBUG cinder.quota [None req-e99e1339-a5a7-4b59-ad8f-480a93a00944 tempest-VolumeSnapshotQuotasNegativeTestJSON-376272934 None] Created reservations ['9946f7a0-385f-4940-8818-1f13da3922d5', 'e8330031-ecea-466b-9522-d649e423c368', '5fcaf95d-d285-47bf-af16-6f560a74d3c4', '612f03c9-c3f7-4581-bfa5-356e888e4216'] {{(pid=87116) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 11:47:43 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-e99e1339-a5a7-4b59-ad8f-480a93a00944 tempest-VolumeSnapshotQuotasNegativeTestJSON-376272934 None] Delete snapshot completed successfully. Nov 06 11:47:43 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-e99e1339-a5a7-4b59-ad8f-480a93a00944 tempest-VolumeSnapshotQuotasNegativeTestJSON-376272934 None] Lock "cinder-e44c13b3-815d-49b5-882c-653622e59e8c-delete_snapshot" released by "delete_snapshot" :: held 2.698s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 11:47:43 devstack sudo[93908]: pam_unix(sudo:session): session closed for user root Nov 06 11:47:44 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [req-57071fa2-337f-418b-9986-389fb6a28d88 req-274d772d-ee6e-4bef-9f3a-b801577a16d0 tempest-ServerActionsTestOtherA-64126338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-d37614a3-9342-4021-b2a4-27556a55c322" returned: 0 in 0.523s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:47:44 devstack cinder-volume[87116]: DEBUG cinder.coordination [req-57071fa2-337f-418b-9986-389fb6a28d88 req-274d772d-ee6e-4bef-9f3a-b801577a16d0 tempest-ServerActionsTestOtherA-64126338 None] Lock "cinder-quobyte-d37614a3-9342-4021-b2a4-27556a55c322" released by "delete_volume" :: held 1.213s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 11:47:44 devstack cinder-volume[87116]: DEBUG cinder.quota [req-57071fa2-337f-418b-9986-389fb6a28d88 req-274d772d-ee6e-4bef-9f3a-b801577a16d0 tempest-ServerActionsTestOtherA-64126338 None] Created reservations ['3a94255e-2b88-498d-bd60-f125f27e5560', 'eb569df8-f9e2-4b16-9990-5aa3a7a11f2d', '18aa3f47-d5cc-460a-949d-83e005794900', '350fc578-3f76-4857-91fd-82b1ad452ac9'] {{(pid=87116) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 11:47:44 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [req-57071fa2-337f-418b-9986-389fb6a28d88 req-274d772d-ee6e-4bef-9f3a-b801577a16d0 tempest-ServerActionsTestOtherA-64126338 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 11:47:44 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [req-57071fa2-337f-418b-9986-389fb6a28d88 req-274d772d-ee6e-4bef-9f3a-b801577a16d0 tempest-ServerActionsTestOtherA-64126338 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 11:47:44 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [req-57071fa2-337f-418b-9986-389fb6a28d88 req-274d772d-ee6e-4bef-9f3a-b801577a16d0 tempest-ServerActionsTestOtherA-64126338 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 11:47:44 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [req-57071fa2-337f-418b-9986-389fb6a28d88 req-274d772d-ee6e-4bef-9f3a-b801577a16d0 tempest-ServerActionsTestOtherA-64126338 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 11:47:44 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [req-57071fa2-337f-418b-9986-389fb6a28d88 req-274d772d-ee6e-4bef-9f3a-b801577a16d0 tempest-ServerActionsTestOtherA-64126338 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 11:47:44 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [req-57071fa2-337f-418b-9986-389fb6a28d88 req-274d772d-ee6e-4bef-9f3a-b801577a16d0 tempest-ServerActionsTestOtherA-64126338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:47:44 devstack sudo[93913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756 Nov 06 11:47:44 devstack sudo[93913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:47:44 devstack sudo[93913]: pam_unix(sudo:session): session closed for user root Nov 06 11:47:44 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [req-57071fa2-337f-418b-9986-389fb6a28d88 req-274d772d-ee6e-4bef-9f3a-b801577a16d0 tempest-ServerActionsTestOtherA-64126338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756" returned: 0 in 0.372s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:47:44 devstack cinder-volume[87116]: DEBUG cinder.manager [req-57071fa2-337f-418b-9986-389fb6a28d88 req-274d772d-ee6e-4bef-9f3a-b801577a16d0 tempest-ServerActionsTestOtherA-64126338 None] Notifying Schedulers of capabilities ... {{(pid=87116) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 11:47:44 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-bf8f0c56-c8b3-4ecf-9c10-b7dcbbb7dfe4 tempest-VolumeSnapshotQuotasNegativeTestJSON-376272934 None] Acquiring lock "cinder-00fd5654-e231-41da-9e8b-22c3539a27ca-delete_volume" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 11:47:44 devstack cinder-volume[87116]: INFO cinder.volume.manager [req-57071fa2-337f-418b-9986-389fb6a28d88 req-274d772d-ee6e-4bef-9f3a-b801577a16d0 tempest-ServerActionsTestOtherA-64126338 None] Deleted volume successfully. Nov 06 11:47:44 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-bf8f0c56-c8b3-4ecf-9c10-b7dcbbb7dfe4 tempest-VolumeSnapshotQuotasNegativeTestJSON-376272934 None] Lock "cinder-00fd5654-e231-41da-9e8b-22c3539a27ca-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 11:47:44 devstack cinder-volume[87116]: DEBUG cinder.coordination [req-57071fa2-337f-418b-9986-389fb6a28d88 req-274d772d-ee6e-4bef-9f3a-b801577a16d0 tempest-ServerActionsTestOtherA-64126338 None] Lock "cinder-d37614a3-9342-4021-b2a4-27556a55c322-delete_volume" released by "delete_volume" :: held 1.878s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 11:47:44 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-bf8f0c56-c8b3-4ecf-9c10-b7dcbbb7dfe4 tempest-VolumeSnapshotQuotasNegativeTestJSON-376272934 None] Acquiring lock "cinder-quobyte-00fd5654-e231-41da-9e8b-22c3539a27ca" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 11:47:44 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-bf8f0c56-c8b3-4ecf-9c10-b7dcbbb7dfe4 tempest-VolumeSnapshotQuotasNegativeTestJSON-376272934 None] Lock "cinder-quobyte-00fd5654-e231-41da-9e8b-22c3539a27ca" acquired by "delete_volume" :: waited 0.036s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 11:47:44 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[4719c08e-420d-4a27-80ec-b5eaf2f133ab]: (4, 'qcow2') {{(pid=88420) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 11:47:44 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-bf8f0c56-c8b3-4ecf-9c10-b7dcbbb7dfe4 tempest-VolumeSnapshotQuotasNegativeTestJSON-376272934 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-00fd5654-e231-41da-9e8b-22c3539a27ca {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:47:45 devstack sudo[93932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-00fd5654-e231-41da-9e8b-22c3539a27ca Nov 06 11:47:45 devstack sudo[93932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:47:45 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-7c801c78-a64e-4f8d-9fb6-d6c0a1a8f60a tempest-ServerActionsTestOtherA-64126338 None] Acquiring lock "cinder-836b7423-57f1-436b-a893-c14fa60ee13d-delete_volume" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 11:47:45 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-7c801c78-a64e-4f8d-9fb6-d6c0a1a8f60a tempest-ServerActionsTestOtherA-64126338 None] Lock "cinder-836b7423-57f1-436b-a893-c14fa60ee13d-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 11:47:45 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-7c801c78-a64e-4f8d-9fb6-d6c0a1a8f60a tempest-ServerActionsTestOtherA-64126338 None] Acquiring lock "cinder-quobyte-836b7423-57f1-436b-a893-c14fa60ee13d" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 11:47:45 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-7c801c78-a64e-4f8d-9fb6-d6c0a1a8f60a tempest-ServerActionsTestOtherA-64126338 None] Lock "cinder-quobyte-836b7423-57f1-436b-a893-c14fa60ee13d" acquired by "delete_volume" :: waited 0.029s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 11:47:45 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[61f19612-41df-4f11-95c4-34626bceac0a]: (4, 'qcow2') {{(pid=88420) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 11:47:45 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-7c801c78-a64e-4f8d-9fb6-d6c0a1a8f60a tempest-ServerActionsTestOtherA-64126338 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-836b7423-57f1-436b-a893-c14fa60ee13d {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:47:45 devstack sudo[93932]: pam_unix(sudo:session): session closed for user root Nov 06 11:47:45 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-bf8f0c56-c8b3-4ecf-9c10-b7dcbbb7dfe4 tempest-VolumeSnapshotQuotasNegativeTestJSON-376272934 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-00fd5654-e231-41da-9e8b-22c3539a27ca" returned: 0 in 0.768s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:47:45 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-bf8f0c56-c8b3-4ecf-9c10-b7dcbbb7dfe4 tempest-VolumeSnapshotQuotasNegativeTestJSON-376272934 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-00fd5654-e231-41da-9e8b-22c3539a27ca {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:47:45 devstack sudo[93944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-836b7423-57f1-436b-a893-c14fa60ee13d Nov 06 11:47:45 devstack sudo[93944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:47:45 devstack sudo[93947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-00fd5654-e231-41da-9e8b-22c3539a27ca Nov 06 11:47:45 devstack sudo[93947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:47:46 devstack sudo[93944]: pam_unix(sudo:session): session closed for user root Nov 06 11:47:46 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-7c801c78-a64e-4f8d-9fb6-d6c0a1a8f60a tempest-ServerActionsTestOtherA-64126338 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-836b7423-57f1-436b-a893-c14fa60ee13d" returned: 0 in 0.657s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:47:46 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-7c801c78-a64e-4f8d-9fb6-d6c0a1a8f60a tempest-ServerActionsTestOtherA-64126338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-836b7423-57f1-436b-a893-c14fa60ee13d {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:47:46 devstack sudo[93955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-836b7423-57f1-436b-a893-c14fa60ee13d Nov 06 11:47:46 devstack sudo[93955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:47:46 devstack sudo[93947]: pam_unix(sudo:session): session closed for user root Nov 06 11:47:46 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-bf8f0c56-c8b3-4ecf-9c10-b7dcbbb7dfe4 tempest-VolumeSnapshotQuotasNegativeTestJSON-376272934 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-00fd5654-e231-41da-9e8b-22c3539a27ca" returned: 0 in 0.649s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:47:46 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-bf8f0c56-c8b3-4ecf-9c10-b7dcbbb7dfe4 tempest-VolumeSnapshotQuotasNegativeTestJSON-376272934 None] Lock "cinder-quobyte-00fd5654-e231-41da-9e8b-22c3539a27ca" released by "delete_volume" :: held 1.572s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 11:47:46 devstack cinder-volume[87116]: DEBUG cinder.quota [None req-bf8f0c56-c8b3-4ecf-9c10-b7dcbbb7dfe4 tempest-VolumeSnapshotQuotasNegativeTestJSON-376272934 None] Created reservations ['63ea2bc4-cc2a-4a8f-ab9a-50d94cb19bc6', '87e7b9ec-5be1-4e7a-b22a-c5e6e61d04a8', '58d748da-2ae5-4c36-aa14-cced57923c80', 'd9d3647f-4ca9-4a8c-9829-6d366f6a5bde'] {{(pid=87116) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 11:47:46 devstack sudo[93955]: pam_unix(sudo:session): session closed for user root Nov 06 11:47:46 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-7c801c78-a64e-4f8d-9fb6-d6c0a1a8f60a tempest-ServerActionsTestOtherA-64126338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-836b7423-57f1-436b-a893-c14fa60ee13d" returned: 0 in 0.381s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:47:46 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-7c801c78-a64e-4f8d-9fb6-d6c0a1a8f60a tempest-ServerActionsTestOtherA-64126338 None] Lock "cinder-quobyte-836b7423-57f1-436b-a893-c14fa60ee13d" released by "delete_volume" :: held 1.126s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 11:47:46 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-bf8f0c56-c8b3-4ecf-9c10-b7dcbbb7dfe4 tempest-VolumeSnapshotQuotasNegativeTestJSON-376272934 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 11:47:46 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-bf8f0c56-c8b3-4ecf-9c10-b7dcbbb7dfe4 tempest-VolumeSnapshotQuotasNegativeTestJSON-376272934 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 11:47:46 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-bf8f0c56-c8b3-4ecf-9c10-b7dcbbb7dfe4 tempest-VolumeSnapshotQuotasNegativeTestJSON-376272934 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 11:47:46 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-bf8f0c56-c8b3-4ecf-9c10-b7dcbbb7dfe4 tempest-VolumeSnapshotQuotasNegativeTestJSON-376272934 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 11:47:46 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-bf8f0c56-c8b3-4ecf-9c10-b7dcbbb7dfe4 tempest-VolumeSnapshotQuotasNegativeTestJSON-376272934 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 11:47:46 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-bf8f0c56-c8b3-4ecf-9c10-b7dcbbb7dfe4 tempest-VolumeSnapshotQuotasNegativeTestJSON-376272934 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:47:46 devstack sudo[93960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756 Nov 06 11:47:46 devstack sudo[93960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:47:46 devstack cinder-volume[87116]: DEBUG cinder.quota [None req-7c801c78-a64e-4f8d-9fb6-d6c0a1a8f60a tempest-ServerActionsTestOtherA-64126338 None] Created reservations ['aef3bcf2-2c3a-4c20-b842-9405d737ba42', 'f32565d3-ee2f-4262-9ce5-37168d9b9a15', 'd7deb066-72ad-4772-98e4-b5d5f3622106', '118b9b2f-6f23-4a76-bdff-c763edd56dbd'] {{(pid=87116) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 11:47:46 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-7c801c78-a64e-4f8d-9fb6-d6c0a1a8f60a tempest-ServerActionsTestOtherA-64126338 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 11:47:46 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-7c801c78-a64e-4f8d-9fb6-d6c0a1a8f60a tempest-ServerActionsTestOtherA-64126338 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 11:47:46 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-7c801c78-a64e-4f8d-9fb6-d6c0a1a8f60a tempest-ServerActionsTestOtherA-64126338 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 11:47:46 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-7c801c78-a64e-4f8d-9fb6-d6c0a1a8f60a tempest-ServerActionsTestOtherA-64126338 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 11:47:46 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-7c801c78-a64e-4f8d-9fb6-d6c0a1a8f60a tempest-ServerActionsTestOtherA-64126338 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 11:47:46 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-7c801c78-a64e-4f8d-9fb6-d6c0a1a8f60a tempest-ServerActionsTestOtherA-64126338 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:47:46 devstack sudo[93962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756 Nov 06 11:47:46 devstack sudo[93962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:47:47 devstack sudo[93960]: pam_unix(sudo:session): session closed for user root Nov 06 11:47:47 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-bf8f0c56-c8b3-4ecf-9c10-b7dcbbb7dfe4 tempest-VolumeSnapshotQuotasNegativeTestJSON-376272934 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756" returned: 0 in 0.501s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:47:47 devstack cinder-volume[87116]: DEBUG cinder.manager [None req-bf8f0c56-c8b3-4ecf-9c10-b7dcbbb7dfe4 tempest-VolumeSnapshotQuotasNegativeTestJSON-376272934 None] Notifying Schedulers of capabilities ... {{(pid=87116) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 11:47:47 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-bf8f0c56-c8b3-4ecf-9c10-b7dcbbb7dfe4 tempest-VolumeSnapshotQuotasNegativeTestJSON-376272934 None] Deleted volume successfully. Nov 06 11:47:47 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-bf8f0c56-c8b3-4ecf-9c10-b7dcbbb7dfe4 tempest-VolumeSnapshotQuotasNegativeTestJSON-376272934 None] Lock "cinder-00fd5654-e231-41da-9e8b-22c3539a27ca-delete_volume" released by "delete_volume" :: held 2.527s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 11:47:47 devstack sudo[93962]: pam_unix(sudo:session): session closed for user root Nov 06 11:47:47 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-7c801c78-a64e-4f8d-9fb6-d6c0a1a8f60a tempest-ServerActionsTestOtherA-64126338 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756" returned: 0 in 0.390s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:47:47 devstack cinder-volume[87116]: DEBUG cinder.manager [None req-7c801c78-a64e-4f8d-9fb6-d6c0a1a8f60a tempest-ServerActionsTestOtherA-64126338 None] Notifying Schedulers of capabilities ... {{(pid=87116) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 11:47:47 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-7c801c78-a64e-4f8d-9fb6-d6c0a1a8f60a tempest-ServerActionsTestOtherA-64126338 None] Deleted volume successfully. Nov 06 11:47:47 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-7c801c78-a64e-4f8d-9fb6-d6c0a1a8f60a tempest-ServerActionsTestOtherA-64126338 None] Lock "cinder-836b7423-57f1-436b-a893-c14fa60ee13d-delete_volume" released by "delete_volume" :: held 1.885s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 11:47:50 devstack cinder-volume[87116]: INFO cinder.volume.manager [req-e8689f6c-d056-4afe-a74c-b3dfd3c8171e req-aa9676f8-61ce-4391-a6e0-62b0cfdecf0e tempest-AttachVolumeNegativeTest-771196063 None] Terminate volume connection completed successfully. Nov 06 11:47:50 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [req-e8689f6c-d056-4afe-a74c-b3dfd3c8171e req-aa9676f8-61ce-4391-a6e0-62b0cfdecf0e tempest-AttachVolumeNegativeTest-771196063 None] Deleting attachment c31c7a05-4d3f-495b-8905-0bcdf44f3ea6. {{(pid=87116) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 06 11:48:00 devstack cinder-volume[87116]: DEBUG dbcounter [-] [87116] Writing DB stats cinder:SELECT=49,cinder:UPDATE=43,cinder:INSERT=9,cinder:DELETE=5 {{(pid=87116) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 11:48:00 devstack cinder-volume[87116]: DEBUG dbcounter [-] [87116] Writing DB stats cinder:SELECT=39,cinder:UPDATE=57,cinder:INSERT=15,cinder:DELETE=3 {{(pid=87116) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 11:48:01 devstack cinder-volume[87116]: DEBUG cinder.volume.flows.manager.create_volume [req-2798ac41-f892-4d37-96b7-8a7eccd0ba6e req-0c732e88-ba9b-4975-8abe-b2aca27fde49 tempest-VolumesGetTestJSON-43429463 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87116) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 11:48:01 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [req-2798ac41-f892-4d37-96b7-8a7eccd0ba6e req-0c732e88-ba9b-4975-8abe-b2aca27fde49 tempest-VolumesGetTestJSON-43429463 None] Flow 'volume_create_manager' (3ea69389-1a76-4ad3-b8ab-5cda988353e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 11:48:01 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [req-2798ac41-f892-4d37-96b7-8a7eccd0ba6e req-0c732e88-ba9b-4975-8abe-b2aca27fde49 tempest-VolumesGetTestJSON-43429463 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5dec3179-e04e-4c06-bb28-1a038c3a7ae8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:48:01 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [req-2798ac41-f892-4d37-96b7-8a7eccd0ba6e req-0c732e88-ba9b-4975-8abe-b2aca27fde49 tempest-VolumesGetTestJSON-43429463 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5dec3179-e04e-4c06-bb28-1a038c3a7ae8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T10:48:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-453645598',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c4c6beaa-198a-4a4b-959e-4a9d72f7dea3,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='548d4f6dc8e14bc180b2638954456121',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T10:48:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T10:48:02Z,use_quota=True,user_id='3e711bb19eae4e2ebab143113dc93dcd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(34d3b144-d9b7-480a-a2e3-01e45f3d54c1),volume_type_id=34d3b144-d9b7-480a-a2e3-01e45f3d54c1)' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:48:01 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [req-2798ac41-f892-4d37-96b7-8a7eccd0ba6e req-0c732e88-ba9b-4975-8abe-b2aca27fde49 tempest-VolumesGetTestJSON-43429463 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (098d39f4-ac03-4ed1-af55-350f080e2ec8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:48:01 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [req-2798ac41-f892-4d37-96b7-8a7eccd0ba6e req-0c732e88-ba9b-4975-8abe-b2aca27fde49 tempest-VolumesGetTestJSON-43429463 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (098d39f4-ac03-4ed1-af55-350f080e2ec8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:48:01 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [req-2798ac41-f892-4d37-96b7-8a7eccd0ba6e req-0c732e88-ba9b-4975-8abe-b2aca27fde49 tempest-VolumesGetTestJSON-43429463 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f453520e-4d21-459b-8999-731835fb1a1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:48:01 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [req-2798ac41-f892-4d37-96b7-8a7eccd0ba6e req-0c732e88-ba9b-4975-8abe-b2aca27fde49 tempest-VolumesGetTestJSON-43429463 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f453520e-4d21-459b-8999-731835fb1a1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c4c6beaa-198a-4a4b-959e-4a9d72f7dea3', 'volume_name': 'volume-c4c6beaa-198a-4a4b-959e-4a9d72f7dea3', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:48:01 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [req-2798ac41-f892-4d37-96b7-8a7eccd0ba6e req-0c732e88-ba9b-4975-8abe-b2aca27fde49 tempest-VolumesGetTestJSON-43429463 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (457d8a7c-823a-40f7-a2d3-62f6191bb369) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:48:01 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [req-2798ac41-f892-4d37-96b7-8a7eccd0ba6e req-0c732e88-ba9b-4975-8abe-b2aca27fde49 tempest-VolumesGetTestJSON-43429463 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (457d8a7c-823a-40f7-a2d3-62f6191bb369) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:48:01 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [req-2798ac41-f892-4d37-96b7-8a7eccd0ba6e req-0c732e88-ba9b-4975-8abe-b2aca27fde49 tempest-VolumesGetTestJSON-43429463 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (68a368f9-ccf3-457b-b7ff-c2b20911ad9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:48:01 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [req-2798ac41-f892-4d37-96b7-8a7eccd0ba6e req-0c732e88-ba9b-4975-8abe-b2aca27fde49 tempest-VolumesGetTestJSON-43429463 None] Volume c4c6beaa-198a-4a4b-959e-4a9d72f7dea3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c4c6beaa-198a-4a4b-959e-4a9d72f7dea3', 'volume_size': 1} Nov 06 11:48:01 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [req-2798ac41-f892-4d37-96b7-8a7eccd0ba6e req-0c732e88-ba9b-4975-8abe-b2aca27fde49 tempest-VolumesGetTestJSON-43429463 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 11:48:01 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [req-2798ac41-f892-4d37-96b7-8a7eccd0ba6e req-0c732e88-ba9b-4975-8abe-b2aca27fde49 tempest-VolumesGetTestJSON-43429463 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 11:48:01 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [req-2798ac41-f892-4d37-96b7-8a7eccd0ba6e req-0c732e88-ba9b-4975-8abe-b2aca27fde49 tempest-VolumesGetTestJSON-43429463 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T10:48:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-453645598',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c4c6beaa-198a-4a4b-959e-4a9d72f7dea3,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='548d4f6dc8e14bc180b2638954456121',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T10:48:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T10:48:02Z,use_quota=True,user_id='3e711bb19eae4e2ebab143113dc93dcd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(34d3b144-d9b7-480a-a2e3-01e45f3d54c1),volume_type_id=34d3b144-d9b7-480a-a2e3-01e45f3d54c1)}" {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 11:48:01 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [req-2798ac41-f892-4d37-96b7-8a7eccd0ba6e req-0c732e88-ba9b-4975-8abe-b2aca27fde49 tempest-VolumesGetTestJSON-43429463 None] Creating volume c4c6beaa-198a-4a4b-959e-4a9d72f7dea3 {{(pid=87116) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 11:48:01 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [req-2798ac41-f892-4d37-96b7-8a7eccd0ba6e req-0c732e88-ba9b-4975-8abe-b2aca27fde49 tempest-VolumesGetTestJSON-43429463 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 11:48:01 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [req-2798ac41-f892-4d37-96b7-8a7eccd0ba6e req-0c732e88-ba9b-4975-8abe-b2aca27fde49 tempest-VolumesGetTestJSON-43429463 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 11:48:01 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [req-2798ac41-f892-4d37-96b7-8a7eccd0ba6e req-0c732e88-ba9b-4975-8abe-b2aca27fde49 tempest-VolumesGetTestJSON-43429463 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 11:48:01 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [req-2798ac41-f892-4d37-96b7-8a7eccd0ba6e req-0c732e88-ba9b-4975-8abe-b2aca27fde49 tempest-VolumesGetTestJSON-43429463 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 11:48:01 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [req-2798ac41-f892-4d37-96b7-8a7eccd0ba6e req-0c732e88-ba9b-4975-8abe-b2aca27fde49 tempest-VolumesGetTestJSON-43429463 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 11:48:01 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [req-2798ac41-f892-4d37-96b7-8a7eccd0ba6e req-0c732e88-ba9b-4975-8abe-b2aca27fde49 tempest-VolumesGetTestJSON-43429463 None] Selected osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f as target Quobyte volume. {{(pid=87116) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 11:48:01 devstack cinder-volume[87116]: INFO cinder.volume.drivers.remotefs [req-2798ac41-f892-4d37-96b7-8a7eccd0ba6e req-0c732e88-ba9b-4975-8abe-b2aca27fde49 tempest-VolumesGetTestJSON-43429463 None] casted to osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f Nov 06 11:48:01 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [req-2798ac41-f892-4d37-96b7-8a7eccd0ba6e req-0c732e88-ba9b-4975-8abe-b2aca27fde49 tempest-VolumesGetTestJSON-43429463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-c4c6beaa-198a-4a4b-959e-4a9d72f7dea3 1073741824 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:48:02 devstack sudo[94027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-c4c6beaa-198a-4a4b-959e-4a9d72f7dea3 1073741824 Nov 06 11:48:02 devstack sudo[94027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:48:02 devstack sudo[94027]: pam_unix(sudo:session): session closed for user root Nov 06 11:48:02 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [req-2798ac41-f892-4d37-96b7-8a7eccd0ba6e req-0c732e88-ba9b-4975-8abe-b2aca27fde49 tempest-VolumesGetTestJSON-43429463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-c4c6beaa-198a-4a4b-959e-4a9d72f7dea3 1073741824" returned: 0 in 0.580s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:48:02 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [req-2798ac41-f892-4d37-96b7-8a7eccd0ba6e req-0c732e88-ba9b-4975-8abe-b2aca27fde49 tempest-VolumesGetTestJSON-43429463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-c4c6beaa-198a-4a4b-959e-4a9d72f7dea3 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:48:02 devstack sudo[94035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-c4c6beaa-198a-4a4b-959e-4a9d72f7dea3 Nov 06 11:48:02 devstack sudo[94035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:48:02 devstack sudo[94035]: pam_unix(sudo:session): session closed for user root Nov 06 11:48:02 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [req-2798ac41-f892-4d37-96b7-8a7eccd0ba6e req-0c732e88-ba9b-4975-8abe-b2aca27fde49 tempest-VolumesGetTestJSON-43429463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-c4c6beaa-198a-4a4b-959e-4a9d72f7dea3" returned: 0 in 0.388s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:48:02 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [req-2798ac41-f892-4d37-96b7-8a7eccd0ba6e req-0c732e88-ba9b-4975-8abe-b2aca27fde49 tempest-VolumesGetTestJSON-43429463 None] <== create_volume: return (1032ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f'} {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 11:48:02 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [req-2798ac41-f892-4d37-96b7-8a7eccd0ba6e req-0c732e88-ba9b-4975-8abe-b2aca27fde49 tempest-VolumesGetTestJSON-43429463 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.035s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 11:48:03 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [req-2798ac41-f892-4d37-96b7-8a7eccd0ba6e req-0c732e88-ba9b-4975-8abe-b2aca27fde49 tempest-VolumesGetTestJSON-43429463 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (68a368f9-ccf3-457b-b7ff-c2b20911ad9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c4c6beaa-198a-4a4b-959e-4a9d72f7dea3', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:48:03 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [req-2798ac41-f892-4d37-96b7-8a7eccd0ba6e req-0c732e88-ba9b-4975-8abe-b2aca27fde49 tempest-VolumesGetTestJSON-43429463 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3f645d43-3c01-43a5-be6b-f6a485d0a0da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:48:03 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [req-2798ac41-f892-4d37-96b7-8a7eccd0ba6e req-0c732e88-ba9b-4975-8abe-b2aca27fde49 tempest-VolumesGetTestJSON-43429463 None] Volume volume-c4c6beaa-198a-4a4b-959e-4a9d72f7dea3 (c4c6beaa-198a-4a4b-959e-4a9d72f7dea3): created successfully Nov 06 11:48:03 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [req-2798ac41-f892-4d37-96b7-8a7eccd0ba6e req-0c732e88-ba9b-4975-8abe-b2aca27fde49 tempest-VolumesGetTestJSON-43429463 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3f645d43-3c01-43a5-be6b-f6a485d0a0da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:48:03 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [req-2798ac41-f892-4d37-96b7-8a7eccd0ba6e req-0c732e88-ba9b-4975-8abe-b2aca27fde49 tempest-VolumesGetTestJSON-43429463 None] Flow 'volume_create_manager' (3ea69389-1a76-4ad3-b8ab-5cda988353e4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 11:48:03 devstack cinder-volume[87116]: INFO cinder.volume.manager [req-2798ac41-f892-4d37-96b7-8a7eccd0ba6e req-0c732e88-ba9b-4975-8abe-b2aca27fde49 tempest-VolumesGetTestJSON-43429463 None] Created volume successfully. Nov 06 11:48:04 devstack cinder-volume[87116]: DEBUG cinder.coordination [req-bc164c67-21f5-438e-8922-ba19ae889e40 req-d59f8fb6-3590-4cd8-97ef-7b676c336d98 tempest-VolumesGetTestJSON-43429463 None] Acquiring lock "cinder-c4c6beaa-198a-4a4b-959e-4a9d72f7dea3-delete_volume" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 11:48:04 devstack cinder-volume[87116]: DEBUG cinder.coordination [req-bc164c67-21f5-438e-8922-ba19ae889e40 req-d59f8fb6-3590-4cd8-97ef-7b676c336d98 tempest-VolumesGetTestJSON-43429463 None] Lock "cinder-c4c6beaa-198a-4a4b-959e-4a9d72f7dea3-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 11:48:04 devstack cinder-volume[87116]: DEBUG cinder.coordination [req-bc164c67-21f5-438e-8922-ba19ae889e40 req-d59f8fb6-3590-4cd8-97ef-7b676c336d98 tempest-VolumesGetTestJSON-43429463 None] Acquiring lock "cinder-quobyte-c4c6beaa-198a-4a4b-959e-4a9d72f7dea3" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 11:48:04 devstack cinder-volume[87116]: DEBUG cinder.coordination [req-bc164c67-21f5-438e-8922-ba19ae889e40 req-d59f8fb6-3590-4cd8-97ef-7b676c336d98 tempest-VolumesGetTestJSON-43429463 None] Lock "cinder-quobyte-c4c6beaa-198a-4a4b-959e-4a9d72f7dea3" acquired by "delete_volume" :: waited 0.016s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 11:48:04 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[7087453a-7fe4-4276-ae12-478b9444c4ef]: (4, 'qcow2') {{(pid=88420) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 11:48:04 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [req-bc164c67-21f5-438e-8922-ba19ae889e40 req-d59f8fb6-3590-4cd8-97ef-7b676c336d98 tempest-VolumesGetTestJSON-43429463 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-c4c6beaa-198a-4a4b-959e-4a9d72f7dea3 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:48:04 devstack sudo[94056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-c4c6beaa-198a-4a4b-959e-4a9d72f7dea3 Nov 06 11:48:04 devstack sudo[94056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:48:04 devstack sudo[94056]: pam_unix(sudo:session): session closed for user root Nov 06 11:48:04 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [req-bc164c67-21f5-438e-8922-ba19ae889e40 req-d59f8fb6-3590-4cd8-97ef-7b676c336d98 tempest-VolumesGetTestJSON-43429463 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-c4c6beaa-198a-4a4b-959e-4a9d72f7dea3" returned: 0 in 0.415s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:48:04 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [req-bc164c67-21f5-438e-8922-ba19ae889e40 req-d59f8fb6-3590-4cd8-97ef-7b676c336d98 tempest-VolumesGetTestJSON-43429463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-c4c6beaa-198a-4a4b-959e-4a9d72f7dea3 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:48:05 devstack sudo[94061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-c4c6beaa-198a-4a4b-959e-4a9d72f7dea3 Nov 06 11:48:05 devstack sudo[94061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:48:05 devstack sudo[94061]: pam_unix(sudo:session): session closed for user root Nov 06 11:48:05 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [req-bc164c67-21f5-438e-8922-ba19ae889e40 req-d59f8fb6-3590-4cd8-97ef-7b676c336d98 tempest-VolumesGetTestJSON-43429463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-c4c6beaa-198a-4a4b-959e-4a9d72f7dea3" returned: 0 in 0.286s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:48:05 devstack cinder-volume[87116]: DEBUG cinder.coordination [req-bc164c67-21f5-438e-8922-ba19ae889e40 req-d59f8fb6-3590-4cd8-97ef-7b676c336d98 tempest-VolumesGetTestJSON-43429463 None] Lock "cinder-quobyte-c4c6beaa-198a-4a4b-959e-4a9d72f7dea3" released by "delete_volume" :: held 0.758s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 11:48:05 devstack cinder-volume[87116]: DEBUG cinder.quota [req-bc164c67-21f5-438e-8922-ba19ae889e40 req-d59f8fb6-3590-4cd8-97ef-7b676c336d98 tempest-VolumesGetTestJSON-43429463 None] Created reservations ['7ed5e4b0-93de-4385-9e18-a42dc48a84d0', '9756803d-ed17-4065-9117-4dbf8cd7cfd7', '48161904-c3ab-4283-a65e-7cac923d09af', 'e452f3d1-4f45-494d-8f3a-9c0b9693e5d1'] {{(pid=87116) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 11:48:05 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [req-bc164c67-21f5-438e-8922-ba19ae889e40 req-d59f8fb6-3590-4cd8-97ef-7b676c336d98 tempest-VolumesGetTestJSON-43429463 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 11:48:05 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [req-bc164c67-21f5-438e-8922-ba19ae889e40 req-d59f8fb6-3590-4cd8-97ef-7b676c336d98 tempest-VolumesGetTestJSON-43429463 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 11:48:05 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [req-bc164c67-21f5-438e-8922-ba19ae889e40 req-d59f8fb6-3590-4cd8-97ef-7b676c336d98 tempest-VolumesGetTestJSON-43429463 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 11:48:05 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [req-bc164c67-21f5-438e-8922-ba19ae889e40 req-d59f8fb6-3590-4cd8-97ef-7b676c336d98 tempest-VolumesGetTestJSON-43429463 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 11:48:05 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [req-bc164c67-21f5-438e-8922-ba19ae889e40 req-d59f8fb6-3590-4cd8-97ef-7b676c336d98 tempest-VolumesGetTestJSON-43429463 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 11:48:05 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [req-bc164c67-21f5-438e-8922-ba19ae889e40 req-d59f8fb6-3590-4cd8-97ef-7b676c336d98 tempest-VolumesGetTestJSON-43429463 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:48:05 devstack sudo[94065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756 Nov 06 11:48:05 devstack sudo[94065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:48:05 devstack sudo[94065]: pam_unix(sudo:session): session closed for user root Nov 06 11:48:05 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [req-bc164c67-21f5-438e-8922-ba19ae889e40 req-d59f8fb6-3590-4cd8-97ef-7b676c336d98 tempest-VolumesGetTestJSON-43429463 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756" returned: 0 in 0.308s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:48:05 devstack cinder-volume[87116]: DEBUG cinder.manager [req-bc164c67-21f5-438e-8922-ba19ae889e40 req-d59f8fb6-3590-4cd8-97ef-7b676c336d98 tempest-VolumesGetTestJSON-43429463 None] Notifying Schedulers of capabilities ... {{(pid=87116) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 11:48:05 devstack cinder-volume[87116]: INFO cinder.volume.manager [req-bc164c67-21f5-438e-8922-ba19ae889e40 req-d59f8fb6-3590-4cd8-97ef-7b676c336d98 tempest-VolumesGetTestJSON-43429463 None] Deleted volume successfully. Nov 06 11:48:05 devstack cinder-volume[87116]: DEBUG cinder.coordination [req-bc164c67-21f5-438e-8922-ba19ae889e40 req-d59f8fb6-3590-4cd8-97ef-7b676c336d98 tempest-VolumesGetTestJSON-43429463 None] Lock "cinder-c4c6beaa-198a-4a4b-959e-4a9d72f7dea3-delete_volume" released by "delete_volume" :: held 1.373s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 11:48:12 devstack cinder-volume[87116]: INFO cinder.volume.manager [req-9e7c3730-1630-4c88-b675-de5489bd2152 req-703c3c5e-14ff-4813-938d-7c0caf8a1b80 tempest-AttachVolumeTestJSON-2007150896 None] Terminate volume connection completed successfully. Nov 06 11:48:12 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [req-9e7c3730-1630-4c88-b675-de5489bd2152 req-703c3c5e-14ff-4813-938d-7c0caf8a1b80 tempest-AttachVolumeTestJSON-2007150896 None] Deleting attachment 6969819f-e67d-4aa9-b84d-0d742f1e1684. {{(pid=87116) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 06 11:48:15 devstack cinder-volume[87116]: DEBUG dbcounter [-] [87116] Writing DB stats cinder:SELECT=5,cinder:UPDATE=11,cinder:INSERT=5,cinder:DELETE=2 {{(pid=87116) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 11:48:22 devstack cinder-volume[87116]: DEBUG dbcounter [-] [87116] Writing DB stats cinder:UPDATE=11,cinder:SELECT=11 {{(pid=87116) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 11:48:23 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-2160e84e-c5b3-44de-bebf-9fbb16620159 tempest-GroupsTest-242324188 None] Group tempest-Group1-468405278: creating Nov 06 11:48:23 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-2160e84e-c5b3-44de-bebf-9fbb16620159 tempest-GroupsTest-242324188 None] Group tempest-Group1-468405278: created successfully Nov 06 11:48:23 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-2160e84e-c5b3-44de-bebf-9fbb16620159 tempest-GroupsTest-242324188 None] Create group completed successfully. Nov 06 11:48:24 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-f81bbd65-1549-478b-8b74-df0bf1b2856c tempest-GroupsTest-242324188 None] Group tempest-Group2-1982365289: creating Nov 06 11:48:24 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-f81bbd65-1549-478b-8b74-df0bf1b2856c tempest-GroupsTest-242324188 None] Group tempest-Group2-1982365289: created successfully Nov 06 11:48:24 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-f81bbd65-1549-478b-8b74-df0bf1b2856c tempest-GroupsTest-242324188 None] Create group completed successfully. Nov 06 11:48:26 devstack cinder-volume[87116]: DEBUG cinder.volume.flows.manager.create_volume [None req-d856f24c-c76b-4a15-b2c0-a6da9e97aad7 tempest-GroupsTest-242324188 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87116) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 11:48:26 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-d856f24c-c76b-4a15-b2c0-a6da9e97aad7 tempest-GroupsTest-242324188 None] Flow 'volume_create_manager' (bc1944bf-b323-4e1f-b83a-c52d2d6a038b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 11:48:26 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-d856f24c-c76b-4a15-b2c0-a6da9e97aad7 tempest-GroupsTest-242324188 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0dfc8538-a26d-4395-95e2-d6b1f1d89d16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:48:26 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-d856f24c-c76b-4a15-b2c0-a6da9e97aad7 tempest-GroupsTest-242324188 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0dfc8538-a26d-4395-95e2-d6b1f1d89d16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T10:48:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-282711020',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=82c99a73-57db-4436-a28f-00a1dc95153a,host='devstack@QuobyteHD#QuobyteHD',id=0185b6d0-d173-40f8-8ed9-551f4f152d02,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6d8f6988d0344b12bc099c2fece0fab5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T10:48:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T10:48:27Z,use_quota=True,user_id='39105704d6d541d1bf2f9532f6d5f90a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fed00bd5-bacb-48c2-8c75-aa5bf8b85f3d),volume_type_id=fed00bd5-bacb-48c2-8c75-aa5bf8b85f3d)' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:48:26 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-d856f24c-c76b-4a15-b2c0-a6da9e97aad7 tempest-GroupsTest-242324188 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e02f4d68-f8a7-4c60-96d3-e8693c3a696f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:48:26 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-d856f24c-c76b-4a15-b2c0-a6da9e97aad7 tempest-GroupsTest-242324188 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e02f4d68-f8a7-4c60-96d3-e8693c3a696f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:48:26 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-d856f24c-c76b-4a15-b2c0-a6da9e97aad7 tempest-GroupsTest-242324188 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3728ecae-1c09-46a5-8f32-0c9517ca1b02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:48:26 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-d856f24c-c76b-4a15-b2c0-a6da9e97aad7 tempest-GroupsTest-242324188 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3728ecae-1c09-46a5-8f32-0c9517ca1b02) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0185b6d0-d173-40f8-8ed9-551f4f152d02', 'volume_name': 'volume-0185b6d0-d173-40f8-8ed9-551f4f152d02', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:48:26 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-d856f24c-c76b-4a15-b2c0-a6da9e97aad7 tempest-GroupsTest-242324188 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (efa96c73-780e-4a69-b3f2-b922189a6aab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:48:26 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-d856f24c-c76b-4a15-b2c0-a6da9e97aad7 tempest-GroupsTest-242324188 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (efa96c73-780e-4a69-b3f2-b922189a6aab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:48:26 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-d856f24c-c76b-4a15-b2c0-a6da9e97aad7 tempest-GroupsTest-242324188 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d76b4836-9670-47d2-8d46-862807dcbb7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:48:26 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-d856f24c-c76b-4a15-b2c0-a6da9e97aad7 tempest-GroupsTest-242324188 None] Volume 0185b6d0-d173-40f8-8ed9-551f4f152d02: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0185b6d0-d173-40f8-8ed9-551f4f152d02', 'volume_size': 1} Nov 06 11:48:26 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-d856f24c-c76b-4a15-b2c0-a6da9e97aad7 tempest-GroupsTest-242324188 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 11:48:26 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-d856f24c-c76b-4a15-b2c0-a6da9e97aad7 tempest-GroupsTest-242324188 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 11:48:26 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-d856f24c-c76b-4a15-b2c0-a6da9e97aad7 tempest-GroupsTest-242324188 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=82c99a73-57db-4436-a28f-00a1dc95153a,created_at=2026-11-06T10:48:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-282711020',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=82c99a73-57db-4436-a28f-00a1dc95153a,host='devstack@QuobyteHD#QuobyteHD',id=0185b6d0-d173-40f8-8ed9-551f4f152d02,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6d8f6988d0344b12bc099c2fece0fab5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T10:48:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T10:48:27Z,use_quota=True,user_id='39105704d6d541d1bf2f9532f6d5f90a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(fed00bd5-bacb-48c2-8c75-aa5bf8b85f3d),volume_type_id=fed00bd5-bacb-48c2-8c75-aa5bf8b85f3d)}" {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 11:48:26 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-d856f24c-c76b-4a15-b2c0-a6da9e97aad7 tempest-GroupsTest-242324188 None] Creating volume 0185b6d0-d173-40f8-8ed9-551f4f152d02 {{(pid=87116) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 11:48:26 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-d856f24c-c76b-4a15-b2c0-a6da9e97aad7 tempest-GroupsTest-242324188 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 11:48:26 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-d856f24c-c76b-4a15-b2c0-a6da9e97aad7 tempest-GroupsTest-242324188 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 11:48:26 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-d856f24c-c76b-4a15-b2c0-a6da9e97aad7 tempest-GroupsTest-242324188 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 11:48:26 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-d856f24c-c76b-4a15-b2c0-a6da9e97aad7 tempest-GroupsTest-242324188 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 11:48:26 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-d856f24c-c76b-4a15-b2c0-a6da9e97aad7 tempest-GroupsTest-242324188 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 11:48:26 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-d856f24c-c76b-4a15-b2c0-a6da9e97aad7 tempest-GroupsTest-242324188 None] Selected osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f as target Quobyte volume. {{(pid=87116) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 11:48:26 devstack cinder-volume[87116]: INFO cinder.volume.drivers.remotefs [None req-d856f24c-c76b-4a15-b2c0-a6da9e97aad7 tempest-GroupsTest-242324188 None] casted to osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f Nov 06 11:48:26 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-d856f24c-c76b-4a15-b2c0-a6da9e97aad7 tempest-GroupsTest-242324188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-0185b6d0-d173-40f8-8ed9-551f4f152d02 1073741824 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:48:26 devstack sudo[94298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-0185b6d0-d173-40f8-8ed9-551f4f152d02 1073741824 Nov 06 11:48:26 devstack sudo[94298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:48:27 devstack sudo[94298]: pam_unix(sudo:session): session closed for user root Nov 06 11:48:27 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-d856f24c-c76b-4a15-b2c0-a6da9e97aad7 tempest-GroupsTest-242324188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-0185b6d0-d173-40f8-8ed9-551f4f152d02 1073741824" returned: 0 in 0.668s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:48:27 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-d856f24c-c76b-4a15-b2c0-a6da9e97aad7 tempest-GroupsTest-242324188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-0185b6d0-d173-40f8-8ed9-551f4f152d02 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:48:27 devstack sudo[94341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-0185b6d0-d173-40f8-8ed9-551f4f152d02 Nov 06 11:48:27 devstack sudo[94341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:48:27 devstack sudo[94341]: pam_unix(sudo:session): session closed for user root Nov 06 11:48:27 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-d856f24c-c76b-4a15-b2c0-a6da9e97aad7 tempest-GroupsTest-242324188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-0185b6d0-d173-40f8-8ed9-551f4f152d02" returned: 0 in 0.306s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:48:27 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-d856f24c-c76b-4a15-b2c0-a6da9e97aad7 tempest-GroupsTest-242324188 None] <== create_volume: return (1060ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f'} {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 11:48:27 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-d856f24c-c76b-4a15-b2c0-a6da9e97aad7 tempest-GroupsTest-242324188 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.063s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 11:48:27 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-d856f24c-c76b-4a15-b2c0-a6da9e97aad7 tempest-GroupsTest-242324188 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d76b4836-9670-47d2-8d46-862807dcbb7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0185b6d0-d173-40f8-8ed9-551f4f152d02', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:48:27 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-d856f24c-c76b-4a15-b2c0-a6da9e97aad7 tempest-GroupsTest-242324188 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (482f8b5a-33a0-4def-b5ee-57d613416e09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:48:27 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-d856f24c-c76b-4a15-b2c0-a6da9e97aad7 tempest-GroupsTest-242324188 None] Volume volume-0185b6d0-d173-40f8-8ed9-551f4f152d02 (0185b6d0-d173-40f8-8ed9-551f4f152d02): created successfully Nov 06 11:48:27 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-d856f24c-c76b-4a15-b2c0-a6da9e97aad7 tempest-GroupsTest-242324188 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (482f8b5a-33a0-4def-b5ee-57d613416e09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:48:28 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-d856f24c-c76b-4a15-b2c0-a6da9e97aad7 tempest-GroupsTest-242324188 None] Flow 'volume_create_manager' (bc1944bf-b323-4e1f-b83a-c52d2d6a038b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 11:48:28 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-d856f24c-c76b-4a15-b2c0-a6da9e97aad7 tempest-GroupsTest-242324188 None] Created volume successfully. Nov 06 11:48:30 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-9751174d-3866-49e6-b26e-674234b5999c tempest-GroupsTest-242324188 None] Acquiring lock "cinder-quobyte-0185b6d0-d173-40f8-8ed9-551f4f152d02" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 11:48:30 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-9751174d-3866-49e6-b26e-674234b5999c tempest-GroupsTest-242324188 None] Lock "cinder-quobyte-0185b6d0-d173-40f8-8ed9-551f4f152d02" acquired by "delete_volume" :: waited 0.052s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 11:48:30 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[c237d95b-c133-4dcf-acbd-312153750e5f]: (4, 'qcow2') {{(pid=88420) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 11:48:30 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-9751174d-3866-49e6-b26e-674234b5999c tempest-GroupsTest-242324188 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-0185b6d0-d173-40f8-8ed9-551f4f152d02 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:48:30 devstack sudo[94360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-0185b6d0-d173-40f8-8ed9-551f4f152d02 Nov 06 11:48:30 devstack sudo[94360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:48:31 devstack sudo[94360]: pam_unix(sudo:session): session closed for user root Nov 06 11:48:31 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-9751174d-3866-49e6-b26e-674234b5999c tempest-GroupsTest-242324188 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-0185b6d0-d173-40f8-8ed9-551f4f152d02" returned: 0 in 0.790s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:48:31 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-9751174d-3866-49e6-b26e-674234b5999c tempest-GroupsTest-242324188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-0185b6d0-d173-40f8-8ed9-551f4f152d02 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:48:31 devstack sudo[94366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-0185b6d0-d173-40f8-8ed9-551f4f152d02 Nov 06 11:48:31 devstack sudo[94366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:48:31 devstack sudo[94366]: pam_unix(sudo:session): session closed for user root Nov 06 11:48:31 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-9751174d-3866-49e6-b26e-674234b5999c tempest-GroupsTest-242324188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-0185b6d0-d173-40f8-8ed9-551f4f152d02" returned: 0 in 0.312s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:48:31 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-9751174d-3866-49e6-b26e-674234b5999c tempest-GroupsTest-242324188 None] Lock "cinder-quobyte-0185b6d0-d173-40f8-8ed9-551f4f152d02" released by "delete_volume" :: held 1.187s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 11:48:31 devstack cinder-volume[87116]: DEBUG cinder.quota [None req-9751174d-3866-49e6-b26e-674234b5999c tempest-GroupsTest-242324188 None] Created reservations ['c8337c6f-b098-4049-a894-ad6d45698654'] {{(pid=87116) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 11:48:31 devstack cinder-volume[87116]: WARNING cinder.quota [None req-9751174d-3866-49e6-b26e-674234b5999c tempest-GroupsTest-242324188 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-2021701566 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-2021701566, it is now deprecated. Please use the default quota class for default quota. Nov 06 11:48:31 devstack cinder-volume[87116]: WARNING cinder.quota [None req-9751174d-3866-49e6-b26e-674234b5999c tempest-GroupsTest-242324188 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-2021701566 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-2021701566, it is now deprecated. Please use the default quota class for default quota. Nov 06 11:48:31 devstack cinder-volume[87116]: DEBUG cinder.quota [None req-9751174d-3866-49e6-b26e-674234b5999c tempest-GroupsTest-242324188 None] Created reservations ['bf82772f-ba9a-4a8a-ac87-d79a219b8b40', 'da8df045-f06a-4e84-9104-d09110f27bbb', 'bb728a22-107a-4559-a17d-cf74972b4180', '81b9f2bc-c71c-4a6c-8e68-56050c07a6c9'] {{(pid=87116) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 11:48:32 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-9751174d-3866-49e6-b26e-674234b5999c tempest-GroupsTest-242324188 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 11:48:32 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-9751174d-3866-49e6-b26e-674234b5999c tempest-GroupsTest-242324188 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.009s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 11:48:32 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-9751174d-3866-49e6-b26e-674234b5999c tempest-GroupsTest-242324188 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 11:48:32 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-9751174d-3866-49e6-b26e-674234b5999c tempest-GroupsTest-242324188 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 11:48:32 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-9751174d-3866-49e6-b26e-674234b5999c tempest-GroupsTest-242324188 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.031s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 11:48:32 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-9751174d-3866-49e6-b26e-674234b5999c tempest-GroupsTest-242324188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:48:32 devstack sudo[94386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756 Nov 06 11:48:32 devstack sudo[94386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:48:32 devstack sudo[94386]: pam_unix(sudo:session): session closed for user root Nov 06 11:48:32 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-9751174d-3866-49e6-b26e-674234b5999c tempest-GroupsTest-242324188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756" returned: 0 in 0.800s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:48:32 devstack cinder-volume[87116]: DEBUG cinder.manager [None req-9751174d-3866-49e6-b26e-674234b5999c tempest-GroupsTest-242324188 None] Notifying Schedulers of capabilities ... {{(pid=87116) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 11:48:32 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-9751174d-3866-49e6-b26e-674234b5999c tempest-GroupsTest-242324188 None] Delete group completed successfully. Nov 06 11:48:33 devstack cinder-volume[87116]: DEBUG cinder.volume.flows.manager.create_volume [None req-53a8b8ad-9f39-480b-a742-b1cf18d5e3de tempest-AttachVolumeNegativeTest-771196063 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87116) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 11:48:33 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-53a8b8ad-9f39-480b-a742-b1cf18d5e3de tempest-AttachVolumeNegativeTest-771196063 None] Flow 'volume_create_manager' (4ac14174-b3ed-4ab3-9a7a-3a9d78afbaab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 11:48:33 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-53a8b8ad-9f39-480b-a742-b1cf18d5e3de tempest-AttachVolumeNegativeTest-771196063 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6d4066ce-f43a-4188-b8f9-c5c170b4d2e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:48:33 devstack cinder-volume[87116]: DEBUG cinder.quota [None req-4c5946dd-f91f-4b62-a1eb-d87ce6d6dab6 tempest-GroupsTest-242324188 None] Created reservations ['313d8838-f55c-485f-9a5c-a052b2a65fc2'] {{(pid=87116) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 11:48:33 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-53a8b8ad-9f39-480b-a742-b1cf18d5e3de tempest-AttachVolumeNegativeTest-771196063 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6d4066ce-f43a-4188-b8f9-c5c170b4d2e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T10:48:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-2032446084',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2232a031-c40c-43e0-b553-d6a9e6a8b941,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b23e8157379c4aa2a39ee3c320d26405',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T10:48:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T10:48:33Z,use_quota=True,user_id='46166ce042cc4a85aa8e38a7a34c4d50',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(34d3b144-d9b7-480a-a2e3-01e45f3d54c1),volume_type_id=34d3b144-d9b7-480a-a2e3-01e45f3d54c1)' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:48:33 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-53a8b8ad-9f39-480b-a742-b1cf18d5e3de tempest-AttachVolumeNegativeTest-771196063 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b1450a2f-be32-4334-85df-cbbdf1c18e88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:48:33 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-53a8b8ad-9f39-480b-a742-b1cf18d5e3de tempest-AttachVolumeNegativeTest-771196063 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b1450a2f-be32-4334-85df-cbbdf1c18e88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:48:33 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-53a8b8ad-9f39-480b-a742-b1cf18d5e3de tempest-AttachVolumeNegativeTest-771196063 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8cac78e4-cdeb-4afa-aefc-f931be1a9dd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:48:33 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-53a8b8ad-9f39-480b-a742-b1cf18d5e3de tempest-AttachVolumeNegativeTest-771196063 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8cac78e4-cdeb-4afa-aefc-f931be1a9dd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2232a031-c40c-43e0-b553-d6a9e6a8b941', 'volume_name': 'volume-2232a031-c40c-43e0-b553-d6a9e6a8b941', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:48:33 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-53a8b8ad-9f39-480b-a742-b1cf18d5e3de tempest-AttachVolumeNegativeTest-771196063 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3984e4b6-df00-422e-8602-f80f8fea843e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:48:33 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-53a8b8ad-9f39-480b-a742-b1cf18d5e3de tempest-AttachVolumeNegativeTest-771196063 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3984e4b6-df00-422e-8602-f80f8fea843e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:48:33 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-53a8b8ad-9f39-480b-a742-b1cf18d5e3de tempest-AttachVolumeNegativeTest-771196063 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2388e8cb-25db-442f-9189-63ba49fa02cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:48:33 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-53a8b8ad-9f39-480b-a742-b1cf18d5e3de tempest-AttachVolumeNegativeTest-771196063 None] Volume 2232a031-c40c-43e0-b553-d6a9e6a8b941: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2232a031-c40c-43e0-b553-d6a9e6a8b941', 'volume_size': 1} Nov 06 11:48:33 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-53a8b8ad-9f39-480b-a742-b1cf18d5e3de tempest-AttachVolumeNegativeTest-771196063 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 11:48:33 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-53a8b8ad-9f39-480b-a742-b1cf18d5e3de tempest-AttachVolumeNegativeTest-771196063 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 11:48:33 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-53a8b8ad-9f39-480b-a742-b1cf18d5e3de tempest-AttachVolumeNegativeTest-771196063 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T10:48:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-2032446084',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2232a031-c40c-43e0-b553-d6a9e6a8b941,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b23e8157379c4aa2a39ee3c320d26405',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T10:48:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T10:48:33Z,use_quota=True,user_id='46166ce042cc4a85aa8e38a7a34c4d50',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(34d3b144-d9b7-480a-a2e3-01e45f3d54c1),volume_type_id=34d3b144-d9b7-480a-a2e3-01e45f3d54c1)}" {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 11:48:33 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-53a8b8ad-9f39-480b-a742-b1cf18d5e3de tempest-AttachVolumeNegativeTest-771196063 None] Creating volume 2232a031-c40c-43e0-b553-d6a9e6a8b941 {{(pid=87116) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 11:48:33 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-53a8b8ad-9f39-480b-a742-b1cf18d5e3de tempest-AttachVolumeNegativeTest-771196063 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 11:48:33 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-53a8b8ad-9f39-480b-a742-b1cf18d5e3de tempest-AttachVolumeNegativeTest-771196063 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 11:48:33 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-53a8b8ad-9f39-480b-a742-b1cf18d5e3de tempest-AttachVolumeNegativeTest-771196063 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 11:48:33 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-53a8b8ad-9f39-480b-a742-b1cf18d5e3de tempest-AttachVolumeNegativeTest-771196063 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 11:48:33 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-53a8b8ad-9f39-480b-a742-b1cf18d5e3de tempest-AttachVolumeNegativeTest-771196063 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 11:48:33 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-53a8b8ad-9f39-480b-a742-b1cf18d5e3de tempest-AttachVolumeNegativeTest-771196063 None] Selected osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f as target Quobyte volume. {{(pid=87116) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 11:48:33 devstack cinder-volume[87116]: INFO cinder.volume.drivers.remotefs [None req-53a8b8ad-9f39-480b-a742-b1cf18d5e3de tempest-AttachVolumeNegativeTest-771196063 None] casted to osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f Nov 06 11:48:33 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-53a8b8ad-9f39-480b-a742-b1cf18d5e3de tempest-AttachVolumeNegativeTest-771196063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-2232a031-c40c-43e0-b553-d6a9e6a8b941 1073741824 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:48:33 devstack sudo[94438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-2232a031-c40c-43e0-b553-d6a9e6a8b941 1073741824 Nov 06 11:48:33 devstack sudo[94438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:48:33 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-4c5946dd-f91f-4b62-a1eb-d87ce6d6dab6 tempest-GroupsTest-242324188 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 11:48:33 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-4c5946dd-f91f-4b62-a1eb-d87ce6d6dab6 tempest-GroupsTest-242324188 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 11:48:33 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-4c5946dd-f91f-4b62-a1eb-d87ce6d6dab6 tempest-GroupsTest-242324188 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 11:48:33 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-4c5946dd-f91f-4b62-a1eb-d87ce6d6dab6 tempest-GroupsTest-242324188 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 11:48:33 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-4c5946dd-f91f-4b62-a1eb-d87ce6d6dab6 tempest-GroupsTest-242324188 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 11:48:33 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-4c5946dd-f91f-4b62-a1eb-d87ce6d6dab6 tempest-GroupsTest-242324188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:48:33 devstack sudo[94440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756 Nov 06 11:48:33 devstack sudo[94440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:48:34 devstack sudo[94440]: pam_unix(sudo:session): session closed for user root Nov 06 11:48:34 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-4c5946dd-f91f-4b62-a1eb-d87ce6d6dab6 tempest-GroupsTest-242324188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756" returned: 0 in 0.497s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:48:34 devstack cinder-volume[87116]: DEBUG cinder.manager [None req-4c5946dd-f91f-4b62-a1eb-d87ce6d6dab6 tempest-GroupsTest-242324188 None] Notifying Schedulers of capabilities ... {{(pid=87116) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 11:48:34 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-4c5946dd-f91f-4b62-a1eb-d87ce6d6dab6 tempest-GroupsTest-242324188 None] Delete group completed successfully. Nov 06 11:48:34 devstack sudo[94438]: pam_unix(sudo:session): session closed for user root Nov 06 11:48:34 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-53a8b8ad-9f39-480b-a742-b1cf18d5e3de tempest-AttachVolumeNegativeTest-771196063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-2232a031-c40c-43e0-b553-d6a9e6a8b941 1073741824" returned: 0 in 0.886s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:48:34 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-53a8b8ad-9f39-480b-a742-b1cf18d5e3de tempest-AttachVolumeNegativeTest-771196063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-2232a031-c40c-43e0-b553-d6a9e6a8b941 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:48:34 devstack sudo[94453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-2232a031-c40c-43e0-b553-d6a9e6a8b941 Nov 06 11:48:34 devstack sudo[94453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:48:35 devstack sudo[94453]: pam_unix(sudo:session): session closed for user root Nov 06 11:48:35 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-53a8b8ad-9f39-480b-a742-b1cf18d5e3de tempest-AttachVolumeNegativeTest-771196063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-2232a031-c40c-43e0-b553-d6a9e6a8b941" returned: 0 in 0.484s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:48:35 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-53a8b8ad-9f39-480b-a742-b1cf18d5e3de tempest-AttachVolumeNegativeTest-771196063 None] <== create_volume: return (1520ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f'} {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 11:48:35 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-53a8b8ad-9f39-480b-a742-b1cf18d5e3de tempest-AttachVolumeNegativeTest-771196063 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.522s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 11:48:35 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-53a8b8ad-9f39-480b-a742-b1cf18d5e3de tempest-AttachVolumeNegativeTest-771196063 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2388e8cb-25db-442f-9189-63ba49fa02cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2232a031-c40c-43e0-b553-d6a9e6a8b941', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:48:35 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-53a8b8ad-9f39-480b-a742-b1cf18d5e3de tempest-AttachVolumeNegativeTest-771196063 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (966bfbd8-1f23-411d-bad4-f111669b5add) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:48:35 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-53a8b8ad-9f39-480b-a742-b1cf18d5e3de tempest-AttachVolumeNegativeTest-771196063 None] Volume volume-2232a031-c40c-43e0-b553-d6a9e6a8b941 (2232a031-c40c-43e0-b553-d6a9e6a8b941): created successfully Nov 06 11:48:35 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-53a8b8ad-9f39-480b-a742-b1cf18d5e3de tempest-AttachVolumeNegativeTest-771196063 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (966bfbd8-1f23-411d-bad4-f111669b5add) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:48:35 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-53a8b8ad-9f39-480b-a742-b1cf18d5e3de tempest-AttachVolumeNegativeTest-771196063 None] Flow 'volume_create_manager' (4ac14174-b3ed-4ab3-9a7a-3a9d78afbaab) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 11:48:35 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-53a8b8ad-9f39-480b-a742-b1cf18d5e3de tempest-AttachVolumeNegativeTest-771196063 None] Created volume successfully. Nov 06 11:48:35 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-2691349f-5b83-4008-8bd0-065bd7c6ea53 tempest-GroupsTest-242324188 None] Group tempest-GroupsTest-Group-693141117: creating Nov 06 11:48:35 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-2691349f-5b83-4008-8bd0-065bd7c6ea53 tempest-GroupsTest-242324188 None] Group tempest-GroupsTest-Group-693141117: created successfully Nov 06 11:48:35 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-2691349f-5b83-4008-8bd0-065bd7c6ea53 tempest-GroupsTest-242324188 None] Create group completed successfully. Nov 06 11:48:36 devstack cinder-volume[87116]: DEBUG cinder.volume.flows.manager.create_volume [None req-7c7cc72d-3a73-4ff8-a14f-372187b30af3 tempest-VolumesActionsTest-436489484 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87116) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 11:48:36 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-7c7cc72d-3a73-4ff8-a14f-372187b30af3 tempest-VolumesActionsTest-436489484 None] Flow 'volume_create_manager' (18ff841d-a66a-4bf7-8348-363b139fa576) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 11:48:36 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-7c7cc72d-3a73-4ff8-a14f-372187b30af3 tempest-VolumesActionsTest-436489484 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d9f0cddd-7917-49b5-8593-6df7d26f543f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:48:36 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-7c7cc72d-3a73-4ff8-a14f-372187b30af3 tempest-VolumesActionsTest-436489484 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d9f0cddd-7917-49b5-8593-6df7d26f543f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T10:48:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-821009357',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2dab18b8-72cf-456d-b99c-bc29b5f06573,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2bcba42d552e466987396405a7bcb7d3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T10:48:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T10:48:36Z,use_quota=True,user_id='9902e935e3b0434bad8989e8c0ae447e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(34d3b144-d9b7-480a-a2e3-01e45f3d54c1),volume_type_id=34d3b144-d9b7-480a-a2e3-01e45f3d54c1)' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:48:36 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-7c7cc72d-3a73-4ff8-a14f-372187b30af3 tempest-VolumesActionsTest-436489484 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ba438450-6bc6-41fd-9b0c-9c75be4edd1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:48:36 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-7c7cc72d-3a73-4ff8-a14f-372187b30af3 tempest-VolumesActionsTest-436489484 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ba438450-6bc6-41fd-9b0c-9c75be4edd1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:48:36 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-7c7cc72d-3a73-4ff8-a14f-372187b30af3 tempest-VolumesActionsTest-436489484 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4694ac42-2223-401f-a859-b5c504c2ad78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:48:36 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-7c7cc72d-3a73-4ff8-a14f-372187b30af3 tempest-VolumesActionsTest-436489484 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4694ac42-2223-401f-a859-b5c504c2ad78) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2dab18b8-72cf-456d-b99c-bc29b5f06573', 'volume_name': 'volume-2dab18b8-72cf-456d-b99c-bc29b5f06573', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:48:36 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-7c7cc72d-3a73-4ff8-a14f-372187b30af3 tempest-VolumesActionsTest-436489484 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e1ffd4b6-3dd4-46ee-8c5d-e7d2714b210e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:48:36 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-7c7cc72d-3a73-4ff8-a14f-372187b30af3 tempest-VolumesActionsTest-436489484 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e1ffd4b6-3dd4-46ee-8c5d-e7d2714b210e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:48:36 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-7c7cc72d-3a73-4ff8-a14f-372187b30af3 tempest-VolumesActionsTest-436489484 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6eb4d728-e37d-44d2-8c7e-590f602f5da3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:48:36 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-7c7cc72d-3a73-4ff8-a14f-372187b30af3 tempest-VolumesActionsTest-436489484 None] Volume 2dab18b8-72cf-456d-b99c-bc29b5f06573: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2dab18b8-72cf-456d-b99c-bc29b5f06573', 'volume_size': 1} Nov 06 11:48:36 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-7c7cc72d-3a73-4ff8-a14f-372187b30af3 tempest-VolumesActionsTest-436489484 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 11:48:36 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-7c7cc72d-3a73-4ff8-a14f-372187b30af3 tempest-VolumesActionsTest-436489484 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 11:48:36 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-7c7cc72d-3a73-4ff8-a14f-372187b30af3 tempest-VolumesActionsTest-436489484 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T10:48:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-821009357',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2dab18b8-72cf-456d-b99c-bc29b5f06573,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2bcba42d552e466987396405a7bcb7d3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T10:48:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T10:48:36Z,use_quota=True,user_id='9902e935e3b0434bad8989e8c0ae447e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(34d3b144-d9b7-480a-a2e3-01e45f3d54c1),volume_type_id=34d3b144-d9b7-480a-a2e3-01e45f3d54c1)}" {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 11:48:36 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-7c7cc72d-3a73-4ff8-a14f-372187b30af3 tempest-VolumesActionsTest-436489484 None] Creating volume 2dab18b8-72cf-456d-b99c-bc29b5f06573 {{(pid=87116) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 11:48:36 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-7c7cc72d-3a73-4ff8-a14f-372187b30af3 tempest-VolumesActionsTest-436489484 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 11:48:36 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-7c7cc72d-3a73-4ff8-a14f-372187b30af3 tempest-VolumesActionsTest-436489484 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 11:48:36 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-7c7cc72d-3a73-4ff8-a14f-372187b30af3 tempest-VolumesActionsTest-436489484 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 11:48:36 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-7c7cc72d-3a73-4ff8-a14f-372187b30af3 tempest-VolumesActionsTest-436489484 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 11:48:36 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-7c7cc72d-3a73-4ff8-a14f-372187b30af3 tempest-VolumesActionsTest-436489484 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 11:48:36 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-7c7cc72d-3a73-4ff8-a14f-372187b30af3 tempest-VolumesActionsTest-436489484 None] Selected osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f as target Quobyte volume. {{(pid=87116) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 11:48:36 devstack cinder-volume[87116]: INFO cinder.volume.drivers.remotefs [None req-7c7cc72d-3a73-4ff8-a14f-372187b30af3 tempest-VolumesActionsTest-436489484 None] casted to osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f Nov 06 11:48:36 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-7c7cc72d-3a73-4ff8-a14f-372187b30af3 tempest-VolumesActionsTest-436489484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-2dab18b8-72cf-456d-b99c-bc29b5f06573 1073741824 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:48:36 devstack sudo[94470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-2dab18b8-72cf-456d-b99c-bc29b5f06573 1073741824 Nov 06 11:48:36 devstack sudo[94470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:48:36 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [req-fda310f7-f8a5-46ff-94ef-aa0e1735c4db req-35b6d68d-928d-4e90-a651-0243df04998c tempest-AttachVolumeNegativeTest-771196063 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 11:48:37 devstack sudo[94470]: pam_unix(sudo:session): session closed for user root Nov 06 11:48:37 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-7c7cc72d-3a73-4ff8-a14f-372187b30af3 tempest-VolumesActionsTest-436489484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-2dab18b8-72cf-456d-b99c-bc29b5f06573 1073741824" returned: 0 in 0.523s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:48:37 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-7c7cc72d-3a73-4ff8-a14f-372187b30af3 tempest-VolumesActionsTest-436489484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-2dab18b8-72cf-456d-b99c-bc29b5f06573 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:48:37 devstack sudo[94482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-2dab18b8-72cf-456d-b99c-bc29b5f06573 Nov 06 11:48:37 devstack sudo[94482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:48:37 devstack cinder-volume[87116]: DEBUG cinder.volume.flows.manager.create_volume [None req-182cfaa0-fe07-4f21-ac69-4acc79c2f8e2 tempest-GroupsTest-242324188 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87116) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 11:48:37 devstack sudo[94482]: pam_unix(sudo:session): session closed for user root Nov 06 11:48:37 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-182cfaa0-fe07-4f21-ac69-4acc79c2f8e2 tempest-GroupsTest-242324188 None] Flow 'volume_create_manager' (34f46864-f180-49d9-8443-c9354a8e8db4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 11:48:37 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-182cfaa0-fe07-4f21-ac69-4acc79c2f8e2 tempest-GroupsTest-242324188 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (97ad6de0-cc33-4312-bcfa-838c8b6ecb18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:48:37 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-7c7cc72d-3a73-4ff8-a14f-372187b30af3 tempest-VolumesActionsTest-436489484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-2dab18b8-72cf-456d-b99c-bc29b5f06573" returned: 0 in 0.305s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:48:37 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-7c7cc72d-3a73-4ff8-a14f-372187b30af3 tempest-VolumesActionsTest-436489484 None] <== create_volume: return (874ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f'} {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 11:48:37 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-7c7cc72d-3a73-4ff8-a14f-372187b30af3 tempest-VolumesActionsTest-436489484 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.877s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 11:48:37 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [req-fda310f7-f8a5-46ff-94ef-aa0e1735c4db req-35b6d68d-928d-4e90-a651-0243df04998c tempest-AttachVolumeNegativeTest-771196063 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.836s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 11:48:37 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-182cfaa0-fe07-4f21-ac69-4acc79c2f8e2 tempest-GroupsTest-242324188 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (97ad6de0-cc33-4312-bcfa-838c8b6ecb18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T10:48:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2142301622',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=e6eb2156-0459-4394-a3fb-a1823c65e6ab,host='devstack@QuobyteHD#QuobyteHD',id=b4b9e98a-b625-46cb-9d3b-cc437558eb05,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6d8f6988d0344b12bc099c2fece0fab5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T10:48:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T10:48:37Z,use_quota=True,user_id='39105704d6d541d1bf2f9532f6d5f90a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(654062d9-c1b6-4882-a96a-a6752a8f4692),volume_type_id=654062d9-c1b6-4882-a96a-a6752a8f4692)' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:48:37 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-182cfaa0-fe07-4f21-ac69-4acc79c2f8e2 tempest-GroupsTest-242324188 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a1ca273d-8f83-44fd-b98a-0f495bd2036c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:48:37 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-182cfaa0-fe07-4f21-ac69-4acc79c2f8e2 tempest-GroupsTest-242324188 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a1ca273d-8f83-44fd-b98a-0f495bd2036c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:48:37 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-182cfaa0-fe07-4f21-ac69-4acc79c2f8e2 tempest-GroupsTest-242324188 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9528d1ce-3e18-4833-a637-7882cc4aef98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:48:37 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-182cfaa0-fe07-4f21-ac69-4acc79c2f8e2 tempest-GroupsTest-242324188 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9528d1ce-3e18-4833-a637-7882cc4aef98) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b4b9e98a-b625-46cb-9d3b-cc437558eb05', 'volume_name': 'volume-b4b9e98a-b625-46cb-9d3b-cc437558eb05', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:48:37 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-182cfaa0-fe07-4f21-ac69-4acc79c2f8e2 tempest-GroupsTest-242324188 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5b52b68c-d6bc-4cae-8d6a-639b5c7a211b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:48:37 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-182cfaa0-fe07-4f21-ac69-4acc79c2f8e2 tempest-GroupsTest-242324188 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5b52b68c-d6bc-4cae-8d6a-639b5c7a211b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:48:37 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-182cfaa0-fe07-4f21-ac69-4acc79c2f8e2 tempest-GroupsTest-242324188 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f6808a15-cb36-449a-b3fb-ee6b4d422f62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:48:37 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-182cfaa0-fe07-4f21-ac69-4acc79c2f8e2 tempest-GroupsTest-242324188 None] Volume b4b9e98a-b625-46cb-9d3b-cc437558eb05: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b4b9e98a-b625-46cb-9d3b-cc437558eb05', 'volume_size': 1} Nov 06 11:48:37 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-182cfaa0-fe07-4f21-ac69-4acc79c2f8e2 tempest-GroupsTest-242324188 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 11:48:37 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-7c7cc72d-3a73-4ff8-a14f-372187b30af3 tempest-VolumesActionsTest-436489484 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6eb4d728-e37d-44d2-8c7e-590f602f5da3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2dab18b8-72cf-456d-b99c-bc29b5f06573', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:48:37 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-7c7cc72d-3a73-4ff8-a14f-372187b30af3 tempest-VolumesActionsTest-436489484 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a9b9c3d3-6714-49ac-86a5-13d98a67ea3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:48:37 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-7c7cc72d-3a73-4ff8-a14f-372187b30af3 tempest-VolumesActionsTest-436489484 None] Volume volume-2dab18b8-72cf-456d-b99c-bc29b5f06573 (2dab18b8-72cf-456d-b99c-bc29b5f06573): created successfully Nov 06 11:48:37 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-7c7cc72d-3a73-4ff8-a14f-372187b30af3 tempest-VolumesActionsTest-436489484 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a9b9c3d3-6714-49ac-86a5-13d98a67ea3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:48:37 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-7c7cc72d-3a73-4ff8-a14f-372187b30af3 tempest-VolumesActionsTest-436489484 None] Flow 'volume_create_manager' (18ff841d-a66a-4bf7-8348-363b139fa576) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 11:48:37 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [req-fda310f7-f8a5-46ff-94ef-aa0e1735c4db req-35b6d68d-928d-4e90-a651-0243df04998c tempest-AttachVolumeNegativeTest-771196063 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.150s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 11:48:37 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-182cfaa0-fe07-4f21-ac69-4acc79c2f8e2 tempest-GroupsTest-242324188 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.049s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 11:48:37 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-182cfaa0-fe07-4f21-ac69-4acc79c2f8e2 tempest-GroupsTest-242324188 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=e6eb2156-0459-4394-a3fb-a1823c65e6ab,created_at=2026-11-06T10:48:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2142301622',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=e6eb2156-0459-4394-a3fb-a1823c65e6ab,host='devstack@QuobyteHD#QuobyteHD',id=b4b9e98a-b625-46cb-9d3b-cc437558eb05,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6d8f6988d0344b12bc099c2fece0fab5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T10:48:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T10:48:37Z,use_quota=True,user_id='39105704d6d541d1bf2f9532f6d5f90a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(654062d9-c1b6-4882-a96a-a6752a8f4692),volume_type_id=654062d9-c1b6-4882-a96a-a6752a8f4692)}" {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 11:48:37 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-182cfaa0-fe07-4f21-ac69-4acc79c2f8e2 tempest-GroupsTest-242324188 None] Creating volume b4b9e98a-b625-46cb-9d3b-cc437558eb05 {{(pid=87116) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 11:48:37 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-182cfaa0-fe07-4f21-ac69-4acc79c2f8e2 tempest-GroupsTest-242324188 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 11:48:37 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-182cfaa0-fe07-4f21-ac69-4acc79c2f8e2 tempest-GroupsTest-242324188 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 11:48:37 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-182cfaa0-fe07-4f21-ac69-4acc79c2f8e2 tempest-GroupsTest-242324188 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 11:48:37 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-182cfaa0-fe07-4f21-ac69-4acc79c2f8e2 tempest-GroupsTest-242324188 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 11:48:37 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-182cfaa0-fe07-4f21-ac69-4acc79c2f8e2 tempest-GroupsTest-242324188 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 11:48:37 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-182cfaa0-fe07-4f21-ac69-4acc79c2f8e2 tempest-GroupsTest-242324188 None] Selected osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f as target Quobyte volume. {{(pid=87116) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 11:48:37 devstack cinder-volume[87116]: INFO cinder.volume.drivers.remotefs [None req-182cfaa0-fe07-4f21-ac69-4acc79c2f8e2 tempest-GroupsTest-242324188 None] casted to osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f Nov 06 11:48:37 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-182cfaa0-fe07-4f21-ac69-4acc79c2f8e2 tempest-GroupsTest-242324188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-b4b9e98a-b625-46cb-9d3b-cc437558eb05 1073741824 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:48:37 devstack sudo[94485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-b4b9e98a-b625-46cb-9d3b-cc437558eb05 1073741824 Nov 06 11:48:37 devstack sudo[94485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:48:37 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-7c7cc72d-3a73-4ff8-a14f-372187b30af3 tempest-VolumesActionsTest-436489484 None] Created volume successfully. Nov 06 11:48:37 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [req-fda310f7-f8a5-46ff-94ef-aa0e1735c4db req-35b6d68d-928d-4e90-a651-0243df04998c tempest-AttachVolumeNegativeTest-771196063 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f', 'name': 'volume-2232a031-c40c-43e0-b553-d6a9e6a8b941', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'd636c671-def8-4563-a091-9eaff11e4592', 'enforce_multipath': True} {{(pid=87116) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 06 11:48:37 devstack cinder-volume[87116]: INFO cinder.volume.manager [req-fda310f7-f8a5-46ff-94ef-aa0e1735c4db req-35b6d68d-928d-4e90-a651-0243df04998c tempest-AttachVolumeNegativeTest-771196063 None] attachment_update completed successfully. Nov 06 11:48:38 devstack sudo[94485]: pam_unix(sudo:session): session closed for user root Nov 06 11:48:38 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-182cfaa0-fe07-4f21-ac69-4acc79c2f8e2 tempest-GroupsTest-242324188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-b4b9e98a-b625-46cb-9d3b-cc437558eb05 1073741824" returned: 0 in 0.491s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:48:38 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-182cfaa0-fe07-4f21-ac69-4acc79c2f8e2 tempest-GroupsTest-242324188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-b4b9e98a-b625-46cb-9d3b-cc437558eb05 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:48:38 devstack sudo[94908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-b4b9e98a-b625-46cb-9d3b-cc437558eb05 Nov 06 11:48:38 devstack sudo[94908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:48:38 devstack sudo[94908]: pam_unix(sudo:session): session closed for user root Nov 06 11:48:38 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-182cfaa0-fe07-4f21-ac69-4acc79c2f8e2 tempest-GroupsTest-242324188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-b4b9e98a-b625-46cb-9d3b-cc437558eb05" returned: 0 in 0.282s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:48:38 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-182cfaa0-fe07-4f21-ac69-4acc79c2f8e2 tempest-GroupsTest-242324188 None] <== create_volume: return (820ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f'} {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 11:48:38 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-182cfaa0-fe07-4f21-ac69-4acc79c2f8e2 tempest-GroupsTest-242324188 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.822s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 11:48:38 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-182cfaa0-fe07-4f21-ac69-4acc79c2f8e2 tempest-GroupsTest-242324188 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f6808a15-cb36-449a-b3fb-ee6b4d422f62) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b4b9e98a-b625-46cb-9d3b-cc437558eb05', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:48:38 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-182cfaa0-fe07-4f21-ac69-4acc79c2f8e2 tempest-GroupsTest-242324188 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (98a4b7a4-17f5-4426-aa8e-100f95488406) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:48:38 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-182cfaa0-fe07-4f21-ac69-4acc79c2f8e2 tempest-GroupsTest-242324188 None] Volume volume-b4b9e98a-b625-46cb-9d3b-cc437558eb05 (b4b9e98a-b625-46cb-9d3b-cc437558eb05): created successfully Nov 06 11:48:38 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-182cfaa0-fe07-4f21-ac69-4acc79c2f8e2 tempest-GroupsTest-242324188 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (98a4b7a4-17f5-4426-aa8e-100f95488406) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:48:38 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-182cfaa0-fe07-4f21-ac69-4acc79c2f8e2 tempest-GroupsTest-242324188 None] Flow 'volume_create_manager' (34f46864-f180-49d9-8443-c9354a8e8db4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 11:48:38 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-182cfaa0-fe07-4f21-ac69-4acc79c2f8e2 tempest-GroupsTest-242324188 None] Created volume successfully. Nov 06 11:48:38 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-a5ff7d64-382d-44d5-96dd-ae1c8fca0349 tempest-VolumesActionsTest-436489484 None] Acquiring lock "cinder-2dab18b8-72cf-456d-b99c-bc29b5f06573" by "attach_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 11:48:38 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-a5ff7d64-382d-44d5-96dd-ae1c8fca0349 tempest-VolumesActionsTest-436489484 None] Lock "cinder-2dab18b8-72cf-456d-b99c-bc29b5f06573" acquired by "attach_volume" :: waited 0.018s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 11:48:38 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-a5ff7d64-382d-44d5-96dd-ae1c8fca0349 tempest-VolumesActionsTest-436489484 None] Attaching volume 2dab18b8-72cf-456d-b99c-bc29b5f06573 to instance 6d36f4b8-a878-49fb-8d14-b962ffc2de42 at mountpoint /dev/vdb on host None. Nov 06 11:48:38 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-a5ff7d64-382d-44d5-96dd-ae1c8fca0349 tempest-VolumesActionsTest-436489484 None] Attach volume completed successfully. Nov 06 11:48:38 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-a5ff7d64-382d-44d5-96dd-ae1c8fca0349 tempest-VolumesActionsTest-436489484 None] Lock "cinder-2dab18b8-72cf-456d-b99c-bc29b5f06573" released by "attach_volume" :: held 0.099s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 11:48:39 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-98648154-d563-494b-84b3-3d1029e90dff tempest-VolumesActionsTest-1095804482 None] Terminate volume connection completed successfully. Nov 06 11:48:39 devstack cinder-volume[87116]: DEBUG cinder.volume.flows.manager.create_volume [None req-3dcc5659-2e19-4933-8165-2cae1f0b8be0 tempest-GroupsTest-242324188 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87116) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 11:48:39 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-3dcc5659-2e19-4933-8165-2cae1f0b8be0 tempest-GroupsTest-242324188 None] Flow 'volume_create_manager' (06a5430d-a16a-432f-ae27-91d4ce9b1e05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 11:48:39 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-3dcc5659-2e19-4933-8165-2cae1f0b8be0 tempest-GroupsTest-242324188 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (38164aef-8031-4bb5-a2c4-f484480f92c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:48:39 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-98648154-d563-494b-84b3-3d1029e90dff tempest-VolumesActionsTest-1095804482 None] Acquiring lock "cinder-2dab18b8-72cf-456d-b99c-bc29b5f06573-detach_volume" by "detach_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 11:48:39 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-3dcc5659-2e19-4933-8165-2cae1f0b8be0 tempest-GroupsTest-242324188 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (38164aef-8031-4bb5-a2c4-f484480f92c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T10:48:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1094604013',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=e6eb2156-0459-4394-a3fb-a1823c65e6ab,host='devstack@QuobyteHD#QuobyteHD',id=414ab8ac-47f5-42d5-b381-03f88485db3e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6d8f6988d0344b12bc099c2fece0fab5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T10:48:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T10:48:39Z,use_quota=True,user_id='39105704d6d541d1bf2f9532f6d5f90a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(654062d9-c1b6-4882-a96a-a6752a8f4692),volume_type_id=654062d9-c1b6-4882-a96a-a6752a8f4692)' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:48:39 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-3dcc5659-2e19-4933-8165-2cae1f0b8be0 tempest-GroupsTest-242324188 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (34e78aca-a446-4868-9dce-b4ea4a453aa7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:48:39 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-3dcc5659-2e19-4933-8165-2cae1f0b8be0 tempest-GroupsTest-242324188 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (34e78aca-a446-4868-9dce-b4ea4a453aa7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:48:39 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-3dcc5659-2e19-4933-8165-2cae1f0b8be0 tempest-GroupsTest-242324188 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0919e9fc-6e54-481e-83b4-6b0d440a4c30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:48:39 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-3dcc5659-2e19-4933-8165-2cae1f0b8be0 tempest-GroupsTest-242324188 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0919e9fc-6e54-481e-83b4-6b0d440a4c30) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '414ab8ac-47f5-42d5-b381-03f88485db3e', 'volume_name': 'volume-414ab8ac-47f5-42d5-b381-03f88485db3e', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:48:39 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-3dcc5659-2e19-4933-8165-2cae1f0b8be0 tempest-GroupsTest-242324188 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2e75b738-54cc-4760-a8cd-f13ff09da532) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:48:39 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-3dcc5659-2e19-4933-8165-2cae1f0b8be0 tempest-GroupsTest-242324188 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2e75b738-54cc-4760-a8cd-f13ff09da532) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:48:39 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-3dcc5659-2e19-4933-8165-2cae1f0b8be0 tempest-GroupsTest-242324188 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (04c5aff6-1e19-46c6-a637-c25ff5e1727a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:48:39 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-3dcc5659-2e19-4933-8165-2cae1f0b8be0 tempest-GroupsTest-242324188 None] Volume 414ab8ac-47f5-42d5-b381-03f88485db3e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-414ab8ac-47f5-42d5-b381-03f88485db3e', 'volume_size': 1} Nov 06 11:48:39 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-3dcc5659-2e19-4933-8165-2cae1f0b8be0 tempest-GroupsTest-242324188 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 11:48:39 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-3dcc5659-2e19-4933-8165-2cae1f0b8be0 tempest-GroupsTest-242324188 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 11:48:39 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-3dcc5659-2e19-4933-8165-2cae1f0b8be0 tempest-GroupsTest-242324188 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=e6eb2156-0459-4394-a3fb-a1823c65e6ab,created_at=2026-11-06T10:48:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1094604013',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=e6eb2156-0459-4394-a3fb-a1823c65e6ab,host='devstack@QuobyteHD#QuobyteHD',id=414ab8ac-47f5-42d5-b381-03f88485db3e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6d8f6988d0344b12bc099c2fece0fab5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T10:48:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T10:48:39Z,use_quota=True,user_id='39105704d6d541d1bf2f9532f6d5f90a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(654062d9-c1b6-4882-a96a-a6752a8f4692),volume_type_id=654062d9-c1b6-4882-a96a-a6752a8f4692)}" {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 11:48:39 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-3dcc5659-2e19-4933-8165-2cae1f0b8be0 tempest-GroupsTest-242324188 None] Creating volume 414ab8ac-47f5-42d5-b381-03f88485db3e {{(pid=87116) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 11:48:39 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-3dcc5659-2e19-4933-8165-2cae1f0b8be0 tempest-GroupsTest-242324188 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 11:48:39 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-3dcc5659-2e19-4933-8165-2cae1f0b8be0 tempest-GroupsTest-242324188 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 11:48:39 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-3dcc5659-2e19-4933-8165-2cae1f0b8be0 tempest-GroupsTest-242324188 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 11:48:39 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-3dcc5659-2e19-4933-8165-2cae1f0b8be0 tempest-GroupsTest-242324188 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 11:48:39 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-3dcc5659-2e19-4933-8165-2cae1f0b8be0 tempest-GroupsTest-242324188 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 11:48:39 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-3dcc5659-2e19-4933-8165-2cae1f0b8be0 tempest-GroupsTest-242324188 None] Selected osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f as target Quobyte volume. {{(pid=87116) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 11:48:39 devstack cinder-volume[87116]: INFO cinder.volume.drivers.remotefs [None req-3dcc5659-2e19-4933-8165-2cae1f0b8be0 tempest-GroupsTest-242324188 None] casted to osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f Nov 06 11:48:39 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-3dcc5659-2e19-4933-8165-2cae1f0b8be0 tempest-GroupsTest-242324188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-414ab8ac-47f5-42d5-b381-03f88485db3e 1073741824 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:48:39 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-98648154-d563-494b-84b3-3d1029e90dff tempest-VolumesActionsTest-1095804482 None] Lock "cinder-2dab18b8-72cf-456d-b99c-bc29b5f06573-detach_volume" acquired by "detach_volume" :: waited 0.083s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 11:48:39 devstack sudo[94911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-414ab8ac-47f5-42d5-b381-03f88485db3e 1073741824 Nov 06 11:48:39 devstack sudo[94911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:48:39 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-98648154-d563-494b-84b3-3d1029e90dff tempest-VolumesActionsTest-1095804482 None] Detaching volume 2dab18b8-72cf-456d-b99c-bc29b5f06573 from instance 6d36f4b8-a878-49fb-8d14-b962ffc2de42. Nov 06 11:48:39 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-98648154-d563-494b-84b3-3d1029e90dff tempest-VolumesActionsTest-1095804482 None] Detach volume completed successfully. Nov 06 11:48:39 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-98648154-d563-494b-84b3-3d1029e90dff tempest-VolumesActionsTest-1095804482 None] Lock "cinder-2dab18b8-72cf-456d-b99c-bc29b5f06573-detach_volume" released by "detach_volume" :: held 0.087s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 11:48:39 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-fa31a5c2-c98e-4729-ac8d-ac19e4464342 tempest-VolumesActionsTest-436489484 None] Acquiring lock "cinder-2dab18b8-72cf-456d-b99c-bc29b5f06573-detach_volume" by "detach_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 11:48:39 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-fa31a5c2-c98e-4729-ac8d-ac19e4464342 tempest-VolumesActionsTest-436489484 None] Lock "cinder-2dab18b8-72cf-456d-b99c-bc29b5f06573-detach_volume" acquired by "detach_volume" :: waited 0.023s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 11:48:39 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-fa31a5c2-c98e-4729-ac8d-ac19e4464342 tempest-VolumesActionsTest-436489484 None] Volume detach called, but volume not attached. Nov 06 11:48:39 devstack cinder-volume[87116]: DEBUG oslo_service.periodic_task [None req-4fab4816-ec2b-4b19-b2ff-8548f2084354 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87116) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 11:48:39 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-4fab4816-ec2b-4b19-b2ff-8548f2084354 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 11:48:39 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-4fab4816-ec2b-4b19-b2ff-8548f2084354 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 11:48:39 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-4fab4816-ec2b-4b19-b2ff-8548f2084354 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 11:48:39 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-4fab4816-ec2b-4b19-b2ff-8548f2084354 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 11:48:39 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-4fab4816-ec2b-4b19-b2ff-8548f2084354 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 11:48:39 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-4fab4816-ec2b-4b19-b2ff-8548f2084354 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:48:39 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-fa31a5c2-c98e-4729-ac8d-ac19e4464342 tempest-VolumesActionsTest-436489484 None] Lock "cinder-2dab18b8-72cf-456d-b99c-bc29b5f06573-detach_volume" released by "detach_volume" :: held 0.055s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 11:48:39 devstack sudo[94916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756 Nov 06 11:48:39 devstack sudo[94916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:48:40 devstack sudo[94911]: pam_unix(sudo:session): session closed for user root Nov 06 11:48:40 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-3dcc5659-2e19-4933-8165-2cae1f0b8be0 tempest-GroupsTest-242324188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-414ab8ac-47f5-42d5-b381-03f88485db3e 1073741824" returned: 0 in 0.698s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:48:40 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-3dcc5659-2e19-4933-8165-2cae1f0b8be0 tempest-GroupsTest-242324188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-414ab8ac-47f5-42d5-b381-03f88485db3e {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:48:40 devstack sudo[94920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-414ab8ac-47f5-42d5-b381-03f88485db3e Nov 06 11:48:40 devstack sudo[94920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:48:40 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-a5439cbe-d901-4e65-b7cb-abd6f4e05daf tempest-VolumesActionsTest-436489484 None] Acquiring lock "cinder-2dab18b8-72cf-456d-b99c-bc29b5f06573-delete_volume" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 11:48:40 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-a5439cbe-d901-4e65-b7cb-abd6f4e05daf tempest-VolumesActionsTest-436489484 None] Lock "cinder-2dab18b8-72cf-456d-b99c-bc29b5f06573-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 11:48:40 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-a5439cbe-d901-4e65-b7cb-abd6f4e05daf tempest-VolumesActionsTest-436489484 None] Acquiring lock "cinder-quobyte-2dab18b8-72cf-456d-b99c-bc29b5f06573" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 11:48:40 devstack sudo[94916]: pam_unix(sudo:session): session closed for user root Nov 06 11:48:40 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-4fab4816-ec2b-4b19-b2ff-8548f2084354 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756" returned: 0 in 0.543s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:48:40 devstack cinder-volume[87116]: DEBUG cinder.manager [None req-4fab4816-ec2b-4b19-b2ff-8548f2084354 None None] Notifying Schedulers of capabilities ... {{(pid=87116) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 11:48:40 devstack cinder-volume[87116]: DEBUG oslo_service.periodic_task [None req-4fab4816-ec2b-4b19-b2ff-8548f2084354 None None] Running periodic task VolumeManager._thread_info {{(pid=87116) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 11:48:40 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-4fab4816-ec2b-4b19-b2ff-8548f2084354 None None] thread count: 28 {{(pid=87116) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 06 11:48:40 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-4fab4816-ec2b-4b19-b2ff-8548f2084354 None None] thread info: [<_MainThread(MainThread, started 131399520669824)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87116) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 06 11:48:40 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-a5439cbe-d901-4e65-b7cb-abd6f4e05daf tempest-VolumesActionsTest-436489484 None] Lock "cinder-quobyte-2dab18b8-72cf-456d-b99c-bc29b5f06573" acquired by "delete_volume" :: waited 0.050s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 11:48:40 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2dc373a-0573-4e64-a84b-eb66b637afb6]: (4, 'qcow2') {{(pid=88420) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 11:48:40 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-a5439cbe-d901-4e65-b7cb-abd6f4e05daf tempest-VolumesActionsTest-436489484 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-2dab18b8-72cf-456d-b99c-bc29b5f06573 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:48:40 devstack sudo[94923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-2dab18b8-72cf-456d-b99c-bc29b5f06573 Nov 06 11:48:40 devstack sudo[94923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:48:40 devstack sudo[94920]: pam_unix(sudo:session): session closed for user root Nov 06 11:48:40 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-3dcc5659-2e19-4933-8165-2cae1f0b8be0 tempest-GroupsTest-242324188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-414ab8ac-47f5-42d5-b381-03f88485db3e" returned: 0 in 0.511s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:48:40 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-3dcc5659-2e19-4933-8165-2cae1f0b8be0 tempest-GroupsTest-242324188 None] <== create_volume: return (1270ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f'} {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 11:48:40 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-3dcc5659-2e19-4933-8165-2cae1f0b8be0 tempest-GroupsTest-242324188 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.274s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 11:48:40 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-3dcc5659-2e19-4933-8165-2cae1f0b8be0 tempest-GroupsTest-242324188 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (04c5aff6-1e19-46c6-a637-c25ff5e1727a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-414ab8ac-47f5-42d5-b381-03f88485db3e', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:48:40 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-3dcc5659-2e19-4933-8165-2cae1f0b8be0 tempest-GroupsTest-242324188 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ee8b55c8-c82e-465d-ad64-23d8a5681154) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:48:40 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-3dcc5659-2e19-4933-8165-2cae1f0b8be0 tempest-GroupsTest-242324188 None] Volume volume-414ab8ac-47f5-42d5-b381-03f88485db3e (414ab8ac-47f5-42d5-b381-03f88485db3e): created successfully Nov 06 11:48:40 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-3dcc5659-2e19-4933-8165-2cae1f0b8be0 tempest-GroupsTest-242324188 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ee8b55c8-c82e-465d-ad64-23d8a5681154) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:48:40 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-3dcc5659-2e19-4933-8165-2cae1f0b8be0 tempest-GroupsTest-242324188 None] Flow 'volume_create_manager' (06a5430d-a16a-432f-ae27-91d4ce9b1e05) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 11:48:40 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-3dcc5659-2e19-4933-8165-2cae1f0b8be0 tempest-GroupsTest-242324188 None] Created volume successfully. Nov 06 11:48:40 devstack cinder-volume[87116]: INFO cinder.volume.manager [req-d182cec2-1618-49b9-b340-7e2e601f3abd req-176a8b3b-c4c7-49fd-a4ad-f56fe0ab7663 tempest-AttachVolumeNegativeTest-771196063 None] Terminate volume connection completed successfully. Nov 06 11:48:40 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [req-d182cec2-1618-49b9-b340-7e2e601f3abd req-176a8b3b-c4c7-49fd-a4ad-f56fe0ab7663 tempest-AttachVolumeNegativeTest-771196063 None] Deleting attachment d636c671-def8-4563-a091-9eaff11e4592. {{(pid=87116) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 06 11:48:40 devstack sudo[94923]: pam_unix(sudo:session): session closed for user root Nov 06 11:48:40 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-a5439cbe-d901-4e65-b7cb-abd6f4e05daf tempest-VolumesActionsTest-436489484 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-2dab18b8-72cf-456d-b99c-bc29b5f06573" returned: 0 in 0.480s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:48:40 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-a5439cbe-d901-4e65-b7cb-abd6f4e05daf tempest-VolumesActionsTest-436489484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-2dab18b8-72cf-456d-b99c-bc29b5f06573 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:48:40 devstack sudo[94955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-2dab18b8-72cf-456d-b99c-bc29b5f06573 Nov 06 11:48:40 devstack sudo[94955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:48:41 devstack sudo[94955]: pam_unix(sudo:session): session closed for user root Nov 06 11:48:41 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-a5439cbe-d901-4e65-b7cb-abd6f4e05daf tempest-VolumesActionsTest-436489484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-2dab18b8-72cf-456d-b99c-bc29b5f06573" returned: 0 in 0.257s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:48:41 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-a5439cbe-d901-4e65-b7cb-abd6f4e05daf tempest-VolumesActionsTest-436489484 None] Lock "cinder-quobyte-2dab18b8-72cf-456d-b99c-bc29b5f06573" released by "delete_volume" :: held 0.814s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 11:48:41 devstack cinder-volume[87116]: DEBUG cinder.quota [None req-a5439cbe-d901-4e65-b7cb-abd6f4e05daf tempest-VolumesActionsTest-436489484 None] Created reservations ['7202c198-82f7-4f02-8c1a-aed3e334fc7f', '22a9c142-64c5-4223-9b40-057877114209', '9e572053-0b6b-40a9-9377-e173dab13716', '1589de9b-b7e3-4c20-a399-616efdbc4e74'] {{(pid=87116) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 11:48:41 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-a5439cbe-d901-4e65-b7cb-abd6f4e05daf tempest-VolumesActionsTest-436489484 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 11:48:41 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-a5439cbe-d901-4e65-b7cb-abd6f4e05daf tempest-VolumesActionsTest-436489484 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 11:48:41 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-a5439cbe-d901-4e65-b7cb-abd6f4e05daf tempest-VolumesActionsTest-436489484 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 11:48:41 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-a5439cbe-d901-4e65-b7cb-abd6f4e05daf tempest-VolumesActionsTest-436489484 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 11:48:41 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-a5439cbe-d901-4e65-b7cb-abd6f4e05daf tempest-VolumesActionsTest-436489484 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 11:48:41 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-a5439cbe-d901-4e65-b7cb-abd6f4e05daf tempest-VolumesActionsTest-436489484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:48:41 devstack sudo[94958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756 Nov 06 11:48:41 devstack sudo[94958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:48:41 devstack sudo[94958]: pam_unix(sudo:session): session closed for user root Nov 06 11:48:41 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-a5439cbe-d901-4e65-b7cb-abd6f4e05daf tempest-VolumesActionsTest-436489484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756" returned: 0 in 0.274s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:48:41 devstack cinder-volume[87116]: DEBUG cinder.manager [None req-a5439cbe-d901-4e65-b7cb-abd6f4e05daf tempest-VolumesActionsTest-436489484 None] Notifying Schedulers of capabilities ... {{(pid=87116) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 11:48:41 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-a5439cbe-d901-4e65-b7cb-abd6f4e05daf tempest-VolumesActionsTest-436489484 None] Deleted volume successfully. Nov 06 11:48:41 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-a5439cbe-d901-4e65-b7cb-abd6f4e05daf tempest-VolumesActionsTest-436489484 None] Lock "cinder-2dab18b8-72cf-456d-b99c-bc29b5f06573-delete_volume" released by "delete_volume" :: held 1.383s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 11:48:42 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-cfda4004-78f3-4855-9c2d-cf3ea38d2568 tempest-GroupsTest-242324188 None] Update group completed successfully. Nov 06 11:48:43 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-5fab8d39-ff1c-40ee-81e6-db5afc74102f tempest-GroupsTest-242324188 None] Update group completed successfully. Nov 06 11:48:45 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-7f7e2dc0-c491-4c46-bd98-e54da059d255 tempest-GroupsTest-242324188 None] Acquiring lock "cinder-quobyte-414ab8ac-47f5-42d5-b381-03f88485db3e" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 11:48:45 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-7f7e2dc0-c491-4c46-bd98-e54da059d255 tempest-GroupsTest-242324188 None] Lock "cinder-quobyte-414ab8ac-47f5-42d5-b381-03f88485db3e" acquired by "delete_volume" :: waited 0.020s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 11:48:45 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6fb39e0-478c-408e-9690-52f513c45c27]: (4, 'qcow2') {{(pid=88420) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 11:48:45 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-7f7e2dc0-c491-4c46-bd98-e54da059d255 tempest-GroupsTest-242324188 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-414ab8ac-47f5-42d5-b381-03f88485db3e {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:48:45 devstack sudo[95009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-414ab8ac-47f5-42d5-b381-03f88485db3e Nov 06 11:48:45 devstack sudo[95009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:48:45 devstack cinder-volume[87116]: DEBUG cinder.volume.flows.manager.create_volume [None req-9e7a8de0-c1b9-42dc-a14f-cfd70562978f tempest-VolumesActionsTest-436489484 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87116) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 11:48:45 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-9e7a8de0-c1b9-42dc-a14f-cfd70562978f tempest-VolumesActionsTest-436489484 None] Flow 'volume_create_manager' (3712aca9-bc1b-4cb6-81d9-a44c0d9c132e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 11:48:45 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-9e7a8de0-c1b9-42dc-a14f-cfd70562978f tempest-VolumesActionsTest-436489484 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2360a313-fcd7-44cb-9329-a89a46742659) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:48:45 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-9e7a8de0-c1b9-42dc-a14f-cfd70562978f tempest-VolumesActionsTest-436489484 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2360a313-fcd7-44cb-9329-a89a46742659) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T10:48:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1744883784',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f5379481-0190-4452-9863-000404019448,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2bcba42d552e466987396405a7bcb7d3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T10:48:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T10:48:46Z,use_quota=True,user_id='9902e935e3b0434bad8989e8c0ae447e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(34d3b144-d9b7-480a-a2e3-01e45f3d54c1),volume_type_id=34d3b144-d9b7-480a-a2e3-01e45f3d54c1)' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:48:45 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-9e7a8de0-c1b9-42dc-a14f-cfd70562978f tempest-VolumesActionsTest-436489484 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3069bc64-f226-4bd5-91d3-2e398d8e18c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:48:45 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-9e7a8de0-c1b9-42dc-a14f-cfd70562978f tempest-VolumesActionsTest-436489484 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3069bc64-f226-4bd5-91d3-2e398d8e18c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:48:46 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-9e7a8de0-c1b9-42dc-a14f-cfd70562978f tempest-VolumesActionsTest-436489484 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5d166532-5a53-4513-a9b0-dd36a0f14b02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:48:46 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-9e7a8de0-c1b9-42dc-a14f-cfd70562978f tempest-VolumesActionsTest-436489484 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5d166532-5a53-4513-a9b0-dd36a0f14b02) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f5379481-0190-4452-9863-000404019448', 'volume_name': 'volume-f5379481-0190-4452-9863-000404019448', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:48:46 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-9e7a8de0-c1b9-42dc-a14f-cfd70562978f tempest-VolumesActionsTest-436489484 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (848f97b8-fa32-41b4-98b7-9b0af525e9b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:48:46 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-9e7a8de0-c1b9-42dc-a14f-cfd70562978f tempest-VolumesActionsTest-436489484 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (848f97b8-fa32-41b4-98b7-9b0af525e9b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:48:46 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-9e7a8de0-c1b9-42dc-a14f-cfd70562978f tempest-VolumesActionsTest-436489484 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f59d5c39-c4e3-4c58-8939-e0638bbd0bb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:48:46 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-9e7a8de0-c1b9-42dc-a14f-cfd70562978f tempest-VolumesActionsTest-436489484 None] Volume f5379481-0190-4452-9863-000404019448: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f5379481-0190-4452-9863-000404019448', 'volume_size': 1} Nov 06 11:48:46 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-9e7a8de0-c1b9-42dc-a14f-cfd70562978f tempest-VolumesActionsTest-436489484 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 11:48:46 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-9e7a8de0-c1b9-42dc-a14f-cfd70562978f tempest-VolumesActionsTest-436489484 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 11:48:46 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-9e7a8de0-c1b9-42dc-a14f-cfd70562978f tempest-VolumesActionsTest-436489484 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T10:48:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1744883784',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f5379481-0190-4452-9863-000404019448,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2bcba42d552e466987396405a7bcb7d3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T10:48:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T10:48:46Z,use_quota=True,user_id='9902e935e3b0434bad8989e8c0ae447e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(34d3b144-d9b7-480a-a2e3-01e45f3d54c1),volume_type_id=34d3b144-d9b7-480a-a2e3-01e45f3d54c1)}" {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 11:48:46 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-9e7a8de0-c1b9-42dc-a14f-cfd70562978f tempest-VolumesActionsTest-436489484 None] Creating volume f5379481-0190-4452-9863-000404019448 {{(pid=87116) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 11:48:46 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-9e7a8de0-c1b9-42dc-a14f-cfd70562978f tempest-VolumesActionsTest-436489484 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 11:48:46 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-9e7a8de0-c1b9-42dc-a14f-cfd70562978f tempest-VolumesActionsTest-436489484 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 11:48:46 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-9e7a8de0-c1b9-42dc-a14f-cfd70562978f tempest-VolumesActionsTest-436489484 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 11:48:46 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-9e7a8de0-c1b9-42dc-a14f-cfd70562978f tempest-VolumesActionsTest-436489484 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 11:48:46 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-9e7a8de0-c1b9-42dc-a14f-cfd70562978f tempest-VolumesActionsTest-436489484 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 11:48:46 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-9e7a8de0-c1b9-42dc-a14f-cfd70562978f tempest-VolumesActionsTest-436489484 None] Selected osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f as target Quobyte volume. {{(pid=87116) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 11:48:46 devstack cinder-volume[87116]: INFO cinder.volume.drivers.remotefs [None req-9e7a8de0-c1b9-42dc-a14f-cfd70562978f tempest-VolumesActionsTest-436489484 None] casted to osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f Nov 06 11:48:46 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-9e7a8de0-c1b9-42dc-a14f-cfd70562978f tempest-VolumesActionsTest-436489484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-f5379481-0190-4452-9863-000404019448 1073741824 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:48:46 devstack sudo[95015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-f5379481-0190-4452-9863-000404019448 1073741824 Nov 06 11:48:46 devstack sudo[95015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:48:46 devstack sudo[95009]: pam_unix(sudo:session): session closed for user root Nov 06 11:48:46 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-7f7e2dc0-c491-4c46-bd98-e54da059d255 tempest-GroupsTest-242324188 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-414ab8ac-47f5-42d5-b381-03f88485db3e" returned: 0 in 0.503s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:48:46 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-7f7e2dc0-c491-4c46-bd98-e54da059d255 tempest-GroupsTest-242324188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-414ab8ac-47f5-42d5-b381-03f88485db3e {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:48:46 devstack sudo[95017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-414ab8ac-47f5-42d5-b381-03f88485db3e Nov 06 11:48:46 devstack sudo[95017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:48:46 devstack sudo[95017]: pam_unix(sudo:session): session closed for user root Nov 06 11:48:46 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-7f7e2dc0-c491-4c46-bd98-e54da059d255 tempest-GroupsTest-242324188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-414ab8ac-47f5-42d5-b381-03f88485db3e" returned: 0 in 0.409s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:48:46 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-7f7e2dc0-c491-4c46-bd98-e54da059d255 tempest-GroupsTest-242324188 None] Lock "cinder-quobyte-414ab8ac-47f5-42d5-b381-03f88485db3e" released by "delete_volume" :: held 1.029s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 11:48:46 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-7f7e2dc0-c491-4c46-bd98-e54da059d255 tempest-GroupsTest-242324188 None] Acquiring lock "cinder-quobyte-b4b9e98a-b625-46cb-9d3b-cc437558eb05" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 11:48:46 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-7f7e2dc0-c491-4c46-bd98-e54da059d255 tempest-GroupsTest-242324188 None] Lock "cinder-quobyte-b4b9e98a-b625-46cb-9d3b-cc437558eb05" acquired by "delete_volume" :: waited 0.031s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 11:48:46 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[719808d5-90ad-4890-b1e0-54cdfa4e18ef]: (4, 'qcow2') {{(pid=88420) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 11:48:46 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-7f7e2dc0-c491-4c46-bd98-e54da059d255 tempest-GroupsTest-242324188 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-b4b9e98a-b625-46cb-9d3b-cc437558eb05 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:48:46 devstack sudo[95038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-b4b9e98a-b625-46cb-9d3b-cc437558eb05 Nov 06 11:48:46 devstack sudo[95038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:48:46 devstack sudo[95015]: pam_unix(sudo:session): session closed for user root Nov 06 11:48:46 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-9e7a8de0-c1b9-42dc-a14f-cfd70562978f tempest-VolumesActionsTest-436489484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-f5379481-0190-4452-9863-000404019448 1073741824" returned: 0 in 0.853s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:48:46 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-9e7a8de0-c1b9-42dc-a14f-cfd70562978f tempest-VolumesActionsTest-436489484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-f5379481-0190-4452-9863-000404019448 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:48:46 devstack sudo[95046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-f5379481-0190-4452-9863-000404019448 Nov 06 11:48:47 devstack sudo[95046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:48:47 devstack sudo[95038]: pam_unix(sudo:session): session closed for user root Nov 06 11:48:47 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-7f7e2dc0-c491-4c46-bd98-e54da059d255 tempest-GroupsTest-242324188 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-b4b9e98a-b625-46cb-9d3b-cc437558eb05" returned: 0 in 0.599s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:48:47 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-7f7e2dc0-c491-4c46-bd98-e54da059d255 tempest-GroupsTest-242324188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-b4b9e98a-b625-46cb-9d3b-cc437558eb05 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:48:47 devstack sudo[95054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-b4b9e98a-b625-46cb-9d3b-cc437558eb05 Nov 06 11:48:47 devstack sudo[95054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:48:47 devstack sudo[95046]: pam_unix(sudo:session): session closed for user root Nov 06 11:48:47 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-9e7a8de0-c1b9-42dc-a14f-cfd70562978f tempest-VolumesActionsTest-436489484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-f5379481-0190-4452-9863-000404019448" returned: 0 in 0.404s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:48:47 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-9e7a8de0-c1b9-42dc-a14f-cfd70562978f tempest-VolumesActionsTest-436489484 None] <== create_volume: return (1328ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f'} {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 11:48:47 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-9e7a8de0-c1b9-42dc-a14f-cfd70562978f tempest-VolumesActionsTest-436489484 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.331s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 11:48:47 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-9e7a8de0-c1b9-42dc-a14f-cfd70562978f tempest-VolumesActionsTest-436489484 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f59d5c39-c4e3-4c58-8939-e0638bbd0bb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f5379481-0190-4452-9863-000404019448', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:48:47 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-9e7a8de0-c1b9-42dc-a14f-cfd70562978f tempest-VolumesActionsTest-436489484 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2804196a-60f4-4f61-808d-0ff736fb5e0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:48:47 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-9e7a8de0-c1b9-42dc-a14f-cfd70562978f tempest-VolumesActionsTest-436489484 None] Volume volume-f5379481-0190-4452-9863-000404019448 (f5379481-0190-4452-9863-000404019448): created successfully Nov 06 11:48:47 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-9e7a8de0-c1b9-42dc-a14f-cfd70562978f tempest-VolumesActionsTest-436489484 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2804196a-60f4-4f61-808d-0ff736fb5e0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:48:47 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-9e7a8de0-c1b9-42dc-a14f-cfd70562978f tempest-VolumesActionsTest-436489484 None] Flow 'volume_create_manager' (3712aca9-bc1b-4cb6-81d9-a44c0d9c132e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 11:48:47 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-9e7a8de0-c1b9-42dc-a14f-cfd70562978f tempest-VolumesActionsTest-436489484 None] Created volume successfully. Nov 06 11:48:47 devstack sudo[95054]: pam_unix(sudo:session): session closed for user root Nov 06 11:48:47 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-7f7e2dc0-c491-4c46-bd98-e54da059d255 tempest-GroupsTest-242324188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-b4b9e98a-b625-46cb-9d3b-cc437558eb05" returned: 0 in 0.293s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:48:47 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-7f7e2dc0-c491-4c46-bd98-e54da059d255 tempest-GroupsTest-242324188 None] Lock "cinder-quobyte-b4b9e98a-b625-46cb-9d3b-cc437558eb05" released by "delete_volume" :: held 0.977s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 11:48:47 devstack cinder-volume[87116]: DEBUG cinder.quota [None req-7f7e2dc0-c491-4c46-bd98-e54da059d255 tempest-GroupsTest-242324188 None] Created reservations ['c13077b2-363c-4074-8d08-c0cf8ac1b4ba'] {{(pid=87116) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 11:48:47 devstack cinder-volume[87116]: WARNING cinder.quota [None req-7f7e2dc0-c491-4c46-bd98-e54da059d255 tempest-GroupsTest-242324188 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1788809865 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1788809865, it is now deprecated. Please use the default quota class for default quota. Nov 06 11:48:47 devstack cinder-volume[87116]: WARNING cinder.quota [None req-7f7e2dc0-c491-4c46-bd98-e54da059d255 tempest-GroupsTest-242324188 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1788809865 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1788809865, it is now deprecated. Please use the default quota class for default quota. Nov 06 11:48:47 devstack cinder-volume[87116]: DEBUG cinder.quota [None req-7f7e2dc0-c491-4c46-bd98-e54da059d255 tempest-GroupsTest-242324188 None] Created reservations ['e78dd828-4814-4a6d-b0e0-0d44556e18db', '47d1dbda-45cd-4e90-9e52-8ca427613bbb', '991f3d6b-4049-419d-91ae-c63c0956cf45', '8627262e-b311-4072-8f57-07d441eb19d4'] {{(pid=87116) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 11:48:47 devstack cinder-volume[87116]: DEBUG cinder.quota [None req-7f7e2dc0-c491-4c46-bd98-e54da059d255 tempest-GroupsTest-242324188 None] Created reservations ['bb7b7b29-1006-4671-98c7-c627d9cd91ce', 'f3af1a38-b872-483b-9f20-6a4afaa5b6f5', '607ea52e-d6de-442f-9a1d-72a287392bc2', 'f50104f5-eed9-4831-baaa-ac8a3a5ee6b8'] {{(pid=87116) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 11:48:48 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-7f7e2dc0-c491-4c46-bd98-e54da059d255 tempest-GroupsTest-242324188 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 11:48:48 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-7f7e2dc0-c491-4c46-bd98-e54da059d255 tempest-GroupsTest-242324188 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 11:48:48 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-7f7e2dc0-c491-4c46-bd98-e54da059d255 tempest-GroupsTest-242324188 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 11:48:48 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-7f7e2dc0-c491-4c46-bd98-e54da059d255 tempest-GroupsTest-242324188 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 11:48:48 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-7f7e2dc0-c491-4c46-bd98-e54da059d255 tempest-GroupsTest-242324188 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 11:48:48 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-7f7e2dc0-c491-4c46-bd98-e54da059d255 tempest-GroupsTest-242324188 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:48:48 devstack sudo[95058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756 Nov 06 11:48:48 devstack sudo[95058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:48:48 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-ee9ba2a5-2e2d-447a-9adc-214fcb874275 tempest-VolumesActionsTest-1095804482 None] Acquiring lock "cinder-f5379481-0190-4452-9863-000404019448-delete_volume" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 11:48:48 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-ee9ba2a5-2e2d-447a-9adc-214fcb874275 tempest-VolumesActionsTest-1095804482 None] Lock "cinder-f5379481-0190-4452-9863-000404019448-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 11:48:48 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-ee9ba2a5-2e2d-447a-9adc-214fcb874275 tempest-VolumesActionsTest-1095804482 None] Acquiring lock "cinder-quobyte-f5379481-0190-4452-9863-000404019448" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 11:48:48 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-ee9ba2a5-2e2d-447a-9adc-214fcb874275 tempest-VolumesActionsTest-1095804482 None] Lock "cinder-quobyte-f5379481-0190-4452-9863-000404019448" acquired by "delete_volume" :: waited 0.022s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 11:48:48 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9188a88-57ee-44b2-9975-e2c2fed48c05]: (4, 'qcow2') {{(pid=88420) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 11:48:48 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-ee9ba2a5-2e2d-447a-9adc-214fcb874275 tempest-VolumesActionsTest-1095804482 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-f5379481-0190-4452-9863-000404019448 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:48:48 devstack sudo[95058]: pam_unix(sudo:session): session closed for user root Nov 06 11:48:48 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-7f7e2dc0-c491-4c46-bd98-e54da059d255 tempest-GroupsTest-242324188 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756" returned: 0 in 0.433s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:48:48 devstack cinder-volume[87116]: DEBUG cinder.manager [None req-7f7e2dc0-c491-4c46-bd98-e54da059d255 tempest-GroupsTest-242324188 None] Notifying Schedulers of capabilities ... {{(pid=87116) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 11:48:48 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-7f7e2dc0-c491-4c46-bd98-e54da059d255 tempest-GroupsTest-242324188 None] Delete group completed successfully. Nov 06 11:48:48 devstack sudo[95063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-f5379481-0190-4452-9863-000404019448 Nov 06 11:48:48 devstack sudo[95063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:48:49 devstack sudo[95063]: pam_unix(sudo:session): session closed for user root Nov 06 11:48:49 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-ee9ba2a5-2e2d-447a-9adc-214fcb874275 tempest-VolumesActionsTest-1095804482 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-f5379481-0190-4452-9863-000404019448" returned: 0 in 0.574s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:48:49 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-ee9ba2a5-2e2d-447a-9adc-214fcb874275 tempest-VolumesActionsTest-1095804482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-f5379481-0190-4452-9863-000404019448 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:48:49 devstack sudo[95071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-f5379481-0190-4452-9863-000404019448 Nov 06 11:48:49 devstack sudo[95071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:48:49 devstack sudo[95071]: pam_unix(sudo:session): session closed for user root Nov 06 11:48:49 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-ee9ba2a5-2e2d-447a-9adc-214fcb874275 tempest-VolumesActionsTest-1095804482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-f5379481-0190-4452-9863-000404019448" returned: 0 in 0.384s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:48:49 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-ee9ba2a5-2e2d-447a-9adc-214fcb874275 tempest-VolumesActionsTest-1095804482 None] Lock "cinder-quobyte-f5379481-0190-4452-9863-000404019448" released by "delete_volume" :: held 1.037s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 11:48:49 devstack cinder-volume[87116]: DEBUG cinder.quota [None req-ee9ba2a5-2e2d-447a-9adc-214fcb874275 tempest-VolumesActionsTest-1095804482 None] Created reservations ['31de5989-9b5f-4277-aac8-b428f5b03835', '83e734fc-5fc1-48f1-bda7-da7e8d6e2c93', '836e98e7-56e7-4733-8d01-54b710b2ea67', '6da7f224-fad6-4777-b2cb-acc1b55021f8'] {{(pid=87116) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 11:48:49 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-ee9ba2a5-2e2d-447a-9adc-214fcb874275 tempest-VolumesActionsTest-1095804482 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 11:48:49 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-ee9ba2a5-2e2d-447a-9adc-214fcb874275 tempest-VolumesActionsTest-1095804482 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 11:48:49 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-ee9ba2a5-2e2d-447a-9adc-214fcb874275 tempest-VolumesActionsTest-1095804482 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 11:48:49 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-ee9ba2a5-2e2d-447a-9adc-214fcb874275 tempest-VolumesActionsTest-1095804482 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 11:48:49 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-ee9ba2a5-2e2d-447a-9adc-214fcb874275 tempest-VolumesActionsTest-1095804482 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 11:48:49 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-ee9ba2a5-2e2d-447a-9adc-214fcb874275 tempest-VolumesActionsTest-1095804482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:48:49 devstack sudo[95074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756 Nov 06 11:48:49 devstack sudo[95074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:48:49 devstack sudo[95074]: pam_unix(sudo:session): session closed for user root Nov 06 11:48:49 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-ee9ba2a5-2e2d-447a-9adc-214fcb874275 tempest-VolumesActionsTest-1095804482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756" returned: 0 in 0.262s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:48:49 devstack cinder-volume[87116]: DEBUG cinder.manager [None req-ee9ba2a5-2e2d-447a-9adc-214fcb874275 tempest-VolumesActionsTest-1095804482 None] Notifying Schedulers of capabilities ... {{(pid=87116) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 11:48:50 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-ee9ba2a5-2e2d-447a-9adc-214fcb874275 tempest-VolumesActionsTest-1095804482 None] Deleted volume successfully. Nov 06 11:48:50 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-ee9ba2a5-2e2d-447a-9adc-214fcb874275 tempest-VolumesActionsTest-1095804482 None] Lock "cinder-f5379481-0190-4452-9863-000404019448-delete_volume" released by "delete_volume" :: held 1.643s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 11:48:51 devstack cinder-volume[87116]: DEBUG cinder.volume.flows.manager.create_volume [None req-dd17d959-d612-45e2-95d7-5117526bf307 tempest-VolumesActionsTest-436489484 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87116) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 11:48:51 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-dd17d959-d612-45e2-95d7-5117526bf307 tempest-VolumesActionsTest-436489484 None] Flow 'volume_create_manager' (d0a460b0-1fa6-4154-926c-751167a675e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 11:48:51 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-dd17d959-d612-45e2-95d7-5117526bf307 tempest-VolumesActionsTest-436489484 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d960ad93-5e71-4a17-933a-71f2f9d2b3dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:48:51 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-dd17d959-d612-45e2-95d7-5117526bf307 tempest-VolumesActionsTest-436489484 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d960ad93-5e71-4a17-933a-71f2f9d2b3dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T10:48:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-859876936',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fdc1612e-a41f-4de6-8fdc-b402571beb3b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2bcba42d552e466987396405a7bcb7d3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T10:48:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T10:48:51Z,use_quota=True,user_id='9902e935e3b0434bad8989e8c0ae447e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(34d3b144-d9b7-480a-a2e3-01e45f3d54c1),volume_type_id=34d3b144-d9b7-480a-a2e3-01e45f3d54c1)' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:48:51 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-dd17d959-d612-45e2-95d7-5117526bf307 tempest-VolumesActionsTest-436489484 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (641424ee-17eb-46cb-abc9-cc331b678de2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:48:51 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-dd17d959-d612-45e2-95d7-5117526bf307 tempest-VolumesActionsTest-436489484 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (641424ee-17eb-46cb-abc9-cc331b678de2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:48:51 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-dd17d959-d612-45e2-95d7-5117526bf307 tempest-VolumesActionsTest-436489484 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b24dbf2e-f9f9-4653-bea8-747d696de139) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:48:51 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-dd17d959-d612-45e2-95d7-5117526bf307 tempest-VolumesActionsTest-436489484 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b24dbf2e-f9f9-4653-bea8-747d696de139) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fdc1612e-a41f-4de6-8fdc-b402571beb3b', 'volume_name': 'volume-fdc1612e-a41f-4de6-8fdc-b402571beb3b', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:48:51 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-dd17d959-d612-45e2-95d7-5117526bf307 tempest-VolumesActionsTest-436489484 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0627cd80-ad17-4f8d-8498-aa4e51f07bf3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:48:51 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-dd17d959-d612-45e2-95d7-5117526bf307 tempest-VolumesActionsTest-436489484 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0627cd80-ad17-4f8d-8498-aa4e51f07bf3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:48:51 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-dd17d959-d612-45e2-95d7-5117526bf307 tempest-VolumesActionsTest-436489484 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c71e7629-8eb7-4671-a96b-4eecc62f1512) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:48:51 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-dd17d959-d612-45e2-95d7-5117526bf307 tempest-VolumesActionsTest-436489484 None] Volume fdc1612e-a41f-4de6-8fdc-b402571beb3b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fdc1612e-a41f-4de6-8fdc-b402571beb3b', 'volume_size': 1} Nov 06 11:48:51 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-dd17d959-d612-45e2-95d7-5117526bf307 tempest-VolumesActionsTest-436489484 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 11:48:51 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-dd17d959-d612-45e2-95d7-5117526bf307 tempest-VolumesActionsTest-436489484 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 11:48:51 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-dd17d959-d612-45e2-95d7-5117526bf307 tempest-VolumesActionsTest-436489484 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T10:48:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-859876936',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fdc1612e-a41f-4de6-8fdc-b402571beb3b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2bcba42d552e466987396405a7bcb7d3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T10:48:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T10:48:51Z,use_quota=True,user_id='9902e935e3b0434bad8989e8c0ae447e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(34d3b144-d9b7-480a-a2e3-01e45f3d54c1),volume_type_id=34d3b144-d9b7-480a-a2e3-01e45f3d54c1)}" {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 11:48:51 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-dd17d959-d612-45e2-95d7-5117526bf307 tempest-VolumesActionsTest-436489484 None] Creating volume fdc1612e-a41f-4de6-8fdc-b402571beb3b {{(pid=87116) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 11:48:51 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-dd17d959-d612-45e2-95d7-5117526bf307 tempest-VolumesActionsTest-436489484 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 11:48:51 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-dd17d959-d612-45e2-95d7-5117526bf307 tempest-VolumesActionsTest-436489484 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 11:48:51 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-dd17d959-d612-45e2-95d7-5117526bf307 tempest-VolumesActionsTest-436489484 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 11:48:51 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-dd17d959-d612-45e2-95d7-5117526bf307 tempest-VolumesActionsTest-436489484 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 11:48:51 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-dd17d959-d612-45e2-95d7-5117526bf307 tempest-VolumesActionsTest-436489484 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 11:48:51 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-dd17d959-d612-45e2-95d7-5117526bf307 tempest-VolumesActionsTest-436489484 None] Selected osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f as target Quobyte volume. {{(pid=87116) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 11:48:51 devstack cinder-volume[87116]: INFO cinder.volume.drivers.remotefs [None req-dd17d959-d612-45e2-95d7-5117526bf307 tempest-VolumesActionsTest-436489484 None] casted to osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f Nov 06 11:48:51 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-dd17d959-d612-45e2-95d7-5117526bf307 tempest-VolumesActionsTest-436489484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-fdc1612e-a41f-4de6-8fdc-b402571beb3b 1073741824 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:48:51 devstack sudo[95077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-fdc1612e-a41f-4de6-8fdc-b402571beb3b 1073741824 Nov 06 11:48:51 devstack sudo[95077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:48:52 devstack sudo[95077]: pam_unix(sudo:session): session closed for user root Nov 06 11:48:52 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-dd17d959-d612-45e2-95d7-5117526bf307 tempest-VolumesActionsTest-436489484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-fdc1612e-a41f-4de6-8fdc-b402571beb3b 1073741824" returned: 0 in 0.603s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:48:52 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-dd17d959-d612-45e2-95d7-5117526bf307 tempest-VolumesActionsTest-436489484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-fdc1612e-a41f-4de6-8fdc-b402571beb3b {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:48:52 devstack sudo[95087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-fdc1612e-a41f-4de6-8fdc-b402571beb3b Nov 06 11:48:52 devstack sudo[95087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:48:52 devstack sudo[95087]: pam_unix(sudo:session): session closed for user root Nov 06 11:48:52 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-dd17d959-d612-45e2-95d7-5117526bf307 tempest-VolumesActionsTest-436489484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-fdc1612e-a41f-4de6-8fdc-b402571beb3b" returned: 0 in 0.432s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:48:52 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-dd17d959-d612-45e2-95d7-5117526bf307 tempest-VolumesActionsTest-436489484 None] <== create_volume: return (1104ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f'} {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 11:48:52 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-dd17d959-d612-45e2-95d7-5117526bf307 tempest-VolumesActionsTest-436489484 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.106s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 11:48:52 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-dd17d959-d612-45e2-95d7-5117526bf307 tempest-VolumesActionsTest-436489484 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c71e7629-8eb7-4671-a96b-4eecc62f1512) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fdc1612e-a41f-4de6-8fdc-b402571beb3b', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:48:52 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-dd17d959-d612-45e2-95d7-5117526bf307 tempest-VolumesActionsTest-436489484 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bfa4f832-a44e-4263-9dbc-61e77fea8785) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:48:52 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-dd17d959-d612-45e2-95d7-5117526bf307 tempest-VolumesActionsTest-436489484 None] Volume volume-fdc1612e-a41f-4de6-8fdc-b402571beb3b (fdc1612e-a41f-4de6-8fdc-b402571beb3b): created successfully Nov 06 11:48:52 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-dd17d959-d612-45e2-95d7-5117526bf307 tempest-VolumesActionsTest-436489484 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bfa4f832-a44e-4263-9dbc-61e77fea8785) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:48:52 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-dd17d959-d612-45e2-95d7-5117526bf307 tempest-VolumesActionsTest-436489484 None] Flow 'volume_create_manager' (d0a460b0-1fa6-4154-926c-751167a675e1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 11:48:52 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-dd17d959-d612-45e2-95d7-5117526bf307 tempest-VolumesActionsTest-436489484 None] Created volume successfully. Nov 06 11:48:53 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-e263bb9e-022c-47b9-b70e-19d16ebab723 tempest-VolumesActionsTest-1095804482 None] Acquiring lock "cinder-fdc1612e-a41f-4de6-8fdc-b402571beb3b-delete_volume" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 11:48:53 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-e263bb9e-022c-47b9-b70e-19d16ebab723 tempest-VolumesActionsTest-1095804482 None] Lock "cinder-fdc1612e-a41f-4de6-8fdc-b402571beb3b-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 11:48:53 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-e263bb9e-022c-47b9-b70e-19d16ebab723 tempest-VolumesActionsTest-1095804482 None] Acquiring lock "cinder-quobyte-fdc1612e-a41f-4de6-8fdc-b402571beb3b" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 11:48:54 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-e263bb9e-022c-47b9-b70e-19d16ebab723 tempest-VolumesActionsTest-1095804482 None] Lock "cinder-quobyte-fdc1612e-a41f-4de6-8fdc-b402571beb3b" acquired by "delete_volume" :: waited 0.034s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 11:48:54 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[95e1742a-c206-4960-afde-2c0af4e7a28f]: (4, 'qcow2') {{(pid=88420) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 11:48:54 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-e263bb9e-022c-47b9-b70e-19d16ebab723 tempest-VolumesActionsTest-1095804482 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-fdc1612e-a41f-4de6-8fdc-b402571beb3b {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:48:54 devstack sudo[95091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-fdc1612e-a41f-4de6-8fdc-b402571beb3b Nov 06 11:48:54 devstack sudo[95091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:48:54 devstack sudo[95091]: pam_unix(sudo:session): session closed for user root Nov 06 11:48:54 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-e263bb9e-022c-47b9-b70e-19d16ebab723 tempest-VolumesActionsTest-1095804482 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-fdc1612e-a41f-4de6-8fdc-b402571beb3b" returned: 0 in 0.596s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:48:54 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-e263bb9e-022c-47b9-b70e-19d16ebab723 tempest-VolumesActionsTest-1095804482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-fdc1612e-a41f-4de6-8fdc-b402571beb3b {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:48:54 devstack sudo[95109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-fdc1612e-a41f-4de6-8fdc-b402571beb3b Nov 06 11:48:54 devstack sudo[95109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:48:55 devstack sudo[95109]: pam_unix(sudo:session): session closed for user root Nov 06 11:48:55 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-e263bb9e-022c-47b9-b70e-19d16ebab723 tempest-VolumesActionsTest-1095804482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-fdc1612e-a41f-4de6-8fdc-b402571beb3b" returned: 0 in 0.474s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:48:55 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-e263bb9e-022c-47b9-b70e-19d16ebab723 tempest-VolumesActionsTest-1095804482 None] Lock "cinder-quobyte-fdc1612e-a41f-4de6-8fdc-b402571beb3b" released by "delete_volume" :: held 1.159s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 11:48:55 devstack cinder-volume[87116]: DEBUG cinder.quota [None req-e263bb9e-022c-47b9-b70e-19d16ebab723 tempest-VolumesActionsTest-1095804482 None] Created reservations ['d14945f9-43b1-4d60-b40f-4a6b51f545f0', '60eb3e55-4019-4a9d-9067-0805ff01d807', 'cb995e35-73b8-4777-87a8-59ad5e18406e', '4bcaf805-d62e-4805-8b3d-6600d962cca0'] {{(pid=87116) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 11:48:55 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-e263bb9e-022c-47b9-b70e-19d16ebab723 tempest-VolumesActionsTest-1095804482 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 11:48:55 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-e263bb9e-022c-47b9-b70e-19d16ebab723 tempest-VolumesActionsTest-1095804482 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 11:48:55 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-e263bb9e-022c-47b9-b70e-19d16ebab723 tempest-VolumesActionsTest-1095804482 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 11:48:55 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-e263bb9e-022c-47b9-b70e-19d16ebab723 tempest-VolumesActionsTest-1095804482 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 11:48:55 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-e263bb9e-022c-47b9-b70e-19d16ebab723 tempest-VolumesActionsTest-1095804482 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 11:48:55 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-e263bb9e-022c-47b9-b70e-19d16ebab723 tempest-VolumesActionsTest-1095804482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:48:55 devstack sudo[95114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756 Nov 06 11:48:55 devstack sudo[95114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:48:55 devstack sudo[95114]: pam_unix(sudo:session): session closed for user root Nov 06 11:48:55 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-e263bb9e-022c-47b9-b70e-19d16ebab723 tempest-VolumesActionsTest-1095804482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756" returned: 0 in 0.315s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:48:55 devstack cinder-volume[87116]: DEBUG cinder.manager [None req-e263bb9e-022c-47b9-b70e-19d16ebab723 tempest-VolumesActionsTest-1095804482 None] Notifying Schedulers of capabilities ... {{(pid=87116) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 11:48:55 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-e263bb9e-022c-47b9-b70e-19d16ebab723 tempest-VolumesActionsTest-1095804482 None] Deleted volume successfully. Nov 06 11:48:55 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-e263bb9e-022c-47b9-b70e-19d16ebab723 tempest-VolumesActionsTest-1095804482 None] Lock "cinder-fdc1612e-a41f-4de6-8fdc-b402571beb3b-delete_volume" released by "delete_volume" :: held 1.784s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 11:48:57 devstack cinder-volume[87116]: DEBUG cinder.volume.flows.manager.create_volume [None req-469c4a3c-51e2-4922-adb3-c59b912832c3 tempest-VolumesActionsTest-436489484 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87116) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 11:48:57 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-469c4a3c-51e2-4922-adb3-c59b912832c3 tempest-VolumesActionsTest-436489484 None] Flow 'volume_create_manager' (85ca1dd7-df6b-4c7c-8805-6e223edd72b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 11:48:57 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-469c4a3c-51e2-4922-adb3-c59b912832c3 tempest-VolumesActionsTest-436489484 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e10de815-3f43-4825-b03f-fd472dab6cb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:48:57 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-469c4a3c-51e2-4922-adb3-c59b912832c3 tempest-VolumesActionsTest-436489484 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e10de815-3f43-4825-b03f-fd472dab6cb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T10:48:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-217194651',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b86c0967-af9a-4a6d-8cbb-cd9f6c3a45ee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2bcba42d552e466987396405a7bcb7d3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T10:48:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T10:48:57Z,use_quota=True,user_id='9902e935e3b0434bad8989e8c0ae447e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(34d3b144-d9b7-480a-a2e3-01e45f3d54c1),volume_type_id=34d3b144-d9b7-480a-a2e3-01e45f3d54c1)' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:48:57 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-469c4a3c-51e2-4922-adb3-c59b912832c3 tempest-VolumesActionsTest-436489484 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (42f4adef-779b-411e-9d2e-66fb8300dfb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:48:57 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-469c4a3c-51e2-4922-adb3-c59b912832c3 tempest-VolumesActionsTest-436489484 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (42f4adef-779b-411e-9d2e-66fb8300dfb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:48:57 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-469c4a3c-51e2-4922-adb3-c59b912832c3 tempest-VolumesActionsTest-436489484 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d85f0a8-cd4c-4bb1-9596-bb2b2aac395d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:48:57 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-469c4a3c-51e2-4922-adb3-c59b912832c3 tempest-VolumesActionsTest-436489484 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d85f0a8-cd4c-4bb1-9596-bb2b2aac395d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b86c0967-af9a-4a6d-8cbb-cd9f6c3a45ee', 'volume_name': 'volume-b86c0967-af9a-4a6d-8cbb-cd9f6c3a45ee', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:48:57 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-469c4a3c-51e2-4922-adb3-c59b912832c3 tempest-VolumesActionsTest-436489484 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (81611a32-e0f9-4bc3-a98d-74fb99cda819) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:48:57 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-469c4a3c-51e2-4922-adb3-c59b912832c3 tempest-VolumesActionsTest-436489484 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (81611a32-e0f9-4bc3-a98d-74fb99cda819) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:48:57 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-469c4a3c-51e2-4922-adb3-c59b912832c3 tempest-VolumesActionsTest-436489484 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8d2d2e12-4c25-4335-a101-1682bf988fb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:48:57 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-469c4a3c-51e2-4922-adb3-c59b912832c3 tempest-VolumesActionsTest-436489484 None] Volume b86c0967-af9a-4a6d-8cbb-cd9f6c3a45ee: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b86c0967-af9a-4a6d-8cbb-cd9f6c3a45ee', 'volume_size': 1} Nov 06 11:48:57 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-469c4a3c-51e2-4922-adb3-c59b912832c3 tempest-VolumesActionsTest-436489484 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 11:48:57 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-469c4a3c-51e2-4922-adb3-c59b912832c3 tempest-VolumesActionsTest-436489484 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 11:48:57 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-469c4a3c-51e2-4922-adb3-c59b912832c3 tempest-VolumesActionsTest-436489484 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T10:48:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-217194651',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b86c0967-af9a-4a6d-8cbb-cd9f6c3a45ee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2bcba42d552e466987396405a7bcb7d3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T10:48:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T10:48:57Z,use_quota=True,user_id='9902e935e3b0434bad8989e8c0ae447e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(34d3b144-d9b7-480a-a2e3-01e45f3d54c1),volume_type_id=34d3b144-d9b7-480a-a2e3-01e45f3d54c1)}" {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 11:48:57 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-469c4a3c-51e2-4922-adb3-c59b912832c3 tempest-VolumesActionsTest-436489484 None] Creating volume b86c0967-af9a-4a6d-8cbb-cd9f6c3a45ee {{(pid=87116) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 11:48:57 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-469c4a3c-51e2-4922-adb3-c59b912832c3 tempest-VolumesActionsTest-436489484 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 11:48:57 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-469c4a3c-51e2-4922-adb3-c59b912832c3 tempest-VolumesActionsTest-436489484 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 11:48:57 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-469c4a3c-51e2-4922-adb3-c59b912832c3 tempest-VolumesActionsTest-436489484 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 11:48:57 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-469c4a3c-51e2-4922-adb3-c59b912832c3 tempest-VolumesActionsTest-436489484 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 11:48:57 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-469c4a3c-51e2-4922-adb3-c59b912832c3 tempest-VolumesActionsTest-436489484 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 11:48:57 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-469c4a3c-51e2-4922-adb3-c59b912832c3 tempest-VolumesActionsTest-436489484 None] Selected osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f as target Quobyte volume. {{(pid=87116) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 11:48:57 devstack cinder-volume[87116]: INFO cinder.volume.drivers.remotefs [None req-469c4a3c-51e2-4922-adb3-c59b912832c3 tempest-VolumesActionsTest-436489484 None] casted to osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f Nov 06 11:48:57 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-469c4a3c-51e2-4922-adb3-c59b912832c3 tempest-VolumesActionsTest-436489484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-b86c0967-af9a-4a6d-8cbb-cd9f6c3a45ee 1073741824 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:48:57 devstack sudo[95138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-b86c0967-af9a-4a6d-8cbb-cd9f6c3a45ee 1073741824 Nov 06 11:48:57 devstack sudo[95138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:48:57 devstack cinder-volume[87116]: DEBUG cinder.volume.flows.manager.create_volume [None req-401cd9fc-70c4-4d94-8422-9942aa30ff04 tempest-SnapshotsActionsTest-1557067016 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87116) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 11:48:57 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-401cd9fc-70c4-4d94-8422-9942aa30ff04 tempest-SnapshotsActionsTest-1557067016 None] Flow 'volume_create_manager' (d541a25f-edb9-4544-9507-72510e60458e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 11:48:57 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-401cd9fc-70c4-4d94-8422-9942aa30ff04 tempest-SnapshotsActionsTest-1557067016 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9b64cb6d-1bc1-41fb-bdae-d74ae28e158c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:48:57 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-401cd9fc-70c4-4d94-8422-9942aa30ff04 tempest-SnapshotsActionsTest-1557067016 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9b64cb6d-1bc1-41fb-bdae-d74ae28e158c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T10:48:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-2055413647',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b7f1d205-2e2b-4d84-bfa7-d51dfc5207ad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1244e6803ef34ac5ae18885fd543f7be',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T10:48:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T10:48:57Z,use_quota=True,user_id='678d4ca960da42b78d3a0730d70b290d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(34d3b144-d9b7-480a-a2e3-01e45f3d54c1),volume_type_id=34d3b144-d9b7-480a-a2e3-01e45f3d54c1)' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:48:57 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-401cd9fc-70c4-4d94-8422-9942aa30ff04 tempest-SnapshotsActionsTest-1557067016 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4e820095-e14e-4e58-af19-8583856f5516) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:48:57 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-401cd9fc-70c4-4d94-8422-9942aa30ff04 tempest-SnapshotsActionsTest-1557067016 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4e820095-e14e-4e58-af19-8583856f5516) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:48:57 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-401cd9fc-70c4-4d94-8422-9942aa30ff04 tempest-SnapshotsActionsTest-1557067016 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ebdb32ec-1b05-493e-aa11-6af058c39392) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:48:57 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-401cd9fc-70c4-4d94-8422-9942aa30ff04 tempest-SnapshotsActionsTest-1557067016 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ebdb32ec-1b05-493e-aa11-6af058c39392) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b7f1d205-2e2b-4d84-bfa7-d51dfc5207ad', 'volume_name': 'volume-b7f1d205-2e2b-4d84-bfa7-d51dfc5207ad', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:48:57 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-401cd9fc-70c4-4d94-8422-9942aa30ff04 tempest-SnapshotsActionsTest-1557067016 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (978dc10d-a972-49cc-8b10-11e213b42022) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:48:57 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-401cd9fc-70c4-4d94-8422-9942aa30ff04 tempest-SnapshotsActionsTest-1557067016 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (978dc10d-a972-49cc-8b10-11e213b42022) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:48:58 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-401cd9fc-70c4-4d94-8422-9942aa30ff04 tempest-SnapshotsActionsTest-1557067016 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6feaf93e-184d-4b3f-a370-673d9a7bfb43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:48:58 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-401cd9fc-70c4-4d94-8422-9942aa30ff04 tempest-SnapshotsActionsTest-1557067016 None] Volume b7f1d205-2e2b-4d84-bfa7-d51dfc5207ad: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b7f1d205-2e2b-4d84-bfa7-d51dfc5207ad', 'volume_size': 1} Nov 06 11:48:58 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-401cd9fc-70c4-4d94-8422-9942aa30ff04 tempest-SnapshotsActionsTest-1557067016 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 11:48:58 devstack sudo[95138]: pam_unix(sudo:session): session closed for user root Nov 06 11:48:58 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-469c4a3c-51e2-4922-adb3-c59b912832c3 tempest-VolumesActionsTest-436489484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-b86c0967-af9a-4a6d-8cbb-cd9f6c3a45ee 1073741824" returned: 0 in 0.777s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:48:58 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-469c4a3c-51e2-4922-adb3-c59b912832c3 tempest-VolumesActionsTest-436489484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-b86c0967-af9a-4a6d-8cbb-cd9f6c3a45ee {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:48:58 devstack sudo[95197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-b86c0967-af9a-4a6d-8cbb-cd9f6c3a45ee Nov 06 11:48:58 devstack sudo[95197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:48:59 devstack sudo[95197]: pam_unix(sudo:session): session closed for user root Nov 06 11:48:59 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-469c4a3c-51e2-4922-adb3-c59b912832c3 tempest-VolumesActionsTest-436489484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-b86c0967-af9a-4a6d-8cbb-cd9f6c3a45ee" returned: 0 in 0.491s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:48:59 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-469c4a3c-51e2-4922-adb3-c59b912832c3 tempest-VolumesActionsTest-436489484 None] <== create_volume: return (1386ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f'} {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 11:48:59 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-469c4a3c-51e2-4922-adb3-c59b912832c3 tempest-VolumesActionsTest-436489484 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.392s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 11:48:59 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-401cd9fc-70c4-4d94-8422-9942aa30ff04 tempest-SnapshotsActionsTest-1557067016 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.034s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 11:48:59 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-401cd9fc-70c4-4d94-8422-9942aa30ff04 tempest-SnapshotsActionsTest-1557067016 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T10:48:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-2055413647',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b7f1d205-2e2b-4d84-bfa7-d51dfc5207ad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1244e6803ef34ac5ae18885fd543f7be',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T10:48:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T10:48:57Z,use_quota=True,user_id='678d4ca960da42b78d3a0730d70b290d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(34d3b144-d9b7-480a-a2e3-01e45f3d54c1),volume_type_id=34d3b144-d9b7-480a-a2e3-01e45f3d54c1)}" {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 11:48:59 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-401cd9fc-70c4-4d94-8422-9942aa30ff04 tempest-SnapshotsActionsTest-1557067016 None] Creating volume b7f1d205-2e2b-4d84-bfa7-d51dfc5207ad {{(pid=87116) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 11:48:59 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-401cd9fc-70c4-4d94-8422-9942aa30ff04 tempest-SnapshotsActionsTest-1557067016 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 11:48:59 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-401cd9fc-70c4-4d94-8422-9942aa30ff04 tempest-SnapshotsActionsTest-1557067016 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 11:48:59 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-401cd9fc-70c4-4d94-8422-9942aa30ff04 tempest-SnapshotsActionsTest-1557067016 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 11:48:59 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-401cd9fc-70c4-4d94-8422-9942aa30ff04 tempest-SnapshotsActionsTest-1557067016 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 11:48:59 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-401cd9fc-70c4-4d94-8422-9942aa30ff04 tempest-SnapshotsActionsTest-1557067016 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 11:48:59 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-401cd9fc-70c4-4d94-8422-9942aa30ff04 tempest-SnapshotsActionsTest-1557067016 None] Selected osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f as target Quobyte volume. {{(pid=87116) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 11:48:59 devstack cinder-volume[87116]: INFO cinder.volume.drivers.remotefs [None req-401cd9fc-70c4-4d94-8422-9942aa30ff04 tempest-SnapshotsActionsTest-1557067016 None] casted to osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f Nov 06 11:48:59 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-401cd9fc-70c4-4d94-8422-9942aa30ff04 tempest-SnapshotsActionsTest-1557067016 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-b7f1d205-2e2b-4d84-bfa7-d51dfc5207ad 1073741824 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:48:59 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-469c4a3c-51e2-4922-adb3-c59b912832c3 tempest-VolumesActionsTest-436489484 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8d2d2e12-4c25-4335-a101-1682bf988fb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b86c0967-af9a-4a6d-8cbb-cd9f6c3a45ee', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:48:59 devstack sudo[95214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-b7f1d205-2e2b-4d84-bfa7-d51dfc5207ad 1073741824 Nov 06 11:48:59 devstack sudo[95214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:48:59 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-469c4a3c-51e2-4922-adb3-c59b912832c3 tempest-VolumesActionsTest-436489484 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4efd32a6-48a2-4dd8-8679-11d47294684e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:48:59 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-469c4a3c-51e2-4922-adb3-c59b912832c3 tempest-VolumesActionsTest-436489484 None] Volume volume-b86c0967-af9a-4a6d-8cbb-cd9f6c3a45ee (b86c0967-af9a-4a6d-8cbb-cd9f6c3a45ee): created successfully Nov 06 11:48:59 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-469c4a3c-51e2-4922-adb3-c59b912832c3 tempest-VolumesActionsTest-436489484 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4efd32a6-48a2-4dd8-8679-11d47294684e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:48:59 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-469c4a3c-51e2-4922-adb3-c59b912832c3 tempest-VolumesActionsTest-436489484 None] Flow 'volume_create_manager' (85ca1dd7-df6b-4c7c-8805-6e223edd72b8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 11:48:59 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-469c4a3c-51e2-4922-adb3-c59b912832c3 tempest-VolumesActionsTest-436489484 None] Created volume successfully. Nov 06 11:49:00 devstack sudo[95214]: pam_unix(sudo:session): session closed for user root Nov 06 11:49:00 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-401cd9fc-70c4-4d94-8422-9942aa30ff04 tempest-SnapshotsActionsTest-1557067016 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-b7f1d205-2e2b-4d84-bfa7-d51dfc5207ad 1073741824" returned: 0 in 0.965s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:49:00 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-401cd9fc-70c4-4d94-8422-9942aa30ff04 tempest-SnapshotsActionsTest-1557067016 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-b7f1d205-2e2b-4d84-bfa7-d51dfc5207ad {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:49:00 devstack sudo[95224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-b7f1d205-2e2b-4d84-bfa7-d51dfc5207ad Nov 06 11:49:00 devstack sudo[95224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:49:00 devstack sudo[95224]: pam_unix(sudo:session): session closed for user root Nov 06 11:49:00 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-401cd9fc-70c4-4d94-8422-9942aa30ff04 tempest-SnapshotsActionsTest-1557067016 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-b7f1d205-2e2b-4d84-bfa7-d51dfc5207ad" returned: 0 in 0.360s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:49:00 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-401cd9fc-70c4-4d94-8422-9942aa30ff04 tempest-SnapshotsActionsTest-1557067016 None] <== create_volume: return (1438ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f'} {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 11:49:00 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-401cd9fc-70c4-4d94-8422-9942aa30ff04 tempest-SnapshotsActionsTest-1557067016 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.447s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 11:49:00 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-401cd9fc-70c4-4d94-8422-9942aa30ff04 tempest-SnapshotsActionsTest-1557067016 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6feaf93e-184d-4b3f-a370-673d9a7bfb43) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b7f1d205-2e2b-4d84-bfa7-d51dfc5207ad', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:49:00 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-401cd9fc-70c4-4d94-8422-9942aa30ff04 tempest-SnapshotsActionsTest-1557067016 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (32fc1b9c-e7a1-45a6-9267-9f3696f42feb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:49:00 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-401cd9fc-70c4-4d94-8422-9942aa30ff04 tempest-SnapshotsActionsTest-1557067016 None] Volume volume-b7f1d205-2e2b-4d84-bfa7-d51dfc5207ad (b7f1d205-2e2b-4d84-bfa7-d51dfc5207ad): created successfully Nov 06 11:49:00 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-401cd9fc-70c4-4d94-8422-9942aa30ff04 tempest-SnapshotsActionsTest-1557067016 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (32fc1b9c-e7a1-45a6-9267-9f3696f42feb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:49:00 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-401cd9fc-70c4-4d94-8422-9942aa30ff04 tempest-SnapshotsActionsTest-1557067016 None] Flow 'volume_create_manager' (d541a25f-edb9-4544-9507-72510e60458e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 11:49:00 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-401cd9fc-70c4-4d94-8422-9942aa30ff04 tempest-SnapshotsActionsTest-1557067016 None] Created volume successfully. Nov 06 11:49:00 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-97a21e0d-2bda-4efb-a522-4391ab8a8cd4 tempest-VolumesActionsTest-1095804482 None] Acquiring lock "cinder-b86c0967-af9a-4a6d-8cbb-cd9f6c3a45ee-delete_volume" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 11:49:00 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-97a21e0d-2bda-4efb-a522-4391ab8a8cd4 tempest-VolumesActionsTest-1095804482 None] Lock "cinder-b86c0967-af9a-4a6d-8cbb-cd9f6c3a45ee-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 11:49:00 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-97a21e0d-2bda-4efb-a522-4391ab8a8cd4 tempest-VolumesActionsTest-1095804482 None] Acquiring lock "cinder-quobyte-b86c0967-af9a-4a6d-8cbb-cd9f6c3a45ee" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 11:49:00 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-97a21e0d-2bda-4efb-a522-4391ab8a8cd4 tempest-VolumesActionsTest-1095804482 None] Lock "cinder-quobyte-b86c0967-af9a-4a6d-8cbb-cd9f6c3a45ee" acquired by "delete_volume" :: waited 0.017s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 11:49:00 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[be7cf955-3bd5-4503-8ae5-78ef30655a02]: (4, 'qcow2') {{(pid=88420) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 11:49:00 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-97a21e0d-2bda-4efb-a522-4391ab8a8cd4 tempest-VolumesActionsTest-1095804482 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-b86c0967-af9a-4a6d-8cbb-cd9f6c3a45ee {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:49:00 devstack sudo[95228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-b86c0967-af9a-4a6d-8cbb-cd9f6c3a45ee Nov 06 11:49:00 devstack sudo[95228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:49:01 devstack sudo[95228]: pam_unix(sudo:session): session closed for user root Nov 06 11:49:01 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-97a21e0d-2bda-4efb-a522-4391ab8a8cd4 tempest-VolumesActionsTest-1095804482 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-b86c0967-af9a-4a6d-8cbb-cd9f6c3a45ee" returned: 0 in 0.432s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:49:01 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-97a21e0d-2bda-4efb-a522-4391ab8a8cd4 tempest-VolumesActionsTest-1095804482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-b86c0967-af9a-4a6d-8cbb-cd9f6c3a45ee {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:49:01 devstack sudo[95234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-b86c0967-af9a-4a6d-8cbb-cd9f6c3a45ee Nov 06 11:49:01 devstack sudo[95234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:49:01 devstack sudo[95234]: pam_unix(sudo:session): session closed for user root Nov 06 11:49:01 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-97a21e0d-2bda-4efb-a522-4391ab8a8cd4 tempest-VolumesActionsTest-1095804482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-b86c0967-af9a-4a6d-8cbb-cd9f6c3a45ee" returned: 0 in 0.432s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:49:01 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-97a21e0d-2bda-4efb-a522-4391ab8a8cd4 tempest-VolumesActionsTest-1095804482 None] Lock "cinder-quobyte-b86c0967-af9a-4a6d-8cbb-cd9f6c3a45ee" released by "delete_volume" :: held 0.973s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 11:49:01 devstack cinder-volume[87116]: DEBUG cinder.quota [None req-97a21e0d-2bda-4efb-a522-4391ab8a8cd4 tempest-VolumesActionsTest-1095804482 None] Created reservations ['16981560-602a-4bbc-824c-ad788e67f9f6', '8e503a48-b907-48c2-82d7-a55923c35e3d', 'ebb9c615-83ff-4349-a883-24a8f964ea26', '876147cc-f8ca-4969-8cc4-e931077e4047'] {{(pid=87116) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 11:49:01 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-bf6fb7bd-52bb-4f04-a230-9a5015bcff60 tempest-SnapshotsActionsTest-1557067016 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 11:49:01 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-bf6fb7bd-52bb-4f04-a230-9a5015bcff60 tempest-SnapshotsActionsTest-1557067016 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 11:49:02 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-bf6fb7bd-52bb-4f04-a230-9a5015bcff60 tempest-SnapshotsActionsTest-1557067016 None] Creating offline snapshot 51fd54bf-7093-4f26-8442-79e90c6b48c7 of volume b7f1d205-2e2b-4d84-bfa7-d51dfc5207ad {{(pid=87116) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 06 11:49:02 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[773a8eb3-14c5-4852-b7fc-f95f1802ba82]: (4, 'qcow2') {{(pid=88420) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 11:49:02 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-bf6fb7bd-52bb-4f04-a230-9a5015bcff60 tempest-SnapshotsActionsTest-1557067016 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-b7f1d205-2e2b-4d84-bfa7-d51dfc5207ad {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:49:02 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-97a21e0d-2bda-4efb-a522-4391ab8a8cd4 tempest-VolumesActionsTest-1095804482 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 11:49:02 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-97a21e0d-2bda-4efb-a522-4391ab8a8cd4 tempest-VolumesActionsTest-1095804482 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.010s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 11:49:02 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-97a21e0d-2bda-4efb-a522-4391ab8a8cd4 tempest-VolumesActionsTest-1095804482 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 11:49:02 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-97a21e0d-2bda-4efb-a522-4391ab8a8cd4 tempest-VolumesActionsTest-1095804482 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 11:49:02 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-97a21e0d-2bda-4efb-a522-4391ab8a8cd4 tempest-VolumesActionsTest-1095804482 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 11:49:02 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-97a21e0d-2bda-4efb-a522-4391ab8a8cd4 tempest-VolumesActionsTest-1095804482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:49:02 devstack sudo[95239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756 Nov 06 11:49:02 devstack sudo[95239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:49:02 devstack sudo[95237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-b7f1d205-2e2b-4d84-bfa7-d51dfc5207ad Nov 06 11:49:02 devstack sudo[95237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:49:02 devstack sudo[95239]: pam_unix(sudo:session): session closed for user root Nov 06 11:49:02 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-97a21e0d-2bda-4efb-a522-4391ab8a8cd4 tempest-VolumesActionsTest-1095804482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756" returned: 0 in 0.795s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:49:02 devstack cinder-volume[87116]: DEBUG cinder.manager [None req-97a21e0d-2bda-4efb-a522-4391ab8a8cd4 tempest-VolumesActionsTest-1095804482 None] Notifying Schedulers of capabilities ... {{(pid=87116) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 11:49:02 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-97a21e0d-2bda-4efb-a522-4391ab8a8cd4 tempest-VolumesActionsTest-1095804482 None] Deleted volume successfully. Nov 06 11:49:03 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-97a21e0d-2bda-4efb-a522-4391ab8a8cd4 tempest-VolumesActionsTest-1095804482 None] Lock "cinder-b86c0967-af9a-4a6d-8cbb-cd9f6c3a45ee-delete_volume" released by "delete_volume" :: held 2.292s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 11:49:03 devstack sudo[95237]: pam_unix(sudo:session): session closed for user root Nov 06 11:49:03 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-bf6fb7bd-52bb-4f04-a230-9a5015bcff60 tempest-SnapshotsActionsTest-1557067016 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-b7f1d205-2e2b-4d84-bfa7-d51dfc5207ad" returned: 0 in 1.321s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:49:03 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-bf6fb7bd-52bb-4f04-a230-9a5015bcff60 tempest-SnapshotsActionsTest-1557067016 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-b7f1d205-2e2b-4d84-bfa7-d51dfc5207ad,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-b7f1d205-2e2b-4d84-bfa7-d51dfc5207ad.51fd54bf-7093-4f26-8442-79e90c6b48c7 1G {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:49:03 devstack sudo[95304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-b7f1d205-2e2b-4d84-bfa7-d51dfc5207ad,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-b7f1d205-2e2b-4d84-bfa7-d51dfc5207ad.51fd54bf-7093-4f26-8442-79e90c6b48c7 1G Nov 06 11:49:03 devstack sudo[95304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:49:04 devstack sudo[95304]: pam_unix(sudo:session): session closed for user root Nov 06 11:49:04 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-bf6fb7bd-52bb-4f04-a230-9a5015bcff60 tempest-SnapshotsActionsTest-1557067016 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-b7f1d205-2e2b-4d84-bfa7-d51dfc5207ad,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-b7f1d205-2e2b-4d84-bfa7-d51dfc5207ad.51fd54bf-7093-4f26-8442-79e90c6b48c7 1G" returned: 0 in 1.003s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:49:04 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-bf6fb7bd-52bb-4f04-a230-9a5015bcff60 tempest-SnapshotsActionsTest-1557067016 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b7f1d205-2e2b-4d84-bfa7-d51dfc5207ad -F qcow2 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-b7f1d205-2e2b-4d84-bfa7-d51dfc5207ad.51fd54bf-7093-4f26-8442-79e90c6b48c7 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:49:04 devstack cinder-volume[87116]: DEBUG cinder.volume.flows.manager.create_volume [None req-353b3564-5dfb-4209-9866-fbc64697fe08 tempest-VolumesActionsTest-436489484 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87116) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 11:49:04 devstack sudo[95319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b7f1d205-2e2b-4d84-bfa7-d51dfc5207ad -F qcow2 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-b7f1d205-2e2b-4d84-bfa7-d51dfc5207ad.51fd54bf-7093-4f26-8442-79e90c6b48c7 Nov 06 11:49:04 devstack sudo[95319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:49:04 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-353b3564-5dfb-4209-9866-fbc64697fe08 tempest-VolumesActionsTest-436489484 None] Flow 'volume_create_manager' (30c73d3b-e5a6-4192-88c4-263e140cebcb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 11:49:04 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-353b3564-5dfb-4209-9866-fbc64697fe08 tempest-VolumesActionsTest-436489484 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cdda7c1f-a186-4d14-aa74-613f36033bd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:49:04 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-353b3564-5dfb-4209-9866-fbc64697fe08 tempest-VolumesActionsTest-436489484 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cdda7c1f-a186-4d14-aa74-613f36033bd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T10:49:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-648525138',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d82e7aec-a0c2-4222-8a3d-52c210a72651,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2bcba42d552e466987396405a7bcb7d3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T10:49:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T10:49:04Z,use_quota=True,user_id='9902e935e3b0434bad8989e8c0ae447e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(34d3b144-d9b7-480a-a2e3-01e45f3d54c1),volume_type_id=34d3b144-d9b7-480a-a2e3-01e45f3d54c1)' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:49:04 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-353b3564-5dfb-4209-9866-fbc64697fe08 tempest-VolumesActionsTest-436489484 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c2777882-d3ba-4207-9873-1ddcc9dfb1bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:49:04 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-353b3564-5dfb-4209-9866-fbc64697fe08 tempest-VolumesActionsTest-436489484 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c2777882-d3ba-4207-9873-1ddcc9dfb1bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:49:04 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-353b3564-5dfb-4209-9866-fbc64697fe08 tempest-VolumesActionsTest-436489484 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5a43f079-c46a-431a-bc94-cd0258fc6fa5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:49:04 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-353b3564-5dfb-4209-9866-fbc64697fe08 tempest-VolumesActionsTest-436489484 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5a43f079-c46a-431a-bc94-cd0258fc6fa5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd82e7aec-a0c2-4222-8a3d-52c210a72651', 'volume_name': 'volume-d82e7aec-a0c2-4222-8a3d-52c210a72651', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:49:04 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-353b3564-5dfb-4209-9866-fbc64697fe08 tempest-VolumesActionsTest-436489484 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0b41b0d9-1395-4c6b-98c4-27507a64a9a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:49:04 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-353b3564-5dfb-4209-9866-fbc64697fe08 tempest-VolumesActionsTest-436489484 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0b41b0d9-1395-4c6b-98c4-27507a64a9a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:49:04 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-353b3564-5dfb-4209-9866-fbc64697fe08 tempest-VolumesActionsTest-436489484 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad47019d-6144-4853-991d-e5dc8860f8ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:49:04 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-353b3564-5dfb-4209-9866-fbc64697fe08 tempest-VolumesActionsTest-436489484 None] Volume d82e7aec-a0c2-4222-8a3d-52c210a72651: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d82e7aec-a0c2-4222-8a3d-52c210a72651', 'volume_size': 1} Nov 06 11:49:04 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-353b3564-5dfb-4209-9866-fbc64697fe08 tempest-VolumesActionsTest-436489484 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 11:49:05 devstack sudo[95319]: pam_unix(sudo:session): session closed for user root Nov 06 11:49:05 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-bf6fb7bd-52bb-4f04-a230-9a5015bcff60 tempest-SnapshotsActionsTest-1557067016 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b7f1d205-2e2b-4d84-bfa7-d51dfc5207ad -F qcow2 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-b7f1d205-2e2b-4d84-bfa7-d51dfc5207ad.51fd54bf-7093-4f26-8442-79e90c6b48c7" returned: 0 in 0.770s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:49:05 devstack cinder-volume[87116]: WARNING cinder.volume.drivers.remotefs [None req-bf6fb7bd-52bb-4f04-a230-9a5015bcff60 tempest-SnapshotsActionsTest-1557067016 None] /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-b7f1d205-2e2b-4d84-bfa7-d51dfc5207ad.51fd54bf-7093-4f26-8442-79e90c6b48c7 is being set with open permissions: ugo+rw Nov 06 11:49:05 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-bf6fb7bd-52bb-4f04-a230-9a5015bcff60 tempest-SnapshotsActionsTest-1557067016 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-b7f1d205-2e2b-4d84-bfa7-d51dfc5207ad.51fd54bf-7093-4f26-8442-79e90c6b48c7 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:49:05 devstack sudo[95327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-b7f1d205-2e2b-4d84-bfa7-d51dfc5207ad.51fd54bf-7093-4f26-8442-79e90c6b48c7 Nov 06 11:49:05 devstack sudo[95327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:49:05 devstack sudo[95327]: pam_unix(sudo:session): session closed for user root Nov 06 11:49:05 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-bf6fb7bd-52bb-4f04-a230-9a5015bcff60 tempest-SnapshotsActionsTest-1557067016 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-b7f1d205-2e2b-4d84-bfa7-d51dfc5207ad.51fd54bf-7093-4f26-8442-79e90c6b48c7" returned: 0 in 0.670s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:49:05 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-bf6fb7bd-52bb-4f04-a230-9a5015bcff60 tempest-SnapshotsActionsTest-1557067016 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-b7f1d205-2e2b-4d84-bfa7-d51dfc5207ad.info {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:49:06 devstack sudo[95331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-b7f1d205-2e2b-4d84-bfa7-d51dfc5207ad.info Nov 06 11:49:06 devstack sudo[95331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:49:06 devstack sudo[95331]: pam_unix(sudo:session): session closed for user root Nov 06 11:49:06 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-bf6fb7bd-52bb-4f04-a230-9a5015bcff60 tempest-SnapshotsActionsTest-1557067016 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-b7f1d205-2e2b-4d84-bfa7-d51dfc5207ad.info" returned: 0 in 0.571s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:49:06 devstack cinder-volume[87116]: WARNING cinder.volume.drivers.remotefs [None req-bf6fb7bd-52bb-4f04-a230-9a5015bcff60 tempest-SnapshotsActionsTest-1557067016 None] /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-b7f1d205-2e2b-4d84-bfa7-d51dfc5207ad.info is being set with open permissions: ugo+rw Nov 06 11:49:06 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-bf6fb7bd-52bb-4f04-a230-9a5015bcff60 tempest-SnapshotsActionsTest-1557067016 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-b7f1d205-2e2b-4d84-bfa7-d51dfc5207ad.info {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:49:06 devstack sudo[95335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-b7f1d205-2e2b-4d84-bfa7-d51dfc5207ad.info Nov 06 11:49:06 devstack sudo[95335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:49:07 devstack sudo[95335]: pam_unix(sudo:session): session closed for user root Nov 06 11:49:07 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-bf6fb7bd-52bb-4f04-a230-9a5015bcff60 tempest-SnapshotsActionsTest-1557067016 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-b7f1d205-2e2b-4d84-bfa7-d51dfc5207ad.info" returned: 0 in 0.523s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:49:07 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-bf6fb7bd-52bb-4f04-a230-9a5015bcff60 tempest-SnapshotsActionsTest-1557067016 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.088s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 11:49:07 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-353b3564-5dfb-4209-9866-fbc64697fe08 tempest-VolumesActionsTest-436489484 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.496s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 11:49:07 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-353b3564-5dfb-4209-9866-fbc64697fe08 tempest-VolumesActionsTest-436489484 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T10:49:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-648525138',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d82e7aec-a0c2-4222-8a3d-52c210a72651,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2bcba42d552e466987396405a7bcb7d3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T10:49:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T10:49:04Z,use_quota=True,user_id='9902e935e3b0434bad8989e8c0ae447e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(34d3b144-d9b7-480a-a2e3-01e45f3d54c1),volume_type_id=34d3b144-d9b7-480a-a2e3-01e45f3d54c1)}" {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 11:49:07 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-353b3564-5dfb-4209-9866-fbc64697fe08 tempest-VolumesActionsTest-436489484 None] Creating volume d82e7aec-a0c2-4222-8a3d-52c210a72651 {{(pid=87116) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 11:49:07 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-353b3564-5dfb-4209-9866-fbc64697fe08 tempest-VolumesActionsTest-436489484 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 11:49:07 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-353b3564-5dfb-4209-9866-fbc64697fe08 tempest-VolumesActionsTest-436489484 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 11:49:07 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-353b3564-5dfb-4209-9866-fbc64697fe08 tempest-VolumesActionsTest-436489484 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 11:49:07 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-353b3564-5dfb-4209-9866-fbc64697fe08 tempest-VolumesActionsTest-436489484 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 11:49:07 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-353b3564-5dfb-4209-9866-fbc64697fe08 tempest-VolumesActionsTest-436489484 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 11:49:07 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-353b3564-5dfb-4209-9866-fbc64697fe08 tempest-VolumesActionsTest-436489484 None] Selected osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f as target Quobyte volume. {{(pid=87116) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 11:49:07 devstack cinder-volume[87116]: INFO cinder.volume.drivers.remotefs [None req-353b3564-5dfb-4209-9866-fbc64697fe08 tempest-VolumesActionsTest-436489484 None] casted to osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f Nov 06 11:49:07 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-353b3564-5dfb-4209-9866-fbc64697fe08 tempest-VolumesActionsTest-436489484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-d82e7aec-a0c2-4222-8a3d-52c210a72651 1073741824 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:49:07 devstack sudo[95339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-d82e7aec-a0c2-4222-8a3d-52c210a72651 1073741824 Nov 06 11:49:07 devstack sudo[95339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:49:07 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-bf6fb7bd-52bb-4f04-a230-9a5015bcff60 tempest-SnapshotsActionsTest-1557067016 None] Create snapshot completed successfully Nov 06 11:49:07 devstack sudo[95339]: pam_unix(sudo:session): session closed for user root Nov 06 11:49:07 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-353b3564-5dfb-4209-9866-fbc64697fe08 tempest-VolumesActionsTest-436489484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-d82e7aec-a0c2-4222-8a3d-52c210a72651 1073741824" returned: 0 in 0.837s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:49:08 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-353b3564-5dfb-4209-9866-fbc64697fe08 tempest-VolumesActionsTest-436489484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-d82e7aec-a0c2-4222-8a3d-52c210a72651 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:49:08 devstack sudo[95347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-d82e7aec-a0c2-4222-8a3d-52c210a72651 Nov 06 11:49:08 devstack sudo[95347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:49:08 devstack sudo[95347]: pam_unix(sudo:session): session closed for user root Nov 06 11:49:08 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-353b3564-5dfb-4209-9866-fbc64697fe08 tempest-VolumesActionsTest-436489484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-d82e7aec-a0c2-4222-8a3d-52c210a72651" returned: 0 in 0.516s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:49:08 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-353b3564-5dfb-4209-9866-fbc64697fe08 tempest-VolumesActionsTest-436489484 None] <== create_volume: return (1466ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f'} {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 11:49:08 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-353b3564-5dfb-4209-9866-fbc64697fe08 tempest-VolumesActionsTest-436489484 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.474s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 11:49:08 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-353b3564-5dfb-4209-9866-fbc64697fe08 tempest-VolumesActionsTest-436489484 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad47019d-6144-4853-991d-e5dc8860f8ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d82e7aec-a0c2-4222-8a3d-52c210a72651', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:49:08 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-353b3564-5dfb-4209-9866-fbc64697fe08 tempest-VolumesActionsTest-436489484 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ca28051e-a4a0-4af4-b86e-9ac2f3ec4eee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:49:08 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-353b3564-5dfb-4209-9866-fbc64697fe08 tempest-VolumesActionsTest-436489484 None] Volume volume-d82e7aec-a0c2-4222-8a3d-52c210a72651 (d82e7aec-a0c2-4222-8a3d-52c210a72651): created successfully Nov 06 11:49:08 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-353b3564-5dfb-4209-9866-fbc64697fe08 tempest-VolumesActionsTest-436489484 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ca28051e-a4a0-4af4-b86e-9ac2f3ec4eee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:49:08 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-353b3564-5dfb-4209-9866-fbc64697fe08 tempest-VolumesActionsTest-436489484 None] Flow 'volume_create_manager' (30c73d3b-e5a6-4192-88c4-263e140cebcb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 11:49:08 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-353b3564-5dfb-4209-9866-fbc64697fe08 tempest-VolumesActionsTest-436489484 None] Created volume successfully. Nov 06 11:49:08 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-e95d7b42-de1c-4d84-b1a7-667cc0deeccb tempest-SnapshotsActionsTest-1557067016 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 11:49:08 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-e95d7b42-de1c-4d84-b1a7-667cc0deeccb tempest-SnapshotsActionsTest-1557067016 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 11:49:08 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-e95d7b42-de1c-4d84-b1a7-667cc0deeccb tempest-SnapshotsActionsTest-1557067016 None] Creating offline snapshot 5ccb07ba-7a6d-46f7-98e2-45c5eaa6fd7f of volume b7f1d205-2e2b-4d84-bfa7-d51dfc5207ad {{(pid=87116) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 06 11:49:09 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bbfa7dd-0d09-4cc7-8d83-d18953c43aa3]: (4, 'qcow2') {{(pid=88420) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 11:49:09 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-e95d7b42-de1c-4d84-b1a7-667cc0deeccb tempest-SnapshotsActionsTest-1557067016 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-b7f1d205-2e2b-4d84-bfa7-d51dfc5207ad.51fd54bf-7093-4f26-8442-79e90c6b48c7 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:49:09 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-daab2e9a-ce06-457d-9f1b-ee1b499b2b64 tempest-VolumesActionsTest-1095804482 None] Acquiring lock "cinder-d82e7aec-a0c2-4222-8a3d-52c210a72651-delete_volume" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 11:49:09 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-daab2e9a-ce06-457d-9f1b-ee1b499b2b64 tempest-VolumesActionsTest-1095804482 None] Lock "cinder-d82e7aec-a0c2-4222-8a3d-52c210a72651-delete_volume" acquired by "delete_volume" :: waited 0.064s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 11:49:09 devstack sudo[95350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-b7f1d205-2e2b-4d84-bfa7-d51dfc5207ad.51fd54bf-7093-4f26-8442-79e90c6b48c7 Nov 06 11:49:09 devstack sudo[95350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:49:09 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-daab2e9a-ce06-457d-9f1b-ee1b499b2b64 tempest-VolumesActionsTest-1095804482 None] Acquiring lock "cinder-quobyte-d82e7aec-a0c2-4222-8a3d-52c210a72651" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 11:49:09 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-daab2e9a-ce06-457d-9f1b-ee1b499b2b64 tempest-VolumesActionsTest-1095804482 None] Lock "cinder-quobyte-d82e7aec-a0c2-4222-8a3d-52c210a72651" acquired by "delete_volume" :: waited 0.046s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 11:49:09 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[1535571e-9658-4418-b20d-8cc4448a5f23]: (4, 'qcow2') {{(pid=88420) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 11:49:09 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-daab2e9a-ce06-457d-9f1b-ee1b499b2b64 tempest-VolumesActionsTest-1095804482 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-d82e7aec-a0c2-4222-8a3d-52c210a72651 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:49:09 devstack sudo[95352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-d82e7aec-a0c2-4222-8a3d-52c210a72651 Nov 06 11:49:09 devstack sudo[95352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:49:09 devstack sudo[95350]: pam_unix(sudo:session): session closed for user root Nov 06 11:49:09 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-e95d7b42-de1c-4d84-b1a7-667cc0deeccb tempest-SnapshotsActionsTest-1557067016 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-b7f1d205-2e2b-4d84-bfa7-d51dfc5207ad.51fd54bf-7093-4f26-8442-79e90c6b48c7" returned: 0 in 0.811s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:49:09 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-e95d7b42-de1c-4d84-b1a7-667cc0deeccb tempest-SnapshotsActionsTest-1557067016 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b7f1d205-2e2b-4d84-bfa7-d51dfc5207ad(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87116) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 11:49:09 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-e95d7b42-de1c-4d84-b1a7-667cc0deeccb tempest-SnapshotsActionsTest-1557067016 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-b7f1d205-2e2b-4d84-bfa7-d51dfc5207ad.51fd54bf-7093-4f26-8442-79e90c6b48c7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-b7f1d205-2e2b-4d84-bfa7-d51dfc5207ad.5ccb07ba-7a6d-46f7-98e2-45c5eaa6fd7f 1G {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:49:09 devstack sudo[95360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-b7f1d205-2e2b-4d84-bfa7-d51dfc5207ad.51fd54bf-7093-4f26-8442-79e90c6b48c7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-b7f1d205-2e2b-4d84-bfa7-d51dfc5207ad.5ccb07ba-7a6d-46f7-98e2-45c5eaa6fd7f 1G Nov 06 11:49:09 devstack sudo[95360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:49:09 devstack sudo[95352]: pam_unix(sudo:session): session closed for user root Nov 06 11:49:09 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-daab2e9a-ce06-457d-9f1b-ee1b499b2b64 tempest-VolumesActionsTest-1095804482 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-d82e7aec-a0c2-4222-8a3d-52c210a72651" returned: 0 in 0.486s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:49:09 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-daab2e9a-ce06-457d-9f1b-ee1b499b2b64 tempest-VolumesActionsTest-1095804482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-d82e7aec-a0c2-4222-8a3d-52c210a72651 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:49:09 devstack sudo[95362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-d82e7aec-a0c2-4222-8a3d-52c210a72651 Nov 06 11:49:09 devstack sudo[95362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:49:10 devstack sudo[95362]: pam_unix(sudo:session): session closed for user root Nov 06 11:49:10 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-daab2e9a-ce06-457d-9f1b-ee1b499b2b64 tempest-VolumesActionsTest-1095804482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-d82e7aec-a0c2-4222-8a3d-52c210a72651" returned: 0 in 0.259s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:49:10 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-daab2e9a-ce06-457d-9f1b-ee1b499b2b64 tempest-VolumesActionsTest-1095804482 None] Lock "cinder-quobyte-d82e7aec-a0c2-4222-8a3d-52c210a72651" released by "delete_volume" :: held 0.836s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 11:49:10 devstack cinder-volume[87116]: DEBUG cinder.quota [None req-daab2e9a-ce06-457d-9f1b-ee1b499b2b64 tempest-VolumesActionsTest-1095804482 None] Created reservations ['3fe02d4a-74e8-483e-a23a-03a97044b9b5', '2e1feab8-68ad-4232-9b32-988c6a7c740e', '1dd822f6-5fe8-4531-8ac2-b13da1bb6407', '6ce81a56-719f-466a-a690-68faa58d93d9'] {{(pid=87116) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 11:49:10 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-daab2e9a-ce06-457d-9f1b-ee1b499b2b64 tempest-VolumesActionsTest-1095804482 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 11:49:10 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-daab2e9a-ce06-457d-9f1b-ee1b499b2b64 tempest-VolumesActionsTest-1095804482 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 11:49:10 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-daab2e9a-ce06-457d-9f1b-ee1b499b2b64 tempest-VolumesActionsTest-1095804482 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 11:49:10 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-daab2e9a-ce06-457d-9f1b-ee1b499b2b64 tempest-VolumesActionsTest-1095804482 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 11:49:10 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-daab2e9a-ce06-457d-9f1b-ee1b499b2b64 tempest-VolumesActionsTest-1095804482 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 11:49:10 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-daab2e9a-ce06-457d-9f1b-ee1b499b2b64 tempest-VolumesActionsTest-1095804482 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:49:10 devstack sudo[95360]: pam_unix(sudo:session): session closed for user root Nov 06 11:49:10 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-e95d7b42-de1c-4d84-b1a7-667cc0deeccb tempest-SnapshotsActionsTest-1557067016 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-b7f1d205-2e2b-4d84-bfa7-d51dfc5207ad.51fd54bf-7093-4f26-8442-79e90c6b48c7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-b7f1d205-2e2b-4d84-bfa7-d51dfc5207ad.5ccb07ba-7a6d-46f7-98e2-45c5eaa6fd7f 1G" returned: 0 in 0.523s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:49:10 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-e95d7b42-de1c-4d84-b1a7-667cc0deeccb tempest-SnapshotsActionsTest-1557067016 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b7f1d205-2e2b-4d84-bfa7-d51dfc5207ad.51fd54bf-7093-4f26-8442-79e90c6b48c7 -F qcow2 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-b7f1d205-2e2b-4d84-bfa7-d51dfc5207ad.5ccb07ba-7a6d-46f7-98e2-45c5eaa6fd7f {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:49:10 devstack sudo[95369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756 Nov 06 11:49:10 devstack sudo[95369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:49:10 devstack sudo[95370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b7f1d205-2e2b-4d84-bfa7-d51dfc5207ad.51fd54bf-7093-4f26-8442-79e90c6b48c7 -F qcow2 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-b7f1d205-2e2b-4d84-bfa7-d51dfc5207ad.5ccb07ba-7a6d-46f7-98e2-45c5eaa6fd7f Nov 06 11:49:10 devstack sudo[95370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:49:10 devstack sudo[95369]: pam_unix(sudo:session): session closed for user root Nov 06 11:49:10 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-daab2e9a-ce06-457d-9f1b-ee1b499b2b64 tempest-VolumesActionsTest-1095804482 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756" returned: 0 in 0.363s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:49:10 devstack cinder-volume[87116]: DEBUG cinder.manager [None req-daab2e9a-ce06-457d-9f1b-ee1b499b2b64 tempest-VolumesActionsTest-1095804482 None] Notifying Schedulers of capabilities ... {{(pid=87116) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 11:49:10 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-daab2e9a-ce06-457d-9f1b-ee1b499b2b64 tempest-VolumesActionsTest-1095804482 None] Deleted volume successfully. Nov 06 11:49:10 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-daab2e9a-ce06-457d-9f1b-ee1b499b2b64 tempest-VolumesActionsTest-1095804482 None] Lock "cinder-d82e7aec-a0c2-4222-8a3d-52c210a72651-delete_volume" released by "delete_volume" :: held 1.556s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 11:49:10 devstack sudo[95370]: pam_unix(sudo:session): session closed for user root Nov 06 11:49:10 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-e95d7b42-de1c-4d84-b1a7-667cc0deeccb tempest-SnapshotsActionsTest-1557067016 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b7f1d205-2e2b-4d84-bfa7-d51dfc5207ad.51fd54bf-7093-4f26-8442-79e90c6b48c7 -F qcow2 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-b7f1d205-2e2b-4d84-bfa7-d51dfc5207ad.5ccb07ba-7a6d-46f7-98e2-45c5eaa6fd7f" returned: 0 in 0.477s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:49:10 devstack cinder-volume[87116]: WARNING cinder.volume.drivers.remotefs [None req-e95d7b42-de1c-4d84-b1a7-667cc0deeccb tempest-SnapshotsActionsTest-1557067016 None] /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-b7f1d205-2e2b-4d84-bfa7-d51dfc5207ad.5ccb07ba-7a6d-46f7-98e2-45c5eaa6fd7f is being set with open permissions: ugo+rw Nov 06 11:49:10 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-e95d7b42-de1c-4d84-b1a7-667cc0deeccb tempest-SnapshotsActionsTest-1557067016 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-b7f1d205-2e2b-4d84-bfa7-d51dfc5207ad.5ccb07ba-7a6d-46f7-98e2-45c5eaa6fd7f {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:49:10 devstack sudo[95377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-b7f1d205-2e2b-4d84-bfa7-d51dfc5207ad.5ccb07ba-7a6d-46f7-98e2-45c5eaa6fd7f Nov 06 11:49:10 devstack sudo[95377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:49:11 devstack sudo[95377]: pam_unix(sudo:session): session closed for user root Nov 06 11:49:11 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-e95d7b42-de1c-4d84-b1a7-667cc0deeccb tempest-SnapshotsActionsTest-1557067016 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-b7f1d205-2e2b-4d84-bfa7-d51dfc5207ad.5ccb07ba-7a6d-46f7-98e2-45c5eaa6fd7f" returned: 0 in 0.409s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:49:11 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-e95d7b42-de1c-4d84-b1a7-667cc0deeccb tempest-SnapshotsActionsTest-1557067016 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.574s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 11:49:11 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-e95d7b42-de1c-4d84-b1a7-667cc0deeccb tempest-SnapshotsActionsTest-1557067016 None] Create snapshot completed successfully Nov 06 11:49:11 devstack cinder-volume[87116]: DEBUG cinder.volume.flows.manager.create_volume [None req-90aa1a02-3483-4061-b017-a204d2c98841 tempest-VolumesActionsTest-436489484 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87116) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 11:49:11 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-90aa1a02-3483-4061-b017-a204d2c98841 tempest-VolumesActionsTest-436489484 None] Flow 'volume_create_manager' (bc74e178-4a73-4aea-ae8b-48b65fa9333c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 11:49:11 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-90aa1a02-3483-4061-b017-a204d2c98841 tempest-VolumesActionsTest-436489484 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (43cd4db8-8fd3-4b2b-85e2-f2e04aa75f30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:49:11 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-90aa1a02-3483-4061-b017-a204d2c98841 tempest-VolumesActionsTest-436489484 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (43cd4db8-8fd3-4b2b-85e2-f2e04aa75f30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T10:49:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1113955691',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=24740704-7a1e-488d-bfa6-4e0767e56eb6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2bcba42d552e466987396405a7bcb7d3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T10:49:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T10:49:11Z,use_quota=True,user_id='9902e935e3b0434bad8989e8c0ae447e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(34d3b144-d9b7-480a-a2e3-01e45f3d54c1),volume_type_id=34d3b144-d9b7-480a-a2e3-01e45f3d54c1)' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:49:11 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-90aa1a02-3483-4061-b017-a204d2c98841 tempest-VolumesActionsTest-436489484 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7e6f4336-2ff8-4491-afcc-e0b675c4dd7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:49:11 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-90aa1a02-3483-4061-b017-a204d2c98841 tempest-VolumesActionsTest-436489484 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7e6f4336-2ff8-4491-afcc-e0b675c4dd7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:49:11 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-90aa1a02-3483-4061-b017-a204d2c98841 tempest-VolumesActionsTest-436489484 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1823deb3-26db-4035-8c96-19a61ffa601c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:49:11 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-90aa1a02-3483-4061-b017-a204d2c98841 tempest-VolumesActionsTest-436489484 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1823deb3-26db-4035-8c96-19a61ffa601c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '24740704-7a1e-488d-bfa6-4e0767e56eb6', 'volume_name': 'volume-24740704-7a1e-488d-bfa6-4e0767e56eb6', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:49:11 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-90aa1a02-3483-4061-b017-a204d2c98841 tempest-VolumesActionsTest-436489484 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9504cf7e-d47b-4bcc-b091-36182d265194) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:49:11 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-90aa1a02-3483-4061-b017-a204d2c98841 tempest-VolumesActionsTest-436489484 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9504cf7e-d47b-4bcc-b091-36182d265194) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:49:11 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-90aa1a02-3483-4061-b017-a204d2c98841 tempest-VolumesActionsTest-436489484 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6ad6a4be-ae40-40a8-93e8-24cf51ec5888) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:49:11 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-90aa1a02-3483-4061-b017-a204d2c98841 tempest-VolumesActionsTest-436489484 None] Volume 24740704-7a1e-488d-bfa6-4e0767e56eb6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-24740704-7a1e-488d-bfa6-4e0767e56eb6', 'volume_size': 1} Nov 06 11:49:11 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-90aa1a02-3483-4061-b017-a204d2c98841 tempest-VolumesActionsTest-436489484 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 11:49:11 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-90aa1a02-3483-4061-b017-a204d2c98841 tempest-VolumesActionsTest-436489484 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 11:49:11 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-90aa1a02-3483-4061-b017-a204d2c98841 tempest-VolumesActionsTest-436489484 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T10:49:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1113955691',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=24740704-7a1e-488d-bfa6-4e0767e56eb6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2bcba42d552e466987396405a7bcb7d3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T10:49:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T10:49:11Z,use_quota=True,user_id='9902e935e3b0434bad8989e8c0ae447e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(34d3b144-d9b7-480a-a2e3-01e45f3d54c1),volume_type_id=34d3b144-d9b7-480a-a2e3-01e45f3d54c1)}" {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 11:49:11 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-90aa1a02-3483-4061-b017-a204d2c98841 tempest-VolumesActionsTest-436489484 None] Creating volume 24740704-7a1e-488d-bfa6-4e0767e56eb6 {{(pid=87116) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 11:49:11 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-90aa1a02-3483-4061-b017-a204d2c98841 tempest-VolumesActionsTest-436489484 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 11:49:11 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-90aa1a02-3483-4061-b017-a204d2c98841 tempest-VolumesActionsTest-436489484 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 11:49:11 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-90aa1a02-3483-4061-b017-a204d2c98841 tempest-VolumesActionsTest-436489484 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 11:49:11 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-90aa1a02-3483-4061-b017-a204d2c98841 tempest-VolumesActionsTest-436489484 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 11:49:11 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-90aa1a02-3483-4061-b017-a204d2c98841 tempest-VolumesActionsTest-436489484 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 11:49:11 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-90aa1a02-3483-4061-b017-a204d2c98841 tempest-VolumesActionsTest-436489484 None] Selected osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f as target Quobyte volume. {{(pid=87116) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 11:49:11 devstack cinder-volume[87116]: INFO cinder.volume.drivers.remotefs [None req-90aa1a02-3483-4061-b017-a204d2c98841 tempest-VolumesActionsTest-436489484 None] casted to osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f Nov 06 11:49:11 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-90aa1a02-3483-4061-b017-a204d2c98841 tempest-VolumesActionsTest-436489484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-24740704-7a1e-488d-bfa6-4e0767e56eb6 1073741824 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:49:11 devstack sudo[95380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-24740704-7a1e-488d-bfa6-4e0767e56eb6 1073741824 Nov 06 11:49:11 devstack sudo[95380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:49:12 devstack sudo[95380]: pam_unix(sudo:session): session closed for user root Nov 06 11:49:12 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-90aa1a02-3483-4061-b017-a204d2c98841 tempest-VolumesActionsTest-436489484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-24740704-7a1e-488d-bfa6-4e0767e56eb6 1073741824" returned: 0 in 0.498s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:49:12 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-fbe5b298-8c61-4632-a141-992173b91de8 tempest-SnapshotsActionsTest-1582719017 None] Acquiring lock "cinder-5ccb07ba-7a6d-46f7-98e2-45c5eaa6fd7f-delete_snapshot" by "delete_snapshot" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 11:49:12 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-fbe5b298-8c61-4632-a141-992173b91de8 tempest-SnapshotsActionsTest-1582719017 None] Lock "cinder-5ccb07ba-7a6d-46f7-98e2-45c5eaa6fd7f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.045s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 11:49:12 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-fbe5b298-8c61-4632-a141-992173b91de8 tempest-SnapshotsActionsTest-1582719017 None] Acquiring lock "cinder-quobyte-b7f1d205-2e2b-4d84-bfa7-d51dfc5207ad" by "delete_snapshot" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 11:49:12 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-90aa1a02-3483-4061-b017-a204d2c98841 tempest-VolumesActionsTest-436489484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-24740704-7a1e-488d-bfa6-4e0767e56eb6 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:49:12 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-fbe5b298-8c61-4632-a141-992173b91de8 tempest-SnapshotsActionsTest-1582719017 None] Lock "cinder-quobyte-b7f1d205-2e2b-4d84-bfa7-d51dfc5207ad" acquired by "delete_snapshot" :: waited 0.042s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 11:49:12 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-fbe5b298-8c61-4632-a141-992173b91de8 tempest-SnapshotsActionsTest-1582719017 None] Acquiring lock "cinder-quobyte-5ccb07ba-7a6d-46f7-98e2-45c5eaa6fd7f" by "_delete_snapshot" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 11:49:12 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-fbe5b298-8c61-4632-a141-992173b91de8 tempest-SnapshotsActionsTest-1582719017 None] Lock "cinder-quobyte-5ccb07ba-7a6d-46f7-98e2-45c5eaa6fd7f" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 11:49:12 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-fbe5b298-8c61-4632-a141-992173b91de8 tempest-SnapshotsActionsTest-1582719017 None] Deleting offline snapshot 5ccb07ba-7a6d-46f7-98e2-45c5eaa6fd7f of volume b7f1d205-2e2b-4d84-bfa7-d51dfc5207ad {{(pid=87116) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 06 11:49:12 devstack sudo[95388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-24740704-7a1e-488d-bfa6-4e0767e56eb6 Nov 06 11:49:12 devstack sudo[95388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:49:12 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-fbe5b298-8c61-4632-a141-992173b91de8 tempest-SnapshotsActionsTest-1582719017 None] snapshot_file for this snap is: volume-b7f1d205-2e2b-4d84-bfa7-d51dfc5207ad.5ccb07ba-7a6d-46f7-98e2-45c5eaa6fd7f {{(pid=87116) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 06 11:49:12 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[14e190d1-46d1-4e56-a021-09740187adf4]: (4, 'qcow2') {{(pid=88420) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 11:49:12 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-fbe5b298-8c61-4632-a141-992173b91de8 tempest-SnapshotsActionsTest-1582719017 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-b7f1d205-2e2b-4d84-bfa7-d51dfc5207ad.5ccb07ba-7a6d-46f7-98e2-45c5eaa6fd7f {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:49:12 devstack sudo[95390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-b7f1d205-2e2b-4d84-bfa7-d51dfc5207ad.5ccb07ba-7a6d-46f7-98e2-45c5eaa6fd7f Nov 06 11:49:12 devstack sudo[95390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:49:12 devstack sudo[95388]: pam_unix(sudo:session): session closed for user root Nov 06 11:49:12 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-90aa1a02-3483-4061-b017-a204d2c98841 tempest-VolumesActionsTest-436489484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-24740704-7a1e-488d-bfa6-4e0767e56eb6" returned: 0 in 0.427s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:49:12 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-90aa1a02-3483-4061-b017-a204d2c98841 tempest-VolumesActionsTest-436489484 None] <== create_volume: return (1035ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f'} {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 11:49:12 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-90aa1a02-3483-4061-b017-a204d2c98841 tempest-VolumesActionsTest-436489484 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.037s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 11:49:12 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-90aa1a02-3483-4061-b017-a204d2c98841 tempest-VolumesActionsTest-436489484 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6ad6a4be-ae40-40a8-93e8-24cf51ec5888) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-24740704-7a1e-488d-bfa6-4e0767e56eb6', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:49:12 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-90aa1a02-3483-4061-b017-a204d2c98841 tempest-VolumesActionsTest-436489484 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf0ca931-a250-444d-ad7e-6678889b3d7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:49:12 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-90aa1a02-3483-4061-b017-a204d2c98841 tempest-VolumesActionsTest-436489484 None] Volume volume-24740704-7a1e-488d-bfa6-4e0767e56eb6 (24740704-7a1e-488d-bfa6-4e0767e56eb6): created successfully Nov 06 11:49:12 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-90aa1a02-3483-4061-b017-a204d2c98841 tempest-VolumesActionsTest-436489484 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf0ca931-a250-444d-ad7e-6678889b3d7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:49:12 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-90aa1a02-3483-4061-b017-a204d2c98841 tempest-VolumesActionsTest-436489484 None] Flow 'volume_create_manager' (bc74e178-4a73-4aea-ae8b-48b65fa9333c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 11:49:12 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-90aa1a02-3483-4061-b017-a204d2c98841 tempest-VolumesActionsTest-436489484 None] Created volume successfully. Nov 06 11:49:12 devstack sudo[95390]: pam_unix(sudo:session): session closed for user root Nov 06 11:49:12 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-fbe5b298-8c61-4632-a141-992173b91de8 tempest-SnapshotsActionsTest-1582719017 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-b7f1d205-2e2b-4d84-bfa7-d51dfc5207ad.5ccb07ba-7a6d-46f7-98e2-45c5eaa6fd7f" returned: 0 in 0.481s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:49:12 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-fbe5b298-8c61-4632-a141-992173b91de8 tempest-SnapshotsActionsTest-1582719017 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b7f1d205-2e2b-4d84-bfa7-d51dfc5207ad(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87116) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 11:49:12 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[5917f459-86e2-43c5-9372-6a3cae893119]: (4, 'qcow2') {{(pid=88420) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 11:49:12 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-fbe5b298-8c61-4632-a141-992173b91de8 tempest-SnapshotsActionsTest-1582719017 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-b7f1d205-2e2b-4d84-bfa7-d51dfc5207ad.51fd54bf-7093-4f26-8442-79e90c6b48c7 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:49:12 devstack sudo[95396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-b7f1d205-2e2b-4d84-bfa7-d51dfc5207ad.51fd54bf-7093-4f26-8442-79e90c6b48c7 Nov 06 11:49:12 devstack sudo[95396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:49:13 devstack sudo[95396]: pam_unix(sudo:session): session closed for user root Nov 06 11:49:13 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-fbe5b298-8c61-4632-a141-992173b91de8 tempest-SnapshotsActionsTest-1582719017 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-b7f1d205-2e2b-4d84-bfa7-d51dfc5207ad.51fd54bf-7093-4f26-8442-79e90c6b48c7" returned: 0 in 0.442s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:49:13 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-fbe5b298-8c61-4632-a141-992173b91de8 tempest-SnapshotsActionsTest-1582719017 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b7f1d205-2e2b-4d84-bfa7-d51dfc5207ad(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87116) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 11:49:13 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-fbe5b298-8c61-4632-a141-992173b91de8 tempest-SnapshotsActionsTest-1582719017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-b7f1d205-2e2b-4d84-bfa7-d51dfc5207ad.5ccb07ba-7a6d-46f7-98e2-45c5eaa6fd7f {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:49:13 devstack sudo[95421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-b7f1d205-2e2b-4d84-bfa7-d51dfc5207ad.5ccb07ba-7a6d-46f7-98e2-45c5eaa6fd7f Nov 06 11:49:13 devstack sudo[95421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:49:13 devstack sudo[95421]: pam_unix(sudo:session): session closed for user root Nov 06 11:49:13 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-fbe5b298-8c61-4632-a141-992173b91de8 tempest-SnapshotsActionsTest-1582719017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-b7f1d205-2e2b-4d84-bfa7-d51dfc5207ad.5ccb07ba-7a6d-46f7-98e2-45c5eaa6fd7f" returned: 0 in 0.458s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:49:13 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-fbe5b298-8c61-4632-a141-992173b91de8 tempest-SnapshotsActionsTest-1582719017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-b7f1d205-2e2b-4d84-bfa7-d51dfc5207ad.5ccb07ba-7a6d-46f7-98e2-45c5eaa6fd7f {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:49:13 devstack sudo[95427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-b7f1d205-2e2b-4d84-bfa7-d51dfc5207ad.5ccb07ba-7a6d-46f7-98e2-45c5eaa6fd7f Nov 06 11:49:13 devstack sudo[95427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:49:13 devstack sudo[95427]: pam_unix(sudo:session): session closed for user root Nov 06 11:49:13 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-fbe5b298-8c61-4632-a141-992173b91de8 tempest-SnapshotsActionsTest-1582719017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-b7f1d205-2e2b-4d84-bfa7-d51dfc5207ad.5ccb07ba-7a6d-46f7-98e2-45c5eaa6fd7f" returned: 0 in 0.280s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:49:13 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-fbe5b298-8c61-4632-a141-992173b91de8 tempest-SnapshotsActionsTest-1582719017 None] Lock "cinder-quobyte-5ccb07ba-7a6d-46f7-98e2-45c5eaa6fd7f" released by "_delete_snapshot" :: held 1.783s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 11:49:13 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-fbe5b298-8c61-4632-a141-992173b91de8 tempest-SnapshotsActionsTest-1582719017 None] Lock "cinder-quobyte-b7f1d205-2e2b-4d84-bfa7-d51dfc5207ad" released by "delete_snapshot" :: held 1.824s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 11:49:14 devstack cinder-volume[87116]: DEBUG cinder.quota [None req-fbe5b298-8c61-4632-a141-992173b91de8 tempest-SnapshotsActionsTest-1582719017 None] Created reservations ['06c65170-4818-44e2-a28e-4ea473e482b4', 'be279c08-a81f-43a3-aaff-e264efad23f7', 'fc35ed42-dd16-4e44-b10c-cbf7ab760dc2', '2f11b867-1ee2-44b2-ba2a-268311f8f8db'] {{(pid=87116) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 11:49:14 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-fbe5b298-8c61-4632-a141-992173b91de8 tempest-SnapshotsActionsTest-1582719017 None] Delete snapshot completed successfully. Nov 06 11:49:14 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-fbe5b298-8c61-4632-a141-992173b91de8 tempest-SnapshotsActionsTest-1582719017 None] Lock "cinder-5ccb07ba-7a6d-46f7-98e2-45c5eaa6fd7f-delete_snapshot" released by "delete_snapshot" :: held 2.031s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 11:49:14 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-1ad21eb7-1149-45b4-b993-97252bd07afc tempest-VolumesActionsTest-436489484 None] Acquiring lock "cinder-24740704-7a1e-488d-bfa6-4e0767e56eb6-delete_volume" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 11:49:14 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-1ad21eb7-1149-45b4-b993-97252bd07afc tempest-VolumesActionsTest-436489484 None] Lock "cinder-24740704-7a1e-488d-bfa6-4e0767e56eb6-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 11:49:14 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-1ad21eb7-1149-45b4-b993-97252bd07afc tempest-VolumesActionsTest-436489484 None] Acquiring lock "cinder-quobyte-24740704-7a1e-488d-bfa6-4e0767e56eb6" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 11:49:14 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-1ad21eb7-1149-45b4-b993-97252bd07afc tempest-VolumesActionsTest-436489484 None] Lock "cinder-quobyte-24740704-7a1e-488d-bfa6-4e0767e56eb6" acquired by "delete_volume" :: waited 0.021s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 11:49:14 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[16c1e707-9ad8-4556-870b-550ffad826bd]: (4, 'qcow2') {{(pid=88420) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 11:49:14 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-1ad21eb7-1149-45b4-b993-97252bd07afc tempest-VolumesActionsTest-436489484 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-24740704-7a1e-488d-bfa6-4e0767e56eb6 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:49:14 devstack sudo[95430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-24740704-7a1e-488d-bfa6-4e0767e56eb6 Nov 06 11:49:14 devstack sudo[95430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:49:14 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-0a982ee4-96db-4b50-9588-db65a492c67b tempest-SnapshotsActionsTest-1557067016 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 11:49:14 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-0a982ee4-96db-4b50-9588-db65a492c67b tempest-SnapshotsActionsTest-1557067016 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 11:49:14 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-0a982ee4-96db-4b50-9588-db65a492c67b tempest-SnapshotsActionsTest-1557067016 None] Creating offline snapshot c5a039d6-eeff-4813-8639-8e1f01f40442 of volume b7f1d205-2e2b-4d84-bfa7-d51dfc5207ad {{(pid=87116) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 06 11:49:14 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[b510311f-5b27-4af1-8a4e-632cfdc8a3ef]: (4, 'qcow2') {{(pid=88420) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 11:49:14 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-0a982ee4-96db-4b50-9588-db65a492c67b tempest-SnapshotsActionsTest-1557067016 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-b7f1d205-2e2b-4d84-bfa7-d51dfc5207ad.51fd54bf-7093-4f26-8442-79e90c6b48c7 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:49:14 devstack sudo[95430]: pam_unix(sudo:session): session closed for user root Nov 06 11:49:14 devstack sudo[95432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-b7f1d205-2e2b-4d84-bfa7-d51dfc5207ad.51fd54bf-7093-4f26-8442-79e90c6b48c7 Nov 06 11:49:14 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-1ad21eb7-1149-45b4-b993-97252bd07afc tempest-VolumesActionsTest-436489484 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-24740704-7a1e-488d-bfa6-4e0767e56eb6" returned: 0 in 0.411s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:49:14 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-1ad21eb7-1149-45b4-b993-97252bd07afc tempest-VolumesActionsTest-436489484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-24740704-7a1e-488d-bfa6-4e0767e56eb6 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:49:14 devstack sudo[95432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:49:14 devstack sudo[95438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-24740704-7a1e-488d-bfa6-4e0767e56eb6 Nov 06 11:49:14 devstack sudo[95438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:49:14 devstack sudo[95432]: pam_unix(sudo:session): session closed for user root Nov 06 11:49:14 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-0a982ee4-96db-4b50-9588-db65a492c67b tempest-SnapshotsActionsTest-1557067016 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-b7f1d205-2e2b-4d84-bfa7-d51dfc5207ad.51fd54bf-7093-4f26-8442-79e90c6b48c7" returned: 0 in 0.373s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:49:14 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-0a982ee4-96db-4b50-9588-db65a492c67b tempest-SnapshotsActionsTest-1557067016 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b7f1d205-2e2b-4d84-bfa7-d51dfc5207ad(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87116) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 11:49:14 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-0a982ee4-96db-4b50-9588-db65a492c67b tempest-SnapshotsActionsTest-1557067016 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-b7f1d205-2e2b-4d84-bfa7-d51dfc5207ad.51fd54bf-7093-4f26-8442-79e90c6b48c7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-b7f1d205-2e2b-4d84-bfa7-d51dfc5207ad.c5a039d6-eeff-4813-8639-8e1f01f40442 1G {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:49:15 devstack sudo[95438]: pam_unix(sudo:session): session closed for user root Nov 06 11:49:15 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-1ad21eb7-1149-45b4-b993-97252bd07afc tempest-VolumesActionsTest-436489484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-24740704-7a1e-488d-bfa6-4e0767e56eb6" returned: 0 in 0.269s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:49:15 devstack sudo[95444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-b7f1d205-2e2b-4d84-bfa7-d51dfc5207ad.51fd54bf-7093-4f26-8442-79e90c6b48c7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-b7f1d205-2e2b-4d84-bfa7-d51dfc5207ad.c5a039d6-eeff-4813-8639-8e1f01f40442 1G Nov 06 11:49:15 devstack sudo[95444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:49:15 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-1ad21eb7-1149-45b4-b993-97252bd07afc tempest-VolumesActionsTest-436489484 None] Lock "cinder-quobyte-24740704-7a1e-488d-bfa6-4e0767e56eb6" released by "delete_volume" :: held 0.731s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 11:49:15 devstack cinder-volume[87116]: DEBUG cinder.quota [None req-1ad21eb7-1149-45b4-b993-97252bd07afc tempest-VolumesActionsTest-436489484 None] Created reservations ['ff644abd-b6d2-4e14-bd2f-2060bcb4b301', 'adc7e159-4ded-4b31-8ba5-5ea35f062c87', '9b73ac02-a96e-43ec-8fab-2310e0a27dee', '347085dc-b1c6-4178-826a-83af9968f4ad'] {{(pid=87116) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 11:49:15 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-1ad21eb7-1149-45b4-b993-97252bd07afc tempest-VolumesActionsTest-436489484 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 11:49:15 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-1ad21eb7-1149-45b4-b993-97252bd07afc tempest-VolumesActionsTest-436489484 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 11:49:15 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-1ad21eb7-1149-45b4-b993-97252bd07afc tempest-VolumesActionsTest-436489484 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 11:49:15 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-1ad21eb7-1149-45b4-b993-97252bd07afc tempest-VolumesActionsTest-436489484 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 11:49:15 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-1ad21eb7-1149-45b4-b993-97252bd07afc tempest-VolumesActionsTest-436489484 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 11:49:15 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-1ad21eb7-1149-45b4-b993-97252bd07afc tempest-VolumesActionsTest-436489484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:49:15 devstack sudo[95446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756 Nov 06 11:49:15 devstack sudo[95446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:49:15 devstack sudo[95446]: pam_unix(sudo:session): session closed for user root Nov 06 11:49:15 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-1ad21eb7-1149-45b4-b993-97252bd07afc tempest-VolumesActionsTest-436489484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756" returned: 0 in 0.290s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:49:15 devstack cinder-volume[87116]: DEBUG cinder.manager [None req-1ad21eb7-1149-45b4-b993-97252bd07afc tempest-VolumesActionsTest-436489484 None] Notifying Schedulers of capabilities ... {{(pid=87116) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 11:49:15 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-1ad21eb7-1149-45b4-b993-97252bd07afc tempest-VolumesActionsTest-436489484 None] Deleted volume successfully. Nov 06 11:49:15 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-1ad21eb7-1149-45b4-b993-97252bd07afc tempest-VolumesActionsTest-436489484 None] Lock "cinder-24740704-7a1e-488d-bfa6-4e0767e56eb6-delete_volume" released by "delete_volume" :: held 1.278s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 11:49:15 devstack sudo[95444]: pam_unix(sudo:session): session closed for user root Nov 06 11:49:15 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-0a982ee4-96db-4b50-9588-db65a492c67b tempest-SnapshotsActionsTest-1557067016 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-b7f1d205-2e2b-4d84-bfa7-d51dfc5207ad.51fd54bf-7093-4f26-8442-79e90c6b48c7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-b7f1d205-2e2b-4d84-bfa7-d51dfc5207ad.c5a039d6-eeff-4813-8639-8e1f01f40442 1G" returned: 0 in 0.515s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:49:15 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-0a982ee4-96db-4b50-9588-db65a492c67b tempest-SnapshotsActionsTest-1557067016 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b7f1d205-2e2b-4d84-bfa7-d51dfc5207ad.51fd54bf-7093-4f26-8442-79e90c6b48c7 -F qcow2 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-b7f1d205-2e2b-4d84-bfa7-d51dfc5207ad.c5a039d6-eeff-4813-8639-8e1f01f40442 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:49:15 devstack sudo[95452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b7f1d205-2e2b-4d84-bfa7-d51dfc5207ad.51fd54bf-7093-4f26-8442-79e90c6b48c7 -F qcow2 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-b7f1d205-2e2b-4d84-bfa7-d51dfc5207ad.c5a039d6-eeff-4813-8639-8e1f01f40442 Nov 06 11:49:15 devstack sudo[95452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:49:15 devstack sudo[95452]: pam_unix(sudo:session): session closed for user root Nov 06 11:49:15 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-0a982ee4-96db-4b50-9588-db65a492c67b tempest-SnapshotsActionsTest-1557067016 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b7f1d205-2e2b-4d84-bfa7-d51dfc5207ad.51fd54bf-7093-4f26-8442-79e90c6b48c7 -F qcow2 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-b7f1d205-2e2b-4d84-bfa7-d51dfc5207ad.c5a039d6-eeff-4813-8639-8e1f01f40442" returned: 0 in 0.417s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:49:15 devstack cinder-volume[87116]: WARNING cinder.volume.drivers.remotefs [None req-0a982ee4-96db-4b50-9588-db65a492c67b tempest-SnapshotsActionsTest-1557067016 None] /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-b7f1d205-2e2b-4d84-bfa7-d51dfc5207ad.c5a039d6-eeff-4813-8639-8e1f01f40442 is being set with open permissions: ugo+rw Nov 06 11:49:15 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-0a982ee4-96db-4b50-9588-db65a492c67b tempest-SnapshotsActionsTest-1557067016 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-b7f1d205-2e2b-4d84-bfa7-d51dfc5207ad.c5a039d6-eeff-4813-8639-8e1f01f40442 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:49:15 devstack sudo[95457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-b7f1d205-2e2b-4d84-bfa7-d51dfc5207ad.c5a039d6-eeff-4813-8639-8e1f01f40442 Nov 06 11:49:15 devstack sudo[95457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:49:16 devstack sudo[95457]: pam_unix(sudo:session): session closed for user root Nov 06 11:49:16 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-0a982ee4-96db-4b50-9588-db65a492c67b tempest-SnapshotsActionsTest-1557067016 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-b7f1d205-2e2b-4d84-bfa7-d51dfc5207ad.c5a039d6-eeff-4813-8639-8e1f01f40442" returned: 0 in 0.280s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:49:16 devstack cinder-volume[87116]: DEBUG dbcounter [-] [87116] Writing DB stats cinder:SELECT=115,cinder:UPDATE=128,cinder:INSERT=32,cinder:DELETE=7 {{(pid=87116) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 11:49:16 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-0a982ee4-96db-4b50-9588-db65a492c67b tempest-SnapshotsActionsTest-1557067016 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.713s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 11:49:16 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-0a982ee4-96db-4b50-9588-db65a492c67b tempest-SnapshotsActionsTest-1557067016 None] Create snapshot completed successfully Nov 06 11:49:16 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-c1225615-c01a-42eb-acda-b2222dad584b tempest-SnapshotsActionsTest-1582719017 None] Acquiring lock "cinder-c5a039d6-eeff-4813-8639-8e1f01f40442-delete_snapshot" by "delete_snapshot" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 11:49:16 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-c1225615-c01a-42eb-acda-b2222dad584b tempest-SnapshotsActionsTest-1582719017 None] Lock "cinder-c5a039d6-eeff-4813-8639-8e1f01f40442-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 11:49:16 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-c1225615-c01a-42eb-acda-b2222dad584b tempest-SnapshotsActionsTest-1582719017 None] Acquiring lock "cinder-quobyte-b7f1d205-2e2b-4d84-bfa7-d51dfc5207ad" by "delete_snapshot" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 11:49:16 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-c1225615-c01a-42eb-acda-b2222dad584b tempest-SnapshotsActionsTest-1582719017 None] Lock "cinder-quobyte-b7f1d205-2e2b-4d84-bfa7-d51dfc5207ad" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 11:49:16 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-c1225615-c01a-42eb-acda-b2222dad584b tempest-SnapshotsActionsTest-1582719017 None] Acquiring lock "cinder-quobyte-c5a039d6-eeff-4813-8639-8e1f01f40442" by "_delete_snapshot" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 11:49:16 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-c1225615-c01a-42eb-acda-b2222dad584b tempest-SnapshotsActionsTest-1582719017 None] Lock "cinder-quobyte-c5a039d6-eeff-4813-8639-8e1f01f40442" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 11:49:16 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-c1225615-c01a-42eb-acda-b2222dad584b tempest-SnapshotsActionsTest-1582719017 None] Deleting offline snapshot c5a039d6-eeff-4813-8639-8e1f01f40442 of volume b7f1d205-2e2b-4d84-bfa7-d51dfc5207ad {{(pid=87116) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 06 11:49:16 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-c1225615-c01a-42eb-acda-b2222dad584b tempest-SnapshotsActionsTest-1582719017 None] snapshot_file for this snap is: volume-b7f1d205-2e2b-4d84-bfa7-d51dfc5207ad.c5a039d6-eeff-4813-8639-8e1f01f40442 {{(pid=87116) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 06 11:49:16 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d859103-58c5-4c9d-a611-e9f3b5eb39b9]: (4, 'qcow2') {{(pid=88420) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 11:49:16 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-c1225615-c01a-42eb-acda-b2222dad584b tempest-SnapshotsActionsTest-1582719017 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-b7f1d205-2e2b-4d84-bfa7-d51dfc5207ad.c5a039d6-eeff-4813-8639-8e1f01f40442 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:49:17 devstack sudo[95461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-b7f1d205-2e2b-4d84-bfa7-d51dfc5207ad.c5a039d6-eeff-4813-8639-8e1f01f40442 Nov 06 11:49:17 devstack sudo[95461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:49:17 devstack sudo[95461]: pam_unix(sudo:session): session closed for user root Nov 06 11:49:17 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-c1225615-c01a-42eb-acda-b2222dad584b tempest-SnapshotsActionsTest-1582719017 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-b7f1d205-2e2b-4d84-bfa7-d51dfc5207ad.c5a039d6-eeff-4813-8639-8e1f01f40442" returned: 0 in 0.410s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:49:17 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-c1225615-c01a-42eb-acda-b2222dad584b tempest-SnapshotsActionsTest-1582719017 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b7f1d205-2e2b-4d84-bfa7-d51dfc5207ad(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87116) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 11:49:17 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f2e24c5-fb58-43bb-bcf8-e2db61d01c61]: (4, 'qcow2') {{(pid=88420) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 11:49:17 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-c1225615-c01a-42eb-acda-b2222dad584b tempest-SnapshotsActionsTest-1582719017 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-b7f1d205-2e2b-4d84-bfa7-d51dfc5207ad.51fd54bf-7093-4f26-8442-79e90c6b48c7 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:49:17 devstack sudo[95466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-b7f1d205-2e2b-4d84-bfa7-d51dfc5207ad.51fd54bf-7093-4f26-8442-79e90c6b48c7 Nov 06 11:49:17 devstack sudo[95466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:49:17 devstack sudo[95466]: pam_unix(sudo:session): session closed for user root Nov 06 11:49:17 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-c1225615-c01a-42eb-acda-b2222dad584b tempest-SnapshotsActionsTest-1582719017 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-b7f1d205-2e2b-4d84-bfa7-d51dfc5207ad.51fd54bf-7093-4f26-8442-79e90c6b48c7" returned: 0 in 0.393s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:49:17 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-c1225615-c01a-42eb-acda-b2222dad584b tempest-SnapshotsActionsTest-1582719017 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b7f1d205-2e2b-4d84-bfa7-d51dfc5207ad(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87116) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 11:49:17 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-c1225615-c01a-42eb-acda-b2222dad584b tempest-SnapshotsActionsTest-1582719017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-b7f1d205-2e2b-4d84-bfa7-d51dfc5207ad.c5a039d6-eeff-4813-8639-8e1f01f40442 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:49:17 devstack sudo[95471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-b7f1d205-2e2b-4d84-bfa7-d51dfc5207ad.c5a039d6-eeff-4813-8639-8e1f01f40442 Nov 06 11:49:17 devstack sudo[95471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:49:18 devstack sudo[95471]: pam_unix(sudo:session): session closed for user root Nov 06 11:49:18 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-c1225615-c01a-42eb-acda-b2222dad584b tempest-SnapshotsActionsTest-1582719017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-b7f1d205-2e2b-4d84-bfa7-d51dfc5207ad.c5a039d6-eeff-4813-8639-8e1f01f40442" returned: 0 in 0.460s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:49:18 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-c1225615-c01a-42eb-acda-b2222dad584b tempest-SnapshotsActionsTest-1582719017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-b7f1d205-2e2b-4d84-bfa7-d51dfc5207ad.c5a039d6-eeff-4813-8639-8e1f01f40442 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:49:18 devstack sudo[95477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-b7f1d205-2e2b-4d84-bfa7-d51dfc5207ad.c5a039d6-eeff-4813-8639-8e1f01f40442 Nov 06 11:49:18 devstack sudo[95477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:49:18 devstack sudo[95477]: pam_unix(sudo:session): session closed for user root Nov 06 11:49:18 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-c1225615-c01a-42eb-acda-b2222dad584b tempest-SnapshotsActionsTest-1582719017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-b7f1d205-2e2b-4d84-bfa7-d51dfc5207ad.c5a039d6-eeff-4813-8639-8e1f01f40442" returned: 0 in 0.260s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:49:18 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-c1225615-c01a-42eb-acda-b2222dad584b tempest-SnapshotsActionsTest-1582719017 None] Lock "cinder-quobyte-c5a039d6-eeff-4813-8639-8e1f01f40442" released by "_delete_snapshot" :: held 1.658s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 11:49:18 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-c1225615-c01a-42eb-acda-b2222dad584b tempest-SnapshotsActionsTest-1582719017 None] Lock "cinder-quobyte-b7f1d205-2e2b-4d84-bfa7-d51dfc5207ad" released by "delete_snapshot" :: held 1.682s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 11:49:18 devstack cinder-volume[87116]: DEBUG cinder.quota [None req-c1225615-c01a-42eb-acda-b2222dad584b tempest-SnapshotsActionsTest-1582719017 None] Created reservations ['8f4bf9dd-04b3-406f-83bf-33dea01f7f8f', '8851d6b6-f583-4212-86e0-cba781a90d29', '72769769-5947-4bc7-8155-4853eac57d48', 'a18f7a81-70b0-4d2a-84a0-33f353e72966'] {{(pid=87116) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 11:49:18 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-c1225615-c01a-42eb-acda-b2222dad584b tempest-SnapshotsActionsTest-1582719017 None] Delete snapshot completed successfully. Nov 06 11:49:18 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-c1225615-c01a-42eb-acda-b2222dad584b tempest-SnapshotsActionsTest-1582719017 None] Lock "cinder-c5a039d6-eeff-4813-8639-8e1f01f40442-delete_snapshot" released by "delete_snapshot" :: held 1.896s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 11:49:19 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-f722a1d8-db3d-49bd-bf89-1a92d009634c tempest-SnapshotsActionsTest-1557067016 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 11:49:19 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-f722a1d8-db3d-49bd-bf89-1a92d009634c tempest-SnapshotsActionsTest-1557067016 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 11:49:19 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-f722a1d8-db3d-49bd-bf89-1a92d009634c tempest-SnapshotsActionsTest-1557067016 None] Creating offline snapshot 1ffe618e-ba81-47b7-a4f2-95bda21d3d41 of volume b7f1d205-2e2b-4d84-bfa7-d51dfc5207ad {{(pid=87116) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 06 11:49:19 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[62935612-87ce-4def-8884-939b7eef732a]: (4, 'qcow2') {{(pid=88420) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 11:49:19 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-f722a1d8-db3d-49bd-bf89-1a92d009634c tempest-SnapshotsActionsTest-1557067016 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-b7f1d205-2e2b-4d84-bfa7-d51dfc5207ad.51fd54bf-7093-4f26-8442-79e90c6b48c7 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:49:19 devstack sudo[95500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-b7f1d205-2e2b-4d84-bfa7-d51dfc5207ad.51fd54bf-7093-4f26-8442-79e90c6b48c7 Nov 06 11:49:19 devstack sudo[95500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:49:19 devstack sudo[95500]: pam_unix(sudo:session): session closed for user root Nov 06 11:49:19 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-f722a1d8-db3d-49bd-bf89-1a92d009634c tempest-SnapshotsActionsTest-1557067016 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-b7f1d205-2e2b-4d84-bfa7-d51dfc5207ad.51fd54bf-7093-4f26-8442-79e90c6b48c7" returned: 0 in 0.413s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:49:19 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-f722a1d8-db3d-49bd-bf89-1a92d009634c tempest-SnapshotsActionsTest-1557067016 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b7f1d205-2e2b-4d84-bfa7-d51dfc5207ad(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87116) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 11:49:19 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-f722a1d8-db3d-49bd-bf89-1a92d009634c tempest-SnapshotsActionsTest-1557067016 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-b7f1d205-2e2b-4d84-bfa7-d51dfc5207ad.51fd54bf-7093-4f26-8442-79e90c6b48c7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-b7f1d205-2e2b-4d84-bfa7-d51dfc5207ad.1ffe618e-ba81-47b7-a4f2-95bda21d3d41 1G {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:49:20 devstack sudo[95505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-b7f1d205-2e2b-4d84-bfa7-d51dfc5207ad.51fd54bf-7093-4f26-8442-79e90c6b48c7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-b7f1d205-2e2b-4d84-bfa7-d51dfc5207ad.1ffe618e-ba81-47b7-a4f2-95bda21d3d41 1G Nov 06 11:49:20 devstack sudo[95505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:49:20 devstack sudo[95505]: pam_unix(sudo:session): session closed for user root Nov 06 11:49:20 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-f722a1d8-db3d-49bd-bf89-1a92d009634c tempest-SnapshotsActionsTest-1557067016 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-b7f1d205-2e2b-4d84-bfa7-d51dfc5207ad.51fd54bf-7093-4f26-8442-79e90c6b48c7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-b7f1d205-2e2b-4d84-bfa7-d51dfc5207ad.1ffe618e-ba81-47b7-a4f2-95bda21d3d41 1G" returned: 0 in 0.613s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:49:20 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-f722a1d8-db3d-49bd-bf89-1a92d009634c tempest-SnapshotsActionsTest-1557067016 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b7f1d205-2e2b-4d84-bfa7-d51dfc5207ad.51fd54bf-7093-4f26-8442-79e90c6b48c7 -F qcow2 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-b7f1d205-2e2b-4d84-bfa7-d51dfc5207ad.1ffe618e-ba81-47b7-a4f2-95bda21d3d41 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:49:20 devstack sudo[95512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b7f1d205-2e2b-4d84-bfa7-d51dfc5207ad.51fd54bf-7093-4f26-8442-79e90c6b48c7 -F qcow2 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-b7f1d205-2e2b-4d84-bfa7-d51dfc5207ad.1ffe618e-ba81-47b7-a4f2-95bda21d3d41 Nov 06 11:49:20 devstack sudo[95512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:49:20 devstack sudo[95512]: pam_unix(sudo:session): session closed for user root Nov 06 11:49:20 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-f722a1d8-db3d-49bd-bf89-1a92d009634c tempest-SnapshotsActionsTest-1557067016 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b7f1d205-2e2b-4d84-bfa7-d51dfc5207ad.51fd54bf-7093-4f26-8442-79e90c6b48c7 -F qcow2 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-b7f1d205-2e2b-4d84-bfa7-d51dfc5207ad.1ffe618e-ba81-47b7-a4f2-95bda21d3d41" returned: 0 in 0.311s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:49:20 devstack cinder-volume[87116]: WARNING cinder.volume.drivers.remotefs [None req-f722a1d8-db3d-49bd-bf89-1a92d009634c tempest-SnapshotsActionsTest-1557067016 None] /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-b7f1d205-2e2b-4d84-bfa7-d51dfc5207ad.1ffe618e-ba81-47b7-a4f2-95bda21d3d41 is being set with open permissions: ugo+rw Nov 06 11:49:20 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-f722a1d8-db3d-49bd-bf89-1a92d009634c tempest-SnapshotsActionsTest-1557067016 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-b7f1d205-2e2b-4d84-bfa7-d51dfc5207ad.1ffe618e-ba81-47b7-a4f2-95bda21d3d41 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:49:20 devstack sudo[95518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-b7f1d205-2e2b-4d84-bfa7-d51dfc5207ad.1ffe618e-ba81-47b7-a4f2-95bda21d3d41 Nov 06 11:49:20 devstack sudo[95518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:49:21 devstack sudo[95518]: pam_unix(sudo:session): session closed for user root Nov 06 11:49:21 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-f722a1d8-db3d-49bd-bf89-1a92d009634c tempest-SnapshotsActionsTest-1557067016 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-b7f1d205-2e2b-4d84-bfa7-d51dfc5207ad.1ffe618e-ba81-47b7-a4f2-95bda21d3d41" returned: 0 in 0.294s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:49:21 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-f722a1d8-db3d-49bd-bf89-1a92d009634c tempest-SnapshotsActionsTest-1557067016 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.771s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 11:49:21 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-f722a1d8-db3d-49bd-bf89-1a92d009634c tempest-SnapshotsActionsTest-1557067016 None] Create snapshot completed successfully Nov 06 11:49:21 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-9684aabe-57e9-413f-a4c2-b824940b80ee tempest-SnapshotsActionsTest-1582719017 None] Acquiring lock "cinder-1ffe618e-ba81-47b7-a4f2-95bda21d3d41-delete_snapshot" by "delete_snapshot" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 11:49:21 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-9684aabe-57e9-413f-a4c2-b824940b80ee tempest-SnapshotsActionsTest-1582719017 None] Lock "cinder-1ffe618e-ba81-47b7-a4f2-95bda21d3d41-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 11:49:21 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-9684aabe-57e9-413f-a4c2-b824940b80ee tempest-SnapshotsActionsTest-1582719017 None] Acquiring lock "cinder-quobyte-b7f1d205-2e2b-4d84-bfa7-d51dfc5207ad" by "delete_snapshot" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 11:49:21 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-9684aabe-57e9-413f-a4c2-b824940b80ee tempest-SnapshotsActionsTest-1582719017 None] Lock "cinder-quobyte-b7f1d205-2e2b-4d84-bfa7-d51dfc5207ad" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 11:49:21 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-9684aabe-57e9-413f-a4c2-b824940b80ee tempest-SnapshotsActionsTest-1582719017 None] Acquiring lock "cinder-quobyte-1ffe618e-ba81-47b7-a4f2-95bda21d3d41" by "_delete_snapshot" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 11:49:21 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-9684aabe-57e9-413f-a4c2-b824940b80ee tempest-SnapshotsActionsTest-1582719017 None] Lock "cinder-quobyte-1ffe618e-ba81-47b7-a4f2-95bda21d3d41" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 11:49:21 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-9684aabe-57e9-413f-a4c2-b824940b80ee tempest-SnapshotsActionsTest-1582719017 None] Deleting offline snapshot 1ffe618e-ba81-47b7-a4f2-95bda21d3d41 of volume b7f1d205-2e2b-4d84-bfa7-d51dfc5207ad {{(pid=87116) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 06 11:49:21 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-9684aabe-57e9-413f-a4c2-b824940b80ee tempest-SnapshotsActionsTest-1582719017 None] snapshot_file for this snap is: volume-b7f1d205-2e2b-4d84-bfa7-d51dfc5207ad.1ffe618e-ba81-47b7-a4f2-95bda21d3d41 {{(pid=87116) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 06 11:49:21 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[d73dbe18-8bb8-4aa2-80ab-6995a901c914]: (4, 'qcow2') {{(pid=88420) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 11:49:21 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-9684aabe-57e9-413f-a4c2-b824940b80ee tempest-SnapshotsActionsTest-1582719017 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-b7f1d205-2e2b-4d84-bfa7-d51dfc5207ad.1ffe618e-ba81-47b7-a4f2-95bda21d3d41 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:49:22 devstack sudo[95524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-b7f1d205-2e2b-4d84-bfa7-d51dfc5207ad.1ffe618e-ba81-47b7-a4f2-95bda21d3d41 Nov 06 11:49:22 devstack sudo[95524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:49:22 devstack sudo[95524]: pam_unix(sudo:session): session closed for user root Nov 06 11:49:22 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-9684aabe-57e9-413f-a4c2-b824940b80ee tempest-SnapshotsActionsTest-1582719017 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-b7f1d205-2e2b-4d84-bfa7-d51dfc5207ad.1ffe618e-ba81-47b7-a4f2-95bda21d3d41" returned: 0 in 0.369s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:49:22 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-9684aabe-57e9-413f-a4c2-b824940b80ee tempest-SnapshotsActionsTest-1582719017 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b7f1d205-2e2b-4d84-bfa7-d51dfc5207ad(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87116) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 11:49:22 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[925568b8-5099-4dc0-b10e-270f0f347b78]: (4, 'qcow2') {{(pid=88420) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 11:49:22 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-9684aabe-57e9-413f-a4c2-b824940b80ee tempest-SnapshotsActionsTest-1582719017 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-b7f1d205-2e2b-4d84-bfa7-d51dfc5207ad.51fd54bf-7093-4f26-8442-79e90c6b48c7 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:49:22 devstack sudo[95530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-b7f1d205-2e2b-4d84-bfa7-d51dfc5207ad.51fd54bf-7093-4f26-8442-79e90c6b48c7 Nov 06 11:49:22 devstack sudo[95530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:49:22 devstack sudo[95530]: pam_unix(sudo:session): session closed for user root Nov 06 11:49:22 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-9684aabe-57e9-413f-a4c2-b824940b80ee tempest-SnapshotsActionsTest-1582719017 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-b7f1d205-2e2b-4d84-bfa7-d51dfc5207ad.51fd54bf-7093-4f26-8442-79e90c6b48c7" returned: 0 in 0.374s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:49:22 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-9684aabe-57e9-413f-a4c2-b824940b80ee tempest-SnapshotsActionsTest-1582719017 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b7f1d205-2e2b-4d84-bfa7-d51dfc5207ad(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87116) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 11:49:22 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-9684aabe-57e9-413f-a4c2-b824940b80ee tempest-SnapshotsActionsTest-1582719017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-b7f1d205-2e2b-4d84-bfa7-d51dfc5207ad.1ffe618e-ba81-47b7-a4f2-95bda21d3d41 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:49:22 devstack sudo[95535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-b7f1d205-2e2b-4d84-bfa7-d51dfc5207ad.1ffe618e-ba81-47b7-a4f2-95bda21d3d41 Nov 06 11:49:22 devstack sudo[95535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:49:23 devstack sudo[95535]: pam_unix(sudo:session): session closed for user root Nov 06 11:49:23 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-9684aabe-57e9-413f-a4c2-b824940b80ee tempest-SnapshotsActionsTest-1582719017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-b7f1d205-2e2b-4d84-bfa7-d51dfc5207ad.1ffe618e-ba81-47b7-a4f2-95bda21d3d41" returned: 0 in 0.402s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:49:23 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-9684aabe-57e9-413f-a4c2-b824940b80ee tempest-SnapshotsActionsTest-1582719017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-b7f1d205-2e2b-4d84-bfa7-d51dfc5207ad.1ffe618e-ba81-47b7-a4f2-95bda21d3d41 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:49:23 devstack sudo[95541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-b7f1d205-2e2b-4d84-bfa7-d51dfc5207ad.1ffe618e-ba81-47b7-a4f2-95bda21d3d41 Nov 06 11:49:23 devstack sudo[95541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:49:23 devstack sudo[95541]: pam_unix(sudo:session): session closed for user root Nov 06 11:49:23 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-9684aabe-57e9-413f-a4c2-b824940b80ee tempest-SnapshotsActionsTest-1582719017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-b7f1d205-2e2b-4d84-bfa7-d51dfc5207ad.1ffe618e-ba81-47b7-a4f2-95bda21d3d41" returned: 0 in 0.234s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:49:23 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-9684aabe-57e9-413f-a4c2-b824940b80ee tempest-SnapshotsActionsTest-1582719017 None] Lock "cinder-quobyte-1ffe618e-ba81-47b7-a4f2-95bda21d3d41" released by "_delete_snapshot" :: held 1.519s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 11:49:23 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-9684aabe-57e9-413f-a4c2-b824940b80ee tempest-SnapshotsActionsTest-1582719017 None] Lock "cinder-quobyte-b7f1d205-2e2b-4d84-bfa7-d51dfc5207ad" released by "delete_snapshot" :: held 1.544s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 11:49:23 devstack cinder-volume[87116]: DEBUG dbcounter [-] [87116] Writing DB stats cinder:SELECT=124,cinder:UPDATE=143,cinder:DELETE=13,cinder:INSERT=27 {{(pid=87116) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 11:49:23 devstack cinder-volume[87116]: DEBUG cinder.quota [None req-9684aabe-57e9-413f-a4c2-b824940b80ee tempest-SnapshotsActionsTest-1582719017 None] Created reservations ['abaf9fb3-5eb0-4f77-8ed7-62cf0c04c21f', '4ba88cc8-771c-4c54-9ecb-c9e0998b7d15', 'a5e846bf-64eb-4812-9b83-c5f77d46be3b', 'fd0a8272-4041-4993-8502-c6e2a5f29b9e'] {{(pid=87116) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 11:49:23 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-9684aabe-57e9-413f-a4c2-b824940b80ee tempest-SnapshotsActionsTest-1582719017 None] Delete snapshot completed successfully. Nov 06 11:49:23 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-9684aabe-57e9-413f-a4c2-b824940b80ee tempest-SnapshotsActionsTest-1582719017 None] Lock "cinder-1ffe618e-ba81-47b7-a4f2-95bda21d3d41-delete_snapshot" released by "delete_snapshot" :: held 1.681s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 11:49:24 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-3a43da2d-9906-4eca-a362-1e731d9e9b3b tempest-SnapshotsActionsTest-1557067016 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 11:49:24 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-3a43da2d-9906-4eca-a362-1e731d9e9b3b tempest-SnapshotsActionsTest-1557067016 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 11:49:24 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-3a43da2d-9906-4eca-a362-1e731d9e9b3b tempest-SnapshotsActionsTest-1557067016 None] Creating offline snapshot 7afe5fdf-deeb-4231-a962-c3e4eb85ee39 of volume b7f1d205-2e2b-4d84-bfa7-d51dfc5207ad {{(pid=87116) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 06 11:49:24 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[091518e4-1abf-451f-a546-150f54e11a7b]: (4, 'qcow2') {{(pid=88420) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 11:49:24 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-3a43da2d-9906-4eca-a362-1e731d9e9b3b tempest-SnapshotsActionsTest-1557067016 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-b7f1d205-2e2b-4d84-bfa7-d51dfc5207ad.51fd54bf-7093-4f26-8442-79e90c6b48c7 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:49:24 devstack sudo[95546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-b7f1d205-2e2b-4d84-bfa7-d51dfc5207ad.51fd54bf-7093-4f26-8442-79e90c6b48c7 Nov 06 11:49:24 devstack sudo[95546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:49:24 devstack sudo[95546]: pam_unix(sudo:session): session closed for user root Nov 06 11:49:24 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-3a43da2d-9906-4eca-a362-1e731d9e9b3b tempest-SnapshotsActionsTest-1557067016 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-b7f1d205-2e2b-4d84-bfa7-d51dfc5207ad.51fd54bf-7093-4f26-8442-79e90c6b48c7" returned: 0 in 0.447s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:49:24 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-3a43da2d-9906-4eca-a362-1e731d9e9b3b tempest-SnapshotsActionsTest-1557067016 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b7f1d205-2e2b-4d84-bfa7-d51dfc5207ad(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87116) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 11:49:24 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-3a43da2d-9906-4eca-a362-1e731d9e9b3b tempest-SnapshotsActionsTest-1557067016 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-b7f1d205-2e2b-4d84-bfa7-d51dfc5207ad.51fd54bf-7093-4f26-8442-79e90c6b48c7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-b7f1d205-2e2b-4d84-bfa7-d51dfc5207ad.7afe5fdf-deeb-4231-a962-c3e4eb85ee39 1G {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:49:24 devstack sudo[95563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-b7f1d205-2e2b-4d84-bfa7-d51dfc5207ad.51fd54bf-7093-4f26-8442-79e90c6b48c7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-b7f1d205-2e2b-4d84-bfa7-d51dfc5207ad.7afe5fdf-deeb-4231-a962-c3e4eb85ee39 1G Nov 06 11:49:24 devstack sudo[95563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:49:25 devstack sudo[95563]: pam_unix(sudo:session): session closed for user root Nov 06 11:49:25 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-3a43da2d-9906-4eca-a362-1e731d9e9b3b tempest-SnapshotsActionsTest-1557067016 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-b7f1d205-2e2b-4d84-bfa7-d51dfc5207ad.51fd54bf-7093-4f26-8442-79e90c6b48c7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-b7f1d205-2e2b-4d84-bfa7-d51dfc5207ad.7afe5fdf-deeb-4231-a962-c3e4eb85ee39 1G" returned: 0 in 0.530s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:49:25 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-3a43da2d-9906-4eca-a362-1e731d9e9b3b tempest-SnapshotsActionsTest-1557067016 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b7f1d205-2e2b-4d84-bfa7-d51dfc5207ad.51fd54bf-7093-4f26-8442-79e90c6b48c7 -F qcow2 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-b7f1d205-2e2b-4d84-bfa7-d51dfc5207ad.7afe5fdf-deeb-4231-a962-c3e4eb85ee39 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:49:25 devstack sudo[95572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b7f1d205-2e2b-4d84-bfa7-d51dfc5207ad.51fd54bf-7093-4f26-8442-79e90c6b48c7 -F qcow2 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-b7f1d205-2e2b-4d84-bfa7-d51dfc5207ad.7afe5fdf-deeb-4231-a962-c3e4eb85ee39 Nov 06 11:49:25 devstack sudo[95572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:49:25 devstack sudo[95572]: pam_unix(sudo:session): session closed for user root Nov 06 11:49:25 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-3a43da2d-9906-4eca-a362-1e731d9e9b3b tempest-SnapshotsActionsTest-1557067016 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b7f1d205-2e2b-4d84-bfa7-d51dfc5207ad.51fd54bf-7093-4f26-8442-79e90c6b48c7 -F qcow2 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-b7f1d205-2e2b-4d84-bfa7-d51dfc5207ad.7afe5fdf-deeb-4231-a962-c3e4eb85ee39" returned: 0 in 0.322s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:49:25 devstack cinder-volume[87116]: WARNING cinder.volume.drivers.remotefs [None req-3a43da2d-9906-4eca-a362-1e731d9e9b3b tempest-SnapshotsActionsTest-1557067016 None] /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-b7f1d205-2e2b-4d84-bfa7-d51dfc5207ad.7afe5fdf-deeb-4231-a962-c3e4eb85ee39 is being set with open permissions: ugo+rw Nov 06 11:49:25 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-3a43da2d-9906-4eca-a362-1e731d9e9b3b tempest-SnapshotsActionsTest-1557067016 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-b7f1d205-2e2b-4d84-bfa7-d51dfc5207ad.7afe5fdf-deeb-4231-a962-c3e4eb85ee39 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:49:25 devstack sudo[95577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-b7f1d205-2e2b-4d84-bfa7-d51dfc5207ad.7afe5fdf-deeb-4231-a962-c3e4eb85ee39 Nov 06 11:49:25 devstack sudo[95577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:49:25 devstack sudo[95577]: pam_unix(sudo:session): session closed for user root Nov 06 11:49:25 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-3a43da2d-9906-4eca-a362-1e731d9e9b3b tempest-SnapshotsActionsTest-1557067016 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-b7f1d205-2e2b-4d84-bfa7-d51dfc5207ad.7afe5fdf-deeb-4231-a962-c3e4eb85ee39" returned: 0 in 0.250s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:49:25 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-3a43da2d-9906-4eca-a362-1e731d9e9b3b tempest-SnapshotsActionsTest-1557067016 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.690s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 11:49:25 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-3a43da2d-9906-4eca-a362-1e731d9e9b3b tempest-SnapshotsActionsTest-1557067016 None] Create snapshot completed successfully Nov 06 11:49:26 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-d0b082a0-1cc4-4dd6-bcdc-0eeb4ec00b29 tempest-SnapshotsActionsTest-1582719017 None] Acquiring lock "cinder-7afe5fdf-deeb-4231-a962-c3e4eb85ee39-delete_snapshot" by "delete_snapshot" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 11:49:26 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-d0b082a0-1cc4-4dd6-bcdc-0eeb4ec00b29 tempest-SnapshotsActionsTest-1582719017 None] Lock "cinder-7afe5fdf-deeb-4231-a962-c3e4eb85ee39-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 11:49:26 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-d0b082a0-1cc4-4dd6-bcdc-0eeb4ec00b29 tempest-SnapshotsActionsTest-1582719017 None] Acquiring lock "cinder-quobyte-b7f1d205-2e2b-4d84-bfa7-d51dfc5207ad" by "delete_snapshot" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 11:49:26 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-d0b082a0-1cc4-4dd6-bcdc-0eeb4ec00b29 tempest-SnapshotsActionsTest-1582719017 None] Lock "cinder-quobyte-b7f1d205-2e2b-4d84-bfa7-d51dfc5207ad" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 11:49:26 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-d0b082a0-1cc4-4dd6-bcdc-0eeb4ec00b29 tempest-SnapshotsActionsTest-1582719017 None] Acquiring lock "cinder-quobyte-7afe5fdf-deeb-4231-a962-c3e4eb85ee39" by "_delete_snapshot" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 11:49:26 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-d0b082a0-1cc4-4dd6-bcdc-0eeb4ec00b29 tempest-SnapshotsActionsTest-1582719017 None] Lock "cinder-quobyte-7afe5fdf-deeb-4231-a962-c3e4eb85ee39" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 11:49:26 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-d0b082a0-1cc4-4dd6-bcdc-0eeb4ec00b29 tempest-SnapshotsActionsTest-1582719017 None] Deleting offline snapshot 7afe5fdf-deeb-4231-a962-c3e4eb85ee39 of volume b7f1d205-2e2b-4d84-bfa7-d51dfc5207ad {{(pid=87116) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 06 11:49:26 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-d0b082a0-1cc4-4dd6-bcdc-0eeb4ec00b29 tempest-SnapshotsActionsTest-1582719017 None] snapshot_file for this snap is: volume-b7f1d205-2e2b-4d84-bfa7-d51dfc5207ad.7afe5fdf-deeb-4231-a962-c3e4eb85ee39 {{(pid=87116) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 06 11:49:26 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[2df168e2-c8a7-4074-9cda-5804619a84a6]: (4, 'qcow2') {{(pid=88420) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 11:49:26 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-d0b082a0-1cc4-4dd6-bcdc-0eeb4ec00b29 tempest-SnapshotsActionsTest-1582719017 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-b7f1d205-2e2b-4d84-bfa7-d51dfc5207ad.7afe5fdf-deeb-4231-a962-c3e4eb85ee39 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:49:26 devstack sudo[95582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-b7f1d205-2e2b-4d84-bfa7-d51dfc5207ad.7afe5fdf-deeb-4231-a962-c3e4eb85ee39 Nov 06 11:49:26 devstack sudo[95582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:49:27 devstack sudo[95582]: pam_unix(sudo:session): session closed for user root Nov 06 11:49:27 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-d0b082a0-1cc4-4dd6-bcdc-0eeb4ec00b29 tempest-SnapshotsActionsTest-1582719017 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-b7f1d205-2e2b-4d84-bfa7-d51dfc5207ad.7afe5fdf-deeb-4231-a962-c3e4eb85ee39" returned: 0 in 0.516s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:49:27 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-d0b082a0-1cc4-4dd6-bcdc-0eeb4ec00b29 tempest-SnapshotsActionsTest-1582719017 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b7f1d205-2e2b-4d84-bfa7-d51dfc5207ad(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87116) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 11:49:27 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b023d30-8c8d-4a33-bc0f-ef11de5d4e99]: (4, 'qcow2') {{(pid=88420) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 11:49:27 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-d0b082a0-1cc4-4dd6-bcdc-0eeb4ec00b29 tempest-SnapshotsActionsTest-1582719017 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-b7f1d205-2e2b-4d84-bfa7-d51dfc5207ad.51fd54bf-7093-4f26-8442-79e90c6b48c7 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:49:27 devstack cinder-volume[87116]: DEBUG cinder.volume.flows.manager.create_volume [None req-91fd8180-165f-403e-ab5c-9ca49d53658b tempest-AttachVolumeNegativeTest-771196063 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87116) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 11:49:27 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-91fd8180-165f-403e-ab5c-9ca49d53658b tempest-AttachVolumeNegativeTest-771196063 None] Flow 'volume_create_manager' (594d6c88-2056-491c-aafb-a40cf394f3f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 11:49:27 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-91fd8180-165f-403e-ab5c-9ca49d53658b tempest-AttachVolumeNegativeTest-771196063 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d52c4692-1963-42c1-8572-4863f0f016c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:49:27 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-91fd8180-165f-403e-ab5c-9ca49d53658b tempest-AttachVolumeNegativeTest-771196063 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d52c4692-1963-42c1-8572-4863f0f016c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T10:49:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1452498520',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fb93bc19-4902-4d1e-955d-ec03b3f7551f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b23e8157379c4aa2a39ee3c320d26405',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T10:49:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T10:49:27Z,use_quota=True,user_id='46166ce042cc4a85aa8e38a7a34c4d50',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(34d3b144-d9b7-480a-a2e3-01e45f3d54c1),volume_type_id=34d3b144-d9b7-480a-a2e3-01e45f3d54c1)' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:49:27 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-91fd8180-165f-403e-ab5c-9ca49d53658b tempest-AttachVolumeNegativeTest-771196063 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (50a61704-44b2-4178-bfa4-2037c2acc4ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:49:27 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-91fd8180-165f-403e-ab5c-9ca49d53658b tempest-AttachVolumeNegativeTest-771196063 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (50a61704-44b2-4178-bfa4-2037c2acc4ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:49:27 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-91fd8180-165f-403e-ab5c-9ca49d53658b tempest-AttachVolumeNegativeTest-771196063 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d239f347-ca20-46a0-b502-0685407ed380) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:49:27 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-91fd8180-165f-403e-ab5c-9ca49d53658b tempest-AttachVolumeNegativeTest-771196063 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d239f347-ca20-46a0-b502-0685407ed380) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fb93bc19-4902-4d1e-955d-ec03b3f7551f', 'volume_name': 'volume-fb93bc19-4902-4d1e-955d-ec03b3f7551f', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:49:27 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-91fd8180-165f-403e-ab5c-9ca49d53658b tempest-AttachVolumeNegativeTest-771196063 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2854908c-e41e-4eaf-8abc-3618e9a38855) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:49:27 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-91fd8180-165f-403e-ab5c-9ca49d53658b tempest-AttachVolumeNegativeTest-771196063 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2854908c-e41e-4eaf-8abc-3618e9a38855) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:49:27 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-91fd8180-165f-403e-ab5c-9ca49d53658b tempest-AttachVolumeNegativeTest-771196063 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0f293452-8402-4b28-a569-b104530f019d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:49:27 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-91fd8180-165f-403e-ab5c-9ca49d53658b tempest-AttachVolumeNegativeTest-771196063 None] Volume fb93bc19-4902-4d1e-955d-ec03b3f7551f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fb93bc19-4902-4d1e-955d-ec03b3f7551f', 'volume_size': 1} Nov 06 11:49:27 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-91fd8180-165f-403e-ab5c-9ca49d53658b tempest-AttachVolumeNegativeTest-771196063 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 11:49:27 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-91fd8180-165f-403e-ab5c-9ca49d53658b tempest-AttachVolumeNegativeTest-771196063 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 11:49:27 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-91fd8180-165f-403e-ab5c-9ca49d53658b tempest-AttachVolumeNegativeTest-771196063 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T10:49:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1452498520',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fb93bc19-4902-4d1e-955d-ec03b3f7551f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b23e8157379c4aa2a39ee3c320d26405',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T10:49:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T10:49:27Z,use_quota=True,user_id='46166ce042cc4a85aa8e38a7a34c4d50',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(34d3b144-d9b7-480a-a2e3-01e45f3d54c1),volume_type_id=34d3b144-d9b7-480a-a2e3-01e45f3d54c1)}" {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 11:49:27 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-91fd8180-165f-403e-ab5c-9ca49d53658b tempest-AttachVolumeNegativeTest-771196063 None] Creating volume fb93bc19-4902-4d1e-955d-ec03b3f7551f {{(pid=87116) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 11:49:27 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-91fd8180-165f-403e-ab5c-9ca49d53658b tempest-AttachVolumeNegativeTest-771196063 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 11:49:27 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-91fd8180-165f-403e-ab5c-9ca49d53658b tempest-AttachVolumeNegativeTest-771196063 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 11:49:27 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-91fd8180-165f-403e-ab5c-9ca49d53658b tempest-AttachVolumeNegativeTest-771196063 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 11:49:27 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-91fd8180-165f-403e-ab5c-9ca49d53658b tempest-AttachVolumeNegativeTest-771196063 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 11:49:27 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-91fd8180-165f-403e-ab5c-9ca49d53658b tempest-AttachVolumeNegativeTest-771196063 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 11:49:27 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-91fd8180-165f-403e-ab5c-9ca49d53658b tempest-AttachVolumeNegativeTest-771196063 None] Selected osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f as target Quobyte volume. {{(pid=87116) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 11:49:27 devstack cinder-volume[87116]: INFO cinder.volume.drivers.remotefs [None req-91fd8180-165f-403e-ab5c-9ca49d53658b tempest-AttachVolumeNegativeTest-771196063 None] casted to osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f Nov 06 11:49:27 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-91fd8180-165f-403e-ab5c-9ca49d53658b tempest-AttachVolumeNegativeTest-771196063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-fb93bc19-4902-4d1e-955d-ec03b3f7551f 1073741824 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:49:27 devstack sudo[95588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-fb93bc19-4902-4d1e-955d-ec03b3f7551f 1073741824 Nov 06 11:49:27 devstack sudo[95588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:49:27 devstack sudo[95587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-b7f1d205-2e2b-4d84-bfa7-d51dfc5207ad.51fd54bf-7093-4f26-8442-79e90c6b48c7 Nov 06 11:49:27 devstack sudo[95587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:49:27 devstack sudo[95587]: pam_unix(sudo:session): session closed for user root Nov 06 11:49:27 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-d0b082a0-1cc4-4dd6-bcdc-0eeb4ec00b29 tempest-SnapshotsActionsTest-1582719017 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-b7f1d205-2e2b-4d84-bfa7-d51dfc5207ad.51fd54bf-7093-4f26-8442-79e90c6b48c7" returned: 0 in 0.526s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:49:27 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-d0b082a0-1cc4-4dd6-bcdc-0eeb4ec00b29 tempest-SnapshotsActionsTest-1582719017 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b7f1d205-2e2b-4d84-bfa7-d51dfc5207ad(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87116) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 11:49:27 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-d0b082a0-1cc4-4dd6-bcdc-0eeb4ec00b29 tempest-SnapshotsActionsTest-1582719017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-b7f1d205-2e2b-4d84-bfa7-d51dfc5207ad.7afe5fdf-deeb-4231-a962-c3e4eb85ee39 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:49:27 devstack sudo[95607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-b7f1d205-2e2b-4d84-bfa7-d51dfc5207ad.7afe5fdf-deeb-4231-a962-c3e4eb85ee39 Nov 06 11:49:27 devstack sudo[95607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:49:28 devstack sudo[95588]: pam_unix(sudo:session): session closed for user root Nov 06 11:49:28 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-91fd8180-165f-403e-ab5c-9ca49d53658b tempest-AttachVolumeNegativeTest-771196063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-fb93bc19-4902-4d1e-955d-ec03b3f7551f 1073741824" returned: 0 in 0.759s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:49:28 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-91fd8180-165f-403e-ab5c-9ca49d53658b tempest-AttachVolumeNegativeTest-771196063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-fb93bc19-4902-4d1e-955d-ec03b3f7551f {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:49:28 devstack sudo[95635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-fb93bc19-4902-4d1e-955d-ec03b3f7551f Nov 06 11:49:28 devstack sudo[95635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:49:28 devstack sudo[95607]: pam_unix(sudo:session): session closed for user root Nov 06 11:49:28 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-d0b082a0-1cc4-4dd6-bcdc-0eeb4ec00b29 tempest-SnapshotsActionsTest-1582719017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-b7f1d205-2e2b-4d84-bfa7-d51dfc5207ad.7afe5fdf-deeb-4231-a962-c3e4eb85ee39" returned: 0 in 0.632s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:49:28 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-d0b082a0-1cc4-4dd6-bcdc-0eeb4ec00b29 tempest-SnapshotsActionsTest-1582719017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-b7f1d205-2e2b-4d84-bfa7-d51dfc5207ad.7afe5fdf-deeb-4231-a962-c3e4eb85ee39 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:49:28 devstack sudo[95640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-b7f1d205-2e2b-4d84-bfa7-d51dfc5207ad.7afe5fdf-deeb-4231-a962-c3e4eb85ee39 Nov 06 11:49:28 devstack sudo[95640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:49:28 devstack sudo[95635]: pam_unix(sudo:session): session closed for user root Nov 06 11:49:28 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-91fd8180-165f-403e-ab5c-9ca49d53658b tempest-AttachVolumeNegativeTest-771196063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-fb93bc19-4902-4d1e-955d-ec03b3f7551f" returned: 0 in 0.420s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:49:28 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-91fd8180-165f-403e-ab5c-9ca49d53658b tempest-AttachVolumeNegativeTest-771196063 None] <== create_volume: return (1252ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f'} {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 11:49:28 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-91fd8180-165f-403e-ab5c-9ca49d53658b tempest-AttachVolumeNegativeTest-771196063 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.255s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 11:49:28 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-91fd8180-165f-403e-ab5c-9ca49d53658b tempest-AttachVolumeNegativeTest-771196063 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0f293452-8402-4b28-a569-b104530f019d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fb93bc19-4902-4d1e-955d-ec03b3f7551f', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:49:28 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-91fd8180-165f-403e-ab5c-9ca49d53658b tempest-AttachVolumeNegativeTest-771196063 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (db205f0e-40b6-447f-a41c-41d01ed7cf3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:49:28 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-91fd8180-165f-403e-ab5c-9ca49d53658b tempest-AttachVolumeNegativeTest-771196063 None] Volume volume-fb93bc19-4902-4d1e-955d-ec03b3f7551f (fb93bc19-4902-4d1e-955d-ec03b3f7551f): created successfully Nov 06 11:49:28 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-91fd8180-165f-403e-ab5c-9ca49d53658b tempest-AttachVolumeNegativeTest-771196063 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (db205f0e-40b6-447f-a41c-41d01ed7cf3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:49:28 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-91fd8180-165f-403e-ab5c-9ca49d53658b tempest-AttachVolumeNegativeTest-771196063 None] Flow 'volume_create_manager' (594d6c88-2056-491c-aafb-a40cf394f3f0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 11:49:28 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-91fd8180-165f-403e-ab5c-9ca49d53658b tempest-AttachVolumeNegativeTest-771196063 None] Created volume successfully. Nov 06 11:49:28 devstack sudo[95640]: pam_unix(sudo:session): session closed for user root Nov 06 11:49:28 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-d0b082a0-1cc4-4dd6-bcdc-0eeb4ec00b29 tempest-SnapshotsActionsTest-1582719017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-b7f1d205-2e2b-4d84-bfa7-d51dfc5207ad.7afe5fdf-deeb-4231-a962-c3e4eb85ee39" returned: 0 in 0.355s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:49:28 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-d0b082a0-1cc4-4dd6-bcdc-0eeb4ec00b29 tempest-SnapshotsActionsTest-1582719017 None] Lock "cinder-quobyte-7afe5fdf-deeb-4231-a962-c3e4eb85ee39" released by "_delete_snapshot" :: held 2.153s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 11:49:28 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-d0b082a0-1cc4-4dd6-bcdc-0eeb4ec00b29 tempest-SnapshotsActionsTest-1582719017 None] Lock "cinder-quobyte-b7f1d205-2e2b-4d84-bfa7-d51dfc5207ad" released by "delete_snapshot" :: held 2.179s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 11:49:28 devstack cinder-volume[87116]: DEBUG cinder.quota [None req-d0b082a0-1cc4-4dd6-bcdc-0eeb4ec00b29 tempest-SnapshotsActionsTest-1582719017 None] Created reservations ['c8a9b0e3-5e38-41ff-9cff-2ba8e533590f', '419a2191-db47-4c43-8921-130ac81d2eff', 'dbec0186-19df-4b8a-84d8-455d55362970', '41e4e283-db55-4901-8352-efeef4112907'] {{(pid=87116) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 11:49:28 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-d0b082a0-1cc4-4dd6-bcdc-0eeb4ec00b29 tempest-SnapshotsActionsTest-1582719017 None] Delete snapshot completed successfully. Nov 06 11:49:28 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-d0b082a0-1cc4-4dd6-bcdc-0eeb4ec00b29 tempest-SnapshotsActionsTest-1582719017 None] Lock "cinder-7afe5fdf-deeb-4231-a962-c3e4eb85ee39-delete_snapshot" released by "delete_snapshot" :: held 2.315s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 11:49:30 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [req-bbdd3b6b-f93e-4074-b0e5-a1dc48821fa9 req-b9173b69-7963-41d6-a7e4-5c3c63d83e36 tempest-AttachVolumeNegativeTest-771196063 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 11:49:30 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [req-bbdd3b6b-f93e-4074-b0e5-a1dc48821fa9 req-b9173b69-7963-41d6-a7e4-5c3c63d83e36 tempest-AttachVolumeNegativeTest-771196063 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 11:49:30 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [req-bbdd3b6b-f93e-4074-b0e5-a1dc48821fa9 req-b9173b69-7963-41d6-a7e4-5c3c63d83e36 tempest-AttachVolumeNegativeTest-771196063 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.020s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 11:49:30 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [req-bbdd3b6b-f93e-4074-b0e5-a1dc48821fa9 req-b9173b69-7963-41d6-a7e4-5c3c63d83e36 tempest-AttachVolumeNegativeTest-771196063 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f', 'name': 'volume-fb93bc19-4902-4d1e-955d-ec03b3f7551f', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '6e228c8d-48ad-4752-9cac-af2583360ebc', 'enforce_multipath': True} {{(pid=87116) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 06 11:49:30 devstack cinder-volume[87116]: DEBUG cinder.volume.flows.manager.create_volume [None req-b6e0c80a-020f-4942-8bf1-a39bc0ef1744 tempest-AttachVolumeTestJSON-2007150896 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87116) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 11:49:30 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-b6e0c80a-020f-4942-8bf1-a39bc0ef1744 tempest-AttachVolumeTestJSON-2007150896 None] Flow 'volume_create_manager' (5f4948a5-978f-459a-80d7-461908c8a1fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 11:49:30 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-b6e0c80a-020f-4942-8bf1-a39bc0ef1744 tempest-AttachVolumeTestJSON-2007150896 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3e333bbc-1481-48cb-870e-83d0008acd43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:49:30 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-b6e0c80a-020f-4942-8bf1-a39bc0ef1744 tempest-AttachVolumeTestJSON-2007150896 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3e333bbc-1481-48cb-870e-83d0008acd43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T10:49:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1808790799',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5cdab199-2399-425d-a524-8b6c91d10727,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4fb663f167d74c87b058c8f41ad5ad85',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T10:49:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T10:49:31Z,use_quota=True,user_id='c910d76b89eb4da199f7551aeaad2695',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(34d3b144-d9b7-480a-a2e3-01e45f3d54c1),volume_type_id=34d3b144-d9b7-480a-a2e3-01e45f3d54c1)' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:49:30 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-b6e0c80a-020f-4942-8bf1-a39bc0ef1744 tempest-AttachVolumeTestJSON-2007150896 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (11992cf9-4107-4dc5-8849-9c4115cc4180) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:49:30 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-b6e0c80a-020f-4942-8bf1-a39bc0ef1744 tempest-AttachVolumeTestJSON-2007150896 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (11992cf9-4107-4dc5-8849-9c4115cc4180) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:49:30 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-b6e0c80a-020f-4942-8bf1-a39bc0ef1744 tempest-AttachVolumeTestJSON-2007150896 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9cb849e9-6477-43fe-8ed0-90bdbd512760) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:49:30 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-b6e0c80a-020f-4942-8bf1-a39bc0ef1744 tempest-AttachVolumeTestJSON-2007150896 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9cb849e9-6477-43fe-8ed0-90bdbd512760) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5cdab199-2399-425d-a524-8b6c91d10727', 'volume_name': 'volume-5cdab199-2399-425d-a524-8b6c91d10727', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:49:30 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-b6e0c80a-020f-4942-8bf1-a39bc0ef1744 tempest-AttachVolumeTestJSON-2007150896 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (635076e8-cc99-438d-ba5e-7bd239222f3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:49:30 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-b6e0c80a-020f-4942-8bf1-a39bc0ef1744 tempest-AttachVolumeTestJSON-2007150896 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (635076e8-cc99-438d-ba5e-7bd239222f3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:49:30 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-b6e0c80a-020f-4942-8bf1-a39bc0ef1744 tempest-AttachVolumeTestJSON-2007150896 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (275f9b5f-c7d4-44e5-a25b-e2223efeda00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:49:30 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-b6e0c80a-020f-4942-8bf1-a39bc0ef1744 tempest-AttachVolumeTestJSON-2007150896 None] Volume 5cdab199-2399-425d-a524-8b6c91d10727: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5cdab199-2399-425d-a524-8b6c91d10727', 'volume_size': 1} Nov 06 11:49:30 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-b6e0c80a-020f-4942-8bf1-a39bc0ef1744 tempest-AttachVolumeTestJSON-2007150896 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 11:49:30 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-b6e0c80a-020f-4942-8bf1-a39bc0ef1744 tempest-AttachVolumeTestJSON-2007150896 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 11:49:30 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-b6e0c80a-020f-4942-8bf1-a39bc0ef1744 tempest-AttachVolumeTestJSON-2007150896 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T10:49:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1808790799',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5cdab199-2399-425d-a524-8b6c91d10727,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4fb663f167d74c87b058c8f41ad5ad85',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T10:49:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T10:49:31Z,use_quota=True,user_id='c910d76b89eb4da199f7551aeaad2695',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(34d3b144-d9b7-480a-a2e3-01e45f3d54c1),volume_type_id=34d3b144-d9b7-480a-a2e3-01e45f3d54c1)}" {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 11:49:30 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-b6e0c80a-020f-4942-8bf1-a39bc0ef1744 tempest-AttachVolumeTestJSON-2007150896 None] Creating volume 5cdab199-2399-425d-a524-8b6c91d10727 {{(pid=87116) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 11:49:30 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-b6e0c80a-020f-4942-8bf1-a39bc0ef1744 tempest-AttachVolumeTestJSON-2007150896 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 11:49:30 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-b6e0c80a-020f-4942-8bf1-a39bc0ef1744 tempest-AttachVolumeTestJSON-2007150896 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 11:49:30 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-b6e0c80a-020f-4942-8bf1-a39bc0ef1744 tempest-AttachVolumeTestJSON-2007150896 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 11:49:30 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-b6e0c80a-020f-4942-8bf1-a39bc0ef1744 tempest-AttachVolumeTestJSON-2007150896 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 11:49:30 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-b6e0c80a-020f-4942-8bf1-a39bc0ef1744 tempest-AttachVolumeTestJSON-2007150896 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 11:49:30 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-b6e0c80a-020f-4942-8bf1-a39bc0ef1744 tempest-AttachVolumeTestJSON-2007150896 None] Selected osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f as target Quobyte volume. {{(pid=87116) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 11:49:30 devstack cinder-volume[87116]: INFO cinder.volume.drivers.remotefs [None req-b6e0c80a-020f-4942-8bf1-a39bc0ef1744 tempest-AttachVolumeTestJSON-2007150896 None] casted to osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f Nov 06 11:49:30 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-b6e0c80a-020f-4942-8bf1-a39bc0ef1744 tempest-AttachVolumeTestJSON-2007150896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-5cdab199-2399-425d-a524-8b6c91d10727 1073741824 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:49:30 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-5aebc032-1236-4585-a7d5-11adad0160ce tempest-SnapshotsActionsTest-1557067016 None] Acquiring lock "cinder-51fd54bf-7093-4f26-8442-79e90c6b48c7-delete_snapshot" by "delete_snapshot" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 11:49:30 devstack sudo[95657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-5cdab199-2399-425d-a524-8b6c91d10727 1073741824 Nov 06 11:49:30 devstack sudo[95657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:49:30 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-5aebc032-1236-4585-a7d5-11adad0160ce tempest-SnapshotsActionsTest-1557067016 None] Lock "cinder-51fd54bf-7093-4f26-8442-79e90c6b48c7-delete_snapshot" acquired by "delete_snapshot" :: waited 0.034s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 11:49:30 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-5aebc032-1236-4585-a7d5-11adad0160ce tempest-SnapshotsActionsTest-1557067016 None] Acquiring lock "cinder-quobyte-b7f1d205-2e2b-4d84-bfa7-d51dfc5207ad" by "delete_snapshot" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 11:49:30 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-5aebc032-1236-4585-a7d5-11adad0160ce tempest-SnapshotsActionsTest-1557067016 None] Lock "cinder-quobyte-b7f1d205-2e2b-4d84-bfa7-d51dfc5207ad" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 11:49:30 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-5aebc032-1236-4585-a7d5-11adad0160ce tempest-SnapshotsActionsTest-1557067016 None] Acquiring lock "cinder-quobyte-51fd54bf-7093-4f26-8442-79e90c6b48c7" by "_delete_snapshot" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 11:49:30 devstack cinder-volume[87116]: INFO cinder.volume.manager [req-bbdd3b6b-f93e-4074-b0e5-a1dc48821fa9 req-b9173b69-7963-41d6-a7e4-5c3c63d83e36 tempest-AttachVolumeNegativeTest-771196063 None] attachment_update completed successfully. Nov 06 11:49:30 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-5aebc032-1236-4585-a7d5-11adad0160ce tempest-SnapshotsActionsTest-1557067016 None] Lock "cinder-quobyte-51fd54bf-7093-4f26-8442-79e90c6b48c7" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 11:49:30 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-5aebc032-1236-4585-a7d5-11adad0160ce tempest-SnapshotsActionsTest-1557067016 None] Deleting offline snapshot 51fd54bf-7093-4f26-8442-79e90c6b48c7 of volume b7f1d205-2e2b-4d84-bfa7-d51dfc5207ad {{(pid=87116) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 06 11:49:30 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-5aebc032-1236-4585-a7d5-11adad0160ce tempest-SnapshotsActionsTest-1557067016 None] snapshot_file for this snap is: volume-b7f1d205-2e2b-4d84-bfa7-d51dfc5207ad.51fd54bf-7093-4f26-8442-79e90c6b48c7 {{(pid=87116) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 06 11:49:31 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[70dbc1ae-712d-4e40-b0d3-e80292f61cf5]: (4, 'qcow2') {{(pid=88420) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 11:49:31 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-5aebc032-1236-4585-a7d5-11adad0160ce tempest-SnapshotsActionsTest-1557067016 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-b7f1d205-2e2b-4d84-bfa7-d51dfc5207ad.51fd54bf-7093-4f26-8442-79e90c6b48c7 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:49:31 devstack sudo[95660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-b7f1d205-2e2b-4d84-bfa7-d51dfc5207ad.51fd54bf-7093-4f26-8442-79e90c6b48c7 Nov 06 11:49:31 devstack sudo[95660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:49:31 devstack sudo[95657]: pam_unix(sudo:session): session closed for user root Nov 06 11:49:31 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-b6e0c80a-020f-4942-8bf1-a39bc0ef1744 tempest-AttachVolumeTestJSON-2007150896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-5cdab199-2399-425d-a524-8b6c91d10727 1073741824" returned: 0 in 0.680s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:49:31 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-b6e0c80a-020f-4942-8bf1-a39bc0ef1744 tempest-AttachVolumeTestJSON-2007150896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-5cdab199-2399-425d-a524-8b6c91d10727 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:49:31 devstack sudo[95660]: pam_unix(sudo:session): session closed for user root Nov 06 11:49:31 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-5aebc032-1236-4585-a7d5-11adad0160ce tempest-SnapshotsActionsTest-1557067016 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-b7f1d205-2e2b-4d84-bfa7-d51dfc5207ad.51fd54bf-7093-4f26-8442-79e90c6b48c7" returned: 0 in 0.571s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:49:31 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-5aebc032-1236-4585-a7d5-11adad0160ce tempest-SnapshotsActionsTest-1557067016 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b7f1d205-2e2b-4d84-bfa7-d51dfc5207ad(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87116) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 11:49:31 devstack sudo[96082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-5cdab199-2399-425d-a524-8b6c91d10727 Nov 06 11:49:31 devstack sudo[96082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:49:31 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[25d0989c-b665-4301-ad64-b65420700b87]: (4, 'qcow2') {{(pid=88420) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 11:49:31 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-5aebc032-1236-4585-a7d5-11adad0160ce tempest-SnapshotsActionsTest-1557067016 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-b7f1d205-2e2b-4d84-bfa7-d51dfc5207ad {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:49:31 devstack sudo[96084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-b7f1d205-2e2b-4d84-bfa7-d51dfc5207ad Nov 06 11:49:31 devstack sudo[96084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:49:31 devstack sudo[96082]: pam_unix(sudo:session): session closed for user root Nov 06 11:49:31 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-b6e0c80a-020f-4942-8bf1-a39bc0ef1744 tempest-AttachVolumeTestJSON-2007150896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-5cdab199-2399-425d-a524-8b6c91d10727" returned: 0 in 0.321s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:49:31 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-b6e0c80a-020f-4942-8bf1-a39bc0ef1744 tempest-AttachVolumeTestJSON-2007150896 None] <== create_volume: return (1058ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f'} {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 11:49:31 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-b6e0c80a-020f-4942-8bf1-a39bc0ef1744 tempest-AttachVolumeTestJSON-2007150896 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.062s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 11:49:31 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-b6e0c80a-020f-4942-8bf1-a39bc0ef1744 tempest-AttachVolumeTestJSON-2007150896 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (275f9b5f-c7d4-44e5-a25b-e2223efeda00) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5cdab199-2399-425d-a524-8b6c91d10727', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:49:31 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-b6e0c80a-020f-4942-8bf1-a39bc0ef1744 tempest-AttachVolumeTestJSON-2007150896 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b8466310-2063-480e-b3fe-e46e40737171) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:49:31 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-b6e0c80a-020f-4942-8bf1-a39bc0ef1744 tempest-AttachVolumeTestJSON-2007150896 None] Volume volume-5cdab199-2399-425d-a524-8b6c91d10727 (5cdab199-2399-425d-a524-8b6c91d10727): created successfully Nov 06 11:49:31 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-b6e0c80a-020f-4942-8bf1-a39bc0ef1744 tempest-AttachVolumeTestJSON-2007150896 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b8466310-2063-480e-b3fe-e46e40737171) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:49:31 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-b6e0c80a-020f-4942-8bf1-a39bc0ef1744 tempest-AttachVolumeTestJSON-2007150896 None] Flow 'volume_create_manager' (5f4948a5-978f-459a-80d7-461908c8a1fc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 11:49:31 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-b6e0c80a-020f-4942-8bf1-a39bc0ef1744 tempest-AttachVolumeTestJSON-2007150896 None] Created volume successfully. Nov 06 11:49:32 devstack sudo[96084]: pam_unix(sudo:session): session closed for user root Nov 06 11:49:32 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-5aebc032-1236-4585-a7d5-11adad0160ce tempest-SnapshotsActionsTest-1557067016 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-b7f1d205-2e2b-4d84-bfa7-d51dfc5207ad" returned: 0 in 0.464s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:49:32 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-5aebc032-1236-4585-a7d5-11adad0160ce tempest-SnapshotsActionsTest-1557067016 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-b7f1d205-2e2b-4d84-bfa7-d51dfc5207ad.51fd54bf-7093-4f26-8442-79e90c6b48c7 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:49:32 devstack sudo[96091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-b7f1d205-2e2b-4d84-bfa7-d51dfc5207ad.51fd54bf-7093-4f26-8442-79e90c6b48c7 Nov 06 11:49:32 devstack sudo[96091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:49:32 devstack sudo[96091]: pam_unix(sudo:session): session closed for user root Nov 06 11:49:32 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-5aebc032-1236-4585-a7d5-11adad0160ce tempest-SnapshotsActionsTest-1557067016 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-b7f1d205-2e2b-4d84-bfa7-d51dfc5207ad.51fd54bf-7093-4f26-8442-79e90c6b48c7" returned: 0 in 0.406s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:49:32 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-5aebc032-1236-4585-a7d5-11adad0160ce tempest-SnapshotsActionsTest-1557067016 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-b7f1d205-2e2b-4d84-bfa7-d51dfc5207ad.51fd54bf-7093-4f26-8442-79e90c6b48c7 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:49:32 devstack sudo[96098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-b7f1d205-2e2b-4d84-bfa7-d51dfc5207ad.51fd54bf-7093-4f26-8442-79e90c6b48c7 Nov 06 11:49:32 devstack sudo[96098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:49:32 devstack sudo[96098]: pam_unix(sudo:session): session closed for user root Nov 06 11:49:32 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-5aebc032-1236-4585-a7d5-11adad0160ce tempest-SnapshotsActionsTest-1557067016 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-b7f1d205-2e2b-4d84-bfa7-d51dfc5207ad.51fd54bf-7093-4f26-8442-79e90c6b48c7" returned: 0 in 0.255s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:49:32 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-5aebc032-1236-4585-a7d5-11adad0160ce tempest-SnapshotsActionsTest-1557067016 None] Lock "cinder-quobyte-51fd54bf-7093-4f26-8442-79e90c6b48c7" released by "_delete_snapshot" :: held 1.886s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 11:49:32 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-5aebc032-1236-4585-a7d5-11adad0160ce tempest-SnapshotsActionsTest-1557067016 None] Lock "cinder-quobyte-b7f1d205-2e2b-4d84-bfa7-d51dfc5207ad" released by "delete_snapshot" :: held 1.920s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 11:49:32 devstack cinder-volume[87116]: DEBUG cinder.quota [None req-5aebc032-1236-4585-a7d5-11adad0160ce tempest-SnapshotsActionsTest-1557067016 None] Created reservations ['594f762e-4b58-4045-9e48-7cb73a98d675', '0743e332-e981-4f2c-aea1-15b268ede97c', '3c27dedf-5ba2-40ec-9fd1-271d52f14c7d', 'f628b718-9254-4019-8975-44822d91a4a6'] {{(pid=87116) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 11:49:33 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-5aebc032-1236-4585-a7d5-11adad0160ce tempest-SnapshotsActionsTest-1557067016 None] Delete snapshot completed successfully. Nov 06 11:49:33 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-5aebc032-1236-4585-a7d5-11adad0160ce tempest-SnapshotsActionsTest-1557067016 None] Lock "cinder-51fd54bf-7093-4f26-8442-79e90c6b48c7-delete_snapshot" released by "delete_snapshot" :: held 2.126s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 11:49:33 devstack cinder-volume[87116]: INFO cinder.volume.manager [req-dfaabff0-2417-4b7a-b285-8b4bba77b162 req-31c5cf98-2b55-481c-b4a2-9681d269dd5e tempest-AttachVolumeNegativeTest-771196063 None] Terminate volume connection completed successfully. Nov 06 11:49:33 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [req-dfaabff0-2417-4b7a-b285-8b4bba77b162 req-31c5cf98-2b55-481c-b4a2-9681d269dd5e tempest-AttachVolumeNegativeTest-771196063 None] Deleting attachment 6e228c8d-48ad-4752-9cac-af2583360ebc. {{(pid=87116) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 06 11:49:33 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [req-3b7b2c6d-3b09-4a50-bc69-8cae9ad3e06a req-2ec51492-c69e-4187-9c0f-88edbbe27b70 tempest-AttachVolumeTestJSON-2007150896 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 11:49:33 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [req-3b7b2c6d-3b09-4a50-bc69-8cae9ad3e06a req-2ec51492-c69e-4187-9c0f-88edbbe27b70 tempest-AttachVolumeTestJSON-2007150896 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 11:49:33 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [req-3b7b2c6d-3b09-4a50-bc69-8cae9ad3e06a req-2ec51492-c69e-4187-9c0f-88edbbe27b70 tempest-AttachVolumeTestJSON-2007150896 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.013s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 11:49:33 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [req-3b7b2c6d-3b09-4a50-bc69-8cae9ad3e06a req-2ec51492-c69e-4187-9c0f-88edbbe27b70 tempest-AttachVolumeTestJSON-2007150896 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f', 'name': 'volume-5cdab199-2399-425d-a524-8b6c91d10727', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'e33dd49e-ee9a-4798-9196-8cf49405fd53', 'enforce_multipath': True} {{(pid=87116) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 06 11:49:34 devstack cinder-volume[87116]: INFO cinder.volume.manager [req-3b7b2c6d-3b09-4a50-bc69-8cae9ad3e06a req-2ec51492-c69e-4187-9c0f-88edbbe27b70 tempest-AttachVolumeTestJSON-2007150896 None] attachment_update completed successfully. Nov 06 11:49:34 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-2ab4d9a5-8c01-4eaa-be29-7fe672a22258 tempest-SnapshotsActionsTest-1557067016 None] Acquiring lock "cinder-b7f1d205-2e2b-4d84-bfa7-d51dfc5207ad-delete_volume" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 11:49:34 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-2ab4d9a5-8c01-4eaa-be29-7fe672a22258 tempest-SnapshotsActionsTest-1557067016 None] Lock "cinder-b7f1d205-2e2b-4d84-bfa7-d51dfc5207ad-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 11:49:34 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-2ab4d9a5-8c01-4eaa-be29-7fe672a22258 tempest-SnapshotsActionsTest-1557067016 None] Acquiring lock "cinder-quobyte-b7f1d205-2e2b-4d84-bfa7-d51dfc5207ad" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 11:49:34 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-2ab4d9a5-8c01-4eaa-be29-7fe672a22258 tempest-SnapshotsActionsTest-1557067016 None] Lock "cinder-quobyte-b7f1d205-2e2b-4d84-bfa7-d51dfc5207ad" acquired by "delete_volume" :: waited 0.034s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 11:49:34 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[56fd6bc0-c181-496c-aa76-87dba282ee4f]: (4, 'qcow2') {{(pid=88420) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 11:49:34 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-2ab4d9a5-8c01-4eaa-be29-7fe672a22258 tempest-SnapshotsActionsTest-1557067016 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-b7f1d205-2e2b-4d84-bfa7-d51dfc5207ad {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:49:34 devstack sudo[96238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-b7f1d205-2e2b-4d84-bfa7-d51dfc5207ad Nov 06 11:49:34 devstack sudo[96238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:49:35 devstack sudo[96238]: pam_unix(sudo:session): session closed for user root Nov 06 11:49:35 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-2ab4d9a5-8c01-4eaa-be29-7fe672a22258 tempest-SnapshotsActionsTest-1557067016 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-b7f1d205-2e2b-4d84-bfa7-d51dfc5207ad" returned: 0 in 0.664s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:49:35 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-2ab4d9a5-8c01-4eaa-be29-7fe672a22258 tempest-SnapshotsActionsTest-1557067016 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-b7f1d205-2e2b-4d84-bfa7-d51dfc5207ad {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:49:35 devstack sudo[96581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-b7f1d205-2e2b-4d84-bfa7-d51dfc5207ad Nov 06 11:49:35 devstack sudo[96581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:49:35 devstack sudo[96581]: pam_unix(sudo:session): session closed for user root Nov 06 11:49:35 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-2ab4d9a5-8c01-4eaa-be29-7fe672a22258 tempest-SnapshotsActionsTest-1557067016 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-b7f1d205-2e2b-4d84-bfa7-d51dfc5207ad" returned: 0 in 0.382s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:49:35 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-2ab4d9a5-8c01-4eaa-be29-7fe672a22258 tempest-SnapshotsActionsTest-1557067016 None] Lock "cinder-quobyte-b7f1d205-2e2b-4d84-bfa7-d51dfc5207ad" released by "delete_volume" :: held 1.156s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 11:49:35 devstack cinder-volume[87116]: DEBUG cinder.quota [None req-2ab4d9a5-8c01-4eaa-be29-7fe672a22258 tempest-SnapshotsActionsTest-1557067016 None] Created reservations ['06e0ca18-723d-43e1-83d0-15996f6e025f', '33665fbd-2a08-4561-8d37-295c029f5d8d', '7e3cffc4-2f08-443e-86bf-c9910db7b2ea', '4a63d073-5583-4987-a94b-36784487cd16'] {{(pid=87116) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 11:49:35 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-2ab4d9a5-8c01-4eaa-be29-7fe672a22258 tempest-SnapshotsActionsTest-1557067016 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 11:49:35 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-2ab4d9a5-8c01-4eaa-be29-7fe672a22258 tempest-SnapshotsActionsTest-1557067016 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 11:49:35 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-2ab4d9a5-8c01-4eaa-be29-7fe672a22258 tempest-SnapshotsActionsTest-1557067016 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 11:49:35 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-2ab4d9a5-8c01-4eaa-be29-7fe672a22258 tempest-SnapshotsActionsTest-1557067016 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 11:49:35 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-2ab4d9a5-8c01-4eaa-be29-7fe672a22258 tempest-SnapshotsActionsTest-1557067016 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 11:49:35 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-2ab4d9a5-8c01-4eaa-be29-7fe672a22258 tempest-SnapshotsActionsTest-1557067016 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:49:35 devstack sudo[96586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756 Nov 06 11:49:35 devstack sudo[96586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:49:35 devstack sudo[96586]: pam_unix(sudo:session): session closed for user root Nov 06 11:49:35 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-2ab4d9a5-8c01-4eaa-be29-7fe672a22258 tempest-SnapshotsActionsTest-1557067016 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756" returned: 0 in 0.319s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:49:35 devstack cinder-volume[87116]: DEBUG cinder.manager [None req-2ab4d9a5-8c01-4eaa-be29-7fe672a22258 tempest-SnapshotsActionsTest-1557067016 None] Notifying Schedulers of capabilities ... {{(pid=87116) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 11:49:36 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-2ab4d9a5-8c01-4eaa-be29-7fe672a22258 tempest-SnapshotsActionsTest-1557067016 None] Deleted volume successfully. Nov 06 11:49:36 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-2ab4d9a5-8c01-4eaa-be29-7fe672a22258 tempest-SnapshotsActionsTest-1557067016 None] Lock "cinder-b7f1d205-2e2b-4d84-bfa7-d51dfc5207ad-delete_volume" released by "delete_volume" :: held 1.808s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 11:49:37 devstack cinder-volume[87116]: DEBUG cinder.volume.flows.manager.create_volume [None req-b3b45e2d-15f5-489d-aeb9-7d4018bd9e4a tempest-AttachVolumeTestJSON-2007150896 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87116) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 11:49:37 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-b3b45e2d-15f5-489d-aeb9-7d4018bd9e4a tempest-AttachVolumeTestJSON-2007150896 None] Flow 'volume_create_manager' (9fef5ca0-3e4e-4f6a-b616-dfec28e14099) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 11:49:37 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-b3b45e2d-15f5-489d-aeb9-7d4018bd9e4a tempest-AttachVolumeTestJSON-2007150896 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fcbf7cf9-62a3-4e3d-b23f-8efef782af04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:49:37 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-b3b45e2d-15f5-489d-aeb9-7d4018bd9e4a tempest-AttachVolumeTestJSON-2007150896 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fcbf7cf9-62a3-4e3d-b23f-8efef782af04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T10:49:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-360235788',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=77f5565d-7637-42c7-b3ac-afa8fa1af13e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4fb663f167d74c87b058c8f41ad5ad85',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T10:49:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T10:49:37Z,use_quota=True,user_id='c910d76b89eb4da199f7551aeaad2695',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(34d3b144-d9b7-480a-a2e3-01e45f3d54c1),volume_type_id=34d3b144-d9b7-480a-a2e3-01e45f3d54c1)' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:49:37 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-b3b45e2d-15f5-489d-aeb9-7d4018bd9e4a tempest-AttachVolumeTestJSON-2007150896 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ae40ab0c-f36b-4983-86cf-29bc1d8a3eac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:49:37 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-b3b45e2d-15f5-489d-aeb9-7d4018bd9e4a tempest-AttachVolumeTestJSON-2007150896 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ae40ab0c-f36b-4983-86cf-29bc1d8a3eac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:49:37 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-b3b45e2d-15f5-489d-aeb9-7d4018bd9e4a tempest-AttachVolumeTestJSON-2007150896 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aa180ddc-687a-47e3-b6a4-6f394b4d2075) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:49:37 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-b3b45e2d-15f5-489d-aeb9-7d4018bd9e4a tempest-AttachVolumeTestJSON-2007150896 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aa180ddc-687a-47e3-b6a4-6f394b4d2075) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '77f5565d-7637-42c7-b3ac-afa8fa1af13e', 'volume_name': 'volume-77f5565d-7637-42c7-b3ac-afa8fa1af13e', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:49:37 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-b3b45e2d-15f5-489d-aeb9-7d4018bd9e4a tempest-AttachVolumeTestJSON-2007150896 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e06153d2-aa35-45e7-9491-3b0e2f3c69b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:49:37 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-b3b45e2d-15f5-489d-aeb9-7d4018bd9e4a tempest-AttachVolumeTestJSON-2007150896 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e06153d2-aa35-45e7-9491-3b0e2f3c69b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:49:37 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-b3b45e2d-15f5-489d-aeb9-7d4018bd9e4a tempest-AttachVolumeTestJSON-2007150896 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b031f60e-9baf-4252-a108-440299cb2a7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:49:37 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-b3b45e2d-15f5-489d-aeb9-7d4018bd9e4a tempest-AttachVolumeTestJSON-2007150896 None] Volume 77f5565d-7637-42c7-b3ac-afa8fa1af13e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-77f5565d-7637-42c7-b3ac-afa8fa1af13e', 'volume_size': 1} Nov 06 11:49:37 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-b3b45e2d-15f5-489d-aeb9-7d4018bd9e4a tempest-AttachVolumeTestJSON-2007150896 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 11:49:37 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-b3b45e2d-15f5-489d-aeb9-7d4018bd9e4a tempest-AttachVolumeTestJSON-2007150896 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 11:49:37 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-b3b45e2d-15f5-489d-aeb9-7d4018bd9e4a tempest-AttachVolumeTestJSON-2007150896 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T10:49:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-360235788',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=77f5565d-7637-42c7-b3ac-afa8fa1af13e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4fb663f167d74c87b058c8f41ad5ad85',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T10:49:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T10:49:37Z,use_quota=True,user_id='c910d76b89eb4da199f7551aeaad2695',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(34d3b144-d9b7-480a-a2e3-01e45f3d54c1),volume_type_id=34d3b144-d9b7-480a-a2e3-01e45f3d54c1)}" {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 11:49:37 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-b3b45e2d-15f5-489d-aeb9-7d4018bd9e4a tempest-AttachVolumeTestJSON-2007150896 None] Creating volume 77f5565d-7637-42c7-b3ac-afa8fa1af13e {{(pid=87116) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 11:49:37 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-b3b45e2d-15f5-489d-aeb9-7d4018bd9e4a tempest-AttachVolumeTestJSON-2007150896 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 11:49:37 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-b3b45e2d-15f5-489d-aeb9-7d4018bd9e4a tempest-AttachVolumeTestJSON-2007150896 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 11:49:37 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-b3b45e2d-15f5-489d-aeb9-7d4018bd9e4a tempest-AttachVolumeTestJSON-2007150896 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 11:49:37 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-b3b45e2d-15f5-489d-aeb9-7d4018bd9e4a tempest-AttachVolumeTestJSON-2007150896 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 11:49:37 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-b3b45e2d-15f5-489d-aeb9-7d4018bd9e4a tempest-AttachVolumeTestJSON-2007150896 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 11:49:37 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-b3b45e2d-15f5-489d-aeb9-7d4018bd9e4a tempest-AttachVolumeTestJSON-2007150896 None] Selected osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f as target Quobyte volume. {{(pid=87116) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 11:49:37 devstack cinder-volume[87116]: INFO cinder.volume.drivers.remotefs [None req-b3b45e2d-15f5-489d-aeb9-7d4018bd9e4a tempest-AttachVolumeTestJSON-2007150896 None] casted to osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f Nov 06 11:49:37 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-b3b45e2d-15f5-489d-aeb9-7d4018bd9e4a tempest-AttachVolumeTestJSON-2007150896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-77f5565d-7637-42c7-b3ac-afa8fa1af13e 1073741824 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:49:37 devstack sudo[96596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-77f5565d-7637-42c7-b3ac-afa8fa1af13e 1073741824 Nov 06 11:49:37 devstack sudo[96596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:49:37 devstack sudo[96596]: pam_unix(sudo:session): session closed for user root Nov 06 11:49:37 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-b3b45e2d-15f5-489d-aeb9-7d4018bd9e4a tempest-AttachVolumeTestJSON-2007150896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-77f5565d-7637-42c7-b3ac-afa8fa1af13e 1073741824" returned: 0 in 0.792s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:49:37 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-b3b45e2d-15f5-489d-aeb9-7d4018bd9e4a tempest-AttachVolumeTestJSON-2007150896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-77f5565d-7637-42c7-b3ac-afa8fa1af13e {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:49:38 devstack sudo[96603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-77f5565d-7637-42c7-b3ac-afa8fa1af13e Nov 06 11:49:38 devstack sudo[96603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:49:38 devstack sudo[96603]: pam_unix(sudo:session): session closed for user root Nov 06 11:49:38 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-b3b45e2d-15f5-489d-aeb9-7d4018bd9e4a tempest-AttachVolumeTestJSON-2007150896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-77f5565d-7637-42c7-b3ac-afa8fa1af13e" returned: 0 in 0.291s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:49:38 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-b3b45e2d-15f5-489d-aeb9-7d4018bd9e4a tempest-AttachVolumeTestJSON-2007150896 None] <== create_volume: return (1135ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f'} {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 11:49:38 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-b3b45e2d-15f5-489d-aeb9-7d4018bd9e4a tempest-AttachVolumeTestJSON-2007150896 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.140s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 11:49:38 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-b3b45e2d-15f5-489d-aeb9-7d4018bd9e4a tempest-AttachVolumeTestJSON-2007150896 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b031f60e-9baf-4252-a108-440299cb2a7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-77f5565d-7637-42c7-b3ac-afa8fa1af13e', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:49:38 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-b3b45e2d-15f5-489d-aeb9-7d4018bd9e4a tempest-AttachVolumeTestJSON-2007150896 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (38b0a69d-3cb6-4494-a06c-d18942cdf04c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:49:38 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-b3b45e2d-15f5-489d-aeb9-7d4018bd9e4a tempest-AttachVolumeTestJSON-2007150896 None] Volume volume-77f5565d-7637-42c7-b3ac-afa8fa1af13e (77f5565d-7637-42c7-b3ac-afa8fa1af13e): created successfully Nov 06 11:49:38 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-b3b45e2d-15f5-489d-aeb9-7d4018bd9e4a tempest-AttachVolumeTestJSON-2007150896 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (38b0a69d-3cb6-4494-a06c-d18942cdf04c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:49:38 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-b3b45e2d-15f5-489d-aeb9-7d4018bd9e4a tempest-AttachVolumeTestJSON-2007150896 None] Flow 'volume_create_manager' (9fef5ca0-3e4e-4f6a-b616-dfec28e14099) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 11:49:38 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-b3b45e2d-15f5-489d-aeb9-7d4018bd9e4a tempest-AttachVolumeTestJSON-2007150896 None] Created volume successfully. Nov 06 11:49:39 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-3950e579-b805-4744-ac47-7dada52e4307 tempest-AttachVolumeNegativeTest-771196063 None] Acquiring lock "cinder-fb93bc19-4902-4d1e-955d-ec03b3f7551f-delete_volume" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 11:49:39 devstack cinder-volume[87116]: DEBUG oslo_service.periodic_task [None req-4fab4816-ec2b-4b19-b2ff-8548f2084354 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87116) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 11:49:39 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-4fab4816-ec2b-4b19-b2ff-8548f2084354 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 11:49:39 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-4fab4816-ec2b-4b19-b2ff-8548f2084354 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 11:49:39 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-4fab4816-ec2b-4b19-b2ff-8548f2084354 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 11:49:39 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-4fab4816-ec2b-4b19-b2ff-8548f2084354 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 11:49:39 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-4fab4816-ec2b-4b19-b2ff-8548f2084354 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 11:49:39 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-4fab4816-ec2b-4b19-b2ff-8548f2084354 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:49:39 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-3950e579-b805-4744-ac47-7dada52e4307 tempest-AttachVolumeNegativeTest-771196063 None] Lock "cinder-fb93bc19-4902-4d1e-955d-ec03b3f7551f-delete_volume" acquired by "delete_volume" :: waited 0.070s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 11:49:39 devstack sudo[96609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756 Nov 06 11:49:39 devstack sudo[96609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:49:39 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-3950e579-b805-4744-ac47-7dada52e4307 tempest-AttachVolumeNegativeTest-771196063 None] Acquiring lock "cinder-quobyte-fb93bc19-4902-4d1e-955d-ec03b3f7551f" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 11:49:39 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-3950e579-b805-4744-ac47-7dada52e4307 tempest-AttachVolumeNegativeTest-771196063 None] Lock "cinder-quobyte-fb93bc19-4902-4d1e-955d-ec03b3f7551f" acquired by "delete_volume" :: waited 0.034s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 11:49:40 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[a07d8478-9cb8-4d22-a130-724836b86802]: (4, 'qcow2') {{(pid=88420) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 11:49:40 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-3950e579-b805-4744-ac47-7dada52e4307 tempest-AttachVolumeNegativeTest-771196063 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-fb93bc19-4902-4d1e-955d-ec03b3f7551f {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:49:40 devstack sudo[96617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-fb93bc19-4902-4d1e-955d-ec03b3f7551f Nov 06 11:49:40 devstack sudo[96617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:49:40 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [req-6f9f40de-0493-4a73-aba3-c2abdaef24c2 req-1fb6ba0c-20ac-43a4-b907-09c88a27721e tempest-AttachVolumeTestJSON-2007150896 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 11:49:40 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [req-6f9f40de-0493-4a73-aba3-c2abdaef24c2 req-1fb6ba0c-20ac-43a4-b907-09c88a27721e tempest-AttachVolumeTestJSON-2007150896 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 11:49:40 devstack sudo[96609]: pam_unix(sudo:session): session closed for user root Nov 06 11:49:40 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [req-6f9f40de-0493-4a73-aba3-c2abdaef24c2 req-1fb6ba0c-20ac-43a4-b907-09c88a27721e tempest-AttachVolumeTestJSON-2007150896 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.020s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 11:49:40 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-4fab4816-ec2b-4b19-b2ff-8548f2084354 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756" returned: 0 in 0.406s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:49:40 devstack cinder-volume[87116]: DEBUG cinder.manager [None req-4fab4816-ec2b-4b19-b2ff-8548f2084354 None None] Notifying Schedulers of capabilities ... {{(pid=87116) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 11:49:40 devstack cinder-volume[87116]: DEBUG oslo_service.periodic_task [None req-4fab4816-ec2b-4b19-b2ff-8548f2084354 None None] Running periodic task VolumeManager._thread_info {{(pid=87116) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 11:49:40 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-4fab4816-ec2b-4b19-b2ff-8548f2084354 None None] thread count: 28 {{(pid=87116) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 06 11:49:40 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-4fab4816-ec2b-4b19-b2ff-8548f2084354 None None] thread info: [<_MainThread(MainThread, started 131399520669824)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87116) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 06 11:49:40 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [req-6f9f40de-0493-4a73-aba3-c2abdaef24c2 req-1fb6ba0c-20ac-43a4-b907-09c88a27721e tempest-AttachVolumeTestJSON-2007150896 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f', 'name': 'volume-77f5565d-7637-42c7-b3ac-afa8fa1af13e', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'b48940ac-af92-4988-af5b-2c2da6aa2c0c', 'enforce_multipath': True} {{(pid=87116) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 06 11:49:40 devstack cinder-volume[87116]: INFO cinder.volume.manager [req-6f9f40de-0493-4a73-aba3-c2abdaef24c2 req-1fb6ba0c-20ac-43a4-b907-09c88a27721e tempest-AttachVolumeTestJSON-2007150896 None] attachment_update completed successfully. Nov 06 11:49:40 devstack cinder-volume[87116]: DEBUG cinder.volume.flows.manager.create_volume [None req-0d95ec65-1f6e-427f-a658-3d531b63dacd tempest-AbsoluteLimitsTests-869614993 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87116) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 11:49:40 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-0d95ec65-1f6e-427f-a658-3d531b63dacd tempest-AbsoluteLimitsTests-869614993 None] Flow 'volume_create_manager' (d3f8aec3-405d-409e-9674-7cc282830b9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 11:49:40 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-0d95ec65-1f6e-427f-a658-3d531b63dacd tempest-AbsoluteLimitsTests-869614993 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7349209c-e3b1-42f6-8906-9c5ca983973a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:49:40 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-0d95ec65-1f6e-427f-a658-3d531b63dacd tempest-AbsoluteLimitsTests-869614993 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7349209c-e3b1-42f6-8906-9c5ca983973a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T10:49:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1287509553',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=66419986-441b-4d25-b10f-31f136b68e28,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='64447adf7a3f4068a525697c1d62d280',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T10:49:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T10:49:40Z,use_quota=True,user_id='19432476f9a7416d985564e4259e3579',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(34d3b144-d9b7-480a-a2e3-01e45f3d54c1),volume_type_id=34d3b144-d9b7-480a-a2e3-01e45f3d54c1)' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:49:40 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-0d95ec65-1f6e-427f-a658-3d531b63dacd tempest-AbsoluteLimitsTests-869614993 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c7f26da3-559f-465a-90d6-bd0434a6fdf7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:49:40 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-0d95ec65-1f6e-427f-a658-3d531b63dacd tempest-AbsoluteLimitsTests-869614993 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c7f26da3-559f-465a-90d6-bd0434a6fdf7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:49:40 devstack sudo[96617]: pam_unix(sudo:session): session closed for user root Nov 06 11:49:40 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-0d95ec65-1f6e-427f-a658-3d531b63dacd tempest-AbsoluteLimitsTests-869614993 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c3d46866-4db5-4208-bc90-fd15b52bcd44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:49:40 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-0d95ec65-1f6e-427f-a658-3d531b63dacd tempest-AbsoluteLimitsTests-869614993 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c3d46866-4db5-4208-bc90-fd15b52bcd44) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '66419986-441b-4d25-b10f-31f136b68e28', 'volume_name': 'volume-66419986-441b-4d25-b10f-31f136b68e28', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:49:40 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-0d95ec65-1f6e-427f-a658-3d531b63dacd tempest-AbsoluteLimitsTests-869614993 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1069ff62-9d81-4582-a7a6-c09bd3262a0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:49:40 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-0d95ec65-1f6e-427f-a658-3d531b63dacd tempest-AbsoluteLimitsTests-869614993 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1069ff62-9d81-4582-a7a6-c09bd3262a0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:49:40 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-0d95ec65-1f6e-427f-a658-3d531b63dacd tempest-AbsoluteLimitsTests-869614993 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5b31d1a8-706b-4205-9e49-c4d1c62ff5d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:49:40 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-0d95ec65-1f6e-427f-a658-3d531b63dacd tempest-AbsoluteLimitsTests-869614993 None] Volume 66419986-441b-4d25-b10f-31f136b68e28: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-66419986-441b-4d25-b10f-31f136b68e28', 'volume_size': 1} Nov 06 11:49:40 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-0d95ec65-1f6e-427f-a658-3d531b63dacd tempest-AbsoluteLimitsTests-869614993 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 11:49:40 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-0d95ec65-1f6e-427f-a658-3d531b63dacd tempest-AbsoluteLimitsTests-869614993 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 11:49:40 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-0d95ec65-1f6e-427f-a658-3d531b63dacd tempest-AbsoluteLimitsTests-869614993 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T10:49:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1287509553',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=66419986-441b-4d25-b10f-31f136b68e28,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='64447adf7a3f4068a525697c1d62d280',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T10:49:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T10:49:40Z,use_quota=True,user_id='19432476f9a7416d985564e4259e3579',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(34d3b144-d9b7-480a-a2e3-01e45f3d54c1),volume_type_id=34d3b144-d9b7-480a-a2e3-01e45f3d54c1)}" {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 11:49:40 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-0d95ec65-1f6e-427f-a658-3d531b63dacd tempest-AbsoluteLimitsTests-869614993 None] Creating volume 66419986-441b-4d25-b10f-31f136b68e28 {{(pid=87116) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 11:49:40 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-0d95ec65-1f6e-427f-a658-3d531b63dacd tempest-AbsoluteLimitsTests-869614993 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 11:49:40 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-0d95ec65-1f6e-427f-a658-3d531b63dacd tempest-AbsoluteLimitsTests-869614993 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 11:49:40 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-0d95ec65-1f6e-427f-a658-3d531b63dacd tempest-AbsoluteLimitsTests-869614993 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 11:49:40 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-0d95ec65-1f6e-427f-a658-3d531b63dacd tempest-AbsoluteLimitsTests-869614993 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 11:49:40 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-0d95ec65-1f6e-427f-a658-3d531b63dacd tempest-AbsoluteLimitsTests-869614993 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 11:49:40 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-0d95ec65-1f6e-427f-a658-3d531b63dacd tempest-AbsoluteLimitsTests-869614993 None] Selected osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f as target Quobyte volume. {{(pid=87116) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 11:49:40 devstack cinder-volume[87116]: INFO cinder.volume.drivers.remotefs [None req-0d95ec65-1f6e-427f-a658-3d531b63dacd tempest-AbsoluteLimitsTests-869614993 None] casted to osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f Nov 06 11:49:40 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-0d95ec65-1f6e-427f-a658-3d531b63dacd tempest-AbsoluteLimitsTests-869614993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-66419986-441b-4d25-b10f-31f136b68e28 1073741824 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:49:40 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-3950e579-b805-4744-ac47-7dada52e4307 tempest-AttachVolumeNegativeTest-771196063 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-fb93bc19-4902-4d1e-955d-ec03b3f7551f" returned: 0 in 0.557s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:49:40 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-3950e579-b805-4744-ac47-7dada52e4307 tempest-AttachVolumeNegativeTest-771196063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-fb93bc19-4902-4d1e-955d-ec03b3f7551f {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:49:40 devstack sudo[96627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-66419986-441b-4d25-b10f-31f136b68e28 1073741824 Nov 06 11:49:40 devstack sudo[96627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:49:40 devstack sudo[96628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-fb93bc19-4902-4d1e-955d-ec03b3f7551f Nov 06 11:49:40 devstack sudo[96628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:49:40 devstack sudo[96628]: pam_unix(sudo:session): session closed for user root Nov 06 11:49:40 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-3950e579-b805-4744-ac47-7dada52e4307 tempest-AttachVolumeNegativeTest-771196063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-fb93bc19-4902-4d1e-955d-ec03b3f7551f" returned: 0 in 0.382s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:49:40 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-3950e579-b805-4744-ac47-7dada52e4307 tempest-AttachVolumeNegativeTest-771196063 None] Lock "cinder-quobyte-fb93bc19-4902-4d1e-955d-ec03b3f7551f" released by "delete_volume" :: held 1.016s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 11:49:41 devstack cinder-volume[87116]: DEBUG cinder.quota [None req-3950e579-b805-4744-ac47-7dada52e4307 tempest-AttachVolumeNegativeTest-771196063 None] Created reservations ['a6fd8f25-f81d-406f-ac3c-5334cb6fde3a', 'e297d04a-33d2-4649-a413-80fc2881b5cd', '422b7f3f-a068-4d17-bd86-ae13515bca0b', 'e2094d79-acf0-485b-a871-72fc9c8b4a26'] {{(pid=87116) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 11:49:41 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-3950e579-b805-4744-ac47-7dada52e4307 tempest-AttachVolumeNegativeTest-771196063 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 11:49:41 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-3950e579-b805-4744-ac47-7dada52e4307 tempest-AttachVolumeNegativeTest-771196063 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 11:49:41 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-3950e579-b805-4744-ac47-7dada52e4307 tempest-AttachVolumeNegativeTest-771196063 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 11:49:41 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-3950e579-b805-4744-ac47-7dada52e4307 tempest-AttachVolumeNegativeTest-771196063 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 11:49:41 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-3950e579-b805-4744-ac47-7dada52e4307 tempest-AttachVolumeNegativeTest-771196063 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 11:49:41 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-3950e579-b805-4744-ac47-7dada52e4307 tempest-AttachVolumeNegativeTest-771196063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:49:41 devstack sudo[96636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756 Nov 06 11:49:41 devstack sudo[96636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:49:41 devstack sudo[96627]: pam_unix(sudo:session): session closed for user root Nov 06 11:49:41 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-0d95ec65-1f6e-427f-a658-3d531b63dacd tempest-AbsoluteLimitsTests-869614993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-66419986-441b-4d25-b10f-31f136b68e28 1073741824" returned: 0 in 0.747s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:49:41 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-0d95ec65-1f6e-427f-a658-3d531b63dacd tempest-AbsoluteLimitsTests-869614993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-66419986-441b-4d25-b10f-31f136b68e28 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:49:41 devstack sudo[96638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-66419986-441b-4d25-b10f-31f136b68e28 Nov 06 11:49:41 devstack sudo[96638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:49:41 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-9dac4f75-9122-4c04-8615-7f687ac363ac tempest-AttachVolumeNegativeTest-771196063 None] Acquiring lock "cinder-2232a031-c40c-43e0-b553-d6a9e6a8b941-delete_volume" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 11:49:41 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-9dac4f75-9122-4c04-8615-7f687ac363ac tempest-AttachVolumeNegativeTest-771196063 None] Lock "cinder-2232a031-c40c-43e0-b553-d6a9e6a8b941-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 11:49:41 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-9dac4f75-9122-4c04-8615-7f687ac363ac tempest-AttachVolumeNegativeTest-771196063 None] Acquiring lock "cinder-quobyte-2232a031-c40c-43e0-b553-d6a9e6a8b941" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 11:49:41 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-9dac4f75-9122-4c04-8615-7f687ac363ac tempest-AttachVolumeNegativeTest-771196063 None] Lock "cinder-quobyte-2232a031-c40c-43e0-b553-d6a9e6a8b941" acquired by "delete_volume" :: waited 0.017s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 11:49:41 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9bd7514-8a14-470b-b50b-891e343a1caf]: (4, 'qcow2') {{(pid=88420) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 11:49:41 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-9dac4f75-9122-4c04-8615-7f687ac363ac tempest-AttachVolumeNegativeTest-771196063 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-2232a031-c40c-43e0-b553-d6a9e6a8b941 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:49:41 devstack sudo[96636]: pam_unix(sudo:session): session closed for user root Nov 06 11:49:41 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-3950e579-b805-4744-ac47-7dada52e4307 tempest-AttachVolumeNegativeTest-771196063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756" returned: 0 in 0.435s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:49:41 devstack cinder-volume[87116]: DEBUG cinder.manager [None req-3950e579-b805-4744-ac47-7dada52e4307 tempest-AttachVolumeNegativeTest-771196063 None] Notifying Schedulers of capabilities ... {{(pid=87116) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 11:49:41 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-3950e579-b805-4744-ac47-7dada52e4307 tempest-AttachVolumeNegativeTest-771196063 None] Deleted volume successfully. Nov 06 11:49:41 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-3950e579-b805-4744-ac47-7dada52e4307 tempest-AttachVolumeNegativeTest-771196063 None] Lock "cinder-fb93bc19-4902-4d1e-955d-ec03b3f7551f-delete_volume" released by "delete_volume" :: held 1.736s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 11:49:41 devstack sudo[96641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-2232a031-c40c-43e0-b553-d6a9e6a8b941 Nov 06 11:49:41 devstack sudo[96641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:49:41 devstack sudo[96638]: pam_unix(sudo:session): session closed for user root Nov 06 11:49:41 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-0d95ec65-1f6e-427f-a658-3d531b63dacd tempest-AbsoluteLimitsTests-869614993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-66419986-441b-4d25-b10f-31f136b68e28" returned: 0 in 0.338s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:49:41 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-0d95ec65-1f6e-427f-a658-3d531b63dacd tempest-AbsoluteLimitsTests-869614993 None] <== create_volume: return (1164ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f'} {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 11:49:41 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-0d95ec65-1f6e-427f-a658-3d531b63dacd tempest-AbsoluteLimitsTests-869614993 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.166s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 11:49:41 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-0d95ec65-1f6e-427f-a658-3d531b63dacd tempest-AbsoluteLimitsTests-869614993 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5b31d1a8-706b-4205-9e49-c4d1c62ff5d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-66419986-441b-4d25-b10f-31f136b68e28', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:49:41 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-0d95ec65-1f6e-427f-a658-3d531b63dacd tempest-AbsoluteLimitsTests-869614993 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b30fccd4-664b-44c2-be5a-957c8a47b397) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:49:41 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-0d95ec65-1f6e-427f-a658-3d531b63dacd tempest-AbsoluteLimitsTests-869614993 None] Volume volume-66419986-441b-4d25-b10f-31f136b68e28 (66419986-441b-4d25-b10f-31f136b68e28): created successfully Nov 06 11:49:41 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-0d95ec65-1f6e-427f-a658-3d531b63dacd tempest-AbsoluteLimitsTests-869614993 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b30fccd4-664b-44c2-be5a-957c8a47b397) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:49:41 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-0d95ec65-1f6e-427f-a658-3d531b63dacd tempest-AbsoluteLimitsTests-869614993 None] Flow 'volume_create_manager' (d3f8aec3-405d-409e-9674-7cc282830b9e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 11:49:41 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-0d95ec65-1f6e-427f-a658-3d531b63dacd tempest-AbsoluteLimitsTests-869614993 None] Created volume successfully. Nov 06 11:49:41 devstack sudo[96641]: pam_unix(sudo:session): session closed for user root Nov 06 11:49:41 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-9dac4f75-9122-4c04-8615-7f687ac363ac tempest-AttachVolumeNegativeTest-771196063 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-2232a031-c40c-43e0-b553-d6a9e6a8b941" returned: 0 in 0.429s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:49:41 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-9dac4f75-9122-4c04-8615-7f687ac363ac tempest-AttachVolumeNegativeTest-771196063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-2232a031-c40c-43e0-b553-d6a9e6a8b941 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:49:42 devstack sudo[96647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-2232a031-c40c-43e0-b553-d6a9e6a8b941 Nov 06 11:49:42 devstack sudo[96647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:49:42 devstack sudo[96647]: pam_unix(sudo:session): session closed for user root Nov 06 11:49:42 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-9dac4f75-9122-4c04-8615-7f687ac363ac tempest-AttachVolumeNegativeTest-771196063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-2232a031-c40c-43e0-b553-d6a9e6a8b941" returned: 0 in 0.264s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:49:42 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-9dac4f75-9122-4c04-8615-7f687ac363ac tempest-AttachVolumeNegativeTest-771196063 None] Lock "cinder-quobyte-2232a031-c40c-43e0-b553-d6a9e6a8b941" released by "delete_volume" :: held 0.749s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 11:49:42 devstack cinder-volume[87116]: DEBUG cinder.quota [None req-9dac4f75-9122-4c04-8615-7f687ac363ac tempest-AttachVolumeNegativeTest-771196063 None] Created reservations ['4f6eb96f-d191-4f53-96c9-eb26dff4ff71', '6f5b21e2-83c2-494c-8acf-b66728b97a5a', 'eedb0e1c-053f-4d14-a66a-319a6011fe2c', '1ebaa802-3289-46c9-bb91-fef888ff82be'] {{(pid=87116) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 11:49:42 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-9dac4f75-9122-4c04-8615-7f687ac363ac tempest-AttachVolumeNegativeTest-771196063 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 11:49:42 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-9dac4f75-9122-4c04-8615-7f687ac363ac tempest-AttachVolumeNegativeTest-771196063 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 11:49:42 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-9dac4f75-9122-4c04-8615-7f687ac363ac tempest-AttachVolumeNegativeTest-771196063 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 11:49:42 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-9dac4f75-9122-4c04-8615-7f687ac363ac tempest-AttachVolumeNegativeTest-771196063 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 11:49:42 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-9dac4f75-9122-4c04-8615-7f687ac363ac tempest-AttachVolumeNegativeTest-771196063 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 11:49:42 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-9dac4f75-9122-4c04-8615-7f687ac363ac tempest-AttachVolumeNegativeTest-771196063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:49:42 devstack sudo[96653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756 Nov 06 11:49:42 devstack sudo[96653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:49:42 devstack sudo[96653]: pam_unix(sudo:session): session closed for user root Nov 06 11:49:42 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-9dac4f75-9122-4c04-8615-7f687ac363ac tempest-AttachVolumeNegativeTest-771196063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756" returned: 0 in 0.350s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:49:42 devstack cinder-volume[87116]: DEBUG cinder.manager [None req-9dac4f75-9122-4c04-8615-7f687ac363ac tempest-AttachVolumeNegativeTest-771196063 None] Notifying Schedulers of capabilities ... {{(pid=87116) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 11:49:42 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-9dac4f75-9122-4c04-8615-7f687ac363ac tempest-AttachVolumeNegativeTest-771196063 None] Deleted volume successfully. Nov 06 11:49:42 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-9dac4f75-9122-4c04-8615-7f687ac363ac tempest-AttachVolumeNegativeTest-771196063 None] Lock "cinder-2232a031-c40c-43e0-b553-d6a9e6a8b941-delete_volume" released by "delete_volume" :: held 1.449s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 11:49:42 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-921f464d-8cf8-43ec-991a-fac3fb10d71e tempest-AttachVolumeNegativeTest-771196063 None] Acquiring lock "cinder-1dee5bbc-4b42-432a-9220-46347ce7d7b2-delete_volume" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 11:49:42 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-921f464d-8cf8-43ec-991a-fac3fb10d71e tempest-AttachVolumeNegativeTest-771196063 None] Lock "cinder-1dee5bbc-4b42-432a-9220-46347ce7d7b2-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 11:49:43 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-921f464d-8cf8-43ec-991a-fac3fb10d71e tempest-AttachVolumeNegativeTest-771196063 None] Acquiring lock "cinder-quobyte-1dee5bbc-4b42-432a-9220-46347ce7d7b2" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 11:49:43 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-921f464d-8cf8-43ec-991a-fac3fb10d71e tempest-AttachVolumeNegativeTest-771196063 None] Lock "cinder-quobyte-1dee5bbc-4b42-432a-9220-46347ce7d7b2" acquired by "delete_volume" :: waited 0.024s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 11:49:43 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b5b73b5-3e49-49b9-9af3-53e63f74c674]: (4, 'qcow2') {{(pid=88420) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 11:49:43 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-921f464d-8cf8-43ec-991a-fac3fb10d71e tempest-AttachVolumeNegativeTest-771196063 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-1dee5bbc-4b42-432a-9220-46347ce7d7b2 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:49:43 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-f6c46a51-a3e3-438e-b558-d98fd8fd4020 tempest-AbsoluteLimitsTests-869614993 None] Acquiring lock "cinder-66419986-441b-4d25-b10f-31f136b68e28-delete_volume" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 11:49:43 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-f6c46a51-a3e3-438e-b558-d98fd8fd4020 tempest-AbsoluteLimitsTests-869614993 None] Lock "cinder-66419986-441b-4d25-b10f-31f136b68e28-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 11:49:43 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-f6c46a51-a3e3-438e-b558-d98fd8fd4020 tempest-AbsoluteLimitsTests-869614993 None] Acquiring lock "cinder-quobyte-66419986-441b-4d25-b10f-31f136b68e28" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 11:49:43 devstack cinder-volume[87116]: INFO cinder.volume.manager [req-ef89036b-c89e-4dc6-a8bb-d11c877b74f1 req-14506779-f7f5-43c0-998a-713d2f96e0ed tempest-AttachVolumeTestJSON-2007150896 None] Terminate volume connection completed successfully. Nov 06 11:49:43 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [req-ef89036b-c89e-4dc6-a8bb-d11c877b74f1 req-14506779-f7f5-43c0-998a-713d2f96e0ed tempest-AttachVolumeTestJSON-2007150896 None] Deleting attachment e33dd49e-ee9a-4798-9196-8cf49405fd53. {{(pid=87116) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 06 11:49:43 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-f6c46a51-a3e3-438e-b558-d98fd8fd4020 tempest-AbsoluteLimitsTests-869614993 None] Lock "cinder-quobyte-66419986-441b-4d25-b10f-31f136b68e28" acquired by "delete_volume" :: waited 0.022s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 11:49:43 devstack sudo[96658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-1dee5bbc-4b42-432a-9220-46347ce7d7b2 Nov 06 11:49:43 devstack sudo[96658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:49:43 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[d62a0b56-a6e2-49f2-a4ed-662437487867]: (4, 'qcow2') {{(pid=88420) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 11:49:43 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-f6c46a51-a3e3-438e-b558-d98fd8fd4020 tempest-AbsoluteLimitsTests-869614993 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-66419986-441b-4d25-b10f-31f136b68e28 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:49:43 devstack sudo[96660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-66419986-441b-4d25-b10f-31f136b68e28 Nov 06 11:49:43 devstack sudo[96660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:49:43 devstack sudo[96658]: pam_unix(sudo:session): session closed for user root Nov 06 11:49:43 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-921f464d-8cf8-43ec-991a-fac3fb10d71e tempest-AttachVolumeNegativeTest-771196063 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-1dee5bbc-4b42-432a-9220-46347ce7d7b2" returned: 0 in 0.448s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:49:43 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-921f464d-8cf8-43ec-991a-fac3fb10d71e tempest-AttachVolumeNegativeTest-771196063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-1dee5bbc-4b42-432a-9220-46347ce7d7b2 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:49:43 devstack sudo[96665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-1dee5bbc-4b42-432a-9220-46347ce7d7b2 Nov 06 11:49:43 devstack sudo[96665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:49:43 devstack sudo[96660]: pam_unix(sudo:session): session closed for user root Nov 06 11:49:43 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-f6c46a51-a3e3-438e-b558-d98fd8fd4020 tempest-AbsoluteLimitsTests-869614993 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-66419986-441b-4d25-b10f-31f136b68e28" returned: 0 in 0.498s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:49:43 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-f6c46a51-a3e3-438e-b558-d98fd8fd4020 tempest-AbsoluteLimitsTests-869614993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-66419986-441b-4d25-b10f-31f136b68e28 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:49:43 devstack sudo[96673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-66419986-441b-4d25-b10f-31f136b68e28 Nov 06 11:49:43 devstack sudo[96673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:49:43 devstack sudo[96665]: pam_unix(sudo:session): session closed for user root Nov 06 11:49:43 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-921f464d-8cf8-43ec-991a-fac3fb10d71e tempest-AttachVolumeNegativeTest-771196063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-1dee5bbc-4b42-432a-9220-46347ce7d7b2" returned: 0 in 0.289s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:49:43 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-921f464d-8cf8-43ec-991a-fac3fb10d71e tempest-AttachVolumeNegativeTest-771196063 None] Lock "cinder-quobyte-1dee5bbc-4b42-432a-9220-46347ce7d7b2" released by "delete_volume" :: held 0.823s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 11:49:43 devstack cinder-volume[87116]: DEBUG cinder.quota [None req-921f464d-8cf8-43ec-991a-fac3fb10d71e tempest-AttachVolumeNegativeTest-771196063 None] Created reservations ['b570e8a3-933b-47c8-b3c0-5c0a822c0a0c', 'db14b6fb-c78c-49e0-928e-25a970982b28', '4ed0741c-6008-4d10-97c8-e4ff0e9ae4c1', 'c87ddf95-9e8b-4a3f-a69a-39fd656a678b'] {{(pid=87116) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 11:49:44 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-921f464d-8cf8-43ec-991a-fac3fb10d71e tempest-AttachVolumeNegativeTest-771196063 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 11:49:44 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-921f464d-8cf8-43ec-991a-fac3fb10d71e tempest-AttachVolumeNegativeTest-771196063 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 11:49:44 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-921f464d-8cf8-43ec-991a-fac3fb10d71e tempest-AttachVolumeNegativeTest-771196063 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 11:49:44 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-921f464d-8cf8-43ec-991a-fac3fb10d71e tempest-AttachVolumeNegativeTest-771196063 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 11:49:44 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-921f464d-8cf8-43ec-991a-fac3fb10d71e tempest-AttachVolumeNegativeTest-771196063 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 11:49:44 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-921f464d-8cf8-43ec-991a-fac3fb10d71e tempest-AttachVolumeNegativeTest-771196063 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:49:44 devstack sudo[96675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756 Nov 06 11:49:44 devstack sudo[96675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:49:44 devstack sudo[96673]: pam_unix(sudo:session): session closed for user root Nov 06 11:49:44 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-f6c46a51-a3e3-438e-b558-d98fd8fd4020 tempest-AbsoluteLimitsTests-869614993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-66419986-441b-4d25-b10f-31f136b68e28" returned: 0 in 0.346s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:49:44 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-f6c46a51-a3e3-438e-b558-d98fd8fd4020 tempest-AbsoluteLimitsTests-869614993 None] Lock "cinder-quobyte-66419986-441b-4d25-b10f-31f136b68e28" released by "delete_volume" :: held 0.923s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 11:49:44 devstack cinder-volume[87116]: DEBUG cinder.quota [None req-f6c46a51-a3e3-438e-b558-d98fd8fd4020 tempest-AbsoluteLimitsTests-869614993 None] Created reservations ['346a681d-40b1-4515-8964-a016561f99eb', 'b7d35ae8-3636-455e-877a-78c9de75c5ae', '7023dd54-6bd0-4b46-80f5-36213ba10486', 'd31d2e2d-a749-4292-b793-edb91e46593c'] {{(pid=87116) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 11:49:44 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-f6c46a51-a3e3-438e-b558-d98fd8fd4020 tempest-AbsoluteLimitsTests-869614993 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 11:49:44 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-f6c46a51-a3e3-438e-b558-d98fd8fd4020 tempest-AbsoluteLimitsTests-869614993 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 11:49:44 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-f6c46a51-a3e3-438e-b558-d98fd8fd4020 tempest-AbsoluteLimitsTests-869614993 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 11:49:44 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-f6c46a51-a3e3-438e-b558-d98fd8fd4020 tempest-AbsoluteLimitsTests-869614993 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 11:49:44 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-f6c46a51-a3e3-438e-b558-d98fd8fd4020 tempest-AbsoluteLimitsTests-869614993 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 11:49:44 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-f6c46a51-a3e3-438e-b558-d98fd8fd4020 tempest-AbsoluteLimitsTests-869614993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:49:44 devstack sudo[96679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756 Nov 06 11:49:44 devstack sudo[96679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:49:44 devstack sudo[96675]: pam_unix(sudo:session): session closed for user root Nov 06 11:49:44 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-921f464d-8cf8-43ec-991a-fac3fb10d71e tempest-AttachVolumeNegativeTest-771196063 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756" returned: 0 in 0.416s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:49:44 devstack cinder-volume[87116]: DEBUG cinder.manager [None req-921f464d-8cf8-43ec-991a-fac3fb10d71e tempest-AttachVolumeNegativeTest-771196063 None] Notifying Schedulers of capabilities ... {{(pid=87116) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 11:49:44 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-921f464d-8cf8-43ec-991a-fac3fb10d71e tempest-AttachVolumeNegativeTest-771196063 None] Deleted volume successfully. Nov 06 11:49:44 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-921f464d-8cf8-43ec-991a-fac3fb10d71e tempest-AttachVolumeNegativeTest-771196063 None] Lock "cinder-1dee5bbc-4b42-432a-9220-46347ce7d7b2-delete_volume" released by "delete_volume" :: held 1.515s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 11:49:44 devstack sudo[96679]: pam_unix(sudo:session): session closed for user root Nov 06 11:49:44 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-f6c46a51-a3e3-438e-b558-d98fd8fd4020 tempest-AbsoluteLimitsTests-869614993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756" returned: 0 in 0.313s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:49:44 devstack cinder-volume[87116]: DEBUG cinder.manager [None req-f6c46a51-a3e3-438e-b558-d98fd8fd4020 tempest-AbsoluteLimitsTests-869614993 None] Notifying Schedulers of capabilities ... {{(pid=87116) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 11:49:44 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-f6c46a51-a3e3-438e-b558-d98fd8fd4020 tempest-AbsoluteLimitsTests-869614993 None] Deleted volume successfully. Nov 06 11:49:44 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-f6c46a51-a3e3-438e-b558-d98fd8fd4020 tempest-AbsoluteLimitsTests-869614993 None] Lock "cinder-66419986-441b-4d25-b10f-31f136b68e28-delete_volume" released by "delete_volume" :: held 1.607s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 11:49:44 devstack cinder-volume[87116]: INFO cinder.volume.manager [req-60d27ada-9386-407a-835b-d96ec29e307e req-65073365-e15f-4d4a-bee9-8f9a91d17487 tempest-AttachVolumeTestJSON-2007150896 None] Terminate volume connection completed successfully. Nov 06 11:49:44 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [req-60d27ada-9386-407a-835b-d96ec29e307e req-65073365-e15f-4d4a-bee9-8f9a91d17487 tempest-AttachVolumeTestJSON-2007150896 None] Deleting attachment b48940ac-af92-4988-af5b-2c2da6aa2c0c. {{(pid=87116) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 06 11:49:52 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-711e7c9e-2b84-4e12-beed-9e7531f41c9e tempest-AttachVolumeTestJSON-2007150896 None] Acquiring lock "cinder-77f5565d-7637-42c7-b3ac-afa8fa1af13e-delete_volume" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 11:49:52 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-711e7c9e-2b84-4e12-beed-9e7531f41c9e tempest-AttachVolumeTestJSON-2007150896 None] Lock "cinder-77f5565d-7637-42c7-b3ac-afa8fa1af13e-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 11:49:52 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-711e7c9e-2b84-4e12-beed-9e7531f41c9e tempest-AttachVolumeTestJSON-2007150896 None] Acquiring lock "cinder-quobyte-77f5565d-7637-42c7-b3ac-afa8fa1af13e" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 11:49:52 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-711e7c9e-2b84-4e12-beed-9e7531f41c9e tempest-AttachVolumeTestJSON-2007150896 None] Lock "cinder-quobyte-77f5565d-7637-42c7-b3ac-afa8fa1af13e" acquired by "delete_volume" :: waited 0.018s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 11:49:52 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae20fe59-c809-4f63-9a59-23917f348006]: (4, 'qcow2') {{(pid=88420) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 11:49:52 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-711e7c9e-2b84-4e12-beed-9e7531f41c9e tempest-AttachVolumeTestJSON-2007150896 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-77f5565d-7637-42c7-b3ac-afa8fa1af13e {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:49:52 devstack sudo[96736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-77f5565d-7637-42c7-b3ac-afa8fa1af13e Nov 06 11:49:52 devstack sudo[96736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:49:53 devstack sudo[96736]: pam_unix(sudo:session): session closed for user root Nov 06 11:49:53 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-711e7c9e-2b84-4e12-beed-9e7531f41c9e tempest-AttachVolumeTestJSON-2007150896 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-77f5565d-7637-42c7-b3ac-afa8fa1af13e" returned: 0 in 0.391s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:49:53 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-711e7c9e-2b84-4e12-beed-9e7531f41c9e tempest-AttachVolumeTestJSON-2007150896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-77f5565d-7637-42c7-b3ac-afa8fa1af13e {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:49:53 devstack sudo[96742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-77f5565d-7637-42c7-b3ac-afa8fa1af13e Nov 06 11:49:53 devstack sudo[96742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:49:53 devstack sudo[96742]: pam_unix(sudo:session): session closed for user root Nov 06 11:49:53 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-711e7c9e-2b84-4e12-beed-9e7531f41c9e tempest-AttachVolumeTestJSON-2007150896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-77f5565d-7637-42c7-b3ac-afa8fa1af13e" returned: 0 in 0.272s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:49:53 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-711e7c9e-2b84-4e12-beed-9e7531f41c9e tempest-AttachVolumeTestJSON-2007150896 None] Lock "cinder-quobyte-77f5565d-7637-42c7-b3ac-afa8fa1af13e" released by "delete_volume" :: held 0.721s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 11:49:53 devstack cinder-volume[87116]: DEBUG cinder.quota [None req-711e7c9e-2b84-4e12-beed-9e7531f41c9e tempest-AttachVolumeTestJSON-2007150896 None] Created reservations ['c835614f-9c97-490a-ba45-cc5c897e82c2', 'bed568bf-8bf4-46c0-892e-7fabf45f49f4', '4ce35491-d7e3-4904-a4e7-ec5b7fbf615e', '7c874721-6e2f-4f81-a20e-f510c1978903'] {{(pid=87116) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 11:49:53 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-711e7c9e-2b84-4e12-beed-9e7531f41c9e tempest-AttachVolumeTestJSON-2007150896 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 11:49:53 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-711e7c9e-2b84-4e12-beed-9e7531f41c9e tempest-AttachVolumeTestJSON-2007150896 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 11:49:53 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-711e7c9e-2b84-4e12-beed-9e7531f41c9e tempest-AttachVolumeTestJSON-2007150896 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 11:49:53 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-711e7c9e-2b84-4e12-beed-9e7531f41c9e tempest-AttachVolumeTestJSON-2007150896 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 11:49:53 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-711e7c9e-2b84-4e12-beed-9e7531f41c9e tempest-AttachVolumeTestJSON-2007150896 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 11:49:53 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-711e7c9e-2b84-4e12-beed-9e7531f41c9e tempest-AttachVolumeTestJSON-2007150896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:49:53 devstack sudo[96745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756 Nov 06 11:49:53 devstack sudo[96745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:49:53 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-e279413e-b299-4de3-9f94-8373736e1c40 tempest-AttachVolumeTestJSON-2007150896 None] Acquiring lock "cinder-5cdab199-2399-425d-a524-8b6c91d10727-delete_volume" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 11:49:53 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-e279413e-b299-4de3-9f94-8373736e1c40 tempest-AttachVolumeTestJSON-2007150896 None] Lock "cinder-5cdab199-2399-425d-a524-8b6c91d10727-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 11:49:53 devstack sudo[96745]: pam_unix(sudo:session): session closed for user root Nov 06 11:49:53 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-711e7c9e-2b84-4e12-beed-9e7531f41c9e tempest-AttachVolumeTestJSON-2007150896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756" returned: 0 in 0.344s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:49:53 devstack cinder-volume[87116]: DEBUG cinder.manager [None req-711e7c9e-2b84-4e12-beed-9e7531f41c9e tempest-AttachVolumeTestJSON-2007150896 None] Notifying Schedulers of capabilities ... {{(pid=87116) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 11:49:53 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-711e7c9e-2b84-4e12-beed-9e7531f41c9e tempest-AttachVolumeTestJSON-2007150896 None] Deleted volume successfully. Nov 06 11:49:54 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-e279413e-b299-4de3-9f94-8373736e1c40 tempest-AttachVolumeTestJSON-2007150896 None] Acquiring lock "cinder-quobyte-5cdab199-2399-425d-a524-8b6c91d10727" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 11:49:54 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-711e7c9e-2b84-4e12-beed-9e7531f41c9e tempest-AttachVolumeTestJSON-2007150896 None] Lock "cinder-77f5565d-7637-42c7-b3ac-afa8fa1af13e-delete_volume" released by "delete_volume" :: held 1.358s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 11:49:54 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-e279413e-b299-4de3-9f94-8373736e1c40 tempest-AttachVolumeTestJSON-2007150896 None] Lock "cinder-quobyte-5cdab199-2399-425d-a524-8b6c91d10727" acquired by "delete_volume" :: waited 0.027s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 11:49:54 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b6b19ca-f653-435c-8549-d83464abba51]: (4, 'qcow2') {{(pid=88420) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 11:49:54 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-e279413e-b299-4de3-9f94-8373736e1c40 tempest-AttachVolumeTestJSON-2007150896 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-5cdab199-2399-425d-a524-8b6c91d10727 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:49:54 devstack cinder-volume[87116]: DEBUG cinder.volume.flows.manager.create_volume [None req-56e97a2e-4a71-4784-a3ac-dc68fa686b2d tempest-VolumesNegativeTest-910129170 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87116) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 11:49:54 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-56e97a2e-4a71-4784-a3ac-dc68fa686b2d tempest-VolumesNegativeTest-910129170 None] Flow 'volume_create_manager' (0804262f-6346-4f9b-aa30-669afd006dcc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 11:49:54 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-56e97a2e-4a71-4784-a3ac-dc68fa686b2d tempest-VolumesNegativeTest-910129170 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2202feb5-836b-4204-822b-f60cd662e490) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:49:54 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-56e97a2e-4a71-4784-a3ac-dc68fa686b2d tempest-VolumesNegativeTest-910129170 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2202feb5-836b-4204-822b-f60cd662e490) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T10:49:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-908531839',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6bd5c6ca-0e56-4011-9598-e3aae15373a3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b149b3586d742d98998a17640f2c96d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T10:49:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T10:49:54Z,use_quota=True,user_id='b303640ab17343fca1164f2298df9a66',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(34d3b144-d9b7-480a-a2e3-01e45f3d54c1),volume_type_id=34d3b144-d9b7-480a-a2e3-01e45f3d54c1)' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:49:54 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-56e97a2e-4a71-4784-a3ac-dc68fa686b2d tempest-VolumesNegativeTest-910129170 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (89d680c8-1d14-48fd-a16f-a77440ac83fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:49:54 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-56e97a2e-4a71-4784-a3ac-dc68fa686b2d tempest-VolumesNegativeTest-910129170 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (89d680c8-1d14-48fd-a16f-a77440ac83fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:49:54 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-56e97a2e-4a71-4784-a3ac-dc68fa686b2d tempest-VolumesNegativeTest-910129170 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (908bc406-de8e-430d-a58d-3365e95a4fce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:49:54 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-56e97a2e-4a71-4784-a3ac-dc68fa686b2d tempest-VolumesNegativeTest-910129170 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (908bc406-de8e-430d-a58d-3365e95a4fce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6bd5c6ca-0e56-4011-9598-e3aae15373a3', 'volume_name': 'volume-6bd5c6ca-0e56-4011-9598-e3aae15373a3', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:49:54 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-56e97a2e-4a71-4784-a3ac-dc68fa686b2d tempest-VolumesNegativeTest-910129170 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bc41712f-67db-439a-af55-b0d762f2cff7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:49:54 devstack sudo[96748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-5cdab199-2399-425d-a524-8b6c91d10727 Nov 06 11:49:54 devstack sudo[96748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:49:54 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-56e97a2e-4a71-4784-a3ac-dc68fa686b2d tempest-VolumesNegativeTest-910129170 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bc41712f-67db-439a-af55-b0d762f2cff7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:49:54 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-56e97a2e-4a71-4784-a3ac-dc68fa686b2d tempest-VolumesNegativeTest-910129170 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (33644e20-bf15-4f49-8d8c-9f98f1e44944) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:49:54 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-56e97a2e-4a71-4784-a3ac-dc68fa686b2d tempest-VolumesNegativeTest-910129170 None] Volume 6bd5c6ca-0e56-4011-9598-e3aae15373a3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6bd5c6ca-0e56-4011-9598-e3aae15373a3', 'volume_size': 1} Nov 06 11:49:54 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-56e97a2e-4a71-4784-a3ac-dc68fa686b2d tempest-VolumesNegativeTest-910129170 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 11:49:54 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-56e97a2e-4a71-4784-a3ac-dc68fa686b2d tempest-VolumesNegativeTest-910129170 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 11:49:54 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-56e97a2e-4a71-4784-a3ac-dc68fa686b2d tempest-VolumesNegativeTest-910129170 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T10:49:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-908531839',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6bd5c6ca-0e56-4011-9598-e3aae15373a3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b149b3586d742d98998a17640f2c96d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T10:49:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T10:49:54Z,use_quota=True,user_id='b303640ab17343fca1164f2298df9a66',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(34d3b144-d9b7-480a-a2e3-01e45f3d54c1),volume_type_id=34d3b144-d9b7-480a-a2e3-01e45f3d54c1)}" {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 11:49:54 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-56e97a2e-4a71-4784-a3ac-dc68fa686b2d tempest-VolumesNegativeTest-910129170 None] Creating volume 6bd5c6ca-0e56-4011-9598-e3aae15373a3 {{(pid=87116) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 11:49:54 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-56e97a2e-4a71-4784-a3ac-dc68fa686b2d tempest-VolumesNegativeTest-910129170 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 11:49:54 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-56e97a2e-4a71-4784-a3ac-dc68fa686b2d tempest-VolumesNegativeTest-910129170 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 11:49:54 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-56e97a2e-4a71-4784-a3ac-dc68fa686b2d tempest-VolumesNegativeTest-910129170 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 11:49:54 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-56e97a2e-4a71-4784-a3ac-dc68fa686b2d tempest-VolumesNegativeTest-910129170 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 11:49:54 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-56e97a2e-4a71-4784-a3ac-dc68fa686b2d tempest-VolumesNegativeTest-910129170 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 11:49:54 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-56e97a2e-4a71-4784-a3ac-dc68fa686b2d tempest-VolumesNegativeTest-910129170 None] Selected osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f as target Quobyte volume. {{(pid=87116) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 11:49:54 devstack cinder-volume[87116]: INFO cinder.volume.drivers.remotefs [None req-56e97a2e-4a71-4784-a3ac-dc68fa686b2d tempest-VolumesNegativeTest-910129170 None] casted to osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f Nov 06 11:49:54 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-56e97a2e-4a71-4784-a3ac-dc68fa686b2d tempest-VolumesNegativeTest-910129170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-6bd5c6ca-0e56-4011-9598-e3aae15373a3 1073741824 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:49:54 devstack sudo[96750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-6bd5c6ca-0e56-4011-9598-e3aae15373a3 1073741824 Nov 06 11:49:54 devstack sudo[96750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:49:54 devstack sudo[96748]: pam_unix(sudo:session): session closed for user root Nov 06 11:49:54 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-e279413e-b299-4de3-9f94-8373736e1c40 tempest-AttachVolumeTestJSON-2007150896 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-5cdab199-2399-425d-a524-8b6c91d10727" returned: 0 in 0.480s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:49:54 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-e279413e-b299-4de3-9f94-8373736e1c40 tempest-AttachVolumeTestJSON-2007150896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-5cdab199-2399-425d-a524-8b6c91d10727 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:49:54 devstack sudo[96758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-5cdab199-2399-425d-a524-8b6c91d10727 Nov 06 11:49:54 devstack sudo[96758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:49:54 devstack sudo[96750]: pam_unix(sudo:session): session closed for user root Nov 06 11:49:54 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-56e97a2e-4a71-4784-a3ac-dc68fa686b2d tempest-VolumesNegativeTest-910129170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-6bd5c6ca-0e56-4011-9598-e3aae15373a3 1073741824" returned: 0 in 0.502s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:49:54 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-56e97a2e-4a71-4784-a3ac-dc68fa686b2d tempest-VolumesNegativeTest-910129170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-6bd5c6ca-0e56-4011-9598-e3aae15373a3 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:49:54 devstack sudo[96761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-6bd5c6ca-0e56-4011-9598-e3aae15373a3 Nov 06 11:49:54 devstack sudo[96761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:49:54 devstack sudo[96758]: pam_unix(sudo:session): session closed for user root Nov 06 11:49:54 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-e279413e-b299-4de3-9f94-8373736e1c40 tempest-AttachVolumeTestJSON-2007150896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-5cdab199-2399-425d-a524-8b6c91d10727" returned: 0 in 0.305s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:49:54 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-e279413e-b299-4de3-9f94-8373736e1c40 tempest-AttachVolumeTestJSON-2007150896 None] Lock "cinder-quobyte-5cdab199-2399-425d-a524-8b6c91d10727" released by "delete_volume" :: held 0.849s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 11:49:54 devstack cinder-volume[87116]: DEBUG cinder.quota [None req-e279413e-b299-4de3-9f94-8373736e1c40 tempest-AttachVolumeTestJSON-2007150896 None] Created reservations ['ae88fee6-9c71-4708-8d24-60b3aff4a4af', 'da923bc9-e6ae-43a8-a259-b594d86270e6', '08d9fefe-2599-4ab9-81cf-d25bf69bdda7', '3838bd3a-64ae-4605-ad17-57f346bfbdc6'] {{(pid=87116) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 11:49:55 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-e279413e-b299-4de3-9f94-8373736e1c40 tempest-AttachVolumeTestJSON-2007150896 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 11:49:55 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-e279413e-b299-4de3-9f94-8373736e1c40 tempest-AttachVolumeTestJSON-2007150896 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 11:49:55 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-e279413e-b299-4de3-9f94-8373736e1c40 tempest-AttachVolumeTestJSON-2007150896 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 11:49:55 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-e279413e-b299-4de3-9f94-8373736e1c40 tempest-AttachVolumeTestJSON-2007150896 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 11:49:55 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-e279413e-b299-4de3-9f94-8373736e1c40 tempest-AttachVolumeTestJSON-2007150896 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 11:49:55 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-e279413e-b299-4de3-9f94-8373736e1c40 tempest-AttachVolumeTestJSON-2007150896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:49:55 devstack sudo[96761]: pam_unix(sudo:session): session closed for user root Nov 06 11:49:55 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-56e97a2e-4a71-4784-a3ac-dc68fa686b2d tempest-VolumesNegativeTest-910129170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-6bd5c6ca-0e56-4011-9598-e3aae15373a3" returned: 0 in 0.351s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:49:55 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-56e97a2e-4a71-4784-a3ac-dc68fa686b2d tempest-VolumesNegativeTest-910129170 None] <== create_volume: return (911ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f'} {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 11:49:55 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-56e97a2e-4a71-4784-a3ac-dc68fa686b2d tempest-VolumesNegativeTest-910129170 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.914s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 11:49:55 devstack sudo[96765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756 Nov 06 11:49:55 devstack sudo[96765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:49:55 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-56e97a2e-4a71-4784-a3ac-dc68fa686b2d tempest-VolumesNegativeTest-910129170 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (33644e20-bf15-4f49-8d8c-9f98f1e44944) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6bd5c6ca-0e56-4011-9598-e3aae15373a3', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:49:55 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-56e97a2e-4a71-4784-a3ac-dc68fa686b2d tempest-VolumesNegativeTest-910129170 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8ebfed03-4e3d-4574-a849-7764a304555a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:49:55 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-56e97a2e-4a71-4784-a3ac-dc68fa686b2d tempest-VolumesNegativeTest-910129170 None] Volume volume-6bd5c6ca-0e56-4011-9598-e3aae15373a3 (6bd5c6ca-0e56-4011-9598-e3aae15373a3): created successfully Nov 06 11:49:55 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-56e97a2e-4a71-4784-a3ac-dc68fa686b2d tempest-VolumesNegativeTest-910129170 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8ebfed03-4e3d-4574-a849-7764a304555a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:49:55 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-56e97a2e-4a71-4784-a3ac-dc68fa686b2d tempest-VolumesNegativeTest-910129170 None] Flow 'volume_create_manager' (0804262f-6346-4f9b-aa30-669afd006dcc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 11:49:55 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-56e97a2e-4a71-4784-a3ac-dc68fa686b2d tempest-VolumesNegativeTest-910129170 None] Created volume successfully. Nov 06 11:49:55 devstack cinder-volume[87116]: DEBUG cinder.volume.flows.manager.create_volume [None req-9912ffec-ad2f-4d60-8af4-24955aa705f8 tempest-VolumesImageMetadata-1503044035 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87116) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 11:49:55 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-9912ffec-ad2f-4d60-8af4-24955aa705f8 tempest-VolumesImageMetadata-1503044035 None] Flow 'volume_create_manager' (c49fdf7a-a52b-41c0-929a-8f574c214c66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 11:49:55 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-9912ffec-ad2f-4d60-8af4-24955aa705f8 tempest-VolumesImageMetadata-1503044035 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d0827051-0d86-4cf0-ad34-624d1734abbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:49:55 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-cf1d444b-57eb-4481-b6d0-fb37057001bd tempest-AttachVolumeTestJSON-2007150896 None] Acquiring lock "cinder-a9c48dcc-d239-4dc5-806f-1abeac6f1cfd-delete_volume" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 11:49:55 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-9912ffec-ad2f-4d60-8af4-24955aa705f8 tempest-VolumesImageMetadata-1503044035 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d0827051-0d86-4cf0-ad34-624d1734abbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T10:49:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1537836578',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f2c06b6c-e056-4e44-b29a-db62f715c237,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='19fe26119b524e4387c9a2e025c7f88e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T10:49:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T10:49:55Z,use_quota=True,user_id='f1b5c0d6381a48649cf88a5cc01b484f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(34d3b144-d9b7-480a-a2e3-01e45f3d54c1),volume_type_id=34d3b144-d9b7-480a-a2e3-01e45f3d54c1)' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:49:55 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-9912ffec-ad2f-4d60-8af4-24955aa705f8 tempest-VolumesImageMetadata-1503044035 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3664206c-0b7f-429e-a2c0-b3c9dd08544d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:49:55 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-9912ffec-ad2f-4d60-8af4-24955aa705f8 tempest-VolumesImageMetadata-1503044035 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3664206c-0b7f-429e-a2c0-b3c9dd08544d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:49:55 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-9912ffec-ad2f-4d60-8af4-24955aa705f8 tempest-VolumesImageMetadata-1503044035 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (82eaa806-7cb2-48c2-90f5-cdb772f02b74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:49:55 devstack cinder-volume[87116]: DEBUG cinder.image.glance [None req-9912ffec-ad2f-4d60-8af4-24955aa705f8 tempest-VolumesImageMetadata-1503044035 None] Creating Keystone auth plugin from conf {{(pid=87116) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 06 11:49:55 devstack sudo[96765]: pam_unix(sudo:session): session closed for user root Nov 06 11:49:55 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-cf1d444b-57eb-4481-b6d0-fb37057001bd tempest-AttachVolumeTestJSON-2007150896 None] Lock "cinder-a9c48dcc-d239-4dc5-806f-1abeac6f1cfd-delete_volume" acquired by "delete_volume" :: waited 0.106s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 11:49:55 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-e279413e-b299-4de3-9f94-8373736e1c40 tempest-AttachVolumeTestJSON-2007150896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756" returned: 0 in 0.364s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:49:55 devstack cinder-volume[87116]: DEBUG cinder.manager [None req-e279413e-b299-4de3-9f94-8373736e1c40 tempest-AttachVolumeTestJSON-2007150896 None] Notifying Schedulers of capabilities ... {{(pid=87116) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 11:49:55 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-e279413e-b299-4de3-9f94-8373736e1c40 tempest-AttachVolumeTestJSON-2007150896 None] Deleted volume successfully. Nov 06 11:49:55 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-e279413e-b299-4de3-9f94-8373736e1c40 tempest-AttachVolumeTestJSON-2007150896 None] Lock "cinder-5cdab199-2399-425d-a524-8b6c91d10727-delete_volume" released by "delete_volume" :: held 1.568s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 11:49:55 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-cf1d444b-57eb-4481-b6d0-fb37057001bd tempest-AttachVolumeTestJSON-2007150896 None] Acquiring lock "cinder-quobyte-a9c48dcc-d239-4dc5-806f-1abeac6f1cfd" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 11:49:55 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-cf1d444b-57eb-4481-b6d0-fb37057001bd tempest-AttachVolumeTestJSON-2007150896 None] Lock "cinder-quobyte-a9c48dcc-d239-4dc5-806f-1abeac6f1cfd" acquired by "delete_volume" :: waited 0.015s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 11:49:55 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[41399262-abd4-4d44-80f3-8d9ddbd9157a]: (4, 'qcow2') {{(pid=88420) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 11:49:55 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-cf1d444b-57eb-4481-b6d0-fb37057001bd tempest-AttachVolumeTestJSON-2007150896 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-a9c48dcc-d239-4dc5-806f-1abeac6f1cfd {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:49:55 devstack sudo[96768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-a9c48dcc-d239-4dc5-806f-1abeac6f1cfd Nov 06 11:49:55 devstack sudo[96768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:49:55 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-9912ffec-ad2f-4d60-8af4-24955aa705f8 tempest-VolumesImageMetadata-1503044035 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (82eaa806-7cb2-48c2-90f5-cdb772f02b74) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'f2c06b6c-e056-4e44-b29a-db62f715c237', 'volume_name': 'volume-f2c06b6c-e056-4e44-b29a-db62f715c237', 'volume_size': 1, 'image_id': '423469e2-d15b-4cf9-87cd-88e68e947d3b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/423469e2-d15b-4cf9-87cd-88e68e947d3b', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b05f927c30c5407aad52949459346010', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '423469e2-d15b-4cf9-87cd-88e68e947d3b', 'created_at': datetime.datetime(2026, 11, 6, 10, 36, 49, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 6, 10, 36, 50, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/423469e2-d15b-4cf9-87cd-88e68e947d3b/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:49:55 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-9912ffec-ad2f-4d60-8af4-24955aa705f8 tempest-VolumesImageMetadata-1503044035 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (377f7955-3a5c-4e32-a96f-3bb384b73955) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:49:55 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-9912ffec-ad2f-4d60-8af4-24955aa705f8 tempest-VolumesImageMetadata-1503044035 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (377f7955-3a5c-4e32-a96f-3bb384b73955) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:49:55 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-9912ffec-ad2f-4d60-8af4-24955aa705f8 tempest-VolumesImageMetadata-1503044035 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b9136821-6e3f-4330-8006-a04088cdddff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:49:55 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-9912ffec-ad2f-4d60-8af4-24955aa705f8 tempest-VolumesImageMetadata-1503044035 None] Volume f2c06b6c-e056-4e44-b29a-db62f715c237: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-f2c06b6c-e056-4e44-b29a-db62f715c237', 'volume_size': 1, 'image_id': '423469e2-d15b-4cf9-87cd-88e68e947d3b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/423469e2-d15b-4cf9-87cd-88e68e947d3b', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b05f927c30c5407aad52949459346010', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '423469e2-d15b-4cf9-87cd-88e68e947d3b', 'created_at': datetime.datetime(2026, 11, 6, 10, 36, 49, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 6, 10, 36, 50, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/423469e2-d15b-4cf9-87cd-88e68e947d3b/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Nov 06 11:49:55 devstack cinder-volume[87116]: DEBUG cinder.volume.flows.manager.create_volume [None req-9912ffec-ad2f-4d60-8af4-24955aa705f8 tempest-VolumesImageMetadata-1503044035 None] Trying to clone f2c06b6c-e056-4e44-b29a-db62f715c237 from image 423469e2-d15b-4cf9-87cd-88e68e947d3b at location (None, [{'url': 'file:///opt/stack/data/glance/images/423469e2-d15b-4cf9-87cd-88e68e947d3b', 'metadata': {}}]). {{(pid=87116) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Nov 06 11:49:56 devstack sudo[96768]: pam_unix(sudo:session): session closed for user root Nov 06 11:49:56 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-cf1d444b-57eb-4481-b6d0-fb37057001bd tempest-AttachVolumeTestJSON-2007150896 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-a9c48dcc-d239-4dc5-806f-1abeac6f1cfd" returned: 0 in 0.464s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:49:56 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-cf1d444b-57eb-4481-b6d0-fb37057001bd tempest-AttachVolumeTestJSON-2007150896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-a9c48dcc-d239-4dc5-806f-1abeac6f1cfd {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:49:56 devstack sudo[96773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-a9c48dcc-d239-4dc5-806f-1abeac6f1cfd Nov 06 11:49:56 devstack sudo[96773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:49:56 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-53e51115-52e1-4e0e-ac04-b53f7ce5aea3 tempest-GroupSnapshotsV319Test-637152665 None] Group tempest-GroupSnapshotsV319Test-Group-66257590: creating Nov 06 11:49:56 devstack sudo[96773]: pam_unix(sudo:session): session closed for user root Nov 06 11:49:56 devstack cinder-volume[87116]: DEBUG cinder.image.image_utils [None req-9912ffec-ad2f-4d60-8af4-24955aa705f8 tempest-VolumesImageMetadata-1503044035 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_423469e2-d15b-4cf9-87cd-88e68e947d3b_vzsc58hndevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87116) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Nov 06 11:49:56 devstack cinder-volume[87116]: INFO cinder.image.image_utils [None req-9912ffec-ad2f-4d60-8af4-24955aa705f8 tempest-VolumesImageMetadata-1503044035 None] Image download 20.69 MB at 20.69 MB/s Nov 06 11:49:56 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-cf1d444b-57eb-4481-b6d0-fb37057001bd tempest-AttachVolumeTestJSON-2007150896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-a9c48dcc-d239-4dc5-806f-1abeac6f1cfd" returned: 0 in 0.408s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:49:56 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-53e51115-52e1-4e0e-ac04-b53f7ce5aea3 tempest-GroupSnapshotsV319Test-637152665 None] Group tempest-GroupSnapshotsV319Test-Group-66257590: created successfully Nov 06 11:49:56 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-cf1d444b-57eb-4481-b6d0-fb37057001bd tempest-AttachVolumeTestJSON-2007150896 None] Lock "cinder-quobyte-a9c48dcc-d239-4dc5-806f-1abeac6f1cfd" released by "delete_volume" :: held 0.948s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 11:49:56 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-53e51115-52e1-4e0e-ac04-b53f7ce5aea3 tempest-GroupSnapshotsV319Test-637152665 None] Create group completed successfully. Nov 06 11:49:56 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cfaddaa-ee0c-44a4-b700-8d617d2206d2]: (4, 'qcow2') {{(pid=88420) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 11:49:56 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-9912ffec-ad2f-4d60-8af4-24955aa705f8 tempest-VolumesImageMetadata-1503044035 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_423469e2-d15b-4cf9-87cd-88e68e947d3b_vzsc58hndevstack@QuobyteHD {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:49:56 devstack cinder-volume[87116]: DEBUG cinder.quota [None req-cf1d444b-57eb-4481-b6d0-fb37057001bd tempest-AttachVolumeTestJSON-2007150896 None] Created reservations ['6a1d7b9f-9853-49df-bf63-48d3c4bc710e', '822003fa-223b-46bd-aedb-21b5bbf15092', '226af96d-c24a-4a26-b55b-b2c5a52000af', '1edf2f4d-01c7-4bc5-89e9-3f534ef07095'] {{(pid=87116) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 11:49:56 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-cf1d444b-57eb-4481-b6d0-fb37057001bd tempest-AttachVolumeTestJSON-2007150896 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 11:49:56 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-cf1d444b-57eb-4481-b6d0-fb37057001bd tempest-AttachVolumeTestJSON-2007150896 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 11:49:56 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-cf1d444b-57eb-4481-b6d0-fb37057001bd tempest-AttachVolumeTestJSON-2007150896 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 11:49:56 devstack sudo[96777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_423469e2-d15b-4cf9-87cd-88e68e947d3b_vzsc58hndevstack@QuobyteHD Nov 06 11:49:56 devstack sudo[96777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:49:56 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-cf1d444b-57eb-4481-b6d0-fb37057001bd tempest-AttachVolumeTestJSON-2007150896 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 11:49:56 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-cf1d444b-57eb-4481-b6d0-fb37057001bd tempest-AttachVolumeTestJSON-2007150896 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 11:49:56 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-cf1d444b-57eb-4481-b6d0-fb37057001bd tempest-AttachVolumeTestJSON-2007150896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:49:56 devstack sudo[96779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756 Nov 06 11:49:56 devstack sudo[96779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:49:56 devstack sudo[96777]: pam_unix(sudo:session): session closed for user root Nov 06 11:49:56 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-9912ffec-ad2f-4d60-8af4-24955aa705f8 tempest-VolumesImageMetadata-1503044035 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_423469e2-d15b-4cf9-87cd-88e68e947d3b_vzsc58hndevstack@QuobyteHD" returned: 0 in 0.438s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:49:56 devstack cinder-volume[87116]: DEBUG cinder.image.image_utils [None req-9912ffec-ad2f-4d60-8af4-24955aa705f8 tempest-VolumesImageMetadata-1503044035 None] Temporary image 423469e2-d15b-4cf9-87cd-88e68e947d3b is fetched for user f1b5c0d6381a48649cf88a5cc01b484f. {{(pid=87116) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Nov 06 11:49:56 devstack sudo[96779]: pam_unix(sudo:session): session closed for user root Nov 06 11:49:56 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-cf1d444b-57eb-4481-b6d0-fb37057001bd tempest-AttachVolumeTestJSON-2007150896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756" returned: 0 in 0.301s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:49:56 devstack cinder-volume[87116]: DEBUG cinder.manager [None req-cf1d444b-57eb-4481-b6d0-fb37057001bd tempest-AttachVolumeTestJSON-2007150896 None] Notifying Schedulers of capabilities ... {{(pid=87116) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 11:49:56 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-cf1d444b-57eb-4481-b6d0-fb37057001bd tempest-AttachVolumeTestJSON-2007150896 None] Deleted volume successfully. Nov 06 11:49:57 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-cf1d444b-57eb-4481-b6d0-fb37057001bd tempest-AttachVolumeTestJSON-2007150896 None] Lock "cinder-a9c48dcc-d239-4dc5-806f-1abeac6f1cfd-delete_volume" released by "delete_volume" :: held 1.580s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 11:49:57 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[108bbc42-68e9-485c-a714-7a82f62f2700]: (4, 'qcow2') {{(pid=88420) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 11:49:57 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-9912ffec-ad2f-4d60-8af4-24955aa705f8 tempest-VolumesImageMetadata-1503044035 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_423469e2-d15b-4cf9-87cd-88e68e947d3b_vzsc58hndevstack@QuobyteHD {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:49:57 devstack sudo[96785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_423469e2-d15b-4cf9-87cd-88e68e947d3b_vzsc58hndevstack@QuobyteHD Nov 06 11:49:57 devstack sudo[96785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:49:57 devstack sudo[96785]: pam_unix(sudo:session): session closed for user root Nov 06 11:49:57 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-9912ffec-ad2f-4d60-8af4-24955aa705f8 tempest-VolumesImageMetadata-1503044035 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_423469e2-d15b-4cf9-87cd-88e68e947d3b_vzsc58hndevstack@QuobyteHD" returned: 0 in 0.395s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:49:57 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-9912ffec-ad2f-4d60-8af4-24955aa705f8 tempest-VolumesImageMetadata-1503044035 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 11:49:57 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-9912ffec-ad2f-4d60-8af4-24955aa705f8 tempest-VolumesImageMetadata-1503044035 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 11:49:57 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-9912ffec-ad2f-4d60-8af4-24955aa705f8 tempest-VolumesImageMetadata-1503044035 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T10:49:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1537836578',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f2c06b6c-e056-4e44-b29a-db62f715c237,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='19fe26119b524e4387c9a2e025c7f88e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T10:49:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T10:49:55Z,use_quota=True,user_id='f1b5c0d6381a48649cf88a5cc01b484f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(34d3b144-d9b7-480a-a2e3-01e45f3d54c1),volume_type_id=34d3b144-d9b7-480a-a2e3-01e45f3d54c1)}" {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 11:49:57 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-9912ffec-ad2f-4d60-8af4-24955aa705f8 tempest-VolumesImageMetadata-1503044035 None] Creating volume f2c06b6c-e056-4e44-b29a-db62f715c237 {{(pid=87116) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 11:49:57 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-9912ffec-ad2f-4d60-8af4-24955aa705f8 tempest-VolumesImageMetadata-1503044035 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 11:49:57 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-9912ffec-ad2f-4d60-8af4-24955aa705f8 tempest-VolumesImageMetadata-1503044035 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 11:49:57 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-9912ffec-ad2f-4d60-8af4-24955aa705f8 tempest-VolumesImageMetadata-1503044035 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 11:49:57 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-9912ffec-ad2f-4d60-8af4-24955aa705f8 tempest-VolumesImageMetadata-1503044035 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 11:49:57 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-9912ffec-ad2f-4d60-8af4-24955aa705f8 tempest-VolumesImageMetadata-1503044035 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 11:49:57 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-9912ffec-ad2f-4d60-8af4-24955aa705f8 tempest-VolumesImageMetadata-1503044035 None] Selected osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f as target Quobyte volume. {{(pid=87116) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 11:49:57 devstack cinder-volume[87116]: INFO cinder.volume.drivers.remotefs [None req-9912ffec-ad2f-4d60-8af4-24955aa705f8 tempest-VolumesImageMetadata-1503044035 None] casted to osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f Nov 06 11:49:57 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-9912ffec-ad2f-4d60-8af4-24955aa705f8 tempest-VolumesImageMetadata-1503044035 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-f2c06b6c-e056-4e44-b29a-db62f715c237 1073741824 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:49:57 devstack sudo[96793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-f2c06b6c-e056-4e44-b29a-db62f715c237 1073741824 Nov 06 11:49:57 devstack sudo[96793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:49:58 devstack sudo[96793]: pam_unix(sudo:session): session closed for user root Nov 06 11:49:58 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-9912ffec-ad2f-4d60-8af4-24955aa705f8 tempest-VolumesImageMetadata-1503044035 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-f2c06b6c-e056-4e44-b29a-db62f715c237 1073741824" returned: 0 in 0.579s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:49:58 devstack cinder-volume[87116]: DEBUG cinder.volume.flows.manager.create_volume [None req-79a96026-afa2-46b7-838b-d43d95cc326f tempest-GroupSnapshotsV319Test-637152665 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87116) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 11:49:58 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-79a96026-afa2-46b7-838b-d43d95cc326f tempest-GroupSnapshotsV319Test-637152665 None] Flow 'volume_create_manager' (e8b52c9e-a8a5-4b45-96ac-a77f7434ca60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 11:49:58 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-79a96026-afa2-46b7-838b-d43d95cc326f tempest-GroupSnapshotsV319Test-637152665 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fe5add43-4d8a-4b8b-8632-f5416ed825ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:49:58 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-79a96026-afa2-46b7-838b-d43d95cc326f tempest-GroupSnapshotsV319Test-637152665 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fe5add43-4d8a-4b8b-8632-f5416ed825ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T10:49:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-211301782',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=b7aa6b4b-0a5b-44c4-bafe-753ff6f31f52,host='devstack@QuobyteHD#QuobyteHD',id=a94c80b9-0e72-4a03-b4db-31b396374dae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='54e6ef6887da4773bfc7a3dd1fbce345',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T10:49:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T10:49:58Z,use_quota=True,user_id='c1a0b70d198b495c9ec08465fb5d9617',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(71c7704b-a2c8-4a6a-9b89-954ac0f0bee4),volume_type_id=71c7704b-a2c8-4a6a-9b89-954ac0f0bee4)' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:49:58 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-79a96026-afa2-46b7-838b-d43d95cc326f tempest-GroupSnapshotsV319Test-637152665 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (14bbea71-78b0-4ddf-94e4-9524c623c774) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:49:58 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-79a96026-afa2-46b7-838b-d43d95cc326f tempest-GroupSnapshotsV319Test-637152665 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (14bbea71-78b0-4ddf-94e4-9524c623c774) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:49:58 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-79a96026-afa2-46b7-838b-d43d95cc326f tempest-GroupSnapshotsV319Test-637152665 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (29d97c82-a90c-462b-b68f-2060059ee2b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:49:58 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-79a96026-afa2-46b7-838b-d43d95cc326f tempest-GroupSnapshotsV319Test-637152665 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (29d97c82-a90c-462b-b68f-2060059ee2b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a94c80b9-0e72-4a03-b4db-31b396374dae', 'volume_name': 'volume-a94c80b9-0e72-4a03-b4db-31b396374dae', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:49:58 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-79a96026-afa2-46b7-838b-d43d95cc326f tempest-GroupSnapshotsV319Test-637152665 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d3f11709-557b-412d-b602-392ac1d5dfbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:49:58 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-79a96026-afa2-46b7-838b-d43d95cc326f tempest-GroupSnapshotsV319Test-637152665 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d3f11709-557b-412d-b602-392ac1d5dfbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:49:58 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-79a96026-afa2-46b7-838b-d43d95cc326f tempest-GroupSnapshotsV319Test-637152665 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0df13fae-648f-4061-b58a-93b1a34d7150) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:49:58 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-79a96026-afa2-46b7-838b-d43d95cc326f tempest-GroupSnapshotsV319Test-637152665 None] Volume a94c80b9-0e72-4a03-b4db-31b396374dae: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a94c80b9-0e72-4a03-b4db-31b396374dae', 'volume_size': 1} Nov 06 11:49:58 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-79a96026-afa2-46b7-838b-d43d95cc326f tempest-GroupSnapshotsV319Test-637152665 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 11:49:58 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-9912ffec-ad2f-4d60-8af4-24955aa705f8 tempest-VolumesImageMetadata-1503044035 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-f2c06b6c-e056-4e44-b29a-db62f715c237 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:49:58 devstack sudo[96799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-f2c06b6c-e056-4e44-b29a-db62f715c237 Nov 06 11:49:58 devstack sudo[96799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:49:58 devstack sudo[96799]: pam_unix(sudo:session): session closed for user root Nov 06 11:49:58 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-9912ffec-ad2f-4d60-8af4-24955aa705f8 tempest-VolumesImageMetadata-1503044035 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-f2c06b6c-e056-4e44-b29a-db62f715c237" returned: 0 in 0.334s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:49:58 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-9912ffec-ad2f-4d60-8af4-24955aa705f8 tempest-VolumesImageMetadata-1503044035 None] <== create_volume: return (1083ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f'} {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 11:49:58 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-9912ffec-ad2f-4d60-8af4-24955aa705f8 tempest-VolumesImageMetadata-1503044035 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.087s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 11:49:58 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-79a96026-afa2-46b7-838b-d43d95cc326f tempest-GroupSnapshotsV319Test-637152665 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.357s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 11:49:58 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-79a96026-afa2-46b7-838b-d43d95cc326f tempest-GroupSnapshotsV319Test-637152665 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=b7aa6b4b-0a5b-44c4-bafe-753ff6f31f52,created_at=2026-11-06T10:49:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-211301782',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=b7aa6b4b-0a5b-44c4-bafe-753ff6f31f52,host='devstack@QuobyteHD#QuobyteHD',id=a94c80b9-0e72-4a03-b4db-31b396374dae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='54e6ef6887da4773bfc7a3dd1fbce345',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T10:49:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T10:49:58Z,use_quota=True,user_id='c1a0b70d198b495c9ec08465fb5d9617',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(71c7704b-a2c8-4a6a-9b89-954ac0f0bee4),volume_type_id=71c7704b-a2c8-4a6a-9b89-954ac0f0bee4)}" {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 11:49:58 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-79a96026-afa2-46b7-838b-d43d95cc326f tempest-GroupSnapshotsV319Test-637152665 None] Creating volume a94c80b9-0e72-4a03-b4db-31b396374dae {{(pid=87116) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 11:49:58 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-79a96026-afa2-46b7-838b-d43d95cc326f tempest-GroupSnapshotsV319Test-637152665 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 11:49:58 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-79a96026-afa2-46b7-838b-d43d95cc326f tempest-GroupSnapshotsV319Test-637152665 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 11:49:58 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-79a96026-afa2-46b7-838b-d43d95cc326f tempest-GroupSnapshotsV319Test-637152665 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 11:49:58 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-79a96026-afa2-46b7-838b-d43d95cc326f tempest-GroupSnapshotsV319Test-637152665 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 11:49:58 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-79a96026-afa2-46b7-838b-d43d95cc326f tempest-GroupSnapshotsV319Test-637152665 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 11:49:58 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-79a96026-afa2-46b7-838b-d43d95cc326f tempest-GroupSnapshotsV319Test-637152665 None] Selected osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f as target Quobyte volume. {{(pid=87116) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 11:49:58 devstack cinder-volume[87116]: INFO cinder.volume.drivers.remotefs [None req-79a96026-afa2-46b7-838b-d43d95cc326f tempest-GroupSnapshotsV319Test-637152665 None] casted to osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f Nov 06 11:49:58 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-79a96026-afa2-46b7-838b-d43d95cc326f tempest-GroupSnapshotsV319Test-637152665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-a94c80b9-0e72-4a03-b4db-31b396374dae 1073741824 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:49:58 devstack sudo[96802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-a94c80b9-0e72-4a03-b4db-31b396374dae 1073741824 Nov 06 11:49:58 devstack sudo[96802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:49:58 devstack cinder-volume[87116]: DEBUG cinder.volume.volume_utils [None req-9912ffec-ad2f-4d60-8af4-24955aa705f8 tempest-VolumesImageMetadata-1503044035 None] Attempting download of 423469e2-d15b-4cf9-87cd-88e68e947d3b ((None, [{'url': 'file:///opt/stack/data/glance/images/423469e2-d15b-4cf9-87cd-88e68e947d3b', 'metadata': {}}])) to volume f2c06b6c-e056-4e44-b29a-db62f715c237. {{(pid=87116) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Nov 06 11:49:58 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[f14c3f1c-bc74-4b2e-b458-ade5178d39bd]: (4, 'raw') {{(pid=88420) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 11:49:58 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-9912ffec-ad2f-4d60-8af4-24955aa705f8 tempest-VolumesImageMetadata-1503044035 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_423469e2-d15b-4cf9-87cd-88e68e947d3b_frh8i69d {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:49:58 devstack sudo[96804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_423469e2-d15b-4cf9-87cd-88e68e947d3b_frh8i69d Nov 06 11:49:58 devstack sudo[96804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:49:59 devstack sudo[96804]: pam_unix(sudo:session): session closed for user root Nov 06 11:49:59 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-9912ffec-ad2f-4d60-8af4-24955aa705f8 tempest-VolumesImageMetadata-1503044035 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_423469e2-d15b-4cf9-87cd-88e68e947d3b_frh8i69d" returned: 0 in 0.478s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:49:59 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-9912ffec-ad2f-4d60-8af4-24955aa705f8 tempest-VolumesImageMetadata-1503044035 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_423469e2-d15b-4cf9-87cd-88e68e947d3b_frh8i69d {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:49:59 devstack sudo[96802]: pam_unix(sudo:session): session closed for user root Nov 06 11:49:59 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-79a96026-afa2-46b7-838b-d43d95cc326f tempest-GroupSnapshotsV319Test-637152665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-a94c80b9-0e72-4a03-b4db-31b396374dae 1073741824" returned: 0 in 0.675s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:49:59 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-79a96026-afa2-46b7-838b-d43d95cc326f tempest-GroupSnapshotsV319Test-637152665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-a94c80b9-0e72-4a03-b4db-31b396374dae {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:49:59 devstack sudo[96822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-a94c80b9-0e72-4a03-b4db-31b396374dae Nov 06 11:49:59 devstack sudo[96822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:49:59 devstack sudo[96816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_423469e2-d15b-4cf9-87cd-88e68e947d3b_frh8i69d Nov 06 11:49:59 devstack sudo[96816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:49:59 devstack sudo[96822]: pam_unix(sudo:session): session closed for user root Nov 06 11:49:59 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-79a96026-afa2-46b7-838b-d43d95cc326f tempest-GroupSnapshotsV319Test-637152665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-a94c80b9-0e72-4a03-b4db-31b396374dae" returned: 0 in 0.400s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:49:59 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-79a96026-afa2-46b7-838b-d43d95cc326f tempest-GroupSnapshotsV319Test-637152665 None] <== create_volume: return (1158ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f'} {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 11:49:59 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-79a96026-afa2-46b7-838b-d43d95cc326f tempest-GroupSnapshotsV319Test-637152665 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.167s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 11:49:59 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-79a96026-afa2-46b7-838b-d43d95cc326f tempest-GroupSnapshotsV319Test-637152665 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0df13fae-648f-4061-b58a-93b1a34d7150) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a94c80b9-0e72-4a03-b4db-31b396374dae', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:49:59 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-79a96026-afa2-46b7-838b-d43d95cc326f tempest-GroupSnapshotsV319Test-637152665 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (da3309bf-88cc-4d0c-9997-6db922dd498b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:49:59 devstack sudo[96816]: pam_unix(sudo:session): session closed for user root Nov 06 11:49:59 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-9912ffec-ad2f-4d60-8af4-24955aa705f8 tempest-VolumesImageMetadata-1503044035 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_423469e2-d15b-4cf9-87cd-88e68e947d3b_frh8i69d" returned: 1 in 0.552s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:49:59 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-9912ffec-ad2f-4d60-8af4-24955aa705f8 tempest-VolumesImageMetadata-1503044035 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_423469e2-d15b-4cf9-87cd-88e68e947d3b_frh8i69d' failed. Not Retrying. {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 06 11:49:59 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c8ba7b5-6d27-448a-98ef-d01119e42a0f]: (4, 'qcow2') {{(pid=88420) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 11:49:59 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-9912ffec-ad2f-4d60-8af4-24955aa705f8 tempest-VolumesImageMetadata-1503044035 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_423469e2-d15b-4cf9-87cd-88e68e947d3b_vzsc58hndevstack@QuobyteHD {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:49:59 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-79a96026-afa2-46b7-838b-d43d95cc326f tempest-GroupSnapshotsV319Test-637152665 None] Volume volume-a94c80b9-0e72-4a03-b4db-31b396374dae (a94c80b9-0e72-4a03-b4db-31b396374dae): created successfully Nov 06 11:49:59 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-79a96026-afa2-46b7-838b-d43d95cc326f tempest-GroupSnapshotsV319Test-637152665 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (da3309bf-88cc-4d0c-9997-6db922dd498b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:49:59 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-79a96026-afa2-46b7-838b-d43d95cc326f tempest-GroupSnapshotsV319Test-637152665 None] Flow 'volume_create_manager' (e8b52c9e-a8a5-4b45-96ac-a77f7434ca60) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 11:49:59 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-79a96026-afa2-46b7-838b-d43d95cc326f tempest-GroupSnapshotsV319Test-637152665 None] Created volume successfully. Nov 06 11:49:59 devstack sudo[96835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_423469e2-d15b-4cf9-87cd-88e68e947d3b_vzsc58hndevstack@QuobyteHD Nov 06 11:49:59 devstack sudo[96835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:50:00 devstack sudo[96835]: pam_unix(sudo:session): session closed for user root Nov 06 11:50:00 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-9912ffec-ad2f-4d60-8af4-24955aa705f8 tempest-VolumesImageMetadata-1503044035 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_423469e2-d15b-4cf9-87cd-88e68e947d3b_vzsc58hndevstack@QuobyteHD" returned: 0 in 0.388s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:50:00 devstack cinder-volume[87116]: DEBUG cinder.image.image_utils [None req-9912ffec-ad2f-4d60-8af4-24955aa705f8 tempest-VolumesImageMetadata-1503044035 None] 423469e2-d15b-4cf9-87cd-88e68e947d3b was qcow2, converting to qcow2 {{(pid=87116) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Nov 06 11:50:00 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-9912ffec-ad2f-4d60-8af4-24955aa705f8 tempest-VolumesImageMetadata-1503044035 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_423469e2-d15b-4cf9-87cd-88e68e947d3b_vzsc58hndevstack@QuobyteHD /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-f2c06b6c-e056-4e44-b29a-db62f715c237 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:50:00 devstack sudo[96841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_423469e2-d15b-4cf9-87cd-88e68e947d3b_vzsc58hndevstack@QuobyteHD /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-f2c06b6c-e056-4e44-b29a-db62f715c237 Nov 06 11:50:00 devstack sudo[96841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:50:00 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-8407f51e-4c90-4edb-b0d6-10a511333c8d tempest-GroupSnapshotsV319Test-637152665 None] GroupSnapshot 093dae88-4364-4350-a32c-8377e9b12e30: creating. Nov 06 11:50:01 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-8407f51e-4c90-4edb-b0d6-10a511333c8d tempest-GroupSnapshotsV319Test-637152665 None] Group snapshot 093dae88-4364-4350-a32c-8377e9b12e30: creating. {{(pid=87116) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Nov 06 11:50:01 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-8407f51e-4c90-4edb-b0d6-10a511333c8d tempest-GroupSnapshotsV319Test-637152665 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 11:50:01 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-8407f51e-4c90-4edb-b0d6-10a511333c8d tempest-GroupSnapshotsV319Test-637152665 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 11:50:01 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-8407f51e-4c90-4edb-b0d6-10a511333c8d tempest-GroupSnapshotsV319Test-637152665 None] Creating offline snapshot 299dcfcf-fff7-407d-954d-a2ba5b15c5f9 of volume a94c80b9-0e72-4a03-b4db-31b396374dae {{(pid=87116) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 06 11:50:01 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b80704c-7a21-4a82-8b0f-f53eca955e2a]: (4, 'qcow2') {{(pid=88420) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 11:50:01 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-8407f51e-4c90-4edb-b0d6-10a511333c8d tempest-GroupSnapshotsV319Test-637152665 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-a94c80b9-0e72-4a03-b4db-31b396374dae {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:50:01 devstack sudo[96849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-a94c80b9-0e72-4a03-b4db-31b396374dae Nov 06 11:50:01 devstack sudo[96849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:50:01 devstack sudo[96849]: pam_unix(sudo:session): session closed for user root Nov 06 11:50:01 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-8407f51e-4c90-4edb-b0d6-10a511333c8d tempest-GroupSnapshotsV319Test-637152665 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-a94c80b9-0e72-4a03-b4db-31b396374dae" returned: 0 in 0.476s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:50:01 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-8407f51e-4c90-4edb-b0d6-10a511333c8d tempest-GroupSnapshotsV319Test-637152665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-a94c80b9-0e72-4a03-b4db-31b396374dae,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-a94c80b9-0e72-4a03-b4db-31b396374dae.299dcfcf-fff7-407d-954d-a2ba5b15c5f9 1G {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:50:01 devstack sudo[96854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-a94c80b9-0e72-4a03-b4db-31b396374dae,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-a94c80b9-0e72-4a03-b4db-31b396374dae.299dcfcf-fff7-407d-954d-a2ba5b15c5f9 1G Nov 06 11:50:01 devstack sudo[96854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:50:02 devstack sudo[96854]: pam_unix(sudo:session): session closed for user root Nov 06 11:50:02 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-8407f51e-4c90-4edb-b0d6-10a511333c8d tempest-GroupSnapshotsV319Test-637152665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-a94c80b9-0e72-4a03-b4db-31b396374dae,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-a94c80b9-0e72-4a03-b4db-31b396374dae.299dcfcf-fff7-407d-954d-a2ba5b15c5f9 1G" returned: 0 in 0.675s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:50:02 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-8407f51e-4c90-4edb-b0d6-10a511333c8d tempest-GroupSnapshotsV319Test-637152665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a94c80b9-0e72-4a03-b4db-31b396374dae -F qcow2 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-a94c80b9-0e72-4a03-b4db-31b396374dae.299dcfcf-fff7-407d-954d-a2ba5b15c5f9 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:50:02 devstack sudo[96862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a94c80b9-0e72-4a03-b4db-31b396374dae -F qcow2 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-a94c80b9-0e72-4a03-b4db-31b396374dae.299dcfcf-fff7-407d-954d-a2ba5b15c5f9 Nov 06 11:50:02 devstack sudo[96862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:50:02 devstack sudo[96862]: pam_unix(sudo:session): session closed for user root Nov 06 11:50:02 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-8407f51e-4c90-4edb-b0d6-10a511333c8d tempest-GroupSnapshotsV319Test-637152665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a94c80b9-0e72-4a03-b4db-31b396374dae -F qcow2 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-a94c80b9-0e72-4a03-b4db-31b396374dae.299dcfcf-fff7-407d-954d-a2ba5b15c5f9" returned: 0 in 0.494s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:50:02 devstack cinder-volume[87116]: WARNING cinder.volume.drivers.remotefs [None req-8407f51e-4c90-4edb-b0d6-10a511333c8d tempest-GroupSnapshotsV319Test-637152665 None] /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-a94c80b9-0e72-4a03-b4db-31b396374dae.299dcfcf-fff7-407d-954d-a2ba5b15c5f9 is being set with open permissions: ugo+rw: NotImplementedError Nov 06 11:50:02 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-8407f51e-4c90-4edb-b0d6-10a511333c8d tempest-GroupSnapshotsV319Test-637152665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-a94c80b9-0e72-4a03-b4db-31b396374dae.299dcfcf-fff7-407d-954d-a2ba5b15c5f9 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:50:02 devstack sudo[96841]: pam_unix(sudo:session): session closed for user root Nov 06 11:50:02 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-9912ffec-ad2f-4d60-8af4-24955aa705f8 tempest-VolumesImageMetadata-1503044035 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_423469e2-d15b-4cf9-87cd-88e68e947d3b_vzsc58hndevstack@QuobyteHD /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-f2c06b6c-e056-4e44-b29a-db62f715c237" returned: 0 in 2.568s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:50:02 devstack cinder-volume[87116]: DEBUG cinder.image.image_utils [None req-9912ffec-ad2f-4d60-8af4-24955aa705f8 tempest-VolumesImageMetadata-1503044035 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_423469e2-d15b-4cf9-87cd-88e68e947d3b_vzsc58hndevstack@QuobyteHD, size 112.00 MB, duration 2.57 sec, destination /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-f2c06b6c-e056-4e44-b29a-db62f715c237 {{(pid=87116) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 06 11:50:02 devstack cinder-volume[87116]: INFO cinder.image.image_utils [None req-9912ffec-ad2f-4d60-8af4-24955aa705f8 tempest-VolumesImageMetadata-1503044035 None] Converted 112.00 MB image at 43.58 MB/s Nov 06 11:50:02 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-9912ffec-ad2f-4d60-8af4-24955aa705f8 tempest-VolumesImageMetadata-1503044035 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-f2c06b6c-e056-4e44-b29a-db62f715c237 1G {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:50:02 devstack sudo[96867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-a94c80b9-0e72-4a03-b4db-31b396374dae.299dcfcf-fff7-407d-954d-a2ba5b15c5f9 Nov 06 11:50:02 devstack sudo[96867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:50:02 devstack sudo[96868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-f2c06b6c-e056-4e44-b29a-db62f715c237 1G Nov 06 11:50:02 devstack sudo[96868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:50:03 devstack sudo[96867]: pam_unix(sudo:session): session closed for user root Nov 06 11:50:03 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-8407f51e-4c90-4edb-b0d6-10a511333c8d tempest-GroupSnapshotsV319Test-637152665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-a94c80b9-0e72-4a03-b4db-31b396374dae.299dcfcf-fff7-407d-954d-a2ba5b15c5f9" returned: 0 in 0.329s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:50:03 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-8407f51e-4c90-4edb-b0d6-10a511333c8d tempest-GroupSnapshotsV319Test-637152665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-a94c80b9-0e72-4a03-b4db-31b396374dae.info {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:50:03 devstack sudo[96875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-a94c80b9-0e72-4a03-b4db-31b396374dae.info Nov 06 11:50:03 devstack sudo[96875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:50:03 devstack sudo[96868]: pam_unix(sudo:session): session closed for user root Nov 06 11:50:03 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-9912ffec-ad2f-4d60-8af4-24955aa705f8 tempest-VolumesImageMetadata-1503044035 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-f2c06b6c-e056-4e44-b29a-db62f715c237 1G" returned: 0 in 0.599s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:50:03 devstack cinder-volume[87116]: DEBUG cinder.volume.volume_utils [None req-9912ffec-ad2f-4d60-8af4-24955aa705f8 tempest-VolumesImageMetadata-1503044035 None] Downloaded image 423469e2-d15b-4cf9-87cd-88e68e947d3b ((None, [{'url': 'file:///opt/stack/data/glance/images/423469e2-d15b-4cf9-87cd-88e68e947d3b', 'metadata': {}}])) to volume f2c06b6c-e056-4e44-b29a-db62f715c237 successfully. {{(pid=87116) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Nov 06 11:50:03 devstack cinder-volume[87116]: DEBUG cinder.image.image_utils [None req-9912ffec-ad2f-4d60-8af4-24955aa705f8 tempest-VolumesImageMetadata-1503044035 None] Temporary image 423469e2-d15b-4cf9-87cd-88e68e947d3b for user f1b5c0d6381a48649cf88a5cc01b484f is deleted. {{(pid=87116) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Nov 06 11:50:03 devstack cinder-volume[87116]: DEBUG cinder.volume.volume_utils [None req-9912ffec-ad2f-4d60-8af4-24955aa705f8 tempest-VolumesImageMetadata-1503044035 None] Marking volume f2c06b6c-e056-4e44-b29a-db62f715c237 as bootable. {{(pid=87116) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Nov 06 11:50:03 devstack cinder-volume[87116]: DEBUG cinder.volume.flows.manager.create_volume [None req-9912ffec-ad2f-4d60-8af4-24955aa705f8 tempest-VolumesImageMetadata-1503044035 None] Copying metadata from image 423469e2-d15b-4cf9-87cd-88e68e947d3b to f2c06b6c-e056-4e44-b29a-db62f715c237. {{(pid=87116) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Nov 06 11:50:03 devstack cinder-volume[87116]: DEBUG cinder.volume.flows.manager.create_volume [None req-9912ffec-ad2f-4d60-8af4-24955aa705f8 tempest-VolumesImageMetadata-1503044035 None] Creating volume glance metadata for volume f2c06b6c-e056-4e44-b29a-db62f715c237 backed by image 423469e2-d15b-4cf9-87cd-88e68e947d3b with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '423469e2-d15b-4cf9-87cd-88e68e947d3b', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87116) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Nov 06 11:50:03 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-9912ffec-ad2f-4d60-8af4-24955aa705f8 tempest-VolumesImageMetadata-1503044035 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b9136821-6e3f-4330-8006-a04088cdddff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f2c06b6c-e056-4e44-b29a-db62f715c237', 'volume_size': 1, 'image_id': '423469e2-d15b-4cf9-87cd-88e68e947d3b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/423469e2-d15b-4cf9-87cd-88e68e947d3b', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b05f927c30c5407aad52949459346010', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '423469e2-d15b-4cf9-87cd-88e68e947d3b', 'created_at': datetime.datetime(2026, 11, 6, 10, 36, 49, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 6, 10, 36, 50, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/423469e2-d15b-4cf9-87cd-88e68e947d3b/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:50:03 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-9912ffec-ad2f-4d60-8af4-24955aa705f8 tempest-VolumesImageMetadata-1503044035 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a81198b1-5124-45a3-b703-3d57b9d6c02f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:50:03 devstack sudo[96875]: pam_unix(sudo:session): session closed for user root Nov 06 11:50:03 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-9912ffec-ad2f-4d60-8af4-24955aa705f8 tempest-VolumesImageMetadata-1503044035 None] Volume volume-f2c06b6c-e056-4e44-b29a-db62f715c237 (f2c06b6c-e056-4e44-b29a-db62f715c237): created successfully Nov 06 11:50:03 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-9912ffec-ad2f-4d60-8af4-24955aa705f8 tempest-VolumesImageMetadata-1503044035 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a81198b1-5124-45a3-b703-3d57b9d6c02f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:50:03 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-9912ffec-ad2f-4d60-8af4-24955aa705f8 tempest-VolumesImageMetadata-1503044035 None] Flow 'volume_create_manager' (c49fdf7a-a52b-41c0-929a-8f574c214c66) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 11:50:03 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-8407f51e-4c90-4edb-b0d6-10a511333c8d tempest-GroupSnapshotsV319Test-637152665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-a94c80b9-0e72-4a03-b4db-31b396374dae.info" returned: 0 in 0.615s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:50:03 devstack cinder-volume[87116]: WARNING cinder.volume.drivers.remotefs [None req-8407f51e-4c90-4edb-b0d6-10a511333c8d tempest-GroupSnapshotsV319Test-637152665 None] /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-a94c80b9-0e72-4a03-b4db-31b396374dae.info is being set with open permissions: ugo+rw: NotImplementedError Nov 06 11:50:03 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-8407f51e-4c90-4edb-b0d6-10a511333c8d tempest-GroupSnapshotsV319Test-637152665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-a94c80b9-0e72-4a03-b4db-31b396374dae.info {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:50:03 devstack sudo[96923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-a94c80b9-0e72-4a03-b4db-31b396374dae.info Nov 06 11:50:03 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-9912ffec-ad2f-4d60-8af4-24955aa705f8 tempest-VolumesImageMetadata-1503044035 None] Created volume successfully. Nov 06 11:50:03 devstack sudo[96923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:50:04 devstack sudo[96923]: pam_unix(sudo:session): session closed for user root Nov 06 11:50:04 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-8407f51e-4c90-4edb-b0d6-10a511333c8d tempest-GroupSnapshotsV319Test-637152665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-a94c80b9-0e72-4a03-b4db-31b396374dae.info" returned: 0 in 0.478s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:50:04 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-8407f51e-4c90-4edb-b0d6-10a511333c8d tempest-GroupSnapshotsV319Test-637152665 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.223s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 11:50:04 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-8407f51e-4c90-4edb-b0d6-10a511333c8d tempest-GroupSnapshotsV319Test-637152665 None] group_snapshot 093dae88-4364-4350-a32c-8377e9b12e30: created successfully Nov 06 11:50:05 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-68df0fb3-e04d-4f33-a01b-622e3c8c515f tempest-VolumesImageMetadata-1503044035 None] Acquiring lock "cinder-f2c06b6c-e056-4e44-b29a-db62f715c237-delete_volume" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 11:50:05 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-68df0fb3-e04d-4f33-a01b-622e3c8c515f tempest-VolumesImageMetadata-1503044035 None] Lock "cinder-f2c06b6c-e056-4e44-b29a-db62f715c237-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 11:50:05 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-68df0fb3-e04d-4f33-a01b-622e3c8c515f tempest-VolumesImageMetadata-1503044035 None] Acquiring lock "cinder-quobyte-f2c06b6c-e056-4e44-b29a-db62f715c237" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 11:50:05 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-68df0fb3-e04d-4f33-a01b-622e3c8c515f tempest-VolumesImageMetadata-1503044035 None] Lock "cinder-quobyte-f2c06b6c-e056-4e44-b29a-db62f715c237" acquired by "delete_volume" :: waited 0.020s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 11:50:05 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[7496ab00-029f-46ed-9060-03c5ec723621]: (4, 'qcow2') {{(pid=88420) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 11:50:05 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-68df0fb3-e04d-4f33-a01b-622e3c8c515f tempest-VolumesImageMetadata-1503044035 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-f2c06b6c-e056-4e44-b29a-db62f715c237 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:50:05 devstack sudo[96955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-f2c06b6c-e056-4e44-b29a-db62f715c237 Nov 06 11:50:05 devstack sudo[96955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:50:05 devstack sudo[96955]: pam_unix(sudo:session): session closed for user root Nov 06 11:50:05 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-68df0fb3-e04d-4f33-a01b-622e3c8c515f tempest-VolumesImageMetadata-1503044035 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-f2c06b6c-e056-4e44-b29a-db62f715c237" returned: 0 in 0.687s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:50:05 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-68df0fb3-e04d-4f33-a01b-622e3c8c515f tempest-VolumesImageMetadata-1503044035 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-f2c06b6c-e056-4e44-b29a-db62f715c237 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:50:05 devstack sudo[96960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-f2c06b6c-e056-4e44-b29a-db62f715c237 Nov 06 11:50:05 devstack sudo[96960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:50:06 devstack sudo[96960]: pam_unix(sudo:session): session closed for user root Nov 06 11:50:06 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-68df0fb3-e04d-4f33-a01b-622e3c8c515f tempest-VolumesImageMetadata-1503044035 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-f2c06b6c-e056-4e44-b29a-db62f715c237" returned: 0 in 0.509s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:50:06 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-68df0fb3-e04d-4f33-a01b-622e3c8c515f tempest-VolumesImageMetadata-1503044035 None] Lock "cinder-quobyte-f2c06b6c-e056-4e44-b29a-db62f715c237" released by "delete_volume" :: held 1.294s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 11:50:06 devstack cinder-volume[87116]: DEBUG cinder.quota [None req-68df0fb3-e04d-4f33-a01b-622e3c8c515f tempest-VolumesImageMetadata-1503044035 None] Created reservations ['5bd19eda-1ddb-437f-8073-54f3dfdebf64', '30a1f650-b1fc-4e97-9b25-c2e1c674aa55', 'b7fbcaff-820e-4b54-9e2f-8aadc01b279f', '62cc8bcb-051f-4418-9883-e4667af052f5'] {{(pid=87116) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 11:50:06 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-68df0fb3-e04d-4f33-a01b-622e3c8c515f tempest-VolumesImageMetadata-1503044035 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 11:50:06 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-68df0fb3-e04d-4f33-a01b-622e3c8c515f tempest-VolumesImageMetadata-1503044035 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 11:50:06 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-68df0fb3-e04d-4f33-a01b-622e3c8c515f tempest-VolumesImageMetadata-1503044035 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 11:50:06 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-68df0fb3-e04d-4f33-a01b-622e3c8c515f tempest-VolumesImageMetadata-1503044035 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 11:50:06 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-68df0fb3-e04d-4f33-a01b-622e3c8c515f tempest-VolumesImageMetadata-1503044035 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 11:50:06 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-68df0fb3-e04d-4f33-a01b-622e3c8c515f tempest-VolumesImageMetadata-1503044035 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:50:06 devstack sudo[96963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756 Nov 06 11:50:06 devstack sudo[96963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:50:06 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-c867e81b-6cce-4559-87d1-313a275d6e2c tempest-GroupSnapshotsV319Test-637152665 None] group_snapshot 093dae88-4364-4350-a32c-8377e9b12e30: deleting Nov 06 11:50:06 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-c867e81b-6cce-4559-87d1-313a275d6e2c tempest-GroupSnapshotsV319Test-637152665 None] group_snapshot 093dae88-4364-4350-a32c-8377e9b12e30: deleting {{(pid=87116) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Nov 06 11:50:06 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-c867e81b-6cce-4559-87d1-313a275d6e2c tempest-GroupSnapshotsV319Test-637152665 None] Acquiring lock "cinder-quobyte-a94c80b9-0e72-4a03-b4db-31b396374dae" by "delete_snapshot" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 11:50:06 devstack sudo[96963]: pam_unix(sudo:session): session closed for user root Nov 06 11:50:06 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-c867e81b-6cce-4559-87d1-313a275d6e2c tempest-GroupSnapshotsV319Test-637152665 None] Lock "cinder-quobyte-a94c80b9-0e72-4a03-b4db-31b396374dae" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 11:50:06 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-c867e81b-6cce-4559-87d1-313a275d6e2c tempest-GroupSnapshotsV319Test-637152665 None] Acquiring lock "cinder-quobyte-299dcfcf-fff7-407d-954d-a2ba5b15c5f9" by "_delete_snapshot" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 11:50:07 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-68df0fb3-e04d-4f33-a01b-622e3c8c515f tempest-VolumesImageMetadata-1503044035 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756" returned: 0 in 0.393s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:50:07 devstack cinder-volume[87116]: DEBUG cinder.manager [None req-68df0fb3-e04d-4f33-a01b-622e3c8c515f tempest-VolumesImageMetadata-1503044035 None] Notifying Schedulers of capabilities ... {{(pid=87116) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 11:50:07 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-68df0fb3-e04d-4f33-a01b-622e3c8c515f tempest-VolumesImageMetadata-1503044035 None] Deleted volume successfully. Nov 06 11:50:07 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-c867e81b-6cce-4559-87d1-313a275d6e2c tempest-GroupSnapshotsV319Test-637152665 None] Lock "cinder-quobyte-299dcfcf-fff7-407d-954d-a2ba5b15c5f9" acquired by "_delete_snapshot" :: waited 0.033s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 11:50:07 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-c867e81b-6cce-4559-87d1-313a275d6e2c tempest-GroupSnapshotsV319Test-637152665 None] Deleting offline snapshot 299dcfcf-fff7-407d-954d-a2ba5b15c5f9 of volume a94c80b9-0e72-4a03-b4db-31b396374dae {{(pid=87116) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 06 11:50:07 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-c867e81b-6cce-4559-87d1-313a275d6e2c tempest-GroupSnapshotsV319Test-637152665 None] snapshot_file for this snap is: volume-a94c80b9-0e72-4a03-b4db-31b396374dae.299dcfcf-fff7-407d-954d-a2ba5b15c5f9 {{(pid=87116) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 06 11:50:07 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-68df0fb3-e04d-4f33-a01b-622e3c8c515f tempest-VolumesImageMetadata-1503044035 None] Lock "cinder-f2c06b6c-e056-4e44-b29a-db62f715c237-delete_volume" released by "delete_volume" :: held 2.056s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 11:50:07 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[889cd17a-3fa9-4879-837a-93b3a02ef19c]: (4, 'qcow2') {{(pid=88420) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 11:50:07 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-c867e81b-6cce-4559-87d1-313a275d6e2c tempest-GroupSnapshotsV319Test-637152665 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-a94c80b9-0e72-4a03-b4db-31b396374dae.299dcfcf-fff7-407d-954d-a2ba5b15c5f9 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:50:07 devstack sudo[96976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-a94c80b9-0e72-4a03-b4db-31b396374dae.299dcfcf-fff7-407d-954d-a2ba5b15c5f9 Nov 06 11:50:07 devstack sudo[96976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:50:07 devstack sudo[96976]: pam_unix(sudo:session): session closed for user root Nov 06 11:50:07 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-c867e81b-6cce-4559-87d1-313a275d6e2c tempest-GroupSnapshotsV319Test-637152665 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-a94c80b9-0e72-4a03-b4db-31b396374dae.299dcfcf-fff7-407d-954d-a2ba5b15c5f9" returned: 0 in 0.594s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:50:07 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-c867e81b-6cce-4559-87d1-313a275d6e2c tempest-GroupSnapshotsV319Test-637152665 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a94c80b9-0e72-4a03-b4db-31b396374dae(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87116) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 11:50:07 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9c2eb57-5a7a-4100-944e-5c7bdf27888d]: (4, 'qcow2') {{(pid=88420) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 11:50:07 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-c867e81b-6cce-4559-87d1-313a275d6e2c tempest-GroupSnapshotsV319Test-637152665 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-a94c80b9-0e72-4a03-b4db-31b396374dae {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:50:07 devstack sudo[96995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-a94c80b9-0e72-4a03-b4db-31b396374dae Nov 06 11:50:07 devstack sudo[96995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:50:08 devstack sudo[96995]: pam_unix(sudo:session): session closed for user root Nov 06 11:50:08 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-c867e81b-6cce-4559-87d1-313a275d6e2c tempest-GroupSnapshotsV319Test-637152665 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-a94c80b9-0e72-4a03-b4db-31b396374dae" returned: 0 in 0.624s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:50:08 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-c867e81b-6cce-4559-87d1-313a275d6e2c tempest-GroupSnapshotsV319Test-637152665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-a94c80b9-0e72-4a03-b4db-31b396374dae.299dcfcf-fff7-407d-954d-a2ba5b15c5f9 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:50:08 devstack sudo[97002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-a94c80b9-0e72-4a03-b4db-31b396374dae.299dcfcf-fff7-407d-954d-a2ba5b15c5f9 Nov 06 11:50:08 devstack sudo[97002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:50:08 devstack sudo[97002]: pam_unix(sudo:session): session closed for user root Nov 06 11:50:08 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-c867e81b-6cce-4559-87d1-313a275d6e2c tempest-GroupSnapshotsV319Test-637152665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-a94c80b9-0e72-4a03-b4db-31b396374dae.299dcfcf-fff7-407d-954d-a2ba5b15c5f9" returned: 0 in 0.489s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:50:08 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-c867e81b-6cce-4559-87d1-313a275d6e2c tempest-GroupSnapshotsV319Test-637152665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-a94c80b9-0e72-4a03-b4db-31b396374dae.299dcfcf-fff7-407d-954d-a2ba5b15c5f9 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:50:08 devstack sudo[97007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-a94c80b9-0e72-4a03-b4db-31b396374dae.299dcfcf-fff7-407d-954d-a2ba5b15c5f9 Nov 06 11:50:08 devstack sudo[97007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:50:09 devstack sudo[97007]: pam_unix(sudo:session): session closed for user root Nov 06 11:50:09 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-c867e81b-6cce-4559-87d1-313a275d6e2c tempest-GroupSnapshotsV319Test-637152665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-a94c80b9-0e72-4a03-b4db-31b396374dae.299dcfcf-fff7-407d-954d-a2ba5b15c5f9" returned: 0 in 0.316s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:50:09 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-c867e81b-6cce-4559-87d1-313a275d6e2c tempest-GroupSnapshotsV319Test-637152665 None] Lock "cinder-quobyte-299dcfcf-fff7-407d-954d-a2ba5b15c5f9" released by "_delete_snapshot" :: held 2.235s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 11:50:09 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-c867e81b-6cce-4559-87d1-313a275d6e2c tempest-GroupSnapshotsV319Test-637152665 None] Lock "cinder-quobyte-a94c80b9-0e72-4a03-b4db-31b396374dae" released by "delete_snapshot" :: held 2.279s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 11:50:09 devstack cinder-volume[87116]: WARNING cinder.quota [None req-c867e81b-6cce-4559-87d1-313a275d6e2c tempest-GroupSnapshotsV319Test-637152665 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1308771280 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1308771280, it is now deprecated. Please use the default quota class for default quota. Nov 06 11:50:09 devstack cinder-volume[87116]: WARNING cinder.quota [None req-c867e81b-6cce-4559-87d1-313a275d6e2c tempest-GroupSnapshotsV319Test-637152665 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-1308771280 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-1308771280, it is now deprecated. Please use the default quota class for default quota. Nov 06 11:50:09 devstack cinder-volume[87116]: DEBUG cinder.quota [None req-c867e81b-6cce-4559-87d1-313a275d6e2c tempest-GroupSnapshotsV319Test-637152665 None] Created reservations ['2cad107b-20b7-42c8-8b9f-6ef69d28c913', 'dab0c43a-0eff-4fd6-a556-554ee9099c93', '1af2f530-e07d-4c82-92d9-033c4eb33813', '04fcdef0-775a-4f4b-a2e0-c862cfff5840'] {{(pid=87116) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 11:50:09 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-c867e81b-6cce-4559-87d1-313a275d6e2c tempest-GroupSnapshotsV319Test-637152665 None] group_snapshot 093dae88-4364-4350-a32c-8377e9b12e30: deleted successfully Nov 06 11:50:09 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-1e4d6eae-1a32-4daa-a2a4-75eedee216eb tempest-GroupSnapshotsV319Test-637152665 None] Acquiring lock "cinder-quobyte-a94c80b9-0e72-4a03-b4db-31b396374dae" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 11:50:09 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-1e4d6eae-1a32-4daa-a2a4-75eedee216eb tempest-GroupSnapshotsV319Test-637152665 None] Lock "cinder-quobyte-a94c80b9-0e72-4a03-b4db-31b396374dae" acquired by "delete_volume" :: waited 0.023s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 11:50:09 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[737fc576-7470-4203-b35e-9d754b15beb8]: (4, 'qcow2') {{(pid=88420) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 11:50:09 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-1e4d6eae-1a32-4daa-a2a4-75eedee216eb tempest-GroupSnapshotsV319Test-637152665 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-a94c80b9-0e72-4a03-b4db-31b396374dae {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:50:10 devstack sudo[97010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-a94c80b9-0e72-4a03-b4db-31b396374dae Nov 06 11:50:10 devstack sudo[97010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:50:10 devstack cinder-volume[87116]: DEBUG cinder.volume.flows.manager.create_volume [req-e71ade48-64f4-4f02-8f11-7af11b733b8d req-5eb39fb6-d231-4acf-9d27-a951f0581c4d tempest-VolumesSnapshotsTestJSON-1498968317 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87116) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 11:50:10 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [req-e71ade48-64f4-4f02-8f11-7af11b733b8d req-5eb39fb6-d231-4acf-9d27-a951f0581c4d tempest-VolumesSnapshotsTestJSON-1498968317 None] Flow 'volume_create_manager' (84c26580-f538-4734-b920-32be41812cb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 11:50:10 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [req-e71ade48-64f4-4f02-8f11-7af11b733b8d req-5eb39fb6-d231-4acf-9d27-a951f0581c4d tempest-VolumesSnapshotsTestJSON-1498968317 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (06dc8311-d776-4f60-861b-93f4a2ccfddc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:50:10 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [req-e71ade48-64f4-4f02-8f11-7af11b733b8d req-5eb39fb6-d231-4acf-9d27-a951f0581c4d tempest-VolumesSnapshotsTestJSON-1498968317 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (06dc8311-d776-4f60-861b-93f4a2ccfddc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T10:50:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1647680506',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=623aa1e4-ee55-4434-a4c6-5c86ad2e6a1a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d80baf9f76b54e1b8c83945fe87404d4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T10:50:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T10:50:10Z,use_quota=True,user_id='8710b5a22e9e4d2ca08ef7b98977c909',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(34d3b144-d9b7-480a-a2e3-01e45f3d54c1),volume_type_id=34d3b144-d9b7-480a-a2e3-01e45f3d54c1)' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:50:10 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [req-e71ade48-64f4-4f02-8f11-7af11b733b8d req-5eb39fb6-d231-4acf-9d27-a951f0581c4d tempest-VolumesSnapshotsTestJSON-1498968317 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a4c2b459-536a-4370-97e5-b5d3b614512a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:50:10 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [req-e71ade48-64f4-4f02-8f11-7af11b733b8d req-5eb39fb6-d231-4acf-9d27-a951f0581c4d tempest-VolumesSnapshotsTestJSON-1498968317 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a4c2b459-536a-4370-97e5-b5d3b614512a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:50:10 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [req-e71ade48-64f4-4f02-8f11-7af11b733b8d req-5eb39fb6-d231-4acf-9d27-a951f0581c4d tempest-VolumesSnapshotsTestJSON-1498968317 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d8581fbb-714c-4173-8281-910002d75c8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:50:10 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [req-e71ade48-64f4-4f02-8f11-7af11b733b8d req-5eb39fb6-d231-4acf-9d27-a951f0581c4d tempest-VolumesSnapshotsTestJSON-1498968317 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d8581fbb-714c-4173-8281-910002d75c8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '623aa1e4-ee55-4434-a4c6-5c86ad2e6a1a', 'volume_name': 'volume-623aa1e4-ee55-4434-a4c6-5c86ad2e6a1a', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:50:10 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [req-e71ade48-64f4-4f02-8f11-7af11b733b8d req-5eb39fb6-d231-4acf-9d27-a951f0581c4d tempest-VolumesSnapshotsTestJSON-1498968317 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7675ee08-3259-4a7b-9e48-8eea34c975c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:50:10 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [req-e71ade48-64f4-4f02-8f11-7af11b733b8d req-5eb39fb6-d231-4acf-9d27-a951f0581c4d tempest-VolumesSnapshotsTestJSON-1498968317 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7675ee08-3259-4a7b-9e48-8eea34c975c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:50:10 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [req-e71ade48-64f4-4f02-8f11-7af11b733b8d req-5eb39fb6-d231-4acf-9d27-a951f0581c4d tempest-VolumesSnapshotsTestJSON-1498968317 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f5fcb9e1-9f34-4e16-9846-75c961719816) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:50:10 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [req-e71ade48-64f4-4f02-8f11-7af11b733b8d req-5eb39fb6-d231-4acf-9d27-a951f0581c4d tempest-VolumesSnapshotsTestJSON-1498968317 None] Volume 623aa1e4-ee55-4434-a4c6-5c86ad2e6a1a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-623aa1e4-ee55-4434-a4c6-5c86ad2e6a1a', 'volume_size': 1} Nov 06 11:50:10 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [req-e71ade48-64f4-4f02-8f11-7af11b733b8d req-5eb39fb6-d231-4acf-9d27-a951f0581c4d tempest-VolumesSnapshotsTestJSON-1498968317 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 11:50:10 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [req-e71ade48-64f4-4f02-8f11-7af11b733b8d req-5eb39fb6-d231-4acf-9d27-a951f0581c4d tempest-VolumesSnapshotsTestJSON-1498968317 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 11:50:10 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [req-e71ade48-64f4-4f02-8f11-7af11b733b8d req-5eb39fb6-d231-4acf-9d27-a951f0581c4d tempest-VolumesSnapshotsTestJSON-1498968317 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T10:50:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1647680506',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=623aa1e4-ee55-4434-a4c6-5c86ad2e6a1a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d80baf9f76b54e1b8c83945fe87404d4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T10:50:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T10:50:10Z,use_quota=True,user_id='8710b5a22e9e4d2ca08ef7b98977c909',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(34d3b144-d9b7-480a-a2e3-01e45f3d54c1),volume_type_id=34d3b144-d9b7-480a-a2e3-01e45f3d54c1)}" {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 11:50:10 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [req-e71ade48-64f4-4f02-8f11-7af11b733b8d req-5eb39fb6-d231-4acf-9d27-a951f0581c4d tempest-VolumesSnapshotsTestJSON-1498968317 None] Creating volume 623aa1e4-ee55-4434-a4c6-5c86ad2e6a1a {{(pid=87116) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 11:50:10 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [req-e71ade48-64f4-4f02-8f11-7af11b733b8d req-5eb39fb6-d231-4acf-9d27-a951f0581c4d tempest-VolumesSnapshotsTestJSON-1498968317 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 11:50:10 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [req-e71ade48-64f4-4f02-8f11-7af11b733b8d req-5eb39fb6-d231-4acf-9d27-a951f0581c4d tempest-VolumesSnapshotsTestJSON-1498968317 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 11:50:10 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [req-e71ade48-64f4-4f02-8f11-7af11b733b8d req-5eb39fb6-d231-4acf-9d27-a951f0581c4d tempest-VolumesSnapshotsTestJSON-1498968317 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 11:50:10 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [req-e71ade48-64f4-4f02-8f11-7af11b733b8d req-5eb39fb6-d231-4acf-9d27-a951f0581c4d tempest-VolumesSnapshotsTestJSON-1498968317 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 11:50:10 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [req-e71ade48-64f4-4f02-8f11-7af11b733b8d req-5eb39fb6-d231-4acf-9d27-a951f0581c4d tempest-VolumesSnapshotsTestJSON-1498968317 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 11:50:10 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [req-e71ade48-64f4-4f02-8f11-7af11b733b8d req-5eb39fb6-d231-4acf-9d27-a951f0581c4d tempest-VolumesSnapshotsTestJSON-1498968317 None] Selected osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f as target Quobyte volume. {{(pid=87116) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 11:50:10 devstack cinder-volume[87116]: INFO cinder.volume.drivers.remotefs [req-e71ade48-64f4-4f02-8f11-7af11b733b8d req-5eb39fb6-d231-4acf-9d27-a951f0581c4d tempest-VolumesSnapshotsTestJSON-1498968317 None] casted to osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f Nov 06 11:50:10 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [req-e71ade48-64f4-4f02-8f11-7af11b733b8d req-5eb39fb6-d231-4acf-9d27-a951f0581c4d tempest-VolumesSnapshotsTestJSON-1498968317 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-623aa1e4-ee55-4434-a4c6-5c86ad2e6a1a 1073741824 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:50:10 devstack sudo[97012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-623aa1e4-ee55-4434-a4c6-5c86ad2e6a1a 1073741824 Nov 06 11:50:10 devstack sudo[97012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:50:10 devstack sudo[97010]: pam_unix(sudo:session): session closed for user root Nov 06 11:50:10 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-1e4d6eae-1a32-4daa-a2a4-75eedee216eb tempest-GroupSnapshotsV319Test-637152665 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-a94c80b9-0e72-4a03-b4db-31b396374dae" returned: 0 in 0.464s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:50:10 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-1e4d6eae-1a32-4daa-a2a4-75eedee216eb tempest-GroupSnapshotsV319Test-637152665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-a94c80b9-0e72-4a03-b4db-31b396374dae {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:50:10 devstack sudo[97017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-a94c80b9-0e72-4a03-b4db-31b396374dae Nov 06 11:50:10 devstack sudo[97017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:50:10 devstack sudo[97017]: pam_unix(sudo:session): session closed for user root Nov 06 11:50:10 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-1e4d6eae-1a32-4daa-a2a4-75eedee216eb tempest-GroupSnapshotsV319Test-637152665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-a94c80b9-0e72-4a03-b4db-31b396374dae" returned: 0 in 0.346s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:50:10 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-1e4d6eae-1a32-4daa-a2a4-75eedee216eb tempest-GroupSnapshotsV319Test-637152665 None] Lock "cinder-quobyte-a94c80b9-0e72-4a03-b4db-31b396374dae" released by "delete_volume" :: held 0.926s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 11:50:10 devstack cinder-volume[87116]: DEBUG cinder.quota [None req-1e4d6eae-1a32-4daa-a2a4-75eedee216eb tempest-GroupSnapshotsV319Test-637152665 None] Created reservations ['6fefa290-3bd5-4f6d-b55b-9c8d53a9f3f9'] {{(pid=87116) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 11:50:10 devstack sudo[97012]: pam_unix(sudo:session): session closed for user root Nov 06 11:50:10 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [req-e71ade48-64f4-4f02-8f11-7af11b733b8d req-5eb39fb6-d231-4acf-9d27-a951f0581c4d tempest-VolumesSnapshotsTestJSON-1498968317 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-623aa1e4-ee55-4434-a4c6-5c86ad2e6a1a 1073741824" returned: 0 in 0.599s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:50:10 devstack cinder-volume[87116]: WARNING cinder.quota [None req-1e4d6eae-1a32-4daa-a2a4-75eedee216eb tempest-GroupSnapshotsV319Test-637152665 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-1308771280 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-1308771280, it is now deprecated. Please use the default quota class for default quota. Nov 06 11:50:10 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [req-e71ade48-64f4-4f02-8f11-7af11b733b8d req-5eb39fb6-d231-4acf-9d27-a951f0581c4d tempest-VolumesSnapshotsTestJSON-1498968317 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-623aa1e4-ee55-4434-a4c6-5c86ad2e6a1a {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:50:10 devstack cinder-volume[87116]: DEBUG cinder.quota [None req-1e4d6eae-1a32-4daa-a2a4-75eedee216eb tempest-GroupSnapshotsV319Test-637152665 None] Created reservations ['f635869d-6d57-4352-a511-0474dccd4a31', 'fcdf60f5-71c3-4561-956c-8a4d387668ef', '8f5f8405-0fc2-4ea4-9089-3a2496f7ebed', '8c0bda3c-ca18-4bd2-bb45-7fff0f81c901'] {{(pid=87116) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 11:50:10 devstack sudo[97024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-623aa1e4-ee55-4434-a4c6-5c86ad2e6a1a Nov 06 11:50:10 devstack sudo[97024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:50:11 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-1e4d6eae-1a32-4daa-a2a4-75eedee216eb tempest-GroupSnapshotsV319Test-637152665 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 11:50:11 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-1e4d6eae-1a32-4daa-a2a4-75eedee216eb tempest-GroupSnapshotsV319Test-637152665 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 11:50:11 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-1e4d6eae-1a32-4daa-a2a4-75eedee216eb tempest-GroupSnapshotsV319Test-637152665 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 11:50:11 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-1e4d6eae-1a32-4daa-a2a4-75eedee216eb tempest-GroupSnapshotsV319Test-637152665 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 11:50:11 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-1e4d6eae-1a32-4daa-a2a4-75eedee216eb tempest-GroupSnapshotsV319Test-637152665 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 11:50:11 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-1e4d6eae-1a32-4daa-a2a4-75eedee216eb tempest-GroupSnapshotsV319Test-637152665 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:50:11 devstack sudo[97026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756 Nov 06 11:50:11 devstack sudo[97026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:50:11 devstack sudo[97024]: pam_unix(sudo:session): session closed for user root Nov 06 11:50:11 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [req-e71ade48-64f4-4f02-8f11-7af11b733b8d req-5eb39fb6-d231-4acf-9d27-a951f0581c4d tempest-VolumesSnapshotsTestJSON-1498968317 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-623aa1e4-ee55-4434-a4c6-5c86ad2e6a1a" returned: 0 in 0.370s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:50:11 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [req-e71ade48-64f4-4f02-8f11-7af11b733b8d req-5eb39fb6-d231-4acf-9d27-a951f0581c4d tempest-VolumesSnapshotsTestJSON-1498968317 None] <== create_volume: return (1031ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f'} {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 11:50:11 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [req-e71ade48-64f4-4f02-8f11-7af11b733b8d req-5eb39fb6-d231-4acf-9d27-a951f0581c4d tempest-VolumesSnapshotsTestJSON-1498968317 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.036s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 11:50:11 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [req-e71ade48-64f4-4f02-8f11-7af11b733b8d req-5eb39fb6-d231-4acf-9d27-a951f0581c4d tempest-VolumesSnapshotsTestJSON-1498968317 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f5fcb9e1-9f34-4e16-9846-75c961719816) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-623aa1e4-ee55-4434-a4c6-5c86ad2e6a1a', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:50:11 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [req-e71ade48-64f4-4f02-8f11-7af11b733b8d req-5eb39fb6-d231-4acf-9d27-a951f0581c4d tempest-VolumesSnapshotsTestJSON-1498968317 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (31f826b0-3c86-4275-ba66-c75d5bb1eb36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:50:11 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [req-e71ade48-64f4-4f02-8f11-7af11b733b8d req-5eb39fb6-d231-4acf-9d27-a951f0581c4d tempest-VolumesSnapshotsTestJSON-1498968317 None] Volume volume-623aa1e4-ee55-4434-a4c6-5c86ad2e6a1a (623aa1e4-ee55-4434-a4c6-5c86ad2e6a1a): created successfully Nov 06 11:50:11 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [req-e71ade48-64f4-4f02-8f11-7af11b733b8d req-5eb39fb6-d231-4acf-9d27-a951f0581c4d tempest-VolumesSnapshotsTestJSON-1498968317 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (31f826b0-3c86-4275-ba66-c75d5bb1eb36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:50:11 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [req-e71ade48-64f4-4f02-8f11-7af11b733b8d req-5eb39fb6-d231-4acf-9d27-a951f0581c4d tempest-VolumesSnapshotsTestJSON-1498968317 None] Flow 'volume_create_manager' (84c26580-f538-4734-b920-32be41812cb8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 11:50:11 devstack cinder-volume[87116]: INFO cinder.volume.manager [req-e71ade48-64f4-4f02-8f11-7af11b733b8d req-5eb39fb6-d231-4acf-9d27-a951f0581c4d tempest-VolumesSnapshotsTestJSON-1498968317 None] Created volume successfully. Nov 06 11:50:11 devstack sudo[97026]: pam_unix(sudo:session): session closed for user root Nov 06 11:50:11 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-1e4d6eae-1a32-4daa-a2a4-75eedee216eb tempest-GroupSnapshotsV319Test-637152665 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756" returned: 0 in 0.372s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:50:11 devstack cinder-volume[87116]: DEBUG cinder.manager [None req-1e4d6eae-1a32-4daa-a2a4-75eedee216eb tempest-GroupSnapshotsV319Test-637152665 None] Notifying Schedulers of capabilities ... {{(pid=87116) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 11:50:11 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-1e4d6eae-1a32-4daa-a2a4-75eedee216eb tempest-GroupSnapshotsV319Test-637152665 None] Delete group completed successfully. Nov 06 11:50:12 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [req-a7c83ffa-47a2-4877-ba10-240e99ccdfc8 req-d34a362a-b6c1-4e23-b8d4-cefa37095a77 tempest-VolumesSnapshotsTestJSON-1498968317 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 11:50:12 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [req-a7c83ffa-47a2-4877-ba10-240e99ccdfc8 req-d34a362a-b6c1-4e23-b8d4-cefa37095a77 tempest-VolumesSnapshotsTestJSON-1498968317 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 11:50:12 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [req-a7c83ffa-47a2-4877-ba10-240e99ccdfc8 req-d34a362a-b6c1-4e23-b8d4-cefa37095a77 tempest-VolumesSnapshotsTestJSON-1498968317 None] Creating offline snapshot f2ab1511-e013-420a-8d03-eb145cb470de of volume 623aa1e4-ee55-4434-a4c6-5c86ad2e6a1a {{(pid=87116) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 06 11:50:12 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc00c8f4-e106-4208-9fce-ca2252387b20]: (4, 'qcow2') {{(pid=88420) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 11:50:12 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [req-a7c83ffa-47a2-4877-ba10-240e99ccdfc8 req-d34a362a-b6c1-4e23-b8d4-cefa37095a77 tempest-VolumesSnapshotsTestJSON-1498968317 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-623aa1e4-ee55-4434-a4c6-5c86ad2e6a1a {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:50:12 devstack sudo[97031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-623aa1e4-ee55-4434-a4c6-5c86ad2e6a1a Nov 06 11:50:12 devstack sudo[97031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:50:12 devstack sudo[97031]: pam_unix(sudo:session): session closed for user root Nov 06 11:50:12 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [req-a7c83ffa-47a2-4877-ba10-240e99ccdfc8 req-d34a362a-b6c1-4e23-b8d4-cefa37095a77 tempest-VolumesSnapshotsTestJSON-1498968317 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-623aa1e4-ee55-4434-a4c6-5c86ad2e6a1a" returned: 0 in 0.383s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:50:12 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [req-a7c83ffa-47a2-4877-ba10-240e99ccdfc8 req-d34a362a-b6c1-4e23-b8d4-cefa37095a77 tempest-VolumesSnapshotsTestJSON-1498968317 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-623aa1e4-ee55-4434-a4c6-5c86ad2e6a1a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-623aa1e4-ee55-4434-a4c6-5c86ad2e6a1a.f2ab1511-e013-420a-8d03-eb145cb470de 1G {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:50:13 devstack sudo[97036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-623aa1e4-ee55-4434-a4c6-5c86ad2e6a1a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-623aa1e4-ee55-4434-a4c6-5c86ad2e6a1a.f2ab1511-e013-420a-8d03-eb145cb470de 1G Nov 06 11:50:13 devstack sudo[97036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:50:13 devstack sudo[97036]: pam_unix(sudo:session): session closed for user root Nov 06 11:50:13 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [req-a7c83ffa-47a2-4877-ba10-240e99ccdfc8 req-d34a362a-b6c1-4e23-b8d4-cefa37095a77 tempest-VolumesSnapshotsTestJSON-1498968317 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-623aa1e4-ee55-4434-a4c6-5c86ad2e6a1a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-623aa1e4-ee55-4434-a4c6-5c86ad2e6a1a.f2ab1511-e013-420a-8d03-eb145cb470de 1G" returned: 0 in 0.682s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:50:13 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [req-a7c83ffa-47a2-4877-ba10-240e99ccdfc8 req-d34a362a-b6c1-4e23-b8d4-cefa37095a77 tempest-VolumesSnapshotsTestJSON-1498968317 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-623aa1e4-ee55-4434-a4c6-5c86ad2e6a1a -F qcow2 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-623aa1e4-ee55-4434-a4c6-5c86ad2e6a1a.f2ab1511-e013-420a-8d03-eb145cb470de {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:50:13 devstack sudo[97043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-623aa1e4-ee55-4434-a4c6-5c86ad2e6a1a -F qcow2 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-623aa1e4-ee55-4434-a4c6-5c86ad2e6a1a.f2ab1511-e013-420a-8d03-eb145cb470de Nov 06 11:50:13 devstack sudo[97043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:50:14 devstack sudo[97043]: pam_unix(sudo:session): session closed for user root Nov 06 11:50:14 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [req-a7c83ffa-47a2-4877-ba10-240e99ccdfc8 req-d34a362a-b6c1-4e23-b8d4-cefa37095a77 tempest-VolumesSnapshotsTestJSON-1498968317 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-623aa1e4-ee55-4434-a4c6-5c86ad2e6a1a -F qcow2 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-623aa1e4-ee55-4434-a4c6-5c86ad2e6a1a.f2ab1511-e013-420a-8d03-eb145cb470de" returned: 0 in 0.460s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:50:14 devstack cinder-volume[87116]: WARNING cinder.volume.drivers.remotefs [req-a7c83ffa-47a2-4877-ba10-240e99ccdfc8 req-d34a362a-b6c1-4e23-b8d4-cefa37095a77 tempest-VolumesSnapshotsTestJSON-1498968317 None] /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-623aa1e4-ee55-4434-a4c6-5c86ad2e6a1a.f2ab1511-e013-420a-8d03-eb145cb470de is being set with open permissions: ugo+rw Nov 06 11:50:14 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [req-a7c83ffa-47a2-4877-ba10-240e99ccdfc8 req-d34a362a-b6c1-4e23-b8d4-cefa37095a77 tempest-VolumesSnapshotsTestJSON-1498968317 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-623aa1e4-ee55-4434-a4c6-5c86ad2e6a1a.f2ab1511-e013-420a-8d03-eb145cb470de {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:50:14 devstack sudo[97048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-623aa1e4-ee55-4434-a4c6-5c86ad2e6a1a.f2ab1511-e013-420a-8d03-eb145cb470de Nov 06 11:50:14 devstack sudo[97048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:50:14 devstack sudo[97048]: pam_unix(sudo:session): session closed for user root Nov 06 11:50:14 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [req-a7c83ffa-47a2-4877-ba10-240e99ccdfc8 req-d34a362a-b6c1-4e23-b8d4-cefa37095a77 tempest-VolumesSnapshotsTestJSON-1498968317 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-623aa1e4-ee55-4434-a4c6-5c86ad2e6a1a.f2ab1511-e013-420a-8d03-eb145cb470de" returned: 0 in 0.411s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:50:14 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [req-a7c83ffa-47a2-4877-ba10-240e99ccdfc8 req-d34a362a-b6c1-4e23-b8d4-cefa37095a77 tempest-VolumesSnapshotsTestJSON-1498968317 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-623aa1e4-ee55-4434-a4c6-5c86ad2e6a1a.info {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:50:14 devstack sudo[97052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-623aa1e4-ee55-4434-a4c6-5c86ad2e6a1a.info Nov 06 11:50:14 devstack sudo[97052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:50:14 devstack sudo[97052]: pam_unix(sudo:session): session closed for user root Nov 06 11:50:14 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [req-a7c83ffa-47a2-4877-ba10-240e99ccdfc8 req-d34a362a-b6c1-4e23-b8d4-cefa37095a77 tempest-VolumesSnapshotsTestJSON-1498968317 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-623aa1e4-ee55-4434-a4c6-5c86ad2e6a1a.info" returned: 0 in 0.335s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:50:14 devstack cinder-volume[87116]: WARNING cinder.volume.drivers.remotefs [req-a7c83ffa-47a2-4877-ba10-240e99ccdfc8 req-d34a362a-b6c1-4e23-b8d4-cefa37095a77 tempest-VolumesSnapshotsTestJSON-1498968317 None] /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-623aa1e4-ee55-4434-a4c6-5c86ad2e6a1a.info is being set with open permissions: ugo+rw Nov 06 11:50:14 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [req-a7c83ffa-47a2-4877-ba10-240e99ccdfc8 req-d34a362a-b6c1-4e23-b8d4-cefa37095a77 tempest-VolumesSnapshotsTestJSON-1498968317 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-623aa1e4-ee55-4434-a4c6-5c86ad2e6a1a.info {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:50:14 devstack sudo[97055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-623aa1e4-ee55-4434-a4c6-5c86ad2e6a1a.info Nov 06 11:50:14 devstack sudo[97055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:50:15 devstack sudo[97055]: pam_unix(sudo:session): session closed for user root Nov 06 11:50:15 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [req-a7c83ffa-47a2-4877-ba10-240e99ccdfc8 req-d34a362a-b6c1-4e23-b8d4-cefa37095a77 tempest-VolumesSnapshotsTestJSON-1498968317 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-623aa1e4-ee55-4434-a4c6-5c86ad2e6a1a.info" returned: 0 in 0.277s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:50:15 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [req-a7c83ffa-47a2-4877-ba10-240e99ccdfc8 req-d34a362a-b6c1-4e23-b8d4-cefa37095a77 tempest-VolumesSnapshotsTestJSON-1498968317 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.695s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 11:50:15 devstack cinder-volume[87116]: INFO cinder.volume.manager [req-a7c83ffa-47a2-4877-ba10-240e99ccdfc8 req-d34a362a-b6c1-4e23-b8d4-cefa37095a77 tempest-VolumesSnapshotsTestJSON-1498968317 None] Create snapshot completed successfully Nov 06 11:50:15 devstack cinder-volume[87116]: DEBUG cinder.coordination [req-bf6aa13b-bf7b-48a1-90d1-9c3c6214264c req-140ac023-5bbb-47ce-8319-8eba1211f0b1 tempest-VolumesSnapshotsTestJSON-1498968317 None] Acquiring lock "cinder-f2ab1511-e013-420a-8d03-eb145cb470de-delete_snapshot" by "delete_snapshot" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 11:50:15 devstack cinder-volume[87116]: DEBUG cinder.coordination [req-bf6aa13b-bf7b-48a1-90d1-9c3c6214264c req-140ac023-5bbb-47ce-8319-8eba1211f0b1 tempest-VolumesSnapshotsTestJSON-1498968317 None] Lock "cinder-f2ab1511-e013-420a-8d03-eb145cb470de-delete_snapshot" acquired by "delete_snapshot" :: waited 0.037s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 11:50:15 devstack cinder-volume[87116]: DEBUG cinder.coordination [req-bf6aa13b-bf7b-48a1-90d1-9c3c6214264c req-140ac023-5bbb-47ce-8319-8eba1211f0b1 tempest-VolumesSnapshotsTestJSON-1498968317 None] Acquiring lock "cinder-quobyte-623aa1e4-ee55-4434-a4c6-5c86ad2e6a1a" by "delete_snapshot" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 11:50:15 devstack cinder-volume[87116]: DEBUG cinder.coordination [req-bf6aa13b-bf7b-48a1-90d1-9c3c6214264c req-140ac023-5bbb-47ce-8319-8eba1211f0b1 tempest-VolumesSnapshotsTestJSON-1498968317 None] Lock "cinder-quobyte-623aa1e4-ee55-4434-a4c6-5c86ad2e6a1a" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 11:50:15 devstack cinder-volume[87116]: DEBUG cinder.coordination [req-bf6aa13b-bf7b-48a1-90d1-9c3c6214264c req-140ac023-5bbb-47ce-8319-8eba1211f0b1 tempest-VolumesSnapshotsTestJSON-1498968317 None] Acquiring lock "cinder-quobyte-f2ab1511-e013-420a-8d03-eb145cb470de" by "_delete_snapshot" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 11:50:15 devstack cinder-volume[87116]: DEBUG cinder.coordination [req-bf6aa13b-bf7b-48a1-90d1-9c3c6214264c req-140ac023-5bbb-47ce-8319-8eba1211f0b1 tempest-VolumesSnapshotsTestJSON-1498968317 None] Lock "cinder-quobyte-f2ab1511-e013-420a-8d03-eb145cb470de" acquired by "_delete_snapshot" :: waited 0.046s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 11:50:15 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [req-bf6aa13b-bf7b-48a1-90d1-9c3c6214264c req-140ac023-5bbb-47ce-8319-8eba1211f0b1 tempest-VolumesSnapshotsTestJSON-1498968317 None] Deleting offline snapshot f2ab1511-e013-420a-8d03-eb145cb470de of volume 623aa1e4-ee55-4434-a4c6-5c86ad2e6a1a {{(pid=87116) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 06 11:50:15 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [req-bf6aa13b-bf7b-48a1-90d1-9c3c6214264c req-140ac023-5bbb-47ce-8319-8eba1211f0b1 tempest-VolumesSnapshotsTestJSON-1498968317 None] snapshot_file for this snap is: volume-623aa1e4-ee55-4434-a4c6-5c86ad2e6a1a.f2ab1511-e013-420a-8d03-eb145cb470de {{(pid=87116) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 06 11:50:15 devstack cinder-volume[87116]: DEBUG cinder.volume.flows.manager.create_volume [None req-4ef9a12c-d91e-481d-a334-742ba5ca24f8 tempest-VolumesTransfersV355Test-968934166 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87116) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 11:50:15 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-4ef9a12c-d91e-481d-a334-742ba5ca24f8 tempest-VolumesTransfersV355Test-968934166 None] Flow 'volume_create_manager' (a77e48f5-2fa1-452d-9cbc-e68314ee696f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 11:50:15 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-4ef9a12c-d91e-481d-a334-742ba5ca24f8 tempest-VolumesTransfersV355Test-968934166 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (80ba0054-830d-4a7d-a27a-67f1449f637b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:50:15 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[e06cf352-31f5-410f-bfd9-48064b3fd43b]: (4, 'qcow2') {{(pid=88420) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 11:50:15 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [req-bf6aa13b-bf7b-48a1-90d1-9c3c6214264c req-140ac023-5bbb-47ce-8319-8eba1211f0b1 tempest-VolumesSnapshotsTestJSON-1498968317 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-623aa1e4-ee55-4434-a4c6-5c86ad2e6a1a.f2ab1511-e013-420a-8d03-eb145cb470de {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:50:15 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-4ef9a12c-d91e-481d-a334-742ba5ca24f8 tempest-VolumesTransfersV355Test-968934166 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (80ba0054-830d-4a7d-a27a-67f1449f637b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T10:50:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1834475435',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d1957e94-891e-4998-b9b0-620914c5758f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3f81734f15c14e3799d81763ef601483',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T10:50:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T10:50:16Z,use_quota=True,user_id='04fcd6b764b54081810992be9f35d1fa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(34d3b144-d9b7-480a-a2e3-01e45f3d54c1),volume_type_id=34d3b144-d9b7-480a-a2e3-01e45f3d54c1)' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:50:15 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-4ef9a12c-d91e-481d-a334-742ba5ca24f8 tempest-VolumesTransfersV355Test-968934166 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5f496ce9-317b-46e5-ac1b-2679eb24636c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:50:15 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-4ef9a12c-d91e-481d-a334-742ba5ca24f8 tempest-VolumesTransfersV355Test-968934166 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5f496ce9-317b-46e5-ac1b-2679eb24636c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:50:15 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-4ef9a12c-d91e-481d-a334-742ba5ca24f8 tempest-VolumesTransfersV355Test-968934166 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (db2dd4ae-40d7-4e31-88e4-25ae37cdebcb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:50:15 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-4ef9a12c-d91e-481d-a334-742ba5ca24f8 tempest-VolumesTransfersV355Test-968934166 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (db2dd4ae-40d7-4e31-88e4-25ae37cdebcb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd1957e94-891e-4998-b9b0-620914c5758f', 'volume_name': 'volume-d1957e94-891e-4998-b9b0-620914c5758f', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:50:15 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-4ef9a12c-d91e-481d-a334-742ba5ca24f8 tempest-VolumesTransfersV355Test-968934166 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (740890a6-db68-4456-9e48-eb1d9e13c67f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:50:15 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-4ef9a12c-d91e-481d-a334-742ba5ca24f8 tempest-VolumesTransfersV355Test-968934166 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (740890a6-db68-4456-9e48-eb1d9e13c67f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:50:15 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-4ef9a12c-d91e-481d-a334-742ba5ca24f8 tempest-VolumesTransfersV355Test-968934166 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4a7566c5-1ccd-40d8-be90-e432cfc0d24d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:50:15 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-4ef9a12c-d91e-481d-a334-742ba5ca24f8 tempest-VolumesTransfersV355Test-968934166 None] Volume d1957e94-891e-4998-b9b0-620914c5758f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d1957e94-891e-4998-b9b0-620914c5758f', 'volume_size': 1} Nov 06 11:50:15 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-4ef9a12c-d91e-481d-a334-742ba5ca24f8 tempest-VolumesTransfersV355Test-968934166 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 11:50:15 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-4ef9a12c-d91e-481d-a334-742ba5ca24f8 tempest-VolumesTransfersV355Test-968934166 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 11:50:15 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-4ef9a12c-d91e-481d-a334-742ba5ca24f8 tempest-VolumesTransfersV355Test-968934166 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T10:50:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1834475435',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d1957e94-891e-4998-b9b0-620914c5758f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3f81734f15c14e3799d81763ef601483',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T10:50:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T10:50:16Z,use_quota=True,user_id='04fcd6b764b54081810992be9f35d1fa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(34d3b144-d9b7-480a-a2e3-01e45f3d54c1),volume_type_id=34d3b144-d9b7-480a-a2e3-01e45f3d54c1)}" {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 11:50:15 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-4ef9a12c-d91e-481d-a334-742ba5ca24f8 tempest-VolumesTransfersV355Test-968934166 None] Creating volume d1957e94-891e-4998-b9b0-620914c5758f {{(pid=87116) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 11:50:15 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-4ef9a12c-d91e-481d-a334-742ba5ca24f8 tempest-VolumesTransfersV355Test-968934166 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 11:50:15 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-4ef9a12c-d91e-481d-a334-742ba5ca24f8 tempest-VolumesTransfersV355Test-968934166 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 11:50:15 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-4ef9a12c-d91e-481d-a334-742ba5ca24f8 tempest-VolumesTransfersV355Test-968934166 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 11:50:15 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-4ef9a12c-d91e-481d-a334-742ba5ca24f8 tempest-VolumesTransfersV355Test-968934166 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 11:50:15 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-4ef9a12c-d91e-481d-a334-742ba5ca24f8 tempest-VolumesTransfersV355Test-968934166 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 11:50:15 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-4ef9a12c-d91e-481d-a334-742ba5ca24f8 tempest-VolumesTransfersV355Test-968934166 None] Selected osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f as target Quobyte volume. {{(pid=87116) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 11:50:15 devstack cinder-volume[87116]: INFO cinder.volume.drivers.remotefs [None req-4ef9a12c-d91e-481d-a334-742ba5ca24f8 tempest-VolumesTransfersV355Test-968934166 None] casted to osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f Nov 06 11:50:15 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-4ef9a12c-d91e-481d-a334-742ba5ca24f8 tempest-VolumesTransfersV355Test-968934166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-d1957e94-891e-4998-b9b0-620914c5758f 1073741824 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:50:15 devstack sudo[97059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-d1957e94-891e-4998-b9b0-620914c5758f 1073741824 Nov 06 11:50:15 devstack sudo[97059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:50:15 devstack sudo[97058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-623aa1e4-ee55-4434-a4c6-5c86ad2e6a1a.f2ab1511-e013-420a-8d03-eb145cb470de Nov 06 11:50:15 devstack sudo[97058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:50:16 devstack sudo[97058]: pam_unix(sudo:session): session closed for user root Nov 06 11:50:16 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [req-bf6aa13b-bf7b-48a1-90d1-9c3c6214264c req-140ac023-5bbb-47ce-8319-8eba1211f0b1 tempest-VolumesSnapshotsTestJSON-1498968317 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-623aa1e4-ee55-4434-a4c6-5c86ad2e6a1a.f2ab1511-e013-420a-8d03-eb145cb470de" returned: 0 in 0.453s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:50:16 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [req-bf6aa13b-bf7b-48a1-90d1-9c3c6214264c req-140ac023-5bbb-47ce-8319-8eba1211f0b1 tempest-VolumesSnapshotsTestJSON-1498968317 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-623aa1e4-ee55-4434-a4c6-5c86ad2e6a1a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87116) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 11:50:16 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7abba96-5e36-4ab9-8f01-3c67a07570d0]: (4, 'qcow2') {{(pid=88420) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 11:50:16 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [req-bf6aa13b-bf7b-48a1-90d1-9c3c6214264c req-140ac023-5bbb-47ce-8319-8eba1211f0b1 tempest-VolumesSnapshotsTestJSON-1498968317 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-623aa1e4-ee55-4434-a4c6-5c86ad2e6a1a {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:50:16 devstack sudo[97069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-623aa1e4-ee55-4434-a4c6-5c86ad2e6a1a Nov 06 11:50:16 devstack sudo[97069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:50:16 devstack sudo[97059]: pam_unix(sudo:session): session closed for user root Nov 06 11:50:16 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-4ef9a12c-d91e-481d-a334-742ba5ca24f8 tempest-VolumesTransfersV355Test-968934166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-d1957e94-891e-4998-b9b0-620914c5758f 1073741824" returned: 0 in 0.558s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:50:16 devstack cinder-volume[87116]: DEBUG dbcounter [-] [87116] Writing DB stats cinder:DELETE=11,cinder:SELECT=135,cinder:INSERT=44,cinder:UPDATE=157 {{(pid=87116) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 11:50:16 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-4ef9a12c-d91e-481d-a334-742ba5ca24f8 tempest-VolumesTransfersV355Test-968934166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-d1957e94-891e-4998-b9b0-620914c5758f {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:50:16 devstack sudo[97071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-d1957e94-891e-4998-b9b0-620914c5758f Nov 06 11:50:16 devstack sudo[97071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:50:16 devstack sudo[97069]: pam_unix(sudo:session): session closed for user root Nov 06 11:50:16 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [req-bf6aa13b-bf7b-48a1-90d1-9c3c6214264c req-140ac023-5bbb-47ce-8319-8eba1211f0b1 tempest-VolumesSnapshotsTestJSON-1498968317 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-623aa1e4-ee55-4434-a4c6-5c86ad2e6a1a" returned: 0 in 0.486s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:50:16 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [req-bf6aa13b-bf7b-48a1-90d1-9c3c6214264c req-140ac023-5bbb-47ce-8319-8eba1211f0b1 tempest-VolumesSnapshotsTestJSON-1498968317 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-623aa1e4-ee55-4434-a4c6-5c86ad2e6a1a.f2ab1511-e013-420a-8d03-eb145cb470de {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:50:16 devstack sudo[97077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-623aa1e4-ee55-4434-a4c6-5c86ad2e6a1a.f2ab1511-e013-420a-8d03-eb145cb470de Nov 06 11:50:16 devstack sudo[97077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:50:16 devstack sudo[97071]: pam_unix(sudo:session): session closed for user root Nov 06 11:50:16 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-4ef9a12c-d91e-481d-a334-742ba5ca24f8 tempest-VolumesTransfersV355Test-968934166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-d1957e94-891e-4998-b9b0-620914c5758f" returned: 0 in 0.365s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:50:16 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-4ef9a12c-d91e-481d-a334-742ba5ca24f8 tempest-VolumesTransfersV355Test-968934166 None] <== create_volume: return (987ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f'} {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 11:50:16 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-4ef9a12c-d91e-481d-a334-742ba5ca24f8 tempest-VolumesTransfersV355Test-968934166 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.991s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 11:50:16 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-4ef9a12c-d91e-481d-a334-742ba5ca24f8 tempest-VolumesTransfersV355Test-968934166 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4a7566c5-1ccd-40d8-be90-e432cfc0d24d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d1957e94-891e-4998-b9b0-620914c5758f', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:50:16 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-4ef9a12c-d91e-481d-a334-742ba5ca24f8 tempest-VolumesTransfersV355Test-968934166 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f85da53f-fb05-46c9-8839-592e5626132a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:50:16 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-4ef9a12c-d91e-481d-a334-742ba5ca24f8 tempest-VolumesTransfersV355Test-968934166 None] Volume volume-d1957e94-891e-4998-b9b0-620914c5758f (d1957e94-891e-4998-b9b0-620914c5758f): created successfully Nov 06 11:50:16 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-4ef9a12c-d91e-481d-a334-742ba5ca24f8 tempest-VolumesTransfersV355Test-968934166 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f85da53f-fb05-46c9-8839-592e5626132a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:50:16 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-4ef9a12c-d91e-481d-a334-742ba5ca24f8 tempest-VolumesTransfersV355Test-968934166 None] Flow 'volume_create_manager' (a77e48f5-2fa1-452d-9cbc-e68314ee696f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 11:50:16 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-4ef9a12c-d91e-481d-a334-742ba5ca24f8 tempest-VolumesTransfersV355Test-968934166 None] Created volume successfully. Nov 06 11:50:17 devstack sudo[97077]: pam_unix(sudo:session): session closed for user root Nov 06 11:50:17 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [req-bf6aa13b-bf7b-48a1-90d1-9c3c6214264c req-140ac023-5bbb-47ce-8319-8eba1211f0b1 tempest-VolumesSnapshotsTestJSON-1498968317 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-623aa1e4-ee55-4434-a4c6-5c86ad2e6a1a.f2ab1511-e013-420a-8d03-eb145cb470de" returned: 0 in 0.391s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:50:17 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [req-bf6aa13b-bf7b-48a1-90d1-9c3c6214264c req-140ac023-5bbb-47ce-8319-8eba1211f0b1 tempest-VolumesSnapshotsTestJSON-1498968317 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-623aa1e4-ee55-4434-a4c6-5c86ad2e6a1a.f2ab1511-e013-420a-8d03-eb145cb470de {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:50:17 devstack sudo[97082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-623aa1e4-ee55-4434-a4c6-5c86ad2e6a1a.f2ab1511-e013-420a-8d03-eb145cb470de Nov 06 11:50:17 devstack sudo[97082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:50:17 devstack sudo[97082]: pam_unix(sudo:session): session closed for user root Nov 06 11:50:17 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [req-bf6aa13b-bf7b-48a1-90d1-9c3c6214264c req-140ac023-5bbb-47ce-8319-8eba1211f0b1 tempest-VolumesSnapshotsTestJSON-1498968317 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-623aa1e4-ee55-4434-a4c6-5c86ad2e6a1a.f2ab1511-e013-420a-8d03-eb145cb470de" returned: 0 in 0.292s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:50:17 devstack cinder-volume[87116]: DEBUG cinder.coordination [req-bf6aa13b-bf7b-48a1-90d1-9c3c6214264c req-140ac023-5bbb-47ce-8319-8eba1211f0b1 tempest-VolumesSnapshotsTestJSON-1498968317 None] Lock "cinder-quobyte-f2ab1511-e013-420a-8d03-eb145cb470de" released by "_delete_snapshot" :: held 1.794s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 11:50:17 devstack cinder-volume[87116]: DEBUG cinder.coordination [req-bf6aa13b-bf7b-48a1-90d1-9c3c6214264c req-140ac023-5bbb-47ce-8319-8eba1211f0b1 tempest-VolumesSnapshotsTestJSON-1498968317 None] Lock "cinder-quobyte-623aa1e4-ee55-4434-a4c6-5c86ad2e6a1a" released by "delete_snapshot" :: held 1.852s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 11:50:17 devstack cinder-volume[87116]: DEBUG cinder.quota [req-bf6aa13b-bf7b-48a1-90d1-9c3c6214264c req-140ac023-5bbb-47ce-8319-8eba1211f0b1 tempest-VolumesSnapshotsTestJSON-1498968317 None] Created reservations ['cdda587a-ab7b-40ff-8cce-c421c5c56d8a', '9b98247f-683b-444e-af6f-f0408892f04d', '88d928dd-03d8-44b8-889e-70d26c4b280c', 'c2957656-6722-4caa-b212-1b938c9ee6f1'] {{(pid=87116) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 11:50:17 devstack cinder-volume[87116]: INFO cinder.volume.manager [req-bf6aa13b-bf7b-48a1-90d1-9c3c6214264c req-140ac023-5bbb-47ce-8319-8eba1211f0b1 tempest-VolumesSnapshotsTestJSON-1498968317 None] Delete snapshot completed successfully. Nov 06 11:50:17 devstack cinder-volume[87116]: DEBUG cinder.coordination [req-bf6aa13b-bf7b-48a1-90d1-9c3c6214264c req-140ac023-5bbb-47ce-8319-8eba1211f0b1 tempest-VolumesSnapshotsTestJSON-1498968317 None] Lock "cinder-f2ab1511-e013-420a-8d03-eb145cb470de-delete_snapshot" released by "delete_snapshot" :: held 2.040s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 11:50:17 devstack cinder-volume[87116]: DEBUG cinder.coordination [req-c2eae90a-3348-4fc2-8a02-2e3624d3adb0 req-cd051f8a-2570-4f66-824c-1b9ef469f346 tempest-VolumesSnapshotsTestJSON-1498968317 None] Acquiring lock "cinder-623aa1e4-ee55-4434-a4c6-5c86ad2e6a1a-delete_volume" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 11:50:17 devstack cinder-volume[87116]: DEBUG cinder.coordination [req-c2eae90a-3348-4fc2-8a02-2e3624d3adb0 req-cd051f8a-2570-4f66-824c-1b9ef469f346 tempest-VolumesSnapshotsTestJSON-1498968317 None] Lock "cinder-623aa1e4-ee55-4434-a4c6-5c86ad2e6a1a-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 11:50:18 devstack cinder-volume[87116]: DEBUG cinder.coordination [req-c2eae90a-3348-4fc2-8a02-2e3624d3adb0 req-cd051f8a-2570-4f66-824c-1b9ef469f346 tempest-VolumesSnapshotsTestJSON-1498968317 None] Acquiring lock "cinder-quobyte-623aa1e4-ee55-4434-a4c6-5c86ad2e6a1a" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 11:50:18 devstack cinder-volume[87116]: DEBUG cinder.coordination [req-c2eae90a-3348-4fc2-8a02-2e3624d3adb0 req-cd051f8a-2570-4f66-824c-1b9ef469f346 tempest-VolumesSnapshotsTestJSON-1498968317 None] Lock "cinder-quobyte-623aa1e4-ee55-4434-a4c6-5c86ad2e6a1a" acquired by "delete_volume" :: waited 0.019s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 11:50:18 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ef7b53c-593f-4c61-bfcd-2e91c2026a64]: (4, 'qcow2') {{(pid=88420) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 11:50:18 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [req-c2eae90a-3348-4fc2-8a02-2e3624d3adb0 req-cd051f8a-2570-4f66-824c-1b9ef469f346 tempest-VolumesSnapshotsTestJSON-1498968317 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-623aa1e4-ee55-4434-a4c6-5c86ad2e6a1a {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:50:18 devstack sudo[97085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-623aa1e4-ee55-4434-a4c6-5c86ad2e6a1a Nov 06 11:50:18 devstack sudo[97085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:50:18 devstack sudo[97085]: pam_unix(sudo:session): session closed for user root Nov 06 11:50:18 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [req-c2eae90a-3348-4fc2-8a02-2e3624d3adb0 req-cd051f8a-2570-4f66-824c-1b9ef469f346 tempest-VolumesSnapshotsTestJSON-1498968317 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-623aa1e4-ee55-4434-a4c6-5c86ad2e6a1a" returned: 0 in 0.438s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:50:18 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [req-c2eae90a-3348-4fc2-8a02-2e3624d3adb0 req-cd051f8a-2570-4f66-824c-1b9ef469f346 tempest-VolumesSnapshotsTestJSON-1498968317 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-623aa1e4-ee55-4434-a4c6-5c86ad2e6a1a {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:50:18 devstack sudo[97090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-623aa1e4-ee55-4434-a4c6-5c86ad2e6a1a Nov 06 11:50:18 devstack sudo[97090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:50:18 devstack sudo[97090]: pam_unix(sudo:session): session closed for user root Nov 06 11:50:18 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [req-c2eae90a-3348-4fc2-8a02-2e3624d3adb0 req-cd051f8a-2570-4f66-824c-1b9ef469f346 tempest-VolumesSnapshotsTestJSON-1498968317 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-623aa1e4-ee55-4434-a4c6-5c86ad2e6a1a" returned: 0 in 0.307s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:50:18 devstack cinder-volume[87116]: DEBUG cinder.coordination [req-c2eae90a-3348-4fc2-8a02-2e3624d3adb0 req-cd051f8a-2570-4f66-824c-1b9ef469f346 tempest-VolumesSnapshotsTestJSON-1498968317 None] Lock "cinder-quobyte-623aa1e4-ee55-4434-a4c6-5c86ad2e6a1a" released by "delete_volume" :: held 0.895s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 11:50:18 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-e0be24fb-b63e-4b32-8cc2-dc6ac55bc99d tempest-VolumesTransfersV355Test-7706693 None] Transfer volume completed successfully. Nov 06 11:50:19 devstack cinder-volume[87116]: DEBUG cinder.quota [req-c2eae90a-3348-4fc2-8a02-2e3624d3adb0 req-cd051f8a-2570-4f66-824c-1b9ef469f346 tempest-VolumesSnapshotsTestJSON-1498968317 None] Created reservations ['e13decb3-e657-4c51-96fa-5854991452b4', 'bd7e918c-90ad-40bf-bad6-1296a9d9fb7a', 'f7951b69-b007-4c59-8cfd-907825a6f2e1', '1248f372-a957-425f-8a02-928ad3bb90e7'] {{(pid=87116) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 11:50:19 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [req-c2eae90a-3348-4fc2-8a02-2e3624d3adb0 req-cd051f8a-2570-4f66-824c-1b9ef469f346 tempest-VolumesSnapshotsTestJSON-1498968317 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 11:50:19 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [req-c2eae90a-3348-4fc2-8a02-2e3624d3adb0 req-cd051f8a-2570-4f66-824c-1b9ef469f346 tempest-VolumesSnapshotsTestJSON-1498968317 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 11:50:19 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [req-c2eae90a-3348-4fc2-8a02-2e3624d3adb0 req-cd051f8a-2570-4f66-824c-1b9ef469f346 tempest-VolumesSnapshotsTestJSON-1498968317 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 11:50:19 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [req-c2eae90a-3348-4fc2-8a02-2e3624d3adb0 req-cd051f8a-2570-4f66-824c-1b9ef469f346 tempest-VolumesSnapshotsTestJSON-1498968317 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 11:50:19 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [req-c2eae90a-3348-4fc2-8a02-2e3624d3adb0 req-cd051f8a-2570-4f66-824c-1b9ef469f346 tempest-VolumesSnapshotsTestJSON-1498968317 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 11:50:19 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [req-c2eae90a-3348-4fc2-8a02-2e3624d3adb0 req-cd051f8a-2570-4f66-824c-1b9ef469f346 tempest-VolumesSnapshotsTestJSON-1498968317 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:50:19 devstack sudo[97094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756 Nov 06 11:50:19 devstack sudo[97094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:50:19 devstack sudo[97094]: pam_unix(sudo:session): session closed for user root Nov 06 11:50:19 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [req-c2eae90a-3348-4fc2-8a02-2e3624d3adb0 req-cd051f8a-2570-4f66-824c-1b9ef469f346 tempest-VolumesSnapshotsTestJSON-1498968317 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756" returned: 0 in 0.296s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:50:19 devstack cinder-volume[87116]: DEBUG cinder.manager [req-c2eae90a-3348-4fc2-8a02-2e3624d3adb0 req-cd051f8a-2570-4f66-824c-1b9ef469f346 tempest-VolumesSnapshotsTestJSON-1498968317 None] Notifying Schedulers of capabilities ... {{(pid=87116) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 11:50:19 devstack cinder-volume[87116]: INFO cinder.volume.manager [req-c2eae90a-3348-4fc2-8a02-2e3624d3adb0 req-cd051f8a-2570-4f66-824c-1b9ef469f346 tempest-VolumesSnapshotsTestJSON-1498968317 None] Deleted volume successfully. Nov 06 11:50:19 devstack cinder-volume[87116]: DEBUG cinder.coordination [req-c2eae90a-3348-4fc2-8a02-2e3624d3adb0 req-cd051f8a-2570-4f66-824c-1b9ef469f346 tempest-VolumesSnapshotsTestJSON-1498968317 None] Lock "cinder-623aa1e4-ee55-4434-a4c6-5c86ad2e6a1a-delete_volume" released by "delete_volume" :: held 1.498s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 11:50:19 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-6b18f7f7-60e1-4883-9b15-481d1edcd8e2 tempest-VolumesTransfersV355Test-1850344214 None] Acquiring lock "cinder-d1957e94-891e-4998-b9b0-620914c5758f-delete_volume" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 11:50:19 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-6b18f7f7-60e1-4883-9b15-481d1edcd8e2 tempest-VolumesTransfersV355Test-1850344214 None] Lock "cinder-d1957e94-891e-4998-b9b0-620914c5758f-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 11:50:19 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-6b18f7f7-60e1-4883-9b15-481d1edcd8e2 tempest-VolumesTransfersV355Test-1850344214 None] Acquiring lock "cinder-quobyte-d1957e94-891e-4998-b9b0-620914c5758f" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 11:50:19 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-6b18f7f7-60e1-4883-9b15-481d1edcd8e2 tempest-VolumesTransfersV355Test-1850344214 None] Lock "cinder-quobyte-d1957e94-891e-4998-b9b0-620914c5758f" acquired by "delete_volume" :: waited 0.022s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 11:50:19 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[52a3f342-1ebe-4c36-afae-aee21e412bed]: (4, 'qcow2') {{(pid=88420) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 11:50:19 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-6b18f7f7-60e1-4883-9b15-481d1edcd8e2 tempest-VolumesTransfersV355Test-1850344214 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-d1957e94-891e-4998-b9b0-620914c5758f {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:50:20 devstack sudo[97097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-d1957e94-891e-4998-b9b0-620914c5758f Nov 06 11:50:20 devstack sudo[97097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:50:20 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-a4a61d91-ad5d-402d-845f-ffdbecb96b4f tempest-VolumesNegativeTest-910129170 None] Acquiring lock "cinder-6bd5c6ca-0e56-4011-9598-e3aae15373a3-delete_volume" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 11:50:20 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-a4a61d91-ad5d-402d-845f-ffdbecb96b4f tempest-VolumesNegativeTest-910129170 None] Lock "cinder-6bd5c6ca-0e56-4011-9598-e3aae15373a3-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 11:50:20 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-a4a61d91-ad5d-402d-845f-ffdbecb96b4f tempest-VolumesNegativeTest-910129170 None] Acquiring lock "cinder-quobyte-6bd5c6ca-0e56-4011-9598-e3aae15373a3" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 11:50:20 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-a4a61d91-ad5d-402d-845f-ffdbecb96b4f tempest-VolumesNegativeTest-910129170 None] Lock "cinder-quobyte-6bd5c6ca-0e56-4011-9598-e3aae15373a3" acquired by "delete_volume" :: waited 0.019s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 11:50:20 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4d76742-0949-48a0-ac64-27ef202052ed]: (4, 'qcow2') {{(pid=88420) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 11:50:20 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-a4a61d91-ad5d-402d-845f-ffdbecb96b4f tempest-VolumesNegativeTest-910129170 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-6bd5c6ca-0e56-4011-9598-e3aae15373a3 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:50:20 devstack sudo[97099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-6bd5c6ca-0e56-4011-9598-e3aae15373a3 Nov 06 11:50:20 devstack sudo[97099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:50:20 devstack sudo[97097]: pam_unix(sudo:session): session closed for user root Nov 06 11:50:20 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-6b18f7f7-60e1-4883-9b15-481d1edcd8e2 tempest-VolumesTransfersV355Test-1850344214 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-d1957e94-891e-4998-b9b0-620914c5758f" returned: 0 in 0.693s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:50:20 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-6b18f7f7-60e1-4883-9b15-481d1edcd8e2 tempest-VolumesTransfersV355Test-1850344214 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-d1957e94-891e-4998-b9b0-620914c5758f {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:50:20 devstack sudo[97104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-d1957e94-891e-4998-b9b0-620914c5758f Nov 06 11:50:20 devstack sudo[97104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:50:20 devstack sudo[97099]: pam_unix(sudo:session): session closed for user root Nov 06 11:50:20 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-a4a61d91-ad5d-402d-845f-ffdbecb96b4f tempest-VolumesNegativeTest-910129170 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-6bd5c6ca-0e56-4011-9598-e3aae15373a3" returned: 0 in 0.502s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:50:20 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-a4a61d91-ad5d-402d-845f-ffdbecb96b4f tempest-VolumesNegativeTest-910129170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-6bd5c6ca-0e56-4011-9598-e3aae15373a3 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:50:20 devstack sudo[97109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-6bd5c6ca-0e56-4011-9598-e3aae15373a3 Nov 06 11:50:20 devstack sudo[97109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:50:20 devstack sudo[97104]: pam_unix(sudo:session): session closed for user root Nov 06 11:50:20 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-6b18f7f7-60e1-4883-9b15-481d1edcd8e2 tempest-VolumesTransfersV355Test-1850344214 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-d1957e94-891e-4998-b9b0-620914c5758f" returned: 0 in 0.379s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:50:20 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-6b18f7f7-60e1-4883-9b15-481d1edcd8e2 tempest-VolumesTransfersV355Test-1850344214 None] Lock "cinder-quobyte-d1957e94-891e-4998-b9b0-620914c5758f" released by "delete_volume" :: held 1.131s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 11:50:21 devstack cinder-volume[87116]: DEBUG cinder.quota [None req-6b18f7f7-60e1-4883-9b15-481d1edcd8e2 tempest-VolumesTransfersV355Test-1850344214 None] Created reservations ['376d53eb-2b40-4b67-9c3c-1c0ac9d4b9e1', 'efda9634-6d8e-41dd-9c89-960f6ea1d08a', '07e1ba94-e024-49ef-9d28-ec001aebd635', 'fd516ae8-13d5-40f2-a66a-27fb73f55866'] {{(pid=87116) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 11:50:21 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-6b18f7f7-60e1-4883-9b15-481d1edcd8e2 tempest-VolumesTransfersV355Test-1850344214 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 11:50:21 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-6b18f7f7-60e1-4883-9b15-481d1edcd8e2 tempest-VolumesTransfersV355Test-1850344214 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 11:50:21 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-6b18f7f7-60e1-4883-9b15-481d1edcd8e2 tempest-VolumesTransfersV355Test-1850344214 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 11:50:21 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-6b18f7f7-60e1-4883-9b15-481d1edcd8e2 tempest-VolumesTransfersV355Test-1850344214 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 11:50:21 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-6b18f7f7-60e1-4883-9b15-481d1edcd8e2 tempest-VolumesTransfersV355Test-1850344214 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 11:50:21 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-6b18f7f7-60e1-4883-9b15-481d1edcd8e2 tempest-VolumesTransfersV355Test-1850344214 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:50:21 devstack sudo[97113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756 Nov 06 11:50:21 devstack sudo[97109]: pam_unix(sudo:session): session closed for user root Nov 06 11:50:21 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-a4a61d91-ad5d-402d-845f-ffdbecb96b4f tempest-VolumesNegativeTest-910129170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-6bd5c6ca-0e56-4011-9598-e3aae15373a3" returned: 0 in 0.354s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:50:21 devstack sudo[97113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:50:21 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-a4a61d91-ad5d-402d-845f-ffdbecb96b4f tempest-VolumesNegativeTest-910129170 None] Lock "cinder-quobyte-6bd5c6ca-0e56-4011-9598-e3aae15373a3" released by "delete_volume" :: held 0.928s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 11:50:21 devstack cinder-volume[87116]: DEBUG cinder.quota [None req-a4a61d91-ad5d-402d-845f-ffdbecb96b4f tempest-VolumesNegativeTest-910129170 None] Created reservations ['bcd151e1-de53-4387-8df7-2588dd8b8b16', 'cea40e2f-a5c3-47e8-b662-8f1c09609350', '00134bbe-8371-47af-be6c-5255b835f9ab', '13e5775b-9d0e-4b49-977b-8a14281f555b'] {{(pid=87116) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 11:50:21 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-a4a61d91-ad5d-402d-845f-ffdbecb96b4f tempest-VolumesNegativeTest-910129170 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 11:50:21 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-a4a61d91-ad5d-402d-845f-ffdbecb96b4f tempest-VolumesNegativeTest-910129170 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 11:50:21 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-a4a61d91-ad5d-402d-845f-ffdbecb96b4f tempest-VolumesNegativeTest-910129170 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 11:50:21 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-a4a61d91-ad5d-402d-845f-ffdbecb96b4f tempest-VolumesNegativeTest-910129170 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 11:50:21 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-a4a61d91-ad5d-402d-845f-ffdbecb96b4f tempest-VolumesNegativeTest-910129170 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 11:50:21 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-a4a61d91-ad5d-402d-845f-ffdbecb96b4f tempest-VolumesNegativeTest-910129170 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:50:21 devstack sudo[97115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756 Nov 06 11:50:21 devstack sudo[97115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:50:21 devstack sudo[97113]: pam_unix(sudo:session): session closed for user root Nov 06 11:50:21 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-6b18f7f7-60e1-4883-9b15-481d1edcd8e2 tempest-VolumesTransfersV355Test-1850344214 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756" returned: 0 in 0.304s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:50:21 devstack cinder-volume[87116]: DEBUG cinder.manager [None req-6b18f7f7-60e1-4883-9b15-481d1edcd8e2 tempest-VolumesTransfersV355Test-1850344214 None] Notifying Schedulers of capabilities ... {{(pid=87116) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 11:50:21 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-6b18f7f7-60e1-4883-9b15-481d1edcd8e2 tempest-VolumesTransfersV355Test-1850344214 None] Deleted volume successfully. Nov 06 11:50:21 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-6b18f7f7-60e1-4883-9b15-481d1edcd8e2 tempest-VolumesTransfersV355Test-1850344214 None] Lock "cinder-d1957e94-891e-4998-b9b0-620914c5758f-delete_volume" released by "delete_volume" :: held 1.735s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 11:50:21 devstack sudo[97115]: pam_unix(sudo:session): session closed for user root Nov 06 11:50:21 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-a4a61d91-ad5d-402d-845f-ffdbecb96b4f tempest-VolumesNegativeTest-910129170 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756" returned: 0 in 0.358s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:50:21 devstack cinder-volume[87116]: DEBUG cinder.manager [None req-a4a61d91-ad5d-402d-845f-ffdbecb96b4f tempest-VolumesNegativeTest-910129170 None] Notifying Schedulers of capabilities ... {{(pid=87116) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 11:50:21 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-a4a61d91-ad5d-402d-845f-ffdbecb96b4f tempest-VolumesNegativeTest-910129170 None] Deleted volume successfully. Nov 06 11:50:21 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-a4a61d91-ad5d-402d-845f-ffdbecb96b4f tempest-VolumesNegativeTest-910129170 None] Lock "cinder-6bd5c6ca-0e56-4011-9598-e3aae15373a3-delete_volume" released by "delete_volume" :: held 1.554s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 11:50:22 devstack cinder-volume[87116]: DEBUG cinder.volume.flows.manager.create_volume [None req-bed659fc-fa14-4a7f-8c8c-53eb13e308c0 tempest-VolumesTransfersV355Test-968934166 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87116) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 11:50:22 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-bed659fc-fa14-4a7f-8c8c-53eb13e308c0 tempest-VolumesTransfersV355Test-968934166 None] Flow 'volume_create_manager' (75623b36-1eed-4a7c-9264-1f60b453797b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 11:50:22 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-bed659fc-fa14-4a7f-8c8c-53eb13e308c0 tempest-VolumesTransfersV355Test-968934166 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eed2bc71-0ceb-40d8-bd8b-b66bcafda532) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:50:22 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-bed659fc-fa14-4a7f-8c8c-53eb13e308c0 tempest-VolumesTransfersV355Test-968934166 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eed2bc71-0ceb-40d8-bd8b-b66bcafda532) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T10:50:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1471868740',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a9aa44d7-addd-4836-8713-ff45c93bc959,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3f81734f15c14e3799d81763ef601483',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T10:50:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T10:50:23Z,use_quota=True,user_id='04fcd6b764b54081810992be9f35d1fa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(34d3b144-d9b7-480a-a2e3-01e45f3d54c1),volume_type_id=34d3b144-d9b7-480a-a2e3-01e45f3d54c1)' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:50:22 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-bed659fc-fa14-4a7f-8c8c-53eb13e308c0 tempest-VolumesTransfersV355Test-968934166 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (31d2b6a4-c295-4205-b454-8a026e03f072) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:50:22 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-bed659fc-fa14-4a7f-8c8c-53eb13e308c0 tempest-VolumesTransfersV355Test-968934166 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (31d2b6a4-c295-4205-b454-8a026e03f072) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:50:22 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-bed659fc-fa14-4a7f-8c8c-53eb13e308c0 tempest-VolumesTransfersV355Test-968934166 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e09ec7a9-80dc-4807-87dd-3886014b68b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:50:22 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-bed659fc-fa14-4a7f-8c8c-53eb13e308c0 tempest-VolumesTransfersV355Test-968934166 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e09ec7a9-80dc-4807-87dd-3886014b68b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a9aa44d7-addd-4836-8713-ff45c93bc959', 'volume_name': 'volume-a9aa44d7-addd-4836-8713-ff45c93bc959', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:50:22 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-bed659fc-fa14-4a7f-8c8c-53eb13e308c0 tempest-VolumesTransfersV355Test-968934166 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7d2e0800-0679-4d8b-a65e-b5cff259d325) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:50:22 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-bed659fc-fa14-4a7f-8c8c-53eb13e308c0 tempest-VolumesTransfersV355Test-968934166 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7d2e0800-0679-4d8b-a65e-b5cff259d325) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:50:22 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-bed659fc-fa14-4a7f-8c8c-53eb13e308c0 tempest-VolumesTransfersV355Test-968934166 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4dc9c746-3e42-4375-9833-be15946a55e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:50:22 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-bed659fc-fa14-4a7f-8c8c-53eb13e308c0 tempest-VolumesTransfersV355Test-968934166 None] Volume a9aa44d7-addd-4836-8713-ff45c93bc959: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a9aa44d7-addd-4836-8713-ff45c93bc959', 'volume_size': 1} Nov 06 11:50:22 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-bed659fc-fa14-4a7f-8c8c-53eb13e308c0 tempest-VolumesTransfersV355Test-968934166 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 11:50:22 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-bed659fc-fa14-4a7f-8c8c-53eb13e308c0 tempest-VolumesTransfersV355Test-968934166 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 11:50:22 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-bed659fc-fa14-4a7f-8c8c-53eb13e308c0 tempest-VolumesTransfersV355Test-968934166 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T10:50:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1471868740',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a9aa44d7-addd-4836-8713-ff45c93bc959,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3f81734f15c14e3799d81763ef601483',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T10:50:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T10:50:23Z,use_quota=True,user_id='04fcd6b764b54081810992be9f35d1fa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(34d3b144-d9b7-480a-a2e3-01e45f3d54c1),volume_type_id=34d3b144-d9b7-480a-a2e3-01e45f3d54c1)}" {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 11:50:22 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-bed659fc-fa14-4a7f-8c8c-53eb13e308c0 tempest-VolumesTransfersV355Test-968934166 None] Creating volume a9aa44d7-addd-4836-8713-ff45c93bc959 {{(pid=87116) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 11:50:22 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-bed659fc-fa14-4a7f-8c8c-53eb13e308c0 tempest-VolumesTransfersV355Test-968934166 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 11:50:22 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-bed659fc-fa14-4a7f-8c8c-53eb13e308c0 tempest-VolumesTransfersV355Test-968934166 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 11:50:22 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-bed659fc-fa14-4a7f-8c8c-53eb13e308c0 tempest-VolumesTransfersV355Test-968934166 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 11:50:22 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-bed659fc-fa14-4a7f-8c8c-53eb13e308c0 tempest-VolumesTransfersV355Test-968934166 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 11:50:22 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-bed659fc-fa14-4a7f-8c8c-53eb13e308c0 tempest-VolumesTransfersV355Test-968934166 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 11:50:22 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-bed659fc-fa14-4a7f-8c8c-53eb13e308c0 tempest-VolumesTransfersV355Test-968934166 None] Selected osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f as target Quobyte volume. {{(pid=87116) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 11:50:22 devstack cinder-volume[87116]: INFO cinder.volume.drivers.remotefs [None req-bed659fc-fa14-4a7f-8c8c-53eb13e308c0 tempest-VolumesTransfersV355Test-968934166 None] casted to osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f Nov 06 11:50:22 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-bed659fc-fa14-4a7f-8c8c-53eb13e308c0 tempest-VolumesTransfersV355Test-968934166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-a9aa44d7-addd-4836-8713-ff45c93bc959 1073741824 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:50:22 devstack sudo[97123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-a9aa44d7-addd-4836-8713-ff45c93bc959 1073741824 Nov 06 11:50:22 devstack sudo[97123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:50:23 devstack sudo[97123]: pam_unix(sudo:session): session closed for user root Nov 06 11:50:23 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-bed659fc-fa14-4a7f-8c8c-53eb13e308c0 tempest-VolumesTransfersV355Test-968934166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-a9aa44d7-addd-4836-8713-ff45c93bc959 1073741824" returned: 0 in 0.668s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:50:23 devstack cinder-volume[87116]: DEBUG dbcounter [-] [87116] Writing DB stats cinder:SELECT=163,cinder:INSERT=47,cinder:UPDATE=171,cinder:DELETE=11 {{(pid=87116) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 11:50:23 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-bed659fc-fa14-4a7f-8c8c-53eb13e308c0 tempest-VolumesTransfersV355Test-968934166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-a9aa44d7-addd-4836-8713-ff45c93bc959 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:50:23 devstack sudo[97129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-a9aa44d7-addd-4836-8713-ff45c93bc959 Nov 06 11:50:23 devstack sudo[97129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:50:23 devstack sudo[97129]: pam_unix(sudo:session): session closed for user root Nov 06 11:50:23 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-bed659fc-fa14-4a7f-8c8c-53eb13e308c0 tempest-VolumesTransfersV355Test-968934166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-a9aa44d7-addd-4836-8713-ff45c93bc959" returned: 0 in 0.283s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:50:23 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-bed659fc-fa14-4a7f-8c8c-53eb13e308c0 tempest-VolumesTransfersV355Test-968934166 None] <== create_volume: return (1048ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f'} {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 11:50:23 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-bed659fc-fa14-4a7f-8c8c-53eb13e308c0 tempest-VolumesTransfersV355Test-968934166 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.051s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 11:50:23 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-bed659fc-fa14-4a7f-8c8c-53eb13e308c0 tempest-VolumesTransfersV355Test-968934166 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4dc9c746-3e42-4375-9833-be15946a55e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a9aa44d7-addd-4836-8713-ff45c93bc959', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:50:23 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-bed659fc-fa14-4a7f-8c8c-53eb13e308c0 tempest-VolumesTransfersV355Test-968934166 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ed22ed47-681e-4abc-95d8-28a7fc4b2fa7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:50:23 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-bed659fc-fa14-4a7f-8c8c-53eb13e308c0 tempest-VolumesTransfersV355Test-968934166 None] Volume volume-a9aa44d7-addd-4836-8713-ff45c93bc959 (a9aa44d7-addd-4836-8713-ff45c93bc959): created successfully Nov 06 11:50:23 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-bed659fc-fa14-4a7f-8c8c-53eb13e308c0 tempest-VolumesTransfersV355Test-968934166 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ed22ed47-681e-4abc-95d8-28a7fc4b2fa7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:50:23 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-bed659fc-fa14-4a7f-8c8c-53eb13e308c0 tempest-VolumesTransfersV355Test-968934166 None] Flow 'volume_create_manager' (75623b36-1eed-4a7c-9264-1f60b453797b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 11:50:23 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-bed659fc-fa14-4a7f-8c8c-53eb13e308c0 tempest-VolumesTransfersV355Test-968934166 None] Created volume successfully. Nov 06 11:50:25 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-bb04458b-5f5c-4a35-8947-79a91354b572 tempest-VolumesTransfersV355Test-1850344214 None] Acquiring lock "cinder-a9aa44d7-addd-4836-8713-ff45c93bc959-delete_volume" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 11:50:25 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-bb04458b-5f5c-4a35-8947-79a91354b572 tempest-VolumesTransfersV355Test-1850344214 None] Lock "cinder-a9aa44d7-addd-4836-8713-ff45c93bc959-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 11:50:25 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-bb04458b-5f5c-4a35-8947-79a91354b572 tempest-VolumesTransfersV355Test-1850344214 None] Acquiring lock "cinder-quobyte-a9aa44d7-addd-4836-8713-ff45c93bc959" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 11:50:25 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-bb04458b-5f5c-4a35-8947-79a91354b572 tempest-VolumesTransfersV355Test-1850344214 None] Lock "cinder-quobyte-a9aa44d7-addd-4836-8713-ff45c93bc959" acquired by "delete_volume" :: waited 0.040s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 11:50:25 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[abc8c557-d91f-4bbf-8b03-3f558cc4b491]: (4, 'qcow2') {{(pid=88420) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 11:50:25 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-bb04458b-5f5c-4a35-8947-79a91354b572 tempest-VolumesTransfersV355Test-1850344214 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-a9aa44d7-addd-4836-8713-ff45c93bc959 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:50:25 devstack sudo[97134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-a9aa44d7-addd-4836-8713-ff45c93bc959 Nov 06 11:50:25 devstack sudo[97134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:50:25 devstack sudo[97134]: pam_unix(sudo:session): session closed for user root Nov 06 11:50:25 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-bb04458b-5f5c-4a35-8947-79a91354b572 tempest-VolumesTransfersV355Test-1850344214 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-a9aa44d7-addd-4836-8713-ff45c93bc959" returned: 0 in 0.511s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:50:25 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-bb04458b-5f5c-4a35-8947-79a91354b572 tempest-VolumesTransfersV355Test-1850344214 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-a9aa44d7-addd-4836-8713-ff45c93bc959 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:50:25 devstack sudo[97140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-a9aa44d7-addd-4836-8713-ff45c93bc959 Nov 06 11:50:26 devstack sudo[97140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:50:26 devstack sudo[97140]: pam_unix(sudo:session): session closed for user root Nov 06 11:50:26 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-bb04458b-5f5c-4a35-8947-79a91354b572 tempest-VolumesTransfersV355Test-1850344214 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-a9aa44d7-addd-4836-8713-ff45c93bc959" returned: 0 in 0.334s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:50:26 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-bb04458b-5f5c-4a35-8947-79a91354b572 tempest-VolumesTransfersV355Test-1850344214 None] Lock "cinder-quobyte-a9aa44d7-addd-4836-8713-ff45c93bc959" released by "delete_volume" :: held 0.933s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 11:50:26 devstack cinder-volume[87116]: DEBUG cinder.quota [None req-bb04458b-5f5c-4a35-8947-79a91354b572 tempest-VolumesTransfersV355Test-1850344214 None] Created reservations ['2dbd2258-d07b-4b18-ba6f-bdb6da7639be', '9fafd3db-f542-4608-a469-fc4d2bdb3930', '57130189-e3c4-4bd6-bd95-864f0770e5aa', 'a3eb0b6f-4783-4aac-8f9e-231e7816b5f2'] {{(pid=87116) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 11:50:26 devstack cinder-volume[87116]: DEBUG cinder.volume.flows.manager.create_volume [None req-510d2dd7-bace-462b-af95-77b33be7b60b tempest-VolumesSnapshotListTestJSON-1428144267 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87116) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 11:50:26 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-510d2dd7-bace-462b-af95-77b33be7b60b tempest-VolumesSnapshotListTestJSON-1428144267 None] Flow 'volume_create_manager' (ac743d2e-599e-422c-88db-f9d80ad3d4de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 11:50:26 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-510d2dd7-bace-462b-af95-77b33be7b60b tempest-VolumesSnapshotListTestJSON-1428144267 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6d4541b5-3e35-4399-b9c9-99cfbbce03bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:50:26 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-510d2dd7-bace-462b-af95-77b33be7b60b tempest-VolumesSnapshotListTestJSON-1428144267 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6d4541b5-3e35-4399-b9c9-99cfbbce03bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T10:50:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1776902343',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a8c51aa6-93ea-4856-8dee-93372c01ce9d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af5d864e11cd47199e0c8f65873e792e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T10:50:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T10:50:26Z,use_quota=True,user_id='96591cd64c4b4e20ba0d937d16ef0027',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(34d3b144-d9b7-480a-a2e3-01e45f3d54c1),volume_type_id=34d3b144-d9b7-480a-a2e3-01e45f3d54c1)' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:50:26 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-510d2dd7-bace-462b-af95-77b33be7b60b tempest-VolumesSnapshotListTestJSON-1428144267 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4b5c678d-48cd-4702-94b9-b2a62a3667f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:50:26 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-510d2dd7-bace-462b-af95-77b33be7b60b tempest-VolumesSnapshotListTestJSON-1428144267 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4b5c678d-48cd-4702-94b9-b2a62a3667f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:50:26 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-510d2dd7-bace-462b-af95-77b33be7b60b tempest-VolumesSnapshotListTestJSON-1428144267 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b0f85024-cedc-490e-877e-bf9af08b7041) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:50:26 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-510d2dd7-bace-462b-af95-77b33be7b60b tempest-VolumesSnapshotListTestJSON-1428144267 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b0f85024-cedc-490e-877e-bf9af08b7041) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a8c51aa6-93ea-4856-8dee-93372c01ce9d', 'volume_name': 'volume-a8c51aa6-93ea-4856-8dee-93372c01ce9d', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:50:26 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-510d2dd7-bace-462b-af95-77b33be7b60b tempest-VolumesSnapshotListTestJSON-1428144267 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4bc811d9-5aa8-48fc-b846-98352223ece4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:50:26 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-510d2dd7-bace-462b-af95-77b33be7b60b tempest-VolumesSnapshotListTestJSON-1428144267 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4bc811d9-5aa8-48fc-b846-98352223ece4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:50:26 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-510d2dd7-bace-462b-af95-77b33be7b60b tempest-VolumesSnapshotListTestJSON-1428144267 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3267381f-6466-470e-a17a-5c7d7989c25e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:50:26 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-510d2dd7-bace-462b-af95-77b33be7b60b tempest-VolumesSnapshotListTestJSON-1428144267 None] Volume a8c51aa6-93ea-4856-8dee-93372c01ce9d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a8c51aa6-93ea-4856-8dee-93372c01ce9d', 'volume_size': 1} Nov 06 11:50:26 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-510d2dd7-bace-462b-af95-77b33be7b60b tempest-VolumesSnapshotListTestJSON-1428144267 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 11:50:26 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-510d2dd7-bace-462b-af95-77b33be7b60b tempest-VolumesSnapshotListTestJSON-1428144267 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 11:50:26 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-510d2dd7-bace-462b-af95-77b33be7b60b tempest-VolumesSnapshotListTestJSON-1428144267 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T10:50:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1776902343',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a8c51aa6-93ea-4856-8dee-93372c01ce9d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='af5d864e11cd47199e0c8f65873e792e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T10:50:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T10:50:26Z,use_quota=True,user_id='96591cd64c4b4e20ba0d937d16ef0027',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(34d3b144-d9b7-480a-a2e3-01e45f3d54c1),volume_type_id=34d3b144-d9b7-480a-a2e3-01e45f3d54c1)}" {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 11:50:26 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-510d2dd7-bace-462b-af95-77b33be7b60b tempest-VolumesSnapshotListTestJSON-1428144267 None] Creating volume a8c51aa6-93ea-4856-8dee-93372c01ce9d {{(pid=87116) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 11:50:26 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-510d2dd7-bace-462b-af95-77b33be7b60b tempest-VolumesSnapshotListTestJSON-1428144267 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 11:50:26 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-510d2dd7-bace-462b-af95-77b33be7b60b tempest-VolumesSnapshotListTestJSON-1428144267 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 11:50:26 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-510d2dd7-bace-462b-af95-77b33be7b60b tempest-VolumesSnapshotListTestJSON-1428144267 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 11:50:26 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-510d2dd7-bace-462b-af95-77b33be7b60b tempest-VolumesSnapshotListTestJSON-1428144267 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 11:50:26 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-510d2dd7-bace-462b-af95-77b33be7b60b tempest-VolumesSnapshotListTestJSON-1428144267 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 11:50:26 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-510d2dd7-bace-462b-af95-77b33be7b60b tempest-VolumesSnapshotListTestJSON-1428144267 None] Selected osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f as target Quobyte volume. {{(pid=87116) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 11:50:26 devstack cinder-volume[87116]: INFO cinder.volume.drivers.remotefs [None req-510d2dd7-bace-462b-af95-77b33be7b60b tempest-VolumesSnapshotListTestJSON-1428144267 None] casted to osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f Nov 06 11:50:26 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-510d2dd7-bace-462b-af95-77b33be7b60b tempest-VolumesSnapshotListTestJSON-1428144267 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-a8c51aa6-93ea-4856-8dee-93372c01ce9d 1073741824 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:50:26 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-bb04458b-5f5c-4a35-8947-79a91354b572 tempest-VolumesTransfersV355Test-1850344214 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 11:50:26 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-bb04458b-5f5c-4a35-8947-79a91354b572 tempest-VolumesTransfersV355Test-1850344214 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 11:50:26 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-bb04458b-5f5c-4a35-8947-79a91354b572 tempest-VolumesTransfersV355Test-1850344214 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 11:50:26 devstack sudo[97143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-a8c51aa6-93ea-4856-8dee-93372c01ce9d 1073741824 Nov 06 11:50:26 devstack sudo[97143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:50:26 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-bb04458b-5f5c-4a35-8947-79a91354b572 tempest-VolumesTransfersV355Test-1850344214 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 11:50:26 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-bb04458b-5f5c-4a35-8947-79a91354b572 tempest-VolumesTransfersV355Test-1850344214 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 11:50:26 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-bb04458b-5f5c-4a35-8947-79a91354b572 tempest-VolumesTransfersV355Test-1850344214 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:50:26 devstack sudo[97145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756 Nov 06 11:50:26 devstack sudo[97145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:50:26 devstack sudo[97145]: pam_unix(sudo:session): session closed for user root Nov 06 11:50:26 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-bb04458b-5f5c-4a35-8947-79a91354b572 tempest-VolumesTransfersV355Test-1850344214 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756" returned: 0 in 0.259s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:50:26 devstack cinder-volume[87116]: DEBUG cinder.manager [None req-bb04458b-5f5c-4a35-8947-79a91354b572 tempest-VolumesTransfersV355Test-1850344214 None] Notifying Schedulers of capabilities ... {{(pid=87116) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 11:50:26 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-bb04458b-5f5c-4a35-8947-79a91354b572 tempest-VolumesTransfersV355Test-1850344214 None] Deleted volume successfully. Nov 06 11:50:26 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-bb04458b-5f5c-4a35-8947-79a91354b572 tempest-VolumesTransfersV355Test-1850344214 None] Lock "cinder-a9aa44d7-addd-4836-8713-ff45c93bc959-delete_volume" released by "delete_volume" :: held 1.647s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 11:50:27 devstack sudo[97143]: pam_unix(sudo:session): session closed for user root Nov 06 11:50:27 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-510d2dd7-bace-462b-af95-77b33be7b60b tempest-VolumesSnapshotListTestJSON-1428144267 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-a8c51aa6-93ea-4856-8dee-93372c01ce9d 1073741824" returned: 0 in 0.555s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:50:27 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-510d2dd7-bace-462b-af95-77b33be7b60b tempest-VolumesSnapshotListTestJSON-1428144267 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-a8c51aa6-93ea-4856-8dee-93372c01ce9d {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:50:27 devstack sudo[97152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-a8c51aa6-93ea-4856-8dee-93372c01ce9d Nov 06 11:50:27 devstack sudo[97152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:50:27 devstack sudo[97152]: pam_unix(sudo:session): session closed for user root Nov 06 11:50:27 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-510d2dd7-bace-462b-af95-77b33be7b60b tempest-VolumesSnapshotListTestJSON-1428144267 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-a8c51aa6-93ea-4856-8dee-93372c01ce9d" returned: 0 in 0.289s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:50:27 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-510d2dd7-bace-462b-af95-77b33be7b60b tempest-VolumesSnapshotListTestJSON-1428144267 None] <== create_volume: return (891ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f'} {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 11:50:27 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-510d2dd7-bace-462b-af95-77b33be7b60b tempest-VolumesSnapshotListTestJSON-1428144267 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.894s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 11:50:27 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-510d2dd7-bace-462b-af95-77b33be7b60b tempest-VolumesSnapshotListTestJSON-1428144267 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3267381f-6466-470e-a17a-5c7d7989c25e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a8c51aa6-93ea-4856-8dee-93372c01ce9d', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:50:27 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-510d2dd7-bace-462b-af95-77b33be7b60b tempest-VolumesSnapshotListTestJSON-1428144267 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (17b07957-9dc6-4df8-bd93-9cf59cd4729b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:50:27 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-510d2dd7-bace-462b-af95-77b33be7b60b tempest-VolumesSnapshotListTestJSON-1428144267 None] Volume volume-a8c51aa6-93ea-4856-8dee-93372c01ce9d (a8c51aa6-93ea-4856-8dee-93372c01ce9d): created successfully Nov 06 11:50:27 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-510d2dd7-bace-462b-af95-77b33be7b60b tempest-VolumesSnapshotListTestJSON-1428144267 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (17b07957-9dc6-4df8-bd93-9cf59cd4729b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:50:27 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-510d2dd7-bace-462b-af95-77b33be7b60b tempest-VolumesSnapshotListTestJSON-1428144267 None] Flow 'volume_create_manager' (ac743d2e-599e-422c-88db-f9d80ad3d4de) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 11:50:27 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-510d2dd7-bace-462b-af95-77b33be7b60b tempest-VolumesSnapshotListTestJSON-1428144267 None] Created volume successfully. Nov 06 11:50:28 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-e51dd615-2bfd-448c-9f0b-7992a373513b tempest-VolumesSnapshotListTestJSON-1428144267 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 11:50:28 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-e51dd615-2bfd-448c-9f0b-7992a373513b tempest-VolumesSnapshotListTestJSON-1428144267 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.004s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 11:50:28 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-e51dd615-2bfd-448c-9f0b-7992a373513b tempest-VolumesSnapshotListTestJSON-1428144267 None] Creating offline snapshot 13fa3cb8-0292-43f7-ab01-bc921fe7ec86 of volume a8c51aa6-93ea-4856-8dee-93372c01ce9d {{(pid=87116) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 06 11:50:28 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[234d0dce-d614-459b-b482-46ea8a492d66]: (4, 'qcow2') {{(pid=88420) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 11:50:28 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-e51dd615-2bfd-448c-9f0b-7992a373513b tempest-VolumesSnapshotListTestJSON-1428144267 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-a8c51aa6-93ea-4856-8dee-93372c01ce9d {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:50:29 devstack sudo[97189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-a8c51aa6-93ea-4856-8dee-93372c01ce9d Nov 06 11:50:29 devstack sudo[97189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:50:29 devstack sudo[97189]: pam_unix(sudo:session): session closed for user root Nov 06 11:50:29 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-e51dd615-2bfd-448c-9f0b-7992a373513b tempest-VolumesSnapshotListTestJSON-1428144267 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-a8c51aa6-93ea-4856-8dee-93372c01ce9d" returned: 0 in 0.420s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:50:29 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-e51dd615-2bfd-448c-9f0b-7992a373513b tempest-VolumesSnapshotListTestJSON-1428144267 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-a8c51aa6-93ea-4856-8dee-93372c01ce9d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-a8c51aa6-93ea-4856-8dee-93372c01ce9d.13fa3cb8-0292-43f7-ab01-bc921fe7ec86 1G {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:50:29 devstack sudo[97197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-a8c51aa6-93ea-4856-8dee-93372c01ce9d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-a8c51aa6-93ea-4856-8dee-93372c01ce9d.13fa3cb8-0292-43f7-ab01-bc921fe7ec86 1G Nov 06 11:50:29 devstack sudo[97197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:50:29 devstack sudo[97197]: pam_unix(sudo:session): session closed for user root Nov 06 11:50:29 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-e51dd615-2bfd-448c-9f0b-7992a373513b tempest-VolumesSnapshotListTestJSON-1428144267 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-a8c51aa6-93ea-4856-8dee-93372c01ce9d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-a8c51aa6-93ea-4856-8dee-93372c01ce9d.13fa3cb8-0292-43f7-ab01-bc921fe7ec86 1G" returned: 0 in 0.505s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:50:29 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-e51dd615-2bfd-448c-9f0b-7992a373513b tempest-VolumesSnapshotListTestJSON-1428144267 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a8c51aa6-93ea-4856-8dee-93372c01ce9d -F qcow2 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-a8c51aa6-93ea-4856-8dee-93372c01ce9d.13fa3cb8-0292-43f7-ab01-bc921fe7ec86 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:50:29 devstack sudo[97203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a8c51aa6-93ea-4856-8dee-93372c01ce9d -F qcow2 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-a8c51aa6-93ea-4856-8dee-93372c01ce9d.13fa3cb8-0292-43f7-ab01-bc921fe7ec86 Nov 06 11:50:29 devstack sudo[97203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:50:30 devstack sudo[97203]: pam_unix(sudo:session): session closed for user root Nov 06 11:50:30 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-e51dd615-2bfd-448c-9f0b-7992a373513b tempest-VolumesSnapshotListTestJSON-1428144267 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a8c51aa6-93ea-4856-8dee-93372c01ce9d -F qcow2 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-a8c51aa6-93ea-4856-8dee-93372c01ce9d.13fa3cb8-0292-43f7-ab01-bc921fe7ec86" returned: 0 in 0.341s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:50:30 devstack cinder-volume[87116]: WARNING cinder.volume.drivers.remotefs [None req-e51dd615-2bfd-448c-9f0b-7992a373513b tempest-VolumesSnapshotListTestJSON-1428144267 None] /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-a8c51aa6-93ea-4856-8dee-93372c01ce9d.13fa3cb8-0292-43f7-ab01-bc921fe7ec86 is being set with open permissions: ugo+rw Nov 06 11:50:30 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-e51dd615-2bfd-448c-9f0b-7992a373513b tempest-VolumesSnapshotListTestJSON-1428144267 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-a8c51aa6-93ea-4856-8dee-93372c01ce9d.13fa3cb8-0292-43f7-ab01-bc921fe7ec86 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:50:30 devstack sudo[97210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-a8c51aa6-93ea-4856-8dee-93372c01ce9d.13fa3cb8-0292-43f7-ab01-bc921fe7ec86 Nov 06 11:50:30 devstack sudo[97210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:50:30 devstack sudo[97210]: pam_unix(sudo:session): session closed for user root Nov 06 11:50:30 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-e51dd615-2bfd-448c-9f0b-7992a373513b tempest-VolumesSnapshotListTestJSON-1428144267 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-a8c51aa6-93ea-4856-8dee-93372c01ce9d.13fa3cb8-0292-43f7-ab01-bc921fe7ec86" returned: 0 in 0.294s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:50:30 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-e51dd615-2bfd-448c-9f0b-7992a373513b tempest-VolumesSnapshotListTestJSON-1428144267 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-a8c51aa6-93ea-4856-8dee-93372c01ce9d.info {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:50:30 devstack sudo[97213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-a8c51aa6-93ea-4856-8dee-93372c01ce9d.info Nov 06 11:50:30 devstack sudo[97213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:50:30 devstack sudo[97213]: pam_unix(sudo:session): session closed for user root Nov 06 11:50:30 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-e51dd615-2bfd-448c-9f0b-7992a373513b tempest-VolumesSnapshotListTestJSON-1428144267 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-a8c51aa6-93ea-4856-8dee-93372c01ce9d.info" returned: 0 in 0.303s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:50:30 devstack cinder-volume[87116]: WARNING cinder.volume.drivers.remotefs [None req-e51dd615-2bfd-448c-9f0b-7992a373513b tempest-VolumesSnapshotListTestJSON-1428144267 None] /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-a8c51aa6-93ea-4856-8dee-93372c01ce9d.info is being set with open permissions: ugo+rw Nov 06 11:50:30 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-e51dd615-2bfd-448c-9f0b-7992a373513b tempest-VolumesSnapshotListTestJSON-1428144267 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-a8c51aa6-93ea-4856-8dee-93372c01ce9d.info {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:50:30 devstack sudo[97216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-a8c51aa6-93ea-4856-8dee-93372c01ce9d.info Nov 06 11:50:30 devstack sudo[97216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:50:31 devstack sudo[97216]: pam_unix(sudo:session): session closed for user root Nov 06 11:50:31 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-e51dd615-2bfd-448c-9f0b-7992a373513b tempest-VolumesSnapshotListTestJSON-1428144267 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-a8c51aa6-93ea-4856-8dee-93372c01ce9d.info" returned: 0 in 0.297s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:50:31 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-e51dd615-2bfd-448c-9f0b-7992a373513b tempest-VolumesSnapshotListTestJSON-1428144267 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.289s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 11:50:31 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-e51dd615-2bfd-448c-9f0b-7992a373513b tempest-VolumesSnapshotListTestJSON-1428144267 None] Create snapshot completed successfully Nov 06 11:50:31 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-a6499be5-a1a7-458e-86f8-42866f57322c tempest-BackendsCapabilitiesAdminTestsJSON-1299671342 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.401268005371, 'free_capacity_gb': 1773.401268005371, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87116) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Nov 06 11:50:31 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-7cc17392-6156-4242-ad81-04bfdb950fba tempest-BackendsCapabilitiesAdminTestsJSON-1299671342 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.401268005371, 'free_capacity_gb': 1773.401268005371, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87116) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Nov 06 11:50:32 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-a68813e0-fb73-488a-9576-8b74237c715b tempest-VolumesSnapshotListTestJSON-1428144267 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 11:50:32 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-a68813e0-fb73-488a-9576-8b74237c715b tempest-VolumesSnapshotListTestJSON-1428144267 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 11:50:32 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-a68813e0-fb73-488a-9576-8b74237c715b tempest-VolumesSnapshotListTestJSON-1428144267 None] Creating offline snapshot ceedaa9b-5270-4e5d-bfde-b0fb810a3df3 of volume a8c51aa6-93ea-4856-8dee-93372c01ce9d {{(pid=87116) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 06 11:50:32 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebdeaa86-1568-4ab0-97da-2bb12f6747e1]: (4, 'qcow2') {{(pid=88420) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 11:50:32 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-a68813e0-fb73-488a-9576-8b74237c715b tempest-VolumesSnapshotListTestJSON-1428144267 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-a8c51aa6-93ea-4856-8dee-93372c01ce9d.13fa3cb8-0292-43f7-ab01-bc921fe7ec86 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:50:32 devstack sudo[97220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-a8c51aa6-93ea-4856-8dee-93372c01ce9d.13fa3cb8-0292-43f7-ab01-bc921fe7ec86 Nov 06 11:50:32 devstack sudo[97220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:50:32 devstack sudo[97220]: pam_unix(sudo:session): session closed for user root Nov 06 11:50:32 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-a68813e0-fb73-488a-9576-8b74237c715b tempest-VolumesSnapshotListTestJSON-1428144267 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-a8c51aa6-93ea-4856-8dee-93372c01ce9d.13fa3cb8-0292-43f7-ab01-bc921fe7ec86" returned: 0 in 0.483s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:50:32 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-a68813e0-fb73-488a-9576-8b74237c715b tempest-VolumesSnapshotListTestJSON-1428144267 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a8c51aa6-93ea-4856-8dee-93372c01ce9d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87116) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 11:50:32 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-a68813e0-fb73-488a-9576-8b74237c715b tempest-VolumesSnapshotListTestJSON-1428144267 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-a8c51aa6-93ea-4856-8dee-93372c01ce9d.13fa3cb8-0292-43f7-ab01-bc921fe7ec86,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-a8c51aa6-93ea-4856-8dee-93372c01ce9d.ceedaa9b-5270-4e5d-bfde-b0fb810a3df3 1G {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:50:32 devstack sudo[97225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-a8c51aa6-93ea-4856-8dee-93372c01ce9d.13fa3cb8-0292-43f7-ab01-bc921fe7ec86,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-a8c51aa6-93ea-4856-8dee-93372c01ce9d.ceedaa9b-5270-4e5d-bfde-b0fb810a3df3 1G Nov 06 11:50:32 devstack sudo[97225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:50:33 devstack sudo[97225]: pam_unix(sudo:session): session closed for user root Nov 06 11:50:33 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-a68813e0-fb73-488a-9576-8b74237c715b tempest-VolumesSnapshotListTestJSON-1428144267 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-a8c51aa6-93ea-4856-8dee-93372c01ce9d.13fa3cb8-0292-43f7-ab01-bc921fe7ec86,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-a8c51aa6-93ea-4856-8dee-93372c01ce9d.ceedaa9b-5270-4e5d-bfde-b0fb810a3df3 1G" returned: 0 in 0.616s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:50:33 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-a68813e0-fb73-488a-9576-8b74237c715b tempest-VolumesSnapshotListTestJSON-1428144267 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a8c51aa6-93ea-4856-8dee-93372c01ce9d.13fa3cb8-0292-43f7-ab01-bc921fe7ec86 -F qcow2 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-a8c51aa6-93ea-4856-8dee-93372c01ce9d.ceedaa9b-5270-4e5d-bfde-b0fb810a3df3 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:50:33 devstack sudo[97231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a8c51aa6-93ea-4856-8dee-93372c01ce9d.13fa3cb8-0292-43f7-ab01-bc921fe7ec86 -F qcow2 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-a8c51aa6-93ea-4856-8dee-93372c01ce9d.ceedaa9b-5270-4e5d-bfde-b0fb810a3df3 Nov 06 11:50:33 devstack sudo[97231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:50:33 devstack sudo[97231]: pam_unix(sudo:session): session closed for user root Nov 06 11:50:33 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-a68813e0-fb73-488a-9576-8b74237c715b tempest-VolumesSnapshotListTestJSON-1428144267 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a8c51aa6-93ea-4856-8dee-93372c01ce9d.13fa3cb8-0292-43f7-ab01-bc921fe7ec86 -F qcow2 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-a8c51aa6-93ea-4856-8dee-93372c01ce9d.ceedaa9b-5270-4e5d-bfde-b0fb810a3df3" returned: 0 in 0.393s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:50:33 devstack cinder-volume[87116]: WARNING cinder.volume.drivers.remotefs [None req-a68813e0-fb73-488a-9576-8b74237c715b tempest-VolumesSnapshotListTestJSON-1428144267 None] /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-a8c51aa6-93ea-4856-8dee-93372c01ce9d.ceedaa9b-5270-4e5d-bfde-b0fb810a3df3 is being set with open permissions: ugo+rw Nov 06 11:50:33 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-a68813e0-fb73-488a-9576-8b74237c715b tempest-VolumesSnapshotListTestJSON-1428144267 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-a8c51aa6-93ea-4856-8dee-93372c01ce9d.ceedaa9b-5270-4e5d-bfde-b0fb810a3df3 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:50:33 devstack sudo[97237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-a8c51aa6-93ea-4856-8dee-93372c01ce9d.ceedaa9b-5270-4e5d-bfde-b0fb810a3df3 Nov 06 11:50:33 devstack sudo[97237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:50:34 devstack sudo[97237]: pam_unix(sudo:session): session closed for user root Nov 06 11:50:34 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-a68813e0-fb73-488a-9576-8b74237c715b tempest-VolumesSnapshotListTestJSON-1428144267 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-a8c51aa6-93ea-4856-8dee-93372c01ce9d.ceedaa9b-5270-4e5d-bfde-b0fb810a3df3" returned: 0 in 0.359s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:50:34 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-a68813e0-fb73-488a-9576-8b74237c715b tempest-VolumesSnapshotListTestJSON-1428144267 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.981s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 11:50:34 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-a68813e0-fb73-488a-9576-8b74237c715b tempest-VolumesSnapshotListTestJSON-1428144267 None] Create snapshot completed successfully Nov 06 11:50:34 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-5b442d29-d90f-4fe6-8292-91e313918679 tempest-VolumesSnapshotListTestJSON-1428144267 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 11:50:34 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-5b442d29-d90f-4fe6-8292-91e313918679 tempest-VolumesSnapshotListTestJSON-1428144267 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 11:50:34 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-5b442d29-d90f-4fe6-8292-91e313918679 tempest-VolumesSnapshotListTestJSON-1428144267 None] Creating offline snapshot 4d3b748a-289c-4151-bbd0-52920c76453b of volume a8c51aa6-93ea-4856-8dee-93372c01ce9d {{(pid=87116) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 06 11:50:34 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1997a5f-494c-4c83-a472-5894d5ec6503]: (4, 'qcow2') {{(pid=88420) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 11:50:34 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-5b442d29-d90f-4fe6-8292-91e313918679 tempest-VolumesSnapshotListTestJSON-1428144267 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-a8c51aa6-93ea-4856-8dee-93372c01ce9d.ceedaa9b-5270-4e5d-bfde-b0fb810a3df3 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:50:34 devstack sudo[97240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-a8c51aa6-93ea-4856-8dee-93372c01ce9d.ceedaa9b-5270-4e5d-bfde-b0fb810a3df3 Nov 06 11:50:34 devstack sudo[97240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:50:35 devstack sudo[97240]: pam_unix(sudo:session): session closed for user root Nov 06 11:50:35 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-5b442d29-d90f-4fe6-8292-91e313918679 tempest-VolumesSnapshotListTestJSON-1428144267 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-a8c51aa6-93ea-4856-8dee-93372c01ce9d.ceedaa9b-5270-4e5d-bfde-b0fb810a3df3" returned: 0 in 0.470s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:50:35 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-5b442d29-d90f-4fe6-8292-91e313918679 tempest-VolumesSnapshotListTestJSON-1428144267 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a8c51aa6-93ea-4856-8dee-93372c01ce9d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87116) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 11:50:35 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-5b442d29-d90f-4fe6-8292-91e313918679 tempest-VolumesSnapshotListTestJSON-1428144267 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-a8c51aa6-93ea-4856-8dee-93372c01ce9d.ceedaa9b-5270-4e5d-bfde-b0fb810a3df3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-a8c51aa6-93ea-4856-8dee-93372c01ce9d.4d3b748a-289c-4151-bbd0-52920c76453b 1G {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:50:35 devstack sudo[97246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-a8c51aa6-93ea-4856-8dee-93372c01ce9d.ceedaa9b-5270-4e5d-bfde-b0fb810a3df3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-a8c51aa6-93ea-4856-8dee-93372c01ce9d.4d3b748a-289c-4151-bbd0-52920c76453b 1G Nov 06 11:50:35 devstack sudo[97246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:50:35 devstack sudo[97246]: pam_unix(sudo:session): session closed for user root Nov 06 11:50:35 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-5b442d29-d90f-4fe6-8292-91e313918679 tempest-VolumesSnapshotListTestJSON-1428144267 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-a8c51aa6-93ea-4856-8dee-93372c01ce9d.ceedaa9b-5270-4e5d-bfde-b0fb810a3df3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-a8c51aa6-93ea-4856-8dee-93372c01ce9d.4d3b748a-289c-4151-bbd0-52920c76453b 1G" returned: 0 in 0.621s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:50:35 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-5b442d29-d90f-4fe6-8292-91e313918679 tempest-VolumesSnapshotListTestJSON-1428144267 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a8c51aa6-93ea-4856-8dee-93372c01ce9d.ceedaa9b-5270-4e5d-bfde-b0fb810a3df3 -F qcow2 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-a8c51aa6-93ea-4856-8dee-93372c01ce9d.4d3b748a-289c-4151-bbd0-52920c76453b {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:50:35 devstack sudo[97251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a8c51aa6-93ea-4856-8dee-93372c01ce9d.ceedaa9b-5270-4e5d-bfde-b0fb810a3df3 -F qcow2 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-a8c51aa6-93ea-4856-8dee-93372c01ce9d.4d3b748a-289c-4151-bbd0-52920c76453b Nov 06 11:50:35 devstack sudo[97251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:50:36 devstack sudo[97251]: pam_unix(sudo:session): session closed for user root Nov 06 11:50:36 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-5b442d29-d90f-4fe6-8292-91e313918679 tempest-VolumesSnapshotListTestJSON-1428144267 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a8c51aa6-93ea-4856-8dee-93372c01ce9d.ceedaa9b-5270-4e5d-bfde-b0fb810a3df3 -F qcow2 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-a8c51aa6-93ea-4856-8dee-93372c01ce9d.4d3b748a-289c-4151-bbd0-52920c76453b" returned: 0 in 0.321s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:50:36 devstack cinder-volume[87116]: WARNING cinder.volume.drivers.remotefs [None req-5b442d29-d90f-4fe6-8292-91e313918679 tempest-VolumesSnapshotListTestJSON-1428144267 None] /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-a8c51aa6-93ea-4856-8dee-93372c01ce9d.4d3b748a-289c-4151-bbd0-52920c76453b is being set with open permissions: ugo+rw Nov 06 11:50:36 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-5b442d29-d90f-4fe6-8292-91e313918679 tempest-VolumesSnapshotListTestJSON-1428144267 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-a8c51aa6-93ea-4856-8dee-93372c01ce9d.4d3b748a-289c-4151-bbd0-52920c76453b {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:50:36 devstack sudo[97256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-a8c51aa6-93ea-4856-8dee-93372c01ce9d.4d3b748a-289c-4151-bbd0-52920c76453b Nov 06 11:50:36 devstack sudo[97256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:50:36 devstack sudo[97256]: pam_unix(sudo:session): session closed for user root Nov 06 11:50:36 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-5b442d29-d90f-4fe6-8292-91e313918679 tempest-VolumesSnapshotListTestJSON-1428144267 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-a8c51aa6-93ea-4856-8dee-93372c01ce9d.4d3b748a-289c-4151-bbd0-52920c76453b" returned: 0 in 0.270s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:50:36 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-5b442d29-d90f-4fe6-8292-91e313918679 tempest-VolumesSnapshotListTestJSON-1428144267 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.826s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 11:50:36 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-5b442d29-d90f-4fe6-8292-91e313918679 tempest-VolumesSnapshotListTestJSON-1428144267 None] Create snapshot completed successfully Nov 06 11:50:38 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-76e60ec3-fc13-4e17-8cfe-e449509694d3 tempest-VolumesSnapshotListTestJSON-1428144267 None] Acquiring lock "cinder-4d3b748a-289c-4151-bbd0-52920c76453b-delete_snapshot" by "delete_snapshot" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 11:50:38 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-76e60ec3-fc13-4e17-8cfe-e449509694d3 tempest-VolumesSnapshotListTestJSON-1428144267 None] Lock "cinder-4d3b748a-289c-4151-bbd0-52920c76453b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.035s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 11:50:38 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-76e60ec3-fc13-4e17-8cfe-e449509694d3 tempest-VolumesSnapshotListTestJSON-1428144267 None] Acquiring lock "cinder-quobyte-a8c51aa6-93ea-4856-8dee-93372c01ce9d" by "delete_snapshot" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 11:50:38 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-76e60ec3-fc13-4e17-8cfe-e449509694d3 tempest-VolumesSnapshotListTestJSON-1428144267 None] Lock "cinder-quobyte-a8c51aa6-93ea-4856-8dee-93372c01ce9d" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 11:50:38 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-76e60ec3-fc13-4e17-8cfe-e449509694d3 tempest-VolumesSnapshotListTestJSON-1428144267 None] Acquiring lock "cinder-quobyte-4d3b748a-289c-4151-bbd0-52920c76453b" by "_delete_snapshot" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 11:50:38 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-76e60ec3-fc13-4e17-8cfe-e449509694d3 tempest-VolumesSnapshotListTestJSON-1428144267 None] Lock "cinder-quobyte-4d3b748a-289c-4151-bbd0-52920c76453b" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 11:50:38 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-76e60ec3-fc13-4e17-8cfe-e449509694d3 tempest-VolumesSnapshotListTestJSON-1428144267 None] Deleting offline snapshot 4d3b748a-289c-4151-bbd0-52920c76453b of volume a8c51aa6-93ea-4856-8dee-93372c01ce9d {{(pid=87116) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 06 11:50:38 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-76e60ec3-fc13-4e17-8cfe-e449509694d3 tempest-VolumesSnapshotListTestJSON-1428144267 None] snapshot_file for this snap is: volume-a8c51aa6-93ea-4856-8dee-93372c01ce9d.4d3b748a-289c-4151-bbd0-52920c76453b {{(pid=87116) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 06 11:50:38 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d05d824-7f10-42b5-86a2-bce71be01327]: (4, 'qcow2') {{(pid=88420) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 11:50:38 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-76e60ec3-fc13-4e17-8cfe-e449509694d3 tempest-VolumesSnapshotListTestJSON-1428144267 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-a8c51aa6-93ea-4856-8dee-93372c01ce9d.4d3b748a-289c-4151-bbd0-52920c76453b {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:50:38 devstack sudo[97265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-a8c51aa6-93ea-4856-8dee-93372c01ce9d.4d3b748a-289c-4151-bbd0-52920c76453b Nov 06 11:50:38 devstack sudo[97265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:50:38 devstack cinder-volume[87116]: DEBUG cinder.volume.flows.manager.create_volume [None req-25441450-0b5c-44d9-b29b-3860a188871a tempest-VolumesTransfersV357Test-1221405526 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87116) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 11:50:38 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-25441450-0b5c-44d9-b29b-3860a188871a tempest-VolumesTransfersV357Test-1221405526 None] Flow 'volume_create_manager' (93619e7b-3f2a-455f-afa4-14a7308a8295) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 11:50:38 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-25441450-0b5c-44d9-b29b-3860a188871a tempest-VolumesTransfersV357Test-1221405526 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e8b8b8c4-7f33-4c31-a38d-a2866ba00d7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:50:38 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-25441450-0b5c-44d9-b29b-3860a188871a tempest-VolumesTransfersV357Test-1221405526 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e8b8b8c4-7f33-4c31-a38d-a2866ba00d7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T10:50:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-313869802',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f3f66174-3e94-4eaf-b1e8-136abe95522d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='946033463743457a908e584cd1fee8c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T10:50:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T10:50:39Z,use_quota=True,user_id='b38fcc4f551b4a47b1f819d4e7c69cf4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(34d3b144-d9b7-480a-a2e3-01e45f3d54c1),volume_type_id=34d3b144-d9b7-480a-a2e3-01e45f3d54c1)' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:50:38 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-25441450-0b5c-44d9-b29b-3860a188871a tempest-VolumesTransfersV357Test-1221405526 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8facda5a-7b57-48ba-a113-c37d814f783c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:50:38 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-25441450-0b5c-44d9-b29b-3860a188871a tempest-VolumesTransfersV357Test-1221405526 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8facda5a-7b57-48ba-a113-c37d814f783c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:50:38 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-25441450-0b5c-44d9-b29b-3860a188871a tempest-VolumesTransfersV357Test-1221405526 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9288f8c0-19cd-46df-8d72-74bd78402c0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:50:38 devstack sudo[97265]: pam_unix(sudo:session): session closed for user root Nov 06 11:50:38 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-25441450-0b5c-44d9-b29b-3860a188871a tempest-VolumesTransfersV357Test-1221405526 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9288f8c0-19cd-46df-8d72-74bd78402c0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f3f66174-3e94-4eaf-b1e8-136abe95522d', 'volume_name': 'volume-f3f66174-3e94-4eaf-b1e8-136abe95522d', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:50:38 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-25441450-0b5c-44d9-b29b-3860a188871a tempest-VolumesTransfersV357Test-1221405526 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2ebde901-807b-4814-8071-f3345b8e5d21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:50:38 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-25441450-0b5c-44d9-b29b-3860a188871a tempest-VolumesTransfersV357Test-1221405526 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2ebde901-807b-4814-8071-f3345b8e5d21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:50:38 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-25441450-0b5c-44d9-b29b-3860a188871a tempest-VolumesTransfersV357Test-1221405526 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e2933a9c-d330-4beb-94ff-10d6b2ad3a42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:50:38 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-25441450-0b5c-44d9-b29b-3860a188871a tempest-VolumesTransfersV357Test-1221405526 None] Volume f3f66174-3e94-4eaf-b1e8-136abe95522d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f3f66174-3e94-4eaf-b1e8-136abe95522d', 'volume_size': 1} Nov 06 11:50:38 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-25441450-0b5c-44d9-b29b-3860a188871a tempest-VolumesTransfersV357Test-1221405526 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 11:50:38 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-25441450-0b5c-44d9-b29b-3860a188871a tempest-VolumesTransfersV357Test-1221405526 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 11:50:38 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-25441450-0b5c-44d9-b29b-3860a188871a tempest-VolumesTransfersV357Test-1221405526 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T10:50:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-313869802',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f3f66174-3e94-4eaf-b1e8-136abe95522d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='946033463743457a908e584cd1fee8c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T10:50:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T10:50:39Z,use_quota=True,user_id='b38fcc4f551b4a47b1f819d4e7c69cf4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(34d3b144-d9b7-480a-a2e3-01e45f3d54c1),volume_type_id=34d3b144-d9b7-480a-a2e3-01e45f3d54c1)}" {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 11:50:38 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-25441450-0b5c-44d9-b29b-3860a188871a tempest-VolumesTransfersV357Test-1221405526 None] Creating volume f3f66174-3e94-4eaf-b1e8-136abe95522d {{(pid=87116) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 11:50:38 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-25441450-0b5c-44d9-b29b-3860a188871a tempest-VolumesTransfersV357Test-1221405526 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 11:50:38 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-25441450-0b5c-44d9-b29b-3860a188871a tempest-VolumesTransfersV357Test-1221405526 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 11:50:38 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-25441450-0b5c-44d9-b29b-3860a188871a tempest-VolumesTransfersV357Test-1221405526 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 11:50:38 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-25441450-0b5c-44d9-b29b-3860a188871a tempest-VolumesTransfersV357Test-1221405526 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 11:50:38 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-25441450-0b5c-44d9-b29b-3860a188871a tempest-VolumesTransfersV357Test-1221405526 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 11:50:38 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-25441450-0b5c-44d9-b29b-3860a188871a tempest-VolumesTransfersV357Test-1221405526 None] Selected osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f as target Quobyte volume. {{(pid=87116) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 11:50:38 devstack cinder-volume[87116]: INFO cinder.volume.drivers.remotefs [None req-25441450-0b5c-44d9-b29b-3860a188871a tempest-VolumesTransfersV357Test-1221405526 None] casted to osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f Nov 06 11:50:38 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-25441450-0b5c-44d9-b29b-3860a188871a tempest-VolumesTransfersV357Test-1221405526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-f3f66174-3e94-4eaf-b1e8-136abe95522d 1073741824 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:50:38 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-76e60ec3-fc13-4e17-8cfe-e449509694d3 tempest-VolumesSnapshotListTestJSON-1428144267 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-a8c51aa6-93ea-4856-8dee-93372c01ce9d.4d3b748a-289c-4151-bbd0-52920c76453b" returned: 0 in 0.594s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:50:38 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-76e60ec3-fc13-4e17-8cfe-e449509694d3 tempest-VolumesSnapshotListTestJSON-1428144267 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a8c51aa6-93ea-4856-8dee-93372c01ce9d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87116) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 11:50:38 devstack sudo[97270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-f3f66174-3e94-4eaf-b1e8-136abe95522d 1073741824 Nov 06 11:50:38 devstack sudo[97270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:50:38 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[a73d0225-e9c6-4f14-af7c-234443729bbf]: (4, 'qcow2') {{(pid=88420) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 11:50:38 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-76e60ec3-fc13-4e17-8cfe-e449509694d3 tempest-VolumesSnapshotListTestJSON-1428144267 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-a8c51aa6-93ea-4856-8dee-93372c01ce9d.ceedaa9b-5270-4e5d-bfde-b0fb810a3df3 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:50:39 devstack sudo[97272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-a8c51aa6-93ea-4856-8dee-93372c01ce9d.ceedaa9b-5270-4e5d-bfde-b0fb810a3df3 Nov 06 11:50:39 devstack sudo[97272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:50:39 devstack sudo[97272]: pam_unix(sudo:session): session closed for user root Nov 06 11:50:39 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-76e60ec3-fc13-4e17-8cfe-e449509694d3 tempest-VolumesSnapshotListTestJSON-1428144267 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-a8c51aa6-93ea-4856-8dee-93372c01ce9d.ceedaa9b-5270-4e5d-bfde-b0fb810a3df3" returned: 0 in 0.463s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:50:39 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-76e60ec3-fc13-4e17-8cfe-e449509694d3 tempest-VolumesSnapshotListTestJSON-1428144267 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a8c51aa6-93ea-4856-8dee-93372c01ce9d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87116) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 11:50:39 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-76e60ec3-fc13-4e17-8cfe-e449509694d3 tempest-VolumesSnapshotListTestJSON-1428144267 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-a8c51aa6-93ea-4856-8dee-93372c01ce9d.4d3b748a-289c-4151-bbd0-52920c76453b {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:50:39 devstack sudo[97283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-a8c51aa6-93ea-4856-8dee-93372c01ce9d.4d3b748a-289c-4151-bbd0-52920c76453b Nov 06 11:50:39 devstack sudo[97283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:50:39 devstack sudo[97270]: pam_unix(sudo:session): session closed for user root Nov 06 11:50:39 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-25441450-0b5c-44d9-b29b-3860a188871a tempest-VolumesTransfersV357Test-1221405526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-f3f66174-3e94-4eaf-b1e8-136abe95522d 1073741824" returned: 0 in 0.617s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:50:39 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-25441450-0b5c-44d9-b29b-3860a188871a tempest-VolumesTransfersV357Test-1221405526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-f3f66174-3e94-4eaf-b1e8-136abe95522d {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:50:39 devstack sudo[97285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-f3f66174-3e94-4eaf-b1e8-136abe95522d Nov 06 11:50:39 devstack sudo[97285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:50:39 devstack sudo[97283]: pam_unix(sudo:session): session closed for user root Nov 06 11:50:39 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-76e60ec3-fc13-4e17-8cfe-e449509694d3 tempest-VolumesSnapshotListTestJSON-1428144267 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-a8c51aa6-93ea-4856-8dee-93372c01ce9d.4d3b748a-289c-4151-bbd0-52920c76453b" returned: 0 in 0.487s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:50:39 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-76e60ec3-fc13-4e17-8cfe-e449509694d3 tempest-VolumesSnapshotListTestJSON-1428144267 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-a8c51aa6-93ea-4856-8dee-93372c01ce9d.4d3b748a-289c-4151-bbd0-52920c76453b {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:50:39 devstack cinder-volume[87116]: DEBUG oslo_service.periodic_task [None req-4fab4816-ec2b-4b19-b2ff-8548f2084354 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87116) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 11:50:39 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-4fab4816-ec2b-4b19-b2ff-8548f2084354 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 11:50:39 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-4fab4816-ec2b-4b19-b2ff-8548f2084354 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 11:50:39 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-4fab4816-ec2b-4b19-b2ff-8548f2084354 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 11:50:39 devstack sudo[97285]: pam_unix(sudo:session): session closed for user root Nov 06 11:50:39 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-4fab4816-ec2b-4b19-b2ff-8548f2084354 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 11:50:39 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-4fab4816-ec2b-4b19-b2ff-8548f2084354 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 11:50:39 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-4fab4816-ec2b-4b19-b2ff-8548f2084354 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:50:39 devstack sudo[97293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-a8c51aa6-93ea-4856-8dee-93372c01ce9d.4d3b748a-289c-4151-bbd0-52920c76453b Nov 06 11:50:39 devstack sudo[97293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:50:39 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-25441450-0b5c-44d9-b29b-3860a188871a tempest-VolumesTransfersV357Test-1221405526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-f3f66174-3e94-4eaf-b1e8-136abe95522d" returned: 0 in 0.347s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:50:39 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-25441450-0b5c-44d9-b29b-3860a188871a tempest-VolumesTransfersV357Test-1221405526 None] <== create_volume: return (1071ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f'} {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 11:50:39 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-25441450-0b5c-44d9-b29b-3860a188871a tempest-VolumesTransfersV357Test-1221405526 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.074s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 11:50:39 devstack sudo[97295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756 Nov 06 11:50:39 devstack sudo[97295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:50:39 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-25441450-0b5c-44d9-b29b-3860a188871a tempest-VolumesTransfersV357Test-1221405526 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e2933a9c-d330-4beb-94ff-10d6b2ad3a42) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f3f66174-3e94-4eaf-b1e8-136abe95522d', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:50:39 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-25441450-0b5c-44d9-b29b-3860a188871a tempest-VolumesTransfersV357Test-1221405526 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (385bb7f3-f728-4ac6-a524-558b501d568d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:50:39 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-25441450-0b5c-44d9-b29b-3860a188871a tempest-VolumesTransfersV357Test-1221405526 None] Volume volume-f3f66174-3e94-4eaf-b1e8-136abe95522d (f3f66174-3e94-4eaf-b1e8-136abe95522d): created successfully Nov 06 11:50:39 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-25441450-0b5c-44d9-b29b-3860a188871a tempest-VolumesTransfersV357Test-1221405526 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (385bb7f3-f728-4ac6-a524-558b501d568d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:50:39 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-25441450-0b5c-44d9-b29b-3860a188871a tempest-VolumesTransfersV357Test-1221405526 None] Flow 'volume_create_manager' (93619e7b-3f2a-455f-afa4-14a7308a8295) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 11:50:39 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-25441450-0b5c-44d9-b29b-3860a188871a tempest-VolumesTransfersV357Test-1221405526 None] Created volume successfully. Nov 06 11:50:40 devstack sudo[97293]: pam_unix(sudo:session): session closed for user root Nov 06 11:50:40 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-76e60ec3-fc13-4e17-8cfe-e449509694d3 tempest-VolumesSnapshotListTestJSON-1428144267 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-a8c51aa6-93ea-4856-8dee-93372c01ce9d.4d3b748a-289c-4151-bbd0-52920c76453b" returned: 0 in 0.310s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:50:40 devstack sudo[97295]: pam_unix(sudo:session): session closed for user root Nov 06 11:50:40 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-4fab4816-ec2b-4b19-b2ff-8548f2084354 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756" returned: 0 in 0.333s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:50:40 devstack cinder-volume[87116]: DEBUG cinder.manager [None req-4fab4816-ec2b-4b19-b2ff-8548f2084354 None None] Notifying Schedulers of capabilities ... {{(pid=87116) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 11:50:40 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-76e60ec3-fc13-4e17-8cfe-e449509694d3 tempest-VolumesSnapshotListTestJSON-1428144267 None] Lock "cinder-quobyte-4d3b748a-289c-4151-bbd0-52920c76453b" released by "_delete_snapshot" :: held 2.024s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 11:50:40 devstack cinder-volume[87116]: DEBUG oslo_service.periodic_task [None req-4fab4816-ec2b-4b19-b2ff-8548f2084354 None None] Running periodic task VolumeManager._thread_info {{(pid=87116) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 11:50:40 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-4fab4816-ec2b-4b19-b2ff-8548f2084354 None None] thread count: 28 {{(pid=87116) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 06 11:50:40 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-4fab4816-ec2b-4b19-b2ff-8548f2084354 None None] thread info: [<_MainThread(MainThread, started 131399520669824)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87116) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 06 11:50:40 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-76e60ec3-fc13-4e17-8cfe-e449509694d3 tempest-VolumesSnapshotListTestJSON-1428144267 None] Lock "cinder-quobyte-a8c51aa6-93ea-4856-8dee-93372c01ce9d" released by "delete_snapshot" :: held 2.067s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 11:50:40 devstack cinder-volume[87116]: DEBUG cinder.quota [None req-76e60ec3-fc13-4e17-8cfe-e449509694d3 tempest-VolumesSnapshotListTestJSON-1428144267 None] Created reservations ['ac4f6039-a98d-4f4b-a052-1e12d242108d', '40ed3309-308b-41b2-8ebd-0941f37ea15c', '995a9422-34a5-4fe2-a46a-b5e5374cf451', '40f9fa50-e6fc-4968-9691-4bd02443c113'] {{(pid=87116) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 11:50:40 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-76e60ec3-fc13-4e17-8cfe-e449509694d3 tempest-VolumesSnapshotListTestJSON-1428144267 None] Delete snapshot completed successfully. Nov 06 11:50:40 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-76e60ec3-fc13-4e17-8cfe-e449509694d3 tempest-VolumesSnapshotListTestJSON-1428144267 None] Lock "cinder-4d3b748a-289c-4151-bbd0-52920c76453b-delete_snapshot" released by "delete_snapshot" :: held 2.247s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 11:50:41 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-f7d75f78-8f3c-462f-90f5-ca57a581bac5 tempest-VolumesSnapshotListTestJSON-1428144267 None] Acquiring lock "cinder-ceedaa9b-5270-4e5d-bfde-b0fb810a3df3-delete_snapshot" by "delete_snapshot" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 11:50:41 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-f7d75f78-8f3c-462f-90f5-ca57a581bac5 tempest-VolumesSnapshotListTestJSON-1428144267 None] Lock "cinder-ceedaa9b-5270-4e5d-bfde-b0fb810a3df3-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 11:50:41 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-f7d75f78-8f3c-462f-90f5-ca57a581bac5 tempest-VolumesSnapshotListTestJSON-1428144267 None] Acquiring lock "cinder-quobyte-a8c51aa6-93ea-4856-8dee-93372c01ce9d" by "delete_snapshot" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 11:50:41 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-f7d75f78-8f3c-462f-90f5-ca57a581bac5 tempest-VolumesSnapshotListTestJSON-1428144267 None] Lock "cinder-quobyte-a8c51aa6-93ea-4856-8dee-93372c01ce9d" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 11:50:41 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-f7d75f78-8f3c-462f-90f5-ca57a581bac5 tempest-VolumesSnapshotListTestJSON-1428144267 None] Acquiring lock "cinder-quobyte-ceedaa9b-5270-4e5d-bfde-b0fb810a3df3" by "_delete_snapshot" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 11:50:41 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-f7d75f78-8f3c-462f-90f5-ca57a581bac5 tempest-VolumesSnapshotListTestJSON-1428144267 None] Lock "cinder-quobyte-ceedaa9b-5270-4e5d-bfde-b0fb810a3df3" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 11:50:41 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-f7d75f78-8f3c-462f-90f5-ca57a581bac5 tempest-VolumesSnapshotListTestJSON-1428144267 None] Deleting offline snapshot ceedaa9b-5270-4e5d-bfde-b0fb810a3df3 of volume a8c51aa6-93ea-4856-8dee-93372c01ce9d {{(pid=87116) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 06 11:50:41 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-f7d75f78-8f3c-462f-90f5-ca57a581bac5 tempest-VolumesSnapshotListTestJSON-1428144267 None] snapshot_file for this snap is: volume-a8c51aa6-93ea-4856-8dee-93372c01ce9d.ceedaa9b-5270-4e5d-bfde-b0fb810a3df3 {{(pid=87116) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 06 11:50:41 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[55608426-63f7-40d1-b041-5b516f0902eb]: (4, 'qcow2') {{(pid=88420) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 11:50:41 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-f7d75f78-8f3c-462f-90f5-ca57a581bac5 tempest-VolumesSnapshotListTestJSON-1428144267 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-a8c51aa6-93ea-4856-8dee-93372c01ce9d.ceedaa9b-5270-4e5d-bfde-b0fb810a3df3 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:50:41 devstack sudo[97299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-a8c51aa6-93ea-4856-8dee-93372c01ce9d.ceedaa9b-5270-4e5d-bfde-b0fb810a3df3 Nov 06 11:50:41 devstack sudo[97299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:50:41 devstack sudo[97299]: pam_unix(sudo:session): session closed for user root Nov 06 11:50:41 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-f7d75f78-8f3c-462f-90f5-ca57a581bac5 tempest-VolumesSnapshotListTestJSON-1428144267 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-a8c51aa6-93ea-4856-8dee-93372c01ce9d.ceedaa9b-5270-4e5d-bfde-b0fb810a3df3" returned: 0 in 0.439s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:50:41 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-f7d75f78-8f3c-462f-90f5-ca57a581bac5 tempest-VolumesSnapshotListTestJSON-1428144267 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a8c51aa6-93ea-4856-8dee-93372c01ce9d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87116) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 11:50:41 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d0caa18-6e6f-47de-99d0-1b669ba704ca]: (4, 'qcow2') {{(pid=88420) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 11:50:41 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-f7d75f78-8f3c-462f-90f5-ca57a581bac5 tempest-VolumesSnapshotListTestJSON-1428144267 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-a8c51aa6-93ea-4856-8dee-93372c01ce9d.13fa3cb8-0292-43f7-ab01-bc921fe7ec86 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:50:42 devstack sudo[97305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-a8c51aa6-93ea-4856-8dee-93372c01ce9d.13fa3cb8-0292-43f7-ab01-bc921fe7ec86 Nov 06 11:50:42 devstack sudo[97305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:50:42 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-dd02b1a7-ee47-478d-9fbf-424aeda7b691 tempest-VolumesTransfersV357Test-848257044 None] Transfer volume completed successfully. Nov 06 11:50:42 devstack sudo[97305]: pam_unix(sudo:session): session closed for user root Nov 06 11:50:42 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-f7d75f78-8f3c-462f-90f5-ca57a581bac5 tempest-VolumesSnapshotListTestJSON-1428144267 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-a8c51aa6-93ea-4856-8dee-93372c01ce9d.13fa3cb8-0292-43f7-ab01-bc921fe7ec86" returned: 0 in 0.554s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:50:42 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-f7d75f78-8f3c-462f-90f5-ca57a581bac5 tempest-VolumesSnapshotListTestJSON-1428144267 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a8c51aa6-93ea-4856-8dee-93372c01ce9d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87116) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 11:50:42 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-f7d75f78-8f3c-462f-90f5-ca57a581bac5 tempest-VolumesSnapshotListTestJSON-1428144267 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-a8c51aa6-93ea-4856-8dee-93372c01ce9d.ceedaa9b-5270-4e5d-bfde-b0fb810a3df3 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:50:42 devstack sudo[97312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-a8c51aa6-93ea-4856-8dee-93372c01ce9d.ceedaa9b-5270-4e5d-bfde-b0fb810a3df3 Nov 06 11:50:42 devstack sudo[97312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:50:43 devstack sudo[97312]: pam_unix(sudo:session): session closed for user root Nov 06 11:50:43 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-f7d75f78-8f3c-462f-90f5-ca57a581bac5 tempest-VolumesSnapshotListTestJSON-1428144267 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-a8c51aa6-93ea-4856-8dee-93372c01ce9d.ceedaa9b-5270-4e5d-bfde-b0fb810a3df3" returned: 0 in 0.498s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:50:43 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-f7d75f78-8f3c-462f-90f5-ca57a581bac5 tempest-VolumesSnapshotListTestJSON-1428144267 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-a8c51aa6-93ea-4856-8dee-93372c01ce9d.ceedaa9b-5270-4e5d-bfde-b0fb810a3df3 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:50:43 devstack sudo[97318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-a8c51aa6-93ea-4856-8dee-93372c01ce9d.ceedaa9b-5270-4e5d-bfde-b0fb810a3df3 Nov 06 11:50:43 devstack sudo[97318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:50:43 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-1ac5ad1d-a14a-46bd-a554-3b81a7684989 tempest-VolumesTransfersV357Test-574463066 None] Acquiring lock "cinder-f3f66174-3e94-4eaf-b1e8-136abe95522d-delete_volume" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 11:50:43 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-1ac5ad1d-a14a-46bd-a554-3b81a7684989 tempest-VolumesTransfersV357Test-574463066 None] Lock "cinder-f3f66174-3e94-4eaf-b1e8-136abe95522d-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 11:50:43 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-1ac5ad1d-a14a-46bd-a554-3b81a7684989 tempest-VolumesTransfersV357Test-574463066 None] Acquiring lock "cinder-quobyte-f3f66174-3e94-4eaf-b1e8-136abe95522d" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 11:50:43 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-1ac5ad1d-a14a-46bd-a554-3b81a7684989 tempest-VolumesTransfersV357Test-574463066 None] Lock "cinder-quobyte-f3f66174-3e94-4eaf-b1e8-136abe95522d" acquired by "delete_volume" :: waited 0.020s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 11:50:43 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[1698dad8-13c6-4c25-bdf5-db7e7536fda8]: (4, 'qcow2') {{(pid=88420) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 11:50:43 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-1ac5ad1d-a14a-46bd-a554-3b81a7684989 tempest-VolumesTransfersV357Test-574463066 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-f3f66174-3e94-4eaf-b1e8-136abe95522d {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:50:43 devstack sudo[97320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-f3f66174-3e94-4eaf-b1e8-136abe95522d Nov 06 11:50:43 devstack sudo[97320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:50:43 devstack sudo[97318]: pam_unix(sudo:session): session closed for user root Nov 06 11:50:43 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-f7d75f78-8f3c-462f-90f5-ca57a581bac5 tempest-VolumesSnapshotListTestJSON-1428144267 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-a8c51aa6-93ea-4856-8dee-93372c01ce9d.ceedaa9b-5270-4e5d-bfde-b0fb810a3df3" returned: 0 in 0.378s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:50:43 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-f7d75f78-8f3c-462f-90f5-ca57a581bac5 tempest-VolumesSnapshotListTestJSON-1428144267 None] Lock "cinder-quobyte-ceedaa9b-5270-4e5d-bfde-b0fb810a3df3" released by "_delete_snapshot" :: held 2.042s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 11:50:43 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-f7d75f78-8f3c-462f-90f5-ca57a581bac5 tempest-VolumesSnapshotListTestJSON-1428144267 None] Lock "cinder-quobyte-a8c51aa6-93ea-4856-8dee-93372c01ce9d" released by "delete_snapshot" :: held 2.074s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 11:50:43 devstack cinder-volume[87116]: DEBUG cinder.quota [None req-f7d75f78-8f3c-462f-90f5-ca57a581bac5 tempest-VolumesSnapshotListTestJSON-1428144267 None] Created reservations ['41eccec6-4627-40f0-967c-f1b7aa3f406c', '53e90921-403c-4523-a5e6-66d01edc5955', '56bde19f-f180-4881-88f8-d24bf5d688f1', 'd595d32b-fdf0-4e7e-a454-f7ac736dda11'] {{(pid=87116) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 11:50:43 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-f7d75f78-8f3c-462f-90f5-ca57a581bac5 tempest-VolumesSnapshotListTestJSON-1428144267 None] Delete snapshot completed successfully. Nov 06 11:50:43 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-f7d75f78-8f3c-462f-90f5-ca57a581bac5 tempest-VolumesSnapshotListTestJSON-1428144267 None] Lock "cinder-ceedaa9b-5270-4e5d-bfde-b0fb810a3df3-delete_snapshot" released by "delete_snapshot" :: held 2.349s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 11:50:43 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-49260104-2bc2-4e52-bfb0-d235aec8951e tempest-VolumesSnapshotListTestJSON-1428144267 None] Acquiring lock "cinder-13fa3cb8-0292-43f7-ab01-bc921fe7ec86-delete_snapshot" by "delete_snapshot" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 11:50:43 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-49260104-2bc2-4e52-bfb0-d235aec8951e tempest-VolumesSnapshotListTestJSON-1428144267 None] Lock "cinder-13fa3cb8-0292-43f7-ab01-bc921fe7ec86-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 11:50:43 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-49260104-2bc2-4e52-bfb0-d235aec8951e tempest-VolumesSnapshotListTestJSON-1428144267 None] Acquiring lock "cinder-quobyte-a8c51aa6-93ea-4856-8dee-93372c01ce9d" by "delete_snapshot" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 11:50:43 devstack sudo[97320]: pam_unix(sudo:session): session closed for user root Nov 06 11:50:43 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-1ac5ad1d-a14a-46bd-a554-3b81a7684989 tempest-VolumesTransfersV357Test-574463066 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-f3f66174-3e94-4eaf-b1e8-136abe95522d" returned: 0 in 0.561s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:50:43 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-1ac5ad1d-a14a-46bd-a554-3b81a7684989 tempest-VolumesTransfersV357Test-574463066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-f3f66174-3e94-4eaf-b1e8-136abe95522d {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:50:43 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-49260104-2bc2-4e52-bfb0-d235aec8951e tempest-VolumesSnapshotListTestJSON-1428144267 None] Lock "cinder-quobyte-a8c51aa6-93ea-4856-8dee-93372c01ce9d" acquired by "delete_snapshot" :: waited 0.045s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 11:50:43 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-49260104-2bc2-4e52-bfb0-d235aec8951e tempest-VolumesSnapshotListTestJSON-1428144267 None] Acquiring lock "cinder-quobyte-13fa3cb8-0292-43f7-ab01-bc921fe7ec86" by "_delete_snapshot" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 11:50:43 devstack sudo[97327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-f3f66174-3e94-4eaf-b1e8-136abe95522d Nov 06 11:50:43 devstack sudo[97327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:50:43 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-49260104-2bc2-4e52-bfb0-d235aec8951e tempest-VolumesSnapshotListTestJSON-1428144267 None] Lock "cinder-quobyte-13fa3cb8-0292-43f7-ab01-bc921fe7ec86" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 11:50:43 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-49260104-2bc2-4e52-bfb0-d235aec8951e tempest-VolumesSnapshotListTestJSON-1428144267 None] Deleting offline snapshot 13fa3cb8-0292-43f7-ab01-bc921fe7ec86 of volume a8c51aa6-93ea-4856-8dee-93372c01ce9d {{(pid=87116) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 06 11:50:43 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-49260104-2bc2-4e52-bfb0-d235aec8951e tempest-VolumesSnapshotListTestJSON-1428144267 None] snapshot_file for this snap is: volume-a8c51aa6-93ea-4856-8dee-93372c01ce9d.13fa3cb8-0292-43f7-ab01-bc921fe7ec86 {{(pid=87116) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 06 11:50:43 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[71aab2d3-ceb2-4bc9-a6dd-8978dff43816]: (4, 'qcow2') {{(pid=88420) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 11:50:43 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-49260104-2bc2-4e52-bfb0-d235aec8951e tempest-VolumesSnapshotListTestJSON-1428144267 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-a8c51aa6-93ea-4856-8dee-93372c01ce9d.13fa3cb8-0292-43f7-ab01-bc921fe7ec86 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:50:44 devstack sudo[97329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-a8c51aa6-93ea-4856-8dee-93372c01ce9d.13fa3cb8-0292-43f7-ab01-bc921fe7ec86 Nov 06 11:50:44 devstack sudo[97329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:50:44 devstack sudo[97327]: pam_unix(sudo:session): session closed for user root Nov 06 11:50:44 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-1ac5ad1d-a14a-46bd-a554-3b81a7684989 tempest-VolumesTransfersV357Test-574463066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-f3f66174-3e94-4eaf-b1e8-136abe95522d" returned: 0 in 0.303s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:50:44 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-1ac5ad1d-a14a-46bd-a554-3b81a7684989 tempest-VolumesTransfersV357Test-574463066 None] Lock "cinder-quobyte-f3f66174-3e94-4eaf-b1e8-136abe95522d" released by "delete_volume" :: held 0.930s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 11:50:44 devstack cinder-volume[87116]: DEBUG cinder.quota [None req-1ac5ad1d-a14a-46bd-a554-3b81a7684989 tempest-VolumesTransfersV357Test-574463066 None] Created reservations ['ed08d70f-fa35-4448-a8ee-0835d4af5ca7', '3f29dc5d-e20b-4269-91ae-ee561c4cba73', 'e2da6c3f-252a-4c06-ab78-3b4ddc4a8dc3', 'c4d59e5b-e71e-43b4-b075-9180f5f46bc5'] {{(pid=87116) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 11:50:44 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-1ac5ad1d-a14a-46bd-a554-3b81a7684989 tempest-VolumesTransfersV357Test-574463066 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 11:50:44 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-1ac5ad1d-a14a-46bd-a554-3b81a7684989 tempest-VolumesTransfersV357Test-574463066 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 11:50:44 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-1ac5ad1d-a14a-46bd-a554-3b81a7684989 tempest-VolumesTransfersV357Test-574463066 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 11:50:44 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-1ac5ad1d-a14a-46bd-a554-3b81a7684989 tempest-VolumesTransfersV357Test-574463066 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 11:50:44 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-1ac5ad1d-a14a-46bd-a554-3b81a7684989 tempest-VolumesTransfersV357Test-574463066 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 11:50:44 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-1ac5ad1d-a14a-46bd-a554-3b81a7684989 tempest-VolumesTransfersV357Test-574463066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:50:44 devstack sudo[97329]: pam_unix(sudo:session): session closed for user root Nov 06 11:50:44 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-49260104-2bc2-4e52-bfb0-d235aec8951e tempest-VolumesSnapshotListTestJSON-1428144267 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-a8c51aa6-93ea-4856-8dee-93372c01ce9d.13fa3cb8-0292-43f7-ab01-bc921fe7ec86" returned: 0 in 0.520s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:50:44 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-49260104-2bc2-4e52-bfb0-d235aec8951e tempest-VolumesSnapshotListTestJSON-1428144267 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a8c51aa6-93ea-4856-8dee-93372c01ce9d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87116) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 11:50:44 devstack sudo[97335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756 Nov 06 11:50:44 devstack sudo[97335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:50:44 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5fe1ba5-64e9-4c58-87db-53bb75c0af13]: (4, 'qcow2') {{(pid=88420) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 11:50:44 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-49260104-2bc2-4e52-bfb0-d235aec8951e tempest-VolumesSnapshotListTestJSON-1428144267 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-a8c51aa6-93ea-4856-8dee-93372c01ce9d {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:50:44 devstack sudo[97337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-a8c51aa6-93ea-4856-8dee-93372c01ce9d Nov 06 11:50:44 devstack sudo[97337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:50:44 devstack sudo[97335]: pam_unix(sudo:session): session closed for user root Nov 06 11:50:44 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-1ac5ad1d-a14a-46bd-a554-3b81a7684989 tempest-VolumesTransfersV357Test-574463066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756" returned: 0 in 0.331s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:50:44 devstack cinder-volume[87116]: DEBUG cinder.manager [None req-1ac5ad1d-a14a-46bd-a554-3b81a7684989 tempest-VolumesTransfersV357Test-574463066 None] Notifying Schedulers of capabilities ... {{(pid=87116) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 11:50:44 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-1ac5ad1d-a14a-46bd-a554-3b81a7684989 tempest-VolumesTransfersV357Test-574463066 None] Deleted volume successfully. Nov 06 11:50:44 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-1ac5ad1d-a14a-46bd-a554-3b81a7684989 tempest-VolumesTransfersV357Test-574463066 None] Lock "cinder-f3f66174-3e94-4eaf-b1e8-136abe95522d-delete_volume" released by "delete_volume" :: held 1.672s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 11:50:44 devstack sudo[97337]: pam_unix(sudo:session): session closed for user root Nov 06 11:50:44 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-49260104-2bc2-4e52-bfb0-d235aec8951e tempest-VolumesSnapshotListTestJSON-1428144267 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-a8c51aa6-93ea-4856-8dee-93372c01ce9d" returned: 0 in 0.433s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:50:44 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-49260104-2bc2-4e52-bfb0-d235aec8951e tempest-VolumesSnapshotListTestJSON-1428144267 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-a8c51aa6-93ea-4856-8dee-93372c01ce9d.13fa3cb8-0292-43f7-ab01-bc921fe7ec86 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:50:44 devstack sudo[97343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-a8c51aa6-93ea-4856-8dee-93372c01ce9d.13fa3cb8-0292-43f7-ab01-bc921fe7ec86 Nov 06 11:50:44 devstack sudo[97343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:50:45 devstack sudo[97343]: pam_unix(sudo:session): session closed for user root Nov 06 11:50:45 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-49260104-2bc2-4e52-bfb0-d235aec8951e tempest-VolumesSnapshotListTestJSON-1428144267 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-a8c51aa6-93ea-4856-8dee-93372c01ce9d.13fa3cb8-0292-43f7-ab01-bc921fe7ec86" returned: 0 in 0.384s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:50:45 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-49260104-2bc2-4e52-bfb0-d235aec8951e tempest-VolumesSnapshotListTestJSON-1428144267 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-a8c51aa6-93ea-4856-8dee-93372c01ce9d.13fa3cb8-0292-43f7-ab01-bc921fe7ec86 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:50:45 devstack sudo[97349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-a8c51aa6-93ea-4856-8dee-93372c01ce9d.13fa3cb8-0292-43f7-ab01-bc921fe7ec86 Nov 06 11:50:45 devstack sudo[97349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:50:45 devstack sudo[97349]: pam_unix(sudo:session): session closed for user root Nov 06 11:50:45 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-49260104-2bc2-4e52-bfb0-d235aec8951e tempest-VolumesSnapshotListTestJSON-1428144267 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-a8c51aa6-93ea-4856-8dee-93372c01ce9d.13fa3cb8-0292-43f7-ab01-bc921fe7ec86" returned: 0 in 0.318s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:50:45 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-49260104-2bc2-4e52-bfb0-d235aec8951e tempest-VolumesSnapshotListTestJSON-1428144267 None] Lock "cinder-quobyte-13fa3cb8-0292-43f7-ab01-bc921fe7ec86" released by "_delete_snapshot" :: held 1.831s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 11:50:45 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-49260104-2bc2-4e52-bfb0-d235aec8951e tempest-VolumesSnapshotListTestJSON-1428144267 None] Lock "cinder-quobyte-a8c51aa6-93ea-4856-8dee-93372c01ce9d" released by "delete_snapshot" :: held 1.865s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 11:50:45 devstack cinder-volume[87116]: DEBUG cinder.quota [None req-49260104-2bc2-4e52-bfb0-d235aec8951e tempest-VolumesSnapshotListTestJSON-1428144267 None] Created reservations ['3ef302dc-aa87-4952-b3f9-fb5dfe8e7d40', '50e116c6-8240-44dc-b820-95ca0ede3487', '50886f8c-3b75-4abf-b20a-a8be4e050184', '84861ae7-125d-4c23-9a37-d4c49c269477'] {{(pid=87116) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 11:50:45 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-49260104-2bc2-4e52-bfb0-d235aec8951e tempest-VolumesSnapshotListTestJSON-1428144267 None] Delete snapshot completed successfully. Nov 06 11:50:45 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-49260104-2bc2-4e52-bfb0-d235aec8951e tempest-VolumesSnapshotListTestJSON-1428144267 None] Lock "cinder-13fa3cb8-0292-43f7-ab01-bc921fe7ec86-delete_snapshot" released by "delete_snapshot" :: held 2.114s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 11:50:46 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-f67c3940-df4e-41fb-8367-d6ff7ae3cfdf tempest-VolumesSnapshotListTestJSON-1428144267 None] Acquiring lock "cinder-a8c51aa6-93ea-4856-8dee-93372c01ce9d-delete_volume" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 11:50:46 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-f67c3940-df4e-41fb-8367-d6ff7ae3cfdf tempest-VolumesSnapshotListTestJSON-1428144267 None] Lock "cinder-a8c51aa6-93ea-4856-8dee-93372c01ce9d-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 11:50:46 devstack cinder-volume[87116]: DEBUG cinder.volume.flows.manager.create_volume [None req-b6969ea3-c183-4039-8bff-9c40163e3dc7 tempest-VolumesTransfersV357Test-1221405526 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87116) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 11:50:46 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-b6969ea3-c183-4039-8bff-9c40163e3dc7 tempest-VolumesTransfersV357Test-1221405526 None] Flow 'volume_create_manager' (7288fea9-7b3c-4c4c-b23c-673bbf0a21e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 11:50:46 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-b6969ea3-c183-4039-8bff-9c40163e3dc7 tempest-VolumesTransfersV357Test-1221405526 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (62d3ef55-5159-4819-8d82-8ca3d78a6d67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:50:46 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-b6969ea3-c183-4039-8bff-9c40163e3dc7 tempest-VolumesTransfersV357Test-1221405526 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (62d3ef55-5159-4819-8d82-8ca3d78a6d67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T10:50:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-897085980',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f0e56b54-b804-44b5-a48f-87e37fea31c4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='946033463743457a908e584cd1fee8c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T10:50:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T10:50:46Z,use_quota=True,user_id='b38fcc4f551b4a47b1f819d4e7c69cf4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(34d3b144-d9b7-480a-a2e3-01e45f3d54c1),volume_type_id=34d3b144-d9b7-480a-a2e3-01e45f3d54c1)' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:50:46 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-b6969ea3-c183-4039-8bff-9c40163e3dc7 tempest-VolumesTransfersV357Test-1221405526 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (32e1cb44-8f0a-4e6d-951f-27cc6ee63088) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:50:46 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-b6969ea3-c183-4039-8bff-9c40163e3dc7 tempest-VolumesTransfersV357Test-1221405526 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (32e1cb44-8f0a-4e6d-951f-27cc6ee63088) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:50:46 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-b6969ea3-c183-4039-8bff-9c40163e3dc7 tempest-VolumesTransfersV357Test-1221405526 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6ef3032d-afd5-47e4-8820-0031df7972ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:50:46 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-b6969ea3-c183-4039-8bff-9c40163e3dc7 tempest-VolumesTransfersV357Test-1221405526 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6ef3032d-afd5-47e4-8820-0031df7972ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f0e56b54-b804-44b5-a48f-87e37fea31c4', 'volume_name': 'volume-f0e56b54-b804-44b5-a48f-87e37fea31c4', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:50:46 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-b6969ea3-c183-4039-8bff-9c40163e3dc7 tempest-VolumesTransfersV357Test-1221405526 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2773ea11-9c93-47dd-a267-bfb84af98766) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:50:46 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-b6969ea3-c183-4039-8bff-9c40163e3dc7 tempest-VolumesTransfersV357Test-1221405526 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2773ea11-9c93-47dd-a267-bfb84af98766) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:50:46 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-b6969ea3-c183-4039-8bff-9c40163e3dc7 tempest-VolumesTransfersV357Test-1221405526 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (91a8356c-5915-47d2-9356-dfe7ef8d5cc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:50:46 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-b6969ea3-c183-4039-8bff-9c40163e3dc7 tempest-VolumesTransfersV357Test-1221405526 None] Volume f0e56b54-b804-44b5-a48f-87e37fea31c4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f0e56b54-b804-44b5-a48f-87e37fea31c4', 'volume_size': 1} Nov 06 11:50:46 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-b6969ea3-c183-4039-8bff-9c40163e3dc7 tempest-VolumesTransfersV357Test-1221405526 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 11:50:46 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-b6969ea3-c183-4039-8bff-9c40163e3dc7 tempest-VolumesTransfersV357Test-1221405526 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 11:50:46 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-b6969ea3-c183-4039-8bff-9c40163e3dc7 tempest-VolumesTransfersV357Test-1221405526 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T10:50:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-897085980',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f0e56b54-b804-44b5-a48f-87e37fea31c4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='946033463743457a908e584cd1fee8c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T10:50:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T10:50:46Z,use_quota=True,user_id='b38fcc4f551b4a47b1f819d4e7c69cf4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(34d3b144-d9b7-480a-a2e3-01e45f3d54c1),volume_type_id=34d3b144-d9b7-480a-a2e3-01e45f3d54c1)}" {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 11:50:46 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-b6969ea3-c183-4039-8bff-9c40163e3dc7 tempest-VolumesTransfersV357Test-1221405526 None] Creating volume f0e56b54-b804-44b5-a48f-87e37fea31c4 {{(pid=87116) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 11:50:46 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-b6969ea3-c183-4039-8bff-9c40163e3dc7 tempest-VolumesTransfersV357Test-1221405526 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 11:50:46 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-b6969ea3-c183-4039-8bff-9c40163e3dc7 tempest-VolumesTransfersV357Test-1221405526 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 11:50:46 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-b6969ea3-c183-4039-8bff-9c40163e3dc7 tempest-VolumesTransfersV357Test-1221405526 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 11:50:46 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-b6969ea3-c183-4039-8bff-9c40163e3dc7 tempest-VolumesTransfersV357Test-1221405526 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 11:50:46 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-b6969ea3-c183-4039-8bff-9c40163e3dc7 tempest-VolumesTransfersV357Test-1221405526 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 11:50:46 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-b6969ea3-c183-4039-8bff-9c40163e3dc7 tempest-VolumesTransfersV357Test-1221405526 None] Selected osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f as target Quobyte volume. {{(pid=87116) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 11:50:46 devstack cinder-volume[87116]: INFO cinder.volume.drivers.remotefs [None req-b6969ea3-c183-4039-8bff-9c40163e3dc7 tempest-VolumesTransfersV357Test-1221405526 None] casted to osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f Nov 06 11:50:46 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-b6969ea3-c183-4039-8bff-9c40163e3dc7 tempest-VolumesTransfersV357Test-1221405526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-f0e56b54-b804-44b5-a48f-87e37fea31c4 1073741824 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:50:46 devstack sudo[97352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-f0e56b54-b804-44b5-a48f-87e37fea31c4 1073741824 Nov 06 11:50:46 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-f67c3940-df4e-41fb-8367-d6ff7ae3cfdf tempest-VolumesSnapshotListTestJSON-1428144267 None] Acquiring lock "cinder-quobyte-a8c51aa6-93ea-4856-8dee-93372c01ce9d" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 11:50:46 devstack sudo[97352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:50:46 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-f67c3940-df4e-41fb-8367-d6ff7ae3cfdf tempest-VolumesSnapshotListTestJSON-1428144267 None] Lock "cinder-quobyte-a8c51aa6-93ea-4856-8dee-93372c01ce9d" acquired by "delete_volume" :: waited 0.020s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 11:50:46 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[df5f2064-9a62-4e47-9ec5-07f7de3e1a44]: (4, 'qcow2') {{(pid=88420) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 11:50:46 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-f67c3940-df4e-41fb-8367-d6ff7ae3cfdf tempest-VolumesSnapshotListTestJSON-1428144267 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-a8c51aa6-93ea-4856-8dee-93372c01ce9d {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:50:46 devstack sudo[97354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-a8c51aa6-93ea-4856-8dee-93372c01ce9d Nov 06 11:50:46 devstack sudo[97354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:50:46 devstack sudo[97354]: pam_unix(sudo:session): session closed for user root Nov 06 11:50:46 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-f67c3940-df4e-41fb-8367-d6ff7ae3cfdf tempest-VolumesSnapshotListTestJSON-1428144267 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-a8c51aa6-93ea-4856-8dee-93372c01ce9d" returned: 0 in 0.449s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:50:46 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-f67c3940-df4e-41fb-8367-d6ff7ae3cfdf tempest-VolumesSnapshotListTestJSON-1428144267 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-a8c51aa6-93ea-4856-8dee-93372c01ce9d {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:50:46 devstack sudo[97363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-a8c51aa6-93ea-4856-8dee-93372c01ce9d Nov 06 11:50:46 devstack sudo[97363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:50:46 devstack sudo[97352]: pam_unix(sudo:session): session closed for user root Nov 06 11:50:46 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-b6969ea3-c183-4039-8bff-9c40163e3dc7 tempest-VolumesTransfersV357Test-1221405526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-f0e56b54-b804-44b5-a48f-87e37fea31c4 1073741824" returned: 0 in 0.624s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:50:46 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-b6969ea3-c183-4039-8bff-9c40163e3dc7 tempest-VolumesTransfersV357Test-1221405526 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-f0e56b54-b804-44b5-a48f-87e37fea31c4 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:50:46 devstack sudo[97365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-f0e56b54-b804-44b5-a48f-87e37fea31c4 Nov 06 11:50:46 devstack sudo[97365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:50:47 devstack sudo[97363]: pam_unix(sudo:session): session closed for user root Nov 06 11:50:47 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-f67c3940-df4e-41fb-8367-d6ff7ae3cfdf tempest-VolumesSnapshotListTestJSON-1428144267 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-a8c51aa6-93ea-4856-8dee-93372c01ce9d" returned: 0 in 0.300s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:50:47 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-f67c3940-df4e-41fb-8367-d6ff7ae3cfdf tempest-VolumesSnapshotListTestJSON-1428144267 None] Lock "cinder-quobyte-a8c51aa6-93ea-4856-8dee-93372c01ce9d" released by "delete_volume" :: held 0.853s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 11:50:47 devstack cinder-volume[87116]: DEBUG cinder.quota [None req-f67c3940-df4e-41fb-8367-d6ff7ae3cfdf tempest-VolumesSnapshotListTestJSON-1428144267 None] Created reservations ['dbe07771-c05b-4806-9442-01f69d5d94fb', 'e9f6b4f9-440d-4d30-8210-247fa65e2787', 'dcd365fa-f168-4b85-b02d-dbd4681672d6', '45845f05-08a9-4be8-8041-af087ff7d796'] {{(pid=87116) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 11:50:47 devstack sudo[97365]: pam_unix(sudo:session): session closed for user root Nov 06 11:50:47 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-f67c3940-df4e-41fb-8367-d6ff7ae3cfdf tempest-VolumesSnapshotListTestJSON-1428144267 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 11:50:47 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-f67c3940-df4e-41fb-8367-d6ff7ae3cfdf tempest-VolumesSnapshotListTestJSON-1428144267 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 11:50:47 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-f67c3940-df4e-41fb-8367-d6ff7ae3cfdf tempest-VolumesSnapshotListTestJSON-1428144267 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 11:50:47 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-f67c3940-df4e-41fb-8367-d6ff7ae3cfdf tempest-VolumesSnapshotListTestJSON-1428144267 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 11:50:47 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-f67c3940-df4e-41fb-8367-d6ff7ae3cfdf tempest-VolumesSnapshotListTestJSON-1428144267 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 11:50:47 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-f67c3940-df4e-41fb-8367-d6ff7ae3cfdf tempest-VolumesSnapshotListTestJSON-1428144267 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:50:47 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-b6969ea3-c183-4039-8bff-9c40163e3dc7 tempest-VolumesTransfersV357Test-1221405526 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-f0e56b54-b804-44b5-a48f-87e37fea31c4" returned: 0 in 0.415s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:50:47 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-b6969ea3-c183-4039-8bff-9c40163e3dc7 tempest-VolumesTransfersV357Test-1221405526 None] <== create_volume: return (1100ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f'} {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 11:50:47 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-b6969ea3-c183-4039-8bff-9c40163e3dc7 tempest-VolumesTransfersV357Test-1221405526 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.103s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 11:50:47 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-b6969ea3-c183-4039-8bff-9c40163e3dc7 tempest-VolumesTransfersV357Test-1221405526 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (91a8356c-5915-47d2-9356-dfe7ef8d5cc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f0e56b54-b804-44b5-a48f-87e37fea31c4', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:50:47 devstack sudo[97369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756 Nov 06 11:50:47 devstack sudo[97369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:50:47 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-b6969ea3-c183-4039-8bff-9c40163e3dc7 tempest-VolumesTransfersV357Test-1221405526 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9deb8703-c4a5-42ef-b712-87543e65be90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:50:47 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-b6969ea3-c183-4039-8bff-9c40163e3dc7 tempest-VolumesTransfersV357Test-1221405526 None] Volume volume-f0e56b54-b804-44b5-a48f-87e37fea31c4 (f0e56b54-b804-44b5-a48f-87e37fea31c4): created successfully Nov 06 11:50:47 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-b6969ea3-c183-4039-8bff-9c40163e3dc7 tempest-VolumesTransfersV357Test-1221405526 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9deb8703-c4a5-42ef-b712-87543e65be90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:50:47 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-b6969ea3-c183-4039-8bff-9c40163e3dc7 tempest-VolumesTransfersV357Test-1221405526 None] Flow 'volume_create_manager' (7288fea9-7b3c-4c4c-b23c-673bbf0a21e0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 11:50:47 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-b6969ea3-c183-4039-8bff-9c40163e3dc7 tempest-VolumesTransfersV357Test-1221405526 None] Created volume successfully. Nov 06 11:50:47 devstack sudo[97369]: pam_unix(sudo:session): session closed for user root Nov 06 11:50:47 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-f67c3940-df4e-41fb-8367-d6ff7ae3cfdf tempest-VolumesSnapshotListTestJSON-1428144267 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756" returned: 0 in 0.289s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:50:47 devstack cinder-volume[87116]: DEBUG cinder.manager [None req-f67c3940-df4e-41fb-8367-d6ff7ae3cfdf tempest-VolumesSnapshotListTestJSON-1428144267 None] Notifying Schedulers of capabilities ... {{(pid=87116) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 11:50:47 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-f67c3940-df4e-41fb-8367-d6ff7ae3cfdf tempest-VolumesSnapshotListTestJSON-1428144267 None] Deleted volume successfully. Nov 06 11:50:47 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-f67c3940-df4e-41fb-8367-d6ff7ae3cfdf tempest-VolumesSnapshotListTestJSON-1428144267 None] Lock "cinder-a8c51aa6-93ea-4856-8dee-93372c01ce9d-delete_volume" released by "delete_volume" :: held 1.546s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 11:50:48 devstack cinder-volume[87116]: DEBUG cinder.volume.flows.manager.create_volume [None req-0fe27c45-cdc4-4782-a39e-35b2f76095fb tempest-VolumeQuotasNegativeTestJSON-143707211 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87116) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 11:50:48 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-0fe27c45-cdc4-4782-a39e-35b2f76095fb tempest-VolumeQuotasNegativeTestJSON-143707211 None] Flow 'volume_create_manager' (72d5d14a-b808-4761-8eb8-3079f50f26af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 11:50:48 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-0fe27c45-cdc4-4782-a39e-35b2f76095fb tempest-VolumeQuotasNegativeTestJSON-143707211 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f88215dd-b9c9-4052-b48e-42daa24294e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:50:48 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-38ed29e6-ab35-43e7-8b8f-931b2555c4c0 tempest-VolumesTransfersV357Test-574463066 None] Acquiring lock "cinder-f0e56b54-b804-44b5-a48f-87e37fea31c4-delete_volume" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 11:50:48 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-38ed29e6-ab35-43e7-8b8f-931b2555c4c0 tempest-VolumesTransfersV357Test-574463066 None] Lock "cinder-f0e56b54-b804-44b5-a48f-87e37fea31c4-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 11:50:48 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-0fe27c45-cdc4-4782-a39e-35b2f76095fb tempest-VolumeQuotasNegativeTestJSON-143707211 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f88215dd-b9c9-4052-b48e-42daa24294e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T10:50:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-56793298',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3ce628f2-f9ef-49cb-bc44-cd43408665eb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='287ebacfdff145559fc32e1a835b6856',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T10:50:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T10:50:48Z,use_quota=True,user_id='6024e18db4d5437280aea2a3e0495796',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(34d3b144-d9b7-480a-a2e3-01e45f3d54c1),volume_type_id=34d3b144-d9b7-480a-a2e3-01e45f3d54c1)' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:50:48 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-0fe27c45-cdc4-4782-a39e-35b2f76095fb tempest-VolumeQuotasNegativeTestJSON-143707211 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (33468c2e-0d3b-42ad-8a4e-5dfaebf54024) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:50:48 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-0fe27c45-cdc4-4782-a39e-35b2f76095fb tempest-VolumeQuotasNegativeTestJSON-143707211 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (33468c2e-0d3b-42ad-8a4e-5dfaebf54024) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:50:48 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-0fe27c45-cdc4-4782-a39e-35b2f76095fb tempest-VolumeQuotasNegativeTestJSON-143707211 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (58931901-e234-44e2-bdd7-9faf97326352) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:50:48 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-0fe27c45-cdc4-4782-a39e-35b2f76095fb tempest-VolumeQuotasNegativeTestJSON-143707211 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (58931901-e234-44e2-bdd7-9faf97326352) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3ce628f2-f9ef-49cb-bc44-cd43408665eb', 'volume_name': 'volume-3ce628f2-f9ef-49cb-bc44-cd43408665eb', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:50:48 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-0fe27c45-cdc4-4782-a39e-35b2f76095fb tempest-VolumeQuotasNegativeTestJSON-143707211 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (79410448-99a5-4a40-a0d3-6e1d8c02ba04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:50:48 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-0fe27c45-cdc4-4782-a39e-35b2f76095fb tempest-VolumeQuotasNegativeTestJSON-143707211 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (79410448-99a5-4a40-a0d3-6e1d8c02ba04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:50:48 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-0fe27c45-cdc4-4782-a39e-35b2f76095fb tempest-VolumeQuotasNegativeTestJSON-143707211 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (14a13f04-81bf-4458-a3d1-bafe206e3235) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:50:48 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-0fe27c45-cdc4-4782-a39e-35b2f76095fb tempest-VolumeQuotasNegativeTestJSON-143707211 None] Volume 3ce628f2-f9ef-49cb-bc44-cd43408665eb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3ce628f2-f9ef-49cb-bc44-cd43408665eb', 'volume_size': 1} Nov 06 11:50:48 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-0fe27c45-cdc4-4782-a39e-35b2f76095fb tempest-VolumeQuotasNegativeTestJSON-143707211 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 11:50:48 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-0fe27c45-cdc4-4782-a39e-35b2f76095fb tempest-VolumeQuotasNegativeTestJSON-143707211 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 11:50:48 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-0fe27c45-cdc4-4782-a39e-35b2f76095fb tempest-VolumeQuotasNegativeTestJSON-143707211 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T10:50:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-56793298',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3ce628f2-f9ef-49cb-bc44-cd43408665eb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='287ebacfdff145559fc32e1a835b6856',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T10:50:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T10:50:48Z,use_quota=True,user_id='6024e18db4d5437280aea2a3e0495796',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(34d3b144-d9b7-480a-a2e3-01e45f3d54c1),volume_type_id=34d3b144-d9b7-480a-a2e3-01e45f3d54c1)}" {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 11:50:48 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-0fe27c45-cdc4-4782-a39e-35b2f76095fb tempest-VolumeQuotasNegativeTestJSON-143707211 None] Creating volume 3ce628f2-f9ef-49cb-bc44-cd43408665eb {{(pid=87116) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 11:50:48 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-0fe27c45-cdc4-4782-a39e-35b2f76095fb tempest-VolumeQuotasNegativeTestJSON-143707211 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 11:50:48 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-0fe27c45-cdc4-4782-a39e-35b2f76095fb tempest-VolumeQuotasNegativeTestJSON-143707211 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 11:50:48 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-0fe27c45-cdc4-4782-a39e-35b2f76095fb tempest-VolumeQuotasNegativeTestJSON-143707211 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 11:50:48 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-0fe27c45-cdc4-4782-a39e-35b2f76095fb tempest-VolumeQuotasNegativeTestJSON-143707211 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 11:50:48 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-0fe27c45-cdc4-4782-a39e-35b2f76095fb tempest-VolumeQuotasNegativeTestJSON-143707211 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 11:50:48 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-0fe27c45-cdc4-4782-a39e-35b2f76095fb tempest-VolumeQuotasNegativeTestJSON-143707211 None] Selected osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f as target Quobyte volume. {{(pid=87116) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 11:50:48 devstack cinder-volume[87116]: INFO cinder.volume.drivers.remotefs [None req-0fe27c45-cdc4-4782-a39e-35b2f76095fb tempest-VolumeQuotasNegativeTestJSON-143707211 None] casted to osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f Nov 06 11:50:48 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-0fe27c45-cdc4-4782-a39e-35b2f76095fb tempest-VolumeQuotasNegativeTestJSON-143707211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-3ce628f2-f9ef-49cb-bc44-cd43408665eb 1073741824 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:50:48 devstack sudo[97372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-3ce628f2-f9ef-49cb-bc44-cd43408665eb 1073741824 Nov 06 11:50:48 devstack sudo[97372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:50:48 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-38ed29e6-ab35-43e7-8b8f-931b2555c4c0 tempest-VolumesTransfersV357Test-574463066 None] Acquiring lock "cinder-quobyte-f0e56b54-b804-44b5-a48f-87e37fea31c4" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 11:50:48 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-38ed29e6-ab35-43e7-8b8f-931b2555c4c0 tempest-VolumesTransfersV357Test-574463066 None] Lock "cinder-quobyte-f0e56b54-b804-44b5-a48f-87e37fea31c4" acquired by "delete_volume" :: waited 0.016s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 11:50:48 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[ceb33f41-8321-4bd6-846e-46c1191fc657]: (4, 'qcow2') {{(pid=88420) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 11:50:48 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-38ed29e6-ab35-43e7-8b8f-931b2555c4c0 tempest-VolumesTransfersV357Test-574463066 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-f0e56b54-b804-44b5-a48f-87e37fea31c4 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:50:48 devstack sudo[97374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-f0e56b54-b804-44b5-a48f-87e37fea31c4 Nov 06 11:50:48 devstack sudo[97374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:50:49 devstack sudo[97372]: pam_unix(sudo:session): session closed for user root Nov 06 11:50:49 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-0fe27c45-cdc4-4782-a39e-35b2f76095fb tempest-VolumeQuotasNegativeTestJSON-143707211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-3ce628f2-f9ef-49cb-bc44-cd43408665eb 1073741824" returned: 0 in 0.517s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:50:49 devstack sudo[97374]: pam_unix(sudo:session): session closed for user root Nov 06 11:50:49 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-38ed29e6-ab35-43e7-8b8f-931b2555c4c0 tempest-VolumesTransfersV357Test-574463066 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-f0e56b54-b804-44b5-a48f-87e37fea31c4" returned: 0 in 0.456s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:50:49 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-38ed29e6-ab35-43e7-8b8f-931b2555c4c0 tempest-VolumesTransfersV357Test-574463066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-f0e56b54-b804-44b5-a48f-87e37fea31c4 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:50:49 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-0fe27c45-cdc4-4782-a39e-35b2f76095fb tempest-VolumeQuotasNegativeTestJSON-143707211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-3ce628f2-f9ef-49cb-bc44-cd43408665eb {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:50:49 devstack sudo[97384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-f0e56b54-b804-44b5-a48f-87e37fea31c4 Nov 06 11:50:49 devstack sudo[97384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:50:49 devstack sudo[97385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-3ce628f2-f9ef-49cb-bc44-cd43408665eb Nov 06 11:50:49 devstack sudo[97385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:50:49 devstack sudo[97385]: pam_unix(sudo:session): session closed for user root Nov 06 11:50:49 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-0fe27c45-cdc4-4782-a39e-35b2f76095fb tempest-VolumeQuotasNegativeTestJSON-143707211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-3ce628f2-f9ef-49cb-bc44-cd43408665eb" returned: 0 in 0.351s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:50:49 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-0fe27c45-cdc4-4782-a39e-35b2f76095fb tempest-VolumeQuotasNegativeTestJSON-143707211 None] <== create_volume: return (933ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f'} {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 11:50:49 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-0fe27c45-cdc4-4782-a39e-35b2f76095fb tempest-VolumeQuotasNegativeTestJSON-143707211 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.935s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 11:50:49 devstack sudo[97384]: pam_unix(sudo:session): session closed for user root Nov 06 11:50:49 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-38ed29e6-ab35-43e7-8b8f-931b2555c4c0 tempest-VolumesTransfersV357Test-574463066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-f0e56b54-b804-44b5-a48f-87e37fea31c4" returned: 0 in 0.371s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:50:49 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-0fe27c45-cdc4-4782-a39e-35b2f76095fb tempest-VolumeQuotasNegativeTestJSON-143707211 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (14a13f04-81bf-4458-a3d1-bafe206e3235) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3ce628f2-f9ef-49cb-bc44-cd43408665eb', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:50:49 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-0fe27c45-cdc4-4782-a39e-35b2f76095fb tempest-VolumeQuotasNegativeTestJSON-143707211 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (472c550a-7d47-4e97-815b-772413749987) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:50:49 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-38ed29e6-ab35-43e7-8b8f-931b2555c4c0 tempest-VolumesTransfersV357Test-574463066 None] Lock "cinder-quobyte-f0e56b54-b804-44b5-a48f-87e37fea31c4" released by "delete_volume" :: held 0.910s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 11:50:49 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-0fe27c45-cdc4-4782-a39e-35b2f76095fb tempest-VolumeQuotasNegativeTestJSON-143707211 None] Volume volume-3ce628f2-f9ef-49cb-bc44-cd43408665eb (3ce628f2-f9ef-49cb-bc44-cd43408665eb): created successfully Nov 06 11:50:49 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-0fe27c45-cdc4-4782-a39e-35b2f76095fb tempest-VolumeQuotasNegativeTestJSON-143707211 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (472c550a-7d47-4e97-815b-772413749987) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:50:49 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-0fe27c45-cdc4-4782-a39e-35b2f76095fb tempest-VolumeQuotasNegativeTestJSON-143707211 None] Flow 'volume_create_manager' (72d5d14a-b808-4761-8eb8-3079f50f26af) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 11:50:49 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-0fe27c45-cdc4-4782-a39e-35b2f76095fb tempest-VolumeQuotasNegativeTestJSON-143707211 None] Created volume successfully. Nov 06 11:50:49 devstack cinder-volume[87116]: DEBUG cinder.quota [None req-38ed29e6-ab35-43e7-8b8f-931b2555c4c0 tempest-VolumesTransfersV357Test-574463066 None] Created reservations ['95923d3d-3e42-4a9b-8576-1f39c45a0888', 'f8ea3e47-cd0a-4761-843d-d0e84790370b', '9ca96f78-dd12-49ec-b987-b4c4d91f645c', '06b85bfe-c237-4e34-9f8b-94f2cec21169'] {{(pid=87116) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 11:50:49 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-38ed29e6-ab35-43e7-8b8f-931b2555c4c0 tempest-VolumesTransfersV357Test-574463066 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 11:50:49 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-38ed29e6-ab35-43e7-8b8f-931b2555c4c0 tempest-VolumesTransfersV357Test-574463066 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 11:50:49 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-38ed29e6-ab35-43e7-8b8f-931b2555c4c0 tempest-VolumesTransfersV357Test-574463066 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 11:50:49 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-38ed29e6-ab35-43e7-8b8f-931b2555c4c0 tempest-VolumesTransfersV357Test-574463066 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 11:50:49 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-38ed29e6-ab35-43e7-8b8f-931b2555c4c0 tempest-VolumesTransfersV357Test-574463066 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 11:50:49 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-38ed29e6-ab35-43e7-8b8f-931b2555c4c0 tempest-VolumesTransfersV357Test-574463066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:50:49 devstack sudo[97391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756 Nov 06 11:50:49 devstack sudo[97391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:50:50 devstack sudo[97391]: pam_unix(sudo:session): session closed for user root Nov 06 11:50:50 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-38ed29e6-ab35-43e7-8b8f-931b2555c4c0 tempest-VolumesTransfersV357Test-574463066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756" returned: 0 in 0.298s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:50:50 devstack cinder-volume[87116]: DEBUG cinder.manager [None req-38ed29e6-ab35-43e7-8b8f-931b2555c4c0 tempest-VolumesTransfersV357Test-574463066 None] Notifying Schedulers of capabilities ... {{(pid=87116) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 11:50:50 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-38ed29e6-ab35-43e7-8b8f-931b2555c4c0 tempest-VolumesTransfersV357Test-574463066 None] Deleted volume successfully. Nov 06 11:50:50 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-38ed29e6-ab35-43e7-8b8f-931b2555c4c0 tempest-VolumesTransfersV357Test-574463066 None] Lock "cinder-f0e56b54-b804-44b5-a48f-87e37fea31c4-delete_volume" released by "delete_volume" :: held 1.571s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 11:50:52 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-16f59ace-4dd1-4574-81db-7339f798a500 tempest-VolumeQuotasNegativeTestJSON-143707211 None] Acquiring lock "cinder-3ce628f2-f9ef-49cb-bc44-cd43408665eb-delete_volume" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 11:50:52 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-16f59ace-4dd1-4574-81db-7339f798a500 tempest-VolumeQuotasNegativeTestJSON-143707211 None] Lock "cinder-3ce628f2-f9ef-49cb-bc44-cd43408665eb-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 11:50:52 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-16f59ace-4dd1-4574-81db-7339f798a500 tempest-VolumeQuotasNegativeTestJSON-143707211 None] Acquiring lock "cinder-quobyte-3ce628f2-f9ef-49cb-bc44-cd43408665eb" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 11:50:52 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-16f59ace-4dd1-4574-81db-7339f798a500 tempest-VolumeQuotasNegativeTestJSON-143707211 None] Lock "cinder-quobyte-3ce628f2-f9ef-49cb-bc44-cd43408665eb" acquired by "delete_volume" :: waited 0.025s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 11:50:52 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff768ec0-a3ef-40f2-a366-f9082c132f82]: (4, 'qcow2') {{(pid=88420) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 11:50:52 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-16f59ace-4dd1-4574-81db-7339f798a500 tempest-VolumeQuotasNegativeTestJSON-143707211 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-3ce628f2-f9ef-49cb-bc44-cd43408665eb {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:50:52 devstack sudo[97395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-3ce628f2-f9ef-49cb-bc44-cd43408665eb Nov 06 11:50:52 devstack sudo[97395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:50:52 devstack sudo[97395]: pam_unix(sudo:session): session closed for user root Nov 06 11:50:52 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-16f59ace-4dd1-4574-81db-7339f798a500 tempest-VolumeQuotasNegativeTestJSON-143707211 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-3ce628f2-f9ef-49cb-bc44-cd43408665eb" returned: 0 in 0.472s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:50:52 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-16f59ace-4dd1-4574-81db-7339f798a500 tempest-VolumeQuotasNegativeTestJSON-143707211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-3ce628f2-f9ef-49cb-bc44-cd43408665eb {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:50:52 devstack sudo[97401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-3ce628f2-f9ef-49cb-bc44-cd43408665eb Nov 06 11:50:52 devstack sudo[97401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:50:53 devstack sudo[97401]: pam_unix(sudo:session): session closed for user root Nov 06 11:50:53 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-16f59ace-4dd1-4574-81db-7339f798a500 tempest-VolumeQuotasNegativeTestJSON-143707211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-3ce628f2-f9ef-49cb-bc44-cd43408665eb" returned: 0 in 0.256s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:50:53 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-16f59ace-4dd1-4574-81db-7339f798a500 tempest-VolumeQuotasNegativeTestJSON-143707211 None] Lock "cinder-quobyte-3ce628f2-f9ef-49cb-bc44-cd43408665eb" released by "delete_volume" :: held 0.792s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 11:50:53 devstack cinder-volume[87116]: DEBUG cinder.quota [None req-16f59ace-4dd1-4574-81db-7339f798a500 tempest-VolumeQuotasNegativeTestJSON-143707211 None] Created reservations ['1cf02b22-614d-4ba3-b4b2-cc5ad82a2bfb', 'abb3fab3-8e01-4ef2-9ec8-2a98cd87d2fd', '9345efe0-d695-44db-a67e-165664ffffa4', '6b8886b6-376a-49b0-b304-23d6fcfb76c4'] {{(pid=87116) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 11:50:53 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-16f59ace-4dd1-4574-81db-7339f798a500 tempest-VolumeQuotasNegativeTestJSON-143707211 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 11:50:53 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-16f59ace-4dd1-4574-81db-7339f798a500 tempest-VolumeQuotasNegativeTestJSON-143707211 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 11:50:53 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-16f59ace-4dd1-4574-81db-7339f798a500 tempest-VolumeQuotasNegativeTestJSON-143707211 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 11:50:53 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-16f59ace-4dd1-4574-81db-7339f798a500 tempest-VolumeQuotasNegativeTestJSON-143707211 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 11:50:53 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-16f59ace-4dd1-4574-81db-7339f798a500 tempest-VolumeQuotasNegativeTestJSON-143707211 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 11:50:53 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-16f59ace-4dd1-4574-81db-7339f798a500 tempest-VolumeQuotasNegativeTestJSON-143707211 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:50:53 devstack sudo[97404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756 Nov 06 11:50:53 devstack sudo[97404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:50:53 devstack sudo[97404]: pam_unix(sudo:session): session closed for user root Nov 06 11:50:53 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-16f59ace-4dd1-4574-81db-7339f798a500 tempest-VolumeQuotasNegativeTestJSON-143707211 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756" returned: 0 in 0.315s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:50:53 devstack cinder-volume[87116]: DEBUG cinder.manager [None req-16f59ace-4dd1-4574-81db-7339f798a500 tempest-VolumeQuotasNegativeTestJSON-143707211 None] Notifying Schedulers of capabilities ... {{(pid=87116) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 11:50:53 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-16f59ace-4dd1-4574-81db-7339f798a500 tempest-VolumeQuotasNegativeTestJSON-143707211 None] Deleted volume successfully. Nov 06 11:50:53 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-16f59ace-4dd1-4574-81db-7339f798a500 tempest-VolumeQuotasNegativeTestJSON-143707211 None] Lock "cinder-3ce628f2-f9ef-49cb-bc44-cd43408665eb-delete_volume" released by "delete_volume" :: held 1.409s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 11:51:00 devstack cinder-volume[87116]: DEBUG cinder.volume.flows.manager.create_volume [None req-b233dce3-c3b5-433f-ac43-55991f5dca99 tempest-VolumeQuotasAdminTestJSON-1817167448 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87116) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 11:51:00 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-b233dce3-c3b5-433f-ac43-55991f5dca99 tempest-VolumeQuotasAdminTestJSON-1817167448 None] Flow 'volume_create_manager' (0ace6e36-a844-4116-b72c-260e44fee25c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 11:51:00 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-b233dce3-c3b5-433f-ac43-55991f5dca99 tempest-VolumeQuotasAdminTestJSON-1817167448 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9d7fd67f-1cc4-47e1-9ddb-7868503492e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:51:00 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-b233dce3-c3b5-433f-ac43-55991f5dca99 tempest-VolumeQuotasAdminTestJSON-1817167448 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9d7fd67f-1cc4-47e1-9ddb-7868503492e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T10:51:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-464009794',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=54f6c7ba-90fc-4fa1-83dd-a99235ff31dd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='34e625b86b62444db1a85966a958c141',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T10:51:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T10:51:00Z,use_quota=True,user_id='5e8dcb8a6aaf4b579c9d6d7b3c5887b9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(34d3b144-d9b7-480a-a2e3-01e45f3d54c1),volume_type_id=34d3b144-d9b7-480a-a2e3-01e45f3d54c1)' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:51:00 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-b233dce3-c3b5-433f-ac43-55991f5dca99 tempest-VolumeQuotasAdminTestJSON-1817167448 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (80dc2c36-f51d-4b9a-8759-80220847cbb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:51:00 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-b233dce3-c3b5-433f-ac43-55991f5dca99 tempest-VolumeQuotasAdminTestJSON-1817167448 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (80dc2c36-f51d-4b9a-8759-80220847cbb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:51:00 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-b233dce3-c3b5-433f-ac43-55991f5dca99 tempest-VolumeQuotasAdminTestJSON-1817167448 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ab99b167-19a3-4433-9f70-d45ada97983d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:51:00 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-b233dce3-c3b5-433f-ac43-55991f5dca99 tempest-VolumeQuotasAdminTestJSON-1817167448 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ab99b167-19a3-4433-9f70-d45ada97983d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '54f6c7ba-90fc-4fa1-83dd-a99235ff31dd', 'volume_name': 'volume-54f6c7ba-90fc-4fa1-83dd-a99235ff31dd', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:51:00 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-b233dce3-c3b5-433f-ac43-55991f5dca99 tempest-VolumeQuotasAdminTestJSON-1817167448 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (403c3f65-625a-4bf0-a194-c77bbca68510) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:51:00 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-b233dce3-c3b5-433f-ac43-55991f5dca99 tempest-VolumeQuotasAdminTestJSON-1817167448 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (403c3f65-625a-4bf0-a194-c77bbca68510) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:51:00 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-b233dce3-c3b5-433f-ac43-55991f5dca99 tempest-VolumeQuotasAdminTestJSON-1817167448 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2d90d8db-3a2f-405b-b86d-50d750e0bc12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:51:00 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-b233dce3-c3b5-433f-ac43-55991f5dca99 tempest-VolumeQuotasAdminTestJSON-1817167448 None] Volume 54f6c7ba-90fc-4fa1-83dd-a99235ff31dd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-54f6c7ba-90fc-4fa1-83dd-a99235ff31dd', 'volume_size': 1} Nov 06 11:51:00 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-b233dce3-c3b5-433f-ac43-55991f5dca99 tempest-VolumeQuotasAdminTestJSON-1817167448 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 11:51:00 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-b233dce3-c3b5-433f-ac43-55991f5dca99 tempest-VolumeQuotasAdminTestJSON-1817167448 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 11:51:00 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-b233dce3-c3b5-433f-ac43-55991f5dca99 tempest-VolumeQuotasAdminTestJSON-1817167448 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T10:51:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-464009794',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=54f6c7ba-90fc-4fa1-83dd-a99235ff31dd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='34e625b86b62444db1a85966a958c141',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T10:51:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T10:51:00Z,use_quota=True,user_id='5e8dcb8a6aaf4b579c9d6d7b3c5887b9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(34d3b144-d9b7-480a-a2e3-01e45f3d54c1),volume_type_id=34d3b144-d9b7-480a-a2e3-01e45f3d54c1)}" {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 11:51:00 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-b233dce3-c3b5-433f-ac43-55991f5dca99 tempest-VolumeQuotasAdminTestJSON-1817167448 None] Creating volume 54f6c7ba-90fc-4fa1-83dd-a99235ff31dd {{(pid=87116) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 11:51:00 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-b233dce3-c3b5-433f-ac43-55991f5dca99 tempest-VolumeQuotasAdminTestJSON-1817167448 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 11:51:00 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-b233dce3-c3b5-433f-ac43-55991f5dca99 tempest-VolumeQuotasAdminTestJSON-1817167448 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 11:51:00 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-b233dce3-c3b5-433f-ac43-55991f5dca99 tempest-VolumeQuotasAdminTestJSON-1817167448 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 11:51:00 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-b233dce3-c3b5-433f-ac43-55991f5dca99 tempest-VolumeQuotasAdminTestJSON-1817167448 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 11:51:00 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-b233dce3-c3b5-433f-ac43-55991f5dca99 tempest-VolumeQuotasAdminTestJSON-1817167448 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 11:51:00 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-b233dce3-c3b5-433f-ac43-55991f5dca99 tempest-VolumeQuotasAdminTestJSON-1817167448 None] Selected osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f as target Quobyte volume. {{(pid=87116) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 11:51:00 devstack cinder-volume[87116]: INFO cinder.volume.drivers.remotefs [None req-b233dce3-c3b5-433f-ac43-55991f5dca99 tempest-VolumeQuotasAdminTestJSON-1817167448 None] casted to osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f Nov 06 11:51:00 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-b233dce3-c3b5-433f-ac43-55991f5dca99 tempest-VolumeQuotasAdminTestJSON-1817167448 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-54f6c7ba-90fc-4fa1-83dd-a99235ff31dd 1073741824 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:51:00 devstack sudo[97407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-54f6c7ba-90fc-4fa1-83dd-a99235ff31dd 1073741824 Nov 06 11:51:00 devstack sudo[97407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:51:01 devstack sudo[97407]: pam_unix(sudo:session): session closed for user root Nov 06 11:51:01 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-b233dce3-c3b5-433f-ac43-55991f5dca99 tempest-VolumeQuotasAdminTestJSON-1817167448 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-54f6c7ba-90fc-4fa1-83dd-a99235ff31dd 1073741824" returned: 0 in 0.677s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:51:01 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-b233dce3-c3b5-433f-ac43-55991f5dca99 tempest-VolumeQuotasAdminTestJSON-1817167448 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-54f6c7ba-90fc-4fa1-83dd-a99235ff31dd {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:51:01 devstack sudo[97413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-54f6c7ba-90fc-4fa1-83dd-a99235ff31dd Nov 06 11:51:01 devstack sudo[97413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:51:01 devstack sudo[97413]: pam_unix(sudo:session): session closed for user root Nov 06 11:51:01 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-b233dce3-c3b5-433f-ac43-55991f5dca99 tempest-VolumeQuotasAdminTestJSON-1817167448 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-54f6c7ba-90fc-4fa1-83dd-a99235ff31dd" returned: 0 in 0.349s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:51:01 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-b233dce3-c3b5-433f-ac43-55991f5dca99 tempest-VolumeQuotasAdminTestJSON-1817167448 None] <== create_volume: return (1093ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f'} {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 11:51:01 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-b233dce3-c3b5-433f-ac43-55991f5dca99 tempest-VolumeQuotasAdminTestJSON-1817167448 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.096s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 11:51:01 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-b233dce3-c3b5-433f-ac43-55991f5dca99 tempest-VolumeQuotasAdminTestJSON-1817167448 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2d90d8db-3a2f-405b-b86d-50d750e0bc12) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-54f6c7ba-90fc-4fa1-83dd-a99235ff31dd', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:51:01 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-b233dce3-c3b5-433f-ac43-55991f5dca99 tempest-VolumeQuotasAdminTestJSON-1817167448 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b50b06b6-ebe0-4b73-9d3b-b34ce5abad9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:51:01 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-b233dce3-c3b5-433f-ac43-55991f5dca99 tempest-VolumeQuotasAdminTestJSON-1817167448 None] Volume volume-54f6c7ba-90fc-4fa1-83dd-a99235ff31dd (54f6c7ba-90fc-4fa1-83dd-a99235ff31dd): created successfully Nov 06 11:51:01 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-b233dce3-c3b5-433f-ac43-55991f5dca99 tempest-VolumeQuotasAdminTestJSON-1817167448 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b50b06b6-ebe0-4b73-9d3b-b34ce5abad9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:51:01 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-b233dce3-c3b5-433f-ac43-55991f5dca99 tempest-VolumeQuotasAdminTestJSON-1817167448 None] Flow 'volume_create_manager' (0ace6e36-a844-4116-b72c-260e44fee25c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 11:51:01 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-b233dce3-c3b5-433f-ac43-55991f5dca99 tempest-VolumeQuotasAdminTestJSON-1817167448 None] Created volume successfully. Nov 06 11:51:02 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-b4627a59-85d9-4702-a6d0-14a08e3e4f1c tempest-VolumeQuotasAdminTestJSON-1817167448 None] Acquiring lock "cinder-54f6c7ba-90fc-4fa1-83dd-a99235ff31dd-delete_volume" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 11:51:02 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-b4627a59-85d9-4702-a6d0-14a08e3e4f1c tempest-VolumeQuotasAdminTestJSON-1817167448 None] Lock "cinder-54f6c7ba-90fc-4fa1-83dd-a99235ff31dd-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 11:51:02 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-b4627a59-85d9-4702-a6d0-14a08e3e4f1c tempest-VolumeQuotasAdminTestJSON-1817167448 None] Acquiring lock "cinder-quobyte-54f6c7ba-90fc-4fa1-83dd-a99235ff31dd" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 11:51:02 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-b4627a59-85d9-4702-a6d0-14a08e3e4f1c tempest-VolumeQuotasAdminTestJSON-1817167448 None] Lock "cinder-quobyte-54f6c7ba-90fc-4fa1-83dd-a99235ff31dd" acquired by "delete_volume" :: waited 0.021s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 11:51:02 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c2e01a0-96f2-4c10-9f40-4681755cefa5]: (4, 'qcow2') {{(pid=88420) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 11:51:02 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-b4627a59-85d9-4702-a6d0-14a08e3e4f1c tempest-VolumeQuotasAdminTestJSON-1817167448 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-54f6c7ba-90fc-4fa1-83dd-a99235ff31dd {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:51:02 devstack sudo[97417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-54f6c7ba-90fc-4fa1-83dd-a99235ff31dd Nov 06 11:51:02 devstack sudo[97417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:51:03 devstack sudo[97417]: pam_unix(sudo:session): session closed for user root Nov 06 11:51:03 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-b4627a59-85d9-4702-a6d0-14a08e3e4f1c tempest-VolumeQuotasAdminTestJSON-1817167448 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-54f6c7ba-90fc-4fa1-83dd-a99235ff31dd" returned: 0 in 0.575s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:51:03 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-b4627a59-85d9-4702-a6d0-14a08e3e4f1c tempest-VolumeQuotasAdminTestJSON-1817167448 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-54f6c7ba-90fc-4fa1-83dd-a99235ff31dd {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:51:03 devstack sudo[97423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-54f6c7ba-90fc-4fa1-83dd-a99235ff31dd Nov 06 11:51:03 devstack sudo[97423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:51:03 devstack cinder-volume[87116]: DEBUG cinder.volume.flows.manager.create_volume [None req-0ba5dc64-52b9-40ec-92f9-d4aca280c025 tempest-VolumeRetypeWithoutMigrationTest-1660436780 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87116) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 11:51:03 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-0ba5dc64-52b9-40ec-92f9-d4aca280c025 tempest-VolumeRetypeWithoutMigrationTest-1660436780 None] Flow 'volume_create_manager' (987b29b9-4b74-406d-aba5-fd51c1f0ffb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 11:51:03 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-0ba5dc64-52b9-40ec-92f9-d4aca280c025 tempest-VolumeRetypeWithoutMigrationTest-1660436780 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (06873722-e679-4b31-9342-5275e98a0ea8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:51:03 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-0ba5dc64-52b9-40ec-92f9-d4aca280c025 tempest-VolumeRetypeWithoutMigrationTest-1660436780 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (06873722-e679-4b31-9342-5275e98a0ea8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T10:51:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-860125403',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7243360a-5233-4e4e-8824-a65bc5129f0a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eb2d772d7c2e4b3f95ed0ab39c403523',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T10:51:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T10:51:03Z,use_quota=True,user_id='4e230770d9e3411b9a87d5018fe5eb63',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b336ff72-7e7e-4a3e-a327-bae109287248),volume_type_id=b336ff72-7e7e-4a3e-a327-bae109287248)' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:51:03 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-0ba5dc64-52b9-40ec-92f9-d4aca280c025 tempest-VolumeRetypeWithoutMigrationTest-1660436780 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0a2b2d43-cc2f-431d-96cf-94be822fb58c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:51:03 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-0ba5dc64-52b9-40ec-92f9-d4aca280c025 tempest-VolumeRetypeWithoutMigrationTest-1660436780 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0a2b2d43-cc2f-431d-96cf-94be822fb58c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:51:03 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-0ba5dc64-52b9-40ec-92f9-d4aca280c025 tempest-VolumeRetypeWithoutMigrationTest-1660436780 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (06f3b7b0-1fc4-4546-b386-69f22f8efd6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:51:03 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-0ba5dc64-52b9-40ec-92f9-d4aca280c025 tempest-VolumeRetypeWithoutMigrationTest-1660436780 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (06f3b7b0-1fc4-4546-b386-69f22f8efd6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7243360a-5233-4e4e-8824-a65bc5129f0a', 'volume_name': 'volume-7243360a-5233-4e4e-8824-a65bc5129f0a', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:51:03 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-0ba5dc64-52b9-40ec-92f9-d4aca280c025 tempest-VolumeRetypeWithoutMigrationTest-1660436780 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d2b1a20a-b2c5-4c79-9f0c-4c19ddaba794) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:51:03 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-0ba5dc64-52b9-40ec-92f9-d4aca280c025 tempest-VolumeRetypeWithoutMigrationTest-1660436780 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d2b1a20a-b2c5-4c79-9f0c-4c19ddaba794) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:51:03 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-0ba5dc64-52b9-40ec-92f9-d4aca280c025 tempest-VolumeRetypeWithoutMigrationTest-1660436780 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b9f81c31-f76b-46f3-b75e-e3aa7c4e11dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:51:03 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-0ba5dc64-52b9-40ec-92f9-d4aca280c025 tempest-VolumeRetypeWithoutMigrationTest-1660436780 None] Volume 7243360a-5233-4e4e-8824-a65bc5129f0a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7243360a-5233-4e4e-8824-a65bc5129f0a', 'volume_size': 1} Nov 06 11:51:03 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-0ba5dc64-52b9-40ec-92f9-d4aca280c025 tempest-VolumeRetypeWithoutMigrationTest-1660436780 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 11:51:03 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-0ba5dc64-52b9-40ec-92f9-d4aca280c025 tempest-VolumeRetypeWithoutMigrationTest-1660436780 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 11:51:03 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-0ba5dc64-52b9-40ec-92f9-d4aca280c025 tempest-VolumeRetypeWithoutMigrationTest-1660436780 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T10:51:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-860125403',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7243360a-5233-4e4e-8824-a65bc5129f0a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eb2d772d7c2e4b3f95ed0ab39c403523',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T10:51:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T10:51:03Z,use_quota=True,user_id='4e230770d9e3411b9a87d5018fe5eb63',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b336ff72-7e7e-4a3e-a327-bae109287248),volume_type_id=b336ff72-7e7e-4a3e-a327-bae109287248)}" {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 11:51:03 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-0ba5dc64-52b9-40ec-92f9-d4aca280c025 tempest-VolumeRetypeWithoutMigrationTest-1660436780 None] Creating volume 7243360a-5233-4e4e-8824-a65bc5129f0a {{(pid=87116) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 11:51:03 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-0ba5dc64-52b9-40ec-92f9-d4aca280c025 tempest-VolumeRetypeWithoutMigrationTest-1660436780 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 11:51:03 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-0ba5dc64-52b9-40ec-92f9-d4aca280c025 tempest-VolumeRetypeWithoutMigrationTest-1660436780 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 11:51:03 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-0ba5dc64-52b9-40ec-92f9-d4aca280c025 tempest-VolumeRetypeWithoutMigrationTest-1660436780 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 11:51:03 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-0ba5dc64-52b9-40ec-92f9-d4aca280c025 tempest-VolumeRetypeWithoutMigrationTest-1660436780 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 11:51:03 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-0ba5dc64-52b9-40ec-92f9-d4aca280c025 tempest-VolumeRetypeWithoutMigrationTest-1660436780 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 11:51:03 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-0ba5dc64-52b9-40ec-92f9-d4aca280c025 tempest-VolumeRetypeWithoutMigrationTest-1660436780 None] Selected osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f as target Quobyte volume. {{(pid=87116) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 11:51:03 devstack cinder-volume[87116]: INFO cinder.volume.drivers.remotefs [None req-0ba5dc64-52b9-40ec-92f9-d4aca280c025 tempest-VolumeRetypeWithoutMigrationTest-1660436780 None] casted to osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f Nov 06 11:51:03 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-0ba5dc64-52b9-40ec-92f9-d4aca280c025 tempest-VolumeRetypeWithoutMigrationTest-1660436780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-7243360a-5233-4e4e-8824-a65bc5129f0a 1073741824 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:51:03 devstack sudo[97425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-7243360a-5233-4e4e-8824-a65bc5129f0a 1073741824 Nov 06 11:51:03 devstack sudo[97425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:51:03 devstack sudo[97423]: pam_unix(sudo:session): session closed for user root Nov 06 11:51:03 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-b4627a59-85d9-4702-a6d0-14a08e3e4f1c tempest-VolumeQuotasAdminTestJSON-1817167448 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-54f6c7ba-90fc-4fa1-83dd-a99235ff31dd" returned: 0 in 0.380s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:51:03 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-b4627a59-85d9-4702-a6d0-14a08e3e4f1c tempest-VolumeQuotasAdminTestJSON-1817167448 None] Lock "cinder-quobyte-54f6c7ba-90fc-4fa1-83dd-a99235ff31dd" released by "delete_volume" :: held 1.037s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 11:51:03 devstack cinder-volume[87116]: DEBUG cinder.quota [None req-b4627a59-85d9-4702-a6d0-14a08e3e4f1c tempest-VolumeQuotasAdminTestJSON-1817167448 None] Created reservations ['c1ab5b39-9151-45b5-95df-c75978226ce5', '265f4ce7-590c-42d7-af11-91a8f8057525', '1b3c979d-74f0-4a09-8029-ea922485af19', 'd064fe7d-9a2c-4c68-b128-da29a80c6157'] {{(pid=87116) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 11:51:03 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-b4627a59-85d9-4702-a6d0-14a08e3e4f1c tempest-VolumeQuotasAdminTestJSON-1817167448 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 11:51:03 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-b4627a59-85d9-4702-a6d0-14a08e3e4f1c tempest-VolumeQuotasAdminTestJSON-1817167448 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 11:51:03 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-b4627a59-85d9-4702-a6d0-14a08e3e4f1c tempest-VolumeQuotasAdminTestJSON-1817167448 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 11:51:03 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-b4627a59-85d9-4702-a6d0-14a08e3e4f1c tempest-VolumeQuotasAdminTestJSON-1817167448 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 11:51:03 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-b4627a59-85d9-4702-a6d0-14a08e3e4f1c tempest-VolumeQuotasAdminTestJSON-1817167448 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 11:51:03 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-b4627a59-85d9-4702-a6d0-14a08e3e4f1c tempest-VolumeQuotasAdminTestJSON-1817167448 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:51:03 devstack sudo[97431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756 Nov 06 11:51:03 devstack sudo[97431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:51:04 devstack sudo[97425]: pam_unix(sudo:session): session closed for user root Nov 06 11:51:04 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-0ba5dc64-52b9-40ec-92f9-d4aca280c025 tempest-VolumeRetypeWithoutMigrationTest-1660436780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-7243360a-5233-4e4e-8824-a65bc5129f0a 1073741824" returned: 0 in 0.584s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:51:04 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-0ba5dc64-52b9-40ec-92f9-d4aca280c025 tempest-VolumeRetypeWithoutMigrationTest-1660436780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-7243360a-5233-4e4e-8824-a65bc5129f0a {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:51:04 devstack sudo[97434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-7243360a-5233-4e4e-8824-a65bc5129f0a Nov 06 11:51:04 devstack sudo[97434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:51:04 devstack sudo[97431]: pam_unix(sudo:session): session closed for user root Nov 06 11:51:04 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-b4627a59-85d9-4702-a6d0-14a08e3e4f1c tempest-VolumeQuotasAdminTestJSON-1817167448 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756" returned: 0 in 0.339s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:51:04 devstack cinder-volume[87116]: DEBUG cinder.manager [None req-b4627a59-85d9-4702-a6d0-14a08e3e4f1c tempest-VolumeQuotasAdminTestJSON-1817167448 None] Notifying Schedulers of capabilities ... {{(pid=87116) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 11:51:04 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-b4627a59-85d9-4702-a6d0-14a08e3e4f1c tempest-VolumeQuotasAdminTestJSON-1817167448 None] Deleted volume successfully. Nov 06 11:51:04 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-b4627a59-85d9-4702-a6d0-14a08e3e4f1c tempest-VolumeQuotasAdminTestJSON-1817167448 None] Lock "cinder-54f6c7ba-90fc-4fa1-83dd-a99235ff31dd-delete_volume" released by "delete_volume" :: held 1.656s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 11:51:04 devstack sudo[97434]: pam_unix(sudo:session): session closed for user root Nov 06 11:51:04 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-0ba5dc64-52b9-40ec-92f9-d4aca280c025 tempest-VolumeRetypeWithoutMigrationTest-1660436780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-7243360a-5233-4e4e-8824-a65bc5129f0a" returned: 0 in 0.330s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:51:04 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-0ba5dc64-52b9-40ec-92f9-d4aca280c025 tempest-VolumeRetypeWithoutMigrationTest-1660436780 None] <== create_volume: return (983ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f'} {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 11:51:04 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-0ba5dc64-52b9-40ec-92f9-d4aca280c025 tempest-VolumeRetypeWithoutMigrationTest-1660436780 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.986s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 11:51:04 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-0ba5dc64-52b9-40ec-92f9-d4aca280c025 tempest-VolumeRetypeWithoutMigrationTest-1660436780 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b9f81c31-f76b-46f3-b75e-e3aa7c4e11dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7243360a-5233-4e4e-8824-a65bc5129f0a', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:51:04 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-0ba5dc64-52b9-40ec-92f9-d4aca280c025 tempest-VolumeRetypeWithoutMigrationTest-1660436780 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2475a9a4-1470-434d-b290-914229cb5554) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:51:04 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-0ba5dc64-52b9-40ec-92f9-d4aca280c025 tempest-VolumeRetypeWithoutMigrationTest-1660436780 None] Volume volume-7243360a-5233-4e4e-8824-a65bc5129f0a (7243360a-5233-4e4e-8824-a65bc5129f0a): created successfully Nov 06 11:51:04 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-0ba5dc64-52b9-40ec-92f9-d4aca280c025 tempest-VolumeRetypeWithoutMigrationTest-1660436780 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2475a9a4-1470-434d-b290-914229cb5554) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:51:04 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-0ba5dc64-52b9-40ec-92f9-d4aca280c025 tempest-VolumeRetypeWithoutMigrationTest-1660436780 None] Flow 'volume_create_manager' (987b29b9-4b74-406d-aba5-fd51c1f0ffb8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 11:51:04 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-0ba5dc64-52b9-40ec-92f9-d4aca280c025 tempest-VolumeRetypeWithoutMigrationTest-1660436780 None] Created volume successfully. Nov 06 11:51:05 devstack cinder-volume[87116]: DEBUG cinder.volume.flows.manager.create_volume [None req-9190f410-6f70-414d-a5c6-0bfb84fb589b tempest-VolumeQuotasAdminTestJSON-1817167448 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87116) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 11:51:05 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-9190f410-6f70-414d-a5c6-0bfb84fb589b tempest-VolumeQuotasAdminTestJSON-1817167448 None] Flow 'volume_create_manager' (db0ebe83-a2bc-419b-906e-38aef8a0b44b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 11:51:05 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-9190f410-6f70-414d-a5c6-0bfb84fb589b tempest-VolumeQuotasAdminTestJSON-1817167448 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a5dd600a-3744-42c7-b3e1-fa1d896498fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:51:05 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-9190f410-6f70-414d-a5c6-0bfb84fb589b tempest-VolumeQuotasAdminTestJSON-1817167448 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a5dd600a-3744-42c7-b3e1-fa1d896498fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T10:51:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-679107417',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e17a22d1-ae57-461a-a390-322e567433b4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='34e625b86b62444db1a85966a958c141',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T10:51:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T10:51:06Z,use_quota=True,user_id='5e8dcb8a6aaf4b579c9d6d7b3c5887b9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(34d3b144-d9b7-480a-a2e3-01e45f3d54c1),volume_type_id=34d3b144-d9b7-480a-a2e3-01e45f3d54c1)' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:51:05 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-9190f410-6f70-414d-a5c6-0bfb84fb589b tempest-VolumeQuotasAdminTestJSON-1817167448 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f9c6ed31-5358-473c-bd0f-10e6ea445c7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:51:05 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-9190f410-6f70-414d-a5c6-0bfb84fb589b tempest-VolumeQuotasAdminTestJSON-1817167448 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f9c6ed31-5358-473c-bd0f-10e6ea445c7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:51:05 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-9190f410-6f70-414d-a5c6-0bfb84fb589b tempest-VolumeQuotasAdminTestJSON-1817167448 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (22a5694b-492a-46c8-bd9c-46fb1be45245) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:51:05 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-9190f410-6f70-414d-a5c6-0bfb84fb589b tempest-VolumeQuotasAdminTestJSON-1817167448 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (22a5694b-492a-46c8-bd9c-46fb1be45245) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e17a22d1-ae57-461a-a390-322e567433b4', 'volume_name': 'volume-e17a22d1-ae57-461a-a390-322e567433b4', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:51:05 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-9190f410-6f70-414d-a5c6-0bfb84fb589b tempest-VolumeQuotasAdminTestJSON-1817167448 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fced7fdf-0b99-46db-afdf-dc2ec18d6fa1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:51:05 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-9190f410-6f70-414d-a5c6-0bfb84fb589b tempest-VolumeQuotasAdminTestJSON-1817167448 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fced7fdf-0b99-46db-afdf-dc2ec18d6fa1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:51:05 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-9190f410-6f70-414d-a5c6-0bfb84fb589b tempest-VolumeQuotasAdminTestJSON-1817167448 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7e5b48f9-0517-4a0b-9e7b-80c1556d8229) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:51:05 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-9190f410-6f70-414d-a5c6-0bfb84fb589b tempest-VolumeQuotasAdminTestJSON-1817167448 None] Volume e17a22d1-ae57-461a-a390-322e567433b4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e17a22d1-ae57-461a-a390-322e567433b4', 'volume_size': 1} Nov 06 11:51:05 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-9190f410-6f70-414d-a5c6-0bfb84fb589b tempest-VolumeQuotasAdminTestJSON-1817167448 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 11:51:05 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-9190f410-6f70-414d-a5c6-0bfb84fb589b tempest-VolumeQuotasAdminTestJSON-1817167448 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 11:51:05 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-9190f410-6f70-414d-a5c6-0bfb84fb589b tempest-VolumeQuotasAdminTestJSON-1817167448 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T10:51:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-679107417',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e17a22d1-ae57-461a-a390-322e567433b4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='34e625b86b62444db1a85966a958c141',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T10:51:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T10:51:06Z,use_quota=True,user_id='5e8dcb8a6aaf4b579c9d6d7b3c5887b9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(34d3b144-d9b7-480a-a2e3-01e45f3d54c1),volume_type_id=34d3b144-d9b7-480a-a2e3-01e45f3d54c1)}" {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 11:51:05 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-9190f410-6f70-414d-a5c6-0bfb84fb589b tempest-VolumeQuotasAdminTestJSON-1817167448 None] Creating volume e17a22d1-ae57-461a-a390-322e567433b4 {{(pid=87116) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 11:51:05 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-9190f410-6f70-414d-a5c6-0bfb84fb589b tempest-VolumeQuotasAdminTestJSON-1817167448 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 11:51:05 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-9190f410-6f70-414d-a5c6-0bfb84fb589b tempest-VolumeQuotasAdminTestJSON-1817167448 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 11:51:05 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-9190f410-6f70-414d-a5c6-0bfb84fb589b tempest-VolumeQuotasAdminTestJSON-1817167448 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 11:51:05 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-9190f410-6f70-414d-a5c6-0bfb84fb589b tempest-VolumeQuotasAdminTestJSON-1817167448 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 11:51:05 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-9190f410-6f70-414d-a5c6-0bfb84fb589b tempest-VolumeQuotasAdminTestJSON-1817167448 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 11:51:05 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-9190f410-6f70-414d-a5c6-0bfb84fb589b tempest-VolumeQuotasAdminTestJSON-1817167448 None] Selected osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f as target Quobyte volume. {{(pid=87116) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 11:51:05 devstack cinder-volume[87116]: INFO cinder.volume.drivers.remotefs [None req-9190f410-6f70-414d-a5c6-0bfb84fb589b tempest-VolumeQuotasAdminTestJSON-1817167448 None] casted to osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f Nov 06 11:51:05 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-9190f410-6f70-414d-a5c6-0bfb84fb589b tempest-VolumeQuotasAdminTestJSON-1817167448 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-e17a22d1-ae57-461a-a390-322e567433b4 1073741824 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:51:05 devstack sudo[97438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-e17a22d1-ae57-461a-a390-322e567433b4 1073741824 Nov 06 11:51:05 devstack sudo[97438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:51:06 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-0dc42c7a-6593-462a-92dc-a8b510058fe0 tempest-VolumeRetypeWithoutMigrationTest-1660436780 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 11:51:06 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-0dc42c7a-6593-462a-92dc-a8b510058fe0 tempest-VolumeRetypeWithoutMigrationTest-1660436780 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 11:51:06 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-0dc42c7a-6593-462a-92dc-a8b510058fe0 tempest-VolumeRetypeWithoutMigrationTest-1660436780 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 11:51:06 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-0dc42c7a-6593-462a-92dc-a8b510058fe0 tempest-VolumeRetypeWithoutMigrationTest-1660436780 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 11:51:06 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-0dc42c7a-6593-462a-92dc-a8b510058fe0 tempest-VolumeRetypeWithoutMigrationTest-1660436780 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 11:51:06 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-0dc42c7a-6593-462a-92dc-a8b510058fe0 tempest-VolumeRetypeWithoutMigrationTest-1660436780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:51:06 devstack sudo[97440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756 Nov 06 11:51:06 devstack sudo[97440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:51:06 devstack cinder-volume[87116]: DEBUG cinder.volume.flows.manager.create_volume [None req-1435ed33-b69a-438e-b200-9a6e3a8aee64 tempest-VolumesListTestJSON-920108207 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87116) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 11:51:06 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-1435ed33-b69a-438e-b200-9a6e3a8aee64 tempest-VolumesListTestJSON-920108207 None] Flow 'volume_create_manager' (ce213fe9-5563-4a33-8b91-9ca0d49c88ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 11:51:06 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-1435ed33-b69a-438e-b200-9a6e3a8aee64 tempest-VolumesListTestJSON-920108207 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4b25cf1d-6e56-46ac-8836-9d086e77f100) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:51:06 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-1435ed33-b69a-438e-b200-9a6e3a8aee64 tempest-VolumesListTestJSON-920108207 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4b25cf1d-6e56-46ac-8836-9d086e77f100) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T10:51:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-234777073',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=31905d79-a881-4485-a424-3b0ff32792c5,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='dbbcf6116f0140eab870976e8cf091b5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T10:51:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T10:51:06Z,use_quota=True,user_id='a588beaf1076427392f90961dd90131a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(34d3b144-d9b7-480a-a2e3-01e45f3d54c1),volume_type_id=34d3b144-d9b7-480a-a2e3-01e45f3d54c1)' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:51:06 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-1435ed33-b69a-438e-b200-9a6e3a8aee64 tempest-VolumesListTestJSON-920108207 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (33c3556e-f32d-4ad1-b9fb-a29e339a963c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:51:06 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-1435ed33-b69a-438e-b200-9a6e3a8aee64 tempest-VolumesListTestJSON-920108207 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (33c3556e-f32d-4ad1-b9fb-a29e339a963c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:51:06 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-1435ed33-b69a-438e-b200-9a6e3a8aee64 tempest-VolumesListTestJSON-920108207 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9920e67a-f065-4dd9-97d2-4187eb7d4fd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:51:06 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-1435ed33-b69a-438e-b200-9a6e3a8aee64 tempest-VolumesListTestJSON-920108207 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9920e67a-f065-4dd9-97d2-4187eb7d4fd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '31905d79-a881-4485-a424-3b0ff32792c5', 'volume_name': 'volume-31905d79-a881-4485-a424-3b0ff32792c5', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:51:06 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-1435ed33-b69a-438e-b200-9a6e3a8aee64 tempest-VolumesListTestJSON-920108207 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (238c0814-ee3c-401c-b814-18da8899eda5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:51:06 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-1435ed33-b69a-438e-b200-9a6e3a8aee64 tempest-VolumesListTestJSON-920108207 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (238c0814-ee3c-401c-b814-18da8899eda5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:51:06 devstack sudo[97440]: pam_unix(sudo:session): session closed for user root Nov 06 11:51:06 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-1435ed33-b69a-438e-b200-9a6e3a8aee64 tempest-VolumesListTestJSON-920108207 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3ba8df1a-8474-47e3-be99-dd90d3e2ad2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:51:06 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-1435ed33-b69a-438e-b200-9a6e3a8aee64 tempest-VolumesListTestJSON-920108207 None] Volume 31905d79-a881-4485-a424-3b0ff32792c5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-31905d79-a881-4485-a424-3b0ff32792c5', 'volume_size': 1} Nov 06 11:51:06 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-1435ed33-b69a-438e-b200-9a6e3a8aee64 tempest-VolumesListTestJSON-920108207 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 11:51:06 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-0dc42c7a-6593-462a-92dc-a8b510058fe0 tempest-VolumeRetypeWithoutMigrationTest-1660436780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756" returned: 0 in 0.327s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:51:06 devstack cinder-volume[87116]: DEBUG cinder.manager [None req-0dc42c7a-6593-462a-92dc-a8b510058fe0 tempest-VolumeRetypeWithoutMigrationTest-1660436780 None] Notifying Schedulers of capabilities ... {{(pid=87116) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 11:51:06 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-0dc42c7a-6593-462a-92dc-a8b510058fe0 tempest-VolumeRetypeWithoutMigrationTest-1660436780 None] Retype volume completed successfully. Nov 06 11:51:06 devstack sudo[97438]: pam_unix(sudo:session): session closed for user root Nov 06 11:51:06 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-9190f410-6f70-414d-a5c6-0bfb84fb589b tempest-VolumeQuotasAdminTestJSON-1817167448 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-e17a22d1-ae57-461a-a390-322e567433b4 1073741824" returned: 0 in 0.670s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:51:06 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-9190f410-6f70-414d-a5c6-0bfb84fb589b tempest-VolumeQuotasAdminTestJSON-1817167448 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-e17a22d1-ae57-461a-a390-322e567433b4 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:51:06 devstack sudo[97447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-e17a22d1-ae57-461a-a390-322e567433b4 Nov 06 11:51:06 devstack sudo[97447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:51:06 devstack sudo[97447]: pam_unix(sudo:session): session closed for user root Nov 06 11:51:06 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-9190f410-6f70-414d-a5c6-0bfb84fb589b tempest-VolumeQuotasAdminTestJSON-1817167448 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-e17a22d1-ae57-461a-a390-322e567433b4" returned: 0 in 0.241s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:51:06 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-9190f410-6f70-414d-a5c6-0bfb84fb589b tempest-VolumeQuotasAdminTestJSON-1817167448 None] <== create_volume: return (955ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f'} {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 11:51:06 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-9190f410-6f70-414d-a5c6-0bfb84fb589b tempest-VolumeQuotasAdminTestJSON-1817167448 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.958s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 11:51:06 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-1435ed33-b69a-438e-b200-9a6e3a8aee64 tempest-VolumesListTestJSON-920108207 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.329s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 11:51:06 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-1435ed33-b69a-438e-b200-9a6e3a8aee64 tempest-VolumesListTestJSON-920108207 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T10:51:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-234777073',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=31905d79-a881-4485-a424-3b0ff32792c5,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='dbbcf6116f0140eab870976e8cf091b5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T10:51:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T10:51:06Z,use_quota=True,user_id='a588beaf1076427392f90961dd90131a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(34d3b144-d9b7-480a-a2e3-01e45f3d54c1),volume_type_id=34d3b144-d9b7-480a-a2e3-01e45f3d54c1)}" {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 11:51:06 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-1435ed33-b69a-438e-b200-9a6e3a8aee64 tempest-VolumesListTestJSON-920108207 None] Creating volume 31905d79-a881-4485-a424-3b0ff32792c5 {{(pid=87116) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 11:51:06 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-1435ed33-b69a-438e-b200-9a6e3a8aee64 tempest-VolumesListTestJSON-920108207 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 11:51:06 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-1435ed33-b69a-438e-b200-9a6e3a8aee64 tempest-VolumesListTestJSON-920108207 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 11:51:06 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-1435ed33-b69a-438e-b200-9a6e3a8aee64 tempest-VolumesListTestJSON-920108207 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 11:51:06 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-1435ed33-b69a-438e-b200-9a6e3a8aee64 tempest-VolumesListTestJSON-920108207 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 11:51:06 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-1435ed33-b69a-438e-b200-9a6e3a8aee64 tempest-VolumesListTestJSON-920108207 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 11:51:06 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-1435ed33-b69a-438e-b200-9a6e3a8aee64 tempest-VolumesListTestJSON-920108207 None] Selected osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f as target Quobyte volume. {{(pid=87116) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 11:51:06 devstack cinder-volume[87116]: INFO cinder.volume.drivers.remotefs [None req-1435ed33-b69a-438e-b200-9a6e3a8aee64 tempest-VolumesListTestJSON-920108207 None] casted to osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f Nov 06 11:51:06 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-1435ed33-b69a-438e-b200-9a6e3a8aee64 tempest-VolumesListTestJSON-920108207 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-31905d79-a881-4485-a424-3b0ff32792c5 1073741824 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:51:06 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-9190f410-6f70-414d-a5c6-0bfb84fb589b tempest-VolumeQuotasAdminTestJSON-1817167448 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7e5b48f9-0517-4a0b-9e7b-80c1556d8229) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e17a22d1-ae57-461a-a390-322e567433b4', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:51:06 devstack sudo[97450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-31905d79-a881-4485-a424-3b0ff32792c5 1073741824 Nov 06 11:51:06 devstack sudo[97450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:51:06 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-9190f410-6f70-414d-a5c6-0bfb84fb589b tempest-VolumeQuotasAdminTestJSON-1817167448 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (263b0d66-a98b-4aad-8de5-ba2be1b5bb40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:51:06 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-9190f410-6f70-414d-a5c6-0bfb84fb589b tempest-VolumeQuotasAdminTestJSON-1817167448 None] Volume volume-e17a22d1-ae57-461a-a390-322e567433b4 (e17a22d1-ae57-461a-a390-322e567433b4): created successfully Nov 06 11:51:06 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-9190f410-6f70-414d-a5c6-0bfb84fb589b tempest-VolumeQuotasAdminTestJSON-1817167448 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (263b0d66-a98b-4aad-8de5-ba2be1b5bb40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:51:06 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-9190f410-6f70-414d-a5c6-0bfb84fb589b tempest-VolumeQuotasAdminTestJSON-1817167448 None] Flow 'volume_create_manager' (db0ebe83-a2bc-419b-906e-38aef8a0b44b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 11:51:06 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-9190f410-6f70-414d-a5c6-0bfb84fb589b tempest-VolumeQuotasAdminTestJSON-1817167448 None] Created volume successfully. Nov 06 11:51:07 devstack sudo[97450]: pam_unix(sudo:session): session closed for user root Nov 06 11:51:07 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-1435ed33-b69a-438e-b200-9a6e3a8aee64 tempest-VolumesListTestJSON-920108207 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-31905d79-a881-4485-a424-3b0ff32792c5 1073741824" returned: 0 in 0.508s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:51:07 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-1435ed33-b69a-438e-b200-9a6e3a8aee64 tempest-VolumesListTestJSON-920108207 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-31905d79-a881-4485-a424-3b0ff32792c5 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:51:07 devstack sudo[97456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-31905d79-a881-4485-a424-3b0ff32792c5 Nov 06 11:51:07 devstack sudo[97456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:51:07 devstack sudo[97456]: pam_unix(sudo:session): session closed for user root Nov 06 11:51:07 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-1435ed33-b69a-438e-b200-9a6e3a8aee64 tempest-VolumesListTestJSON-920108207 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-31905d79-a881-4485-a424-3b0ff32792c5" returned: 0 in 0.277s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:51:07 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-1435ed33-b69a-438e-b200-9a6e3a8aee64 tempest-VolumesListTestJSON-920108207 None] <== create_volume: return (834ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f'} {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 11:51:07 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-1435ed33-b69a-438e-b200-9a6e3a8aee64 tempest-VolumesListTestJSON-920108207 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.836s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 11:51:07 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-1435ed33-b69a-438e-b200-9a6e3a8aee64 tempest-VolumesListTestJSON-920108207 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3ba8df1a-8474-47e3-be99-dd90d3e2ad2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-31905d79-a881-4485-a424-3b0ff32792c5', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:51:07 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-1435ed33-b69a-438e-b200-9a6e3a8aee64 tempest-VolumesListTestJSON-920108207 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c1709068-7014-47b8-81fb-bbec31781a0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:51:07 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-1435ed33-b69a-438e-b200-9a6e3a8aee64 tempest-VolumesListTestJSON-920108207 None] Volume volume-31905d79-a881-4485-a424-3b0ff32792c5 (31905d79-a881-4485-a424-3b0ff32792c5): created successfully Nov 06 11:51:07 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-1435ed33-b69a-438e-b200-9a6e3a8aee64 tempest-VolumesListTestJSON-920108207 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c1709068-7014-47b8-81fb-bbec31781a0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:51:07 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-1435ed33-b69a-438e-b200-9a6e3a8aee64 tempest-VolumesListTestJSON-920108207 None] Flow 'volume_create_manager' (ce213fe9-5563-4a33-8b91-9ca0d49c88ca) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 11:51:07 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-1435ed33-b69a-438e-b200-9a6e3a8aee64 tempest-VolumesListTestJSON-920108207 None] Created volume successfully. Nov 06 11:51:07 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-da376926-0827-456d-a54c-46b1c390be7d tempest-VolumeRetypeWithoutMigrationTest-1660436780 None] Acquiring lock "cinder-7243360a-5233-4e4e-8824-a65bc5129f0a-delete_volume" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 11:51:07 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-da376926-0827-456d-a54c-46b1c390be7d tempest-VolumeRetypeWithoutMigrationTest-1660436780 None] Lock "cinder-7243360a-5233-4e4e-8824-a65bc5129f0a-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 11:51:07 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-da376926-0827-456d-a54c-46b1c390be7d tempest-VolumeRetypeWithoutMigrationTest-1660436780 None] Acquiring lock "cinder-quobyte-7243360a-5233-4e4e-8824-a65bc5129f0a" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 11:51:07 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-da376926-0827-456d-a54c-46b1c390be7d tempest-VolumeRetypeWithoutMigrationTest-1660436780 None] Lock "cinder-quobyte-7243360a-5233-4e4e-8824-a65bc5129f0a" acquired by "delete_volume" :: waited 0.015s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 11:51:07 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[28db9668-fea0-487f-ae93-3686e02ecc71]: (4, 'qcow2') {{(pid=88420) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 11:51:07 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-da376926-0827-456d-a54c-46b1c390be7d tempest-VolumeRetypeWithoutMigrationTest-1660436780 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-7243360a-5233-4e4e-8824-a65bc5129f0a {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:51:07 devstack sudo[97459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-7243360a-5233-4e4e-8824-a65bc5129f0a Nov 06 11:51:08 devstack sudo[97459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:51:08 devstack sudo[97459]: pam_unix(sudo:session): session closed for user root Nov 06 11:51:08 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-da376926-0827-456d-a54c-46b1c390be7d tempest-VolumeRetypeWithoutMigrationTest-1660436780 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-7243360a-5233-4e4e-8824-a65bc5129f0a" returned: 0 in 0.497s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:51:08 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-da376926-0827-456d-a54c-46b1c390be7d tempest-VolumeRetypeWithoutMigrationTest-1660436780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-7243360a-5233-4e4e-8824-a65bc5129f0a {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:51:08 devstack sudo[97464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-7243360a-5233-4e4e-8824-a65bc5129f0a Nov 06 11:51:08 devstack sudo[97464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:51:08 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-9aea78cc-d5f6-466f-bd98-b4dd7e6b0826 tempest-VolumeQuotasAdminTestJSON-868493744 None] Transfer volume completed successfully. Nov 06 11:51:08 devstack sudo[97464]: pam_unix(sudo:session): session closed for user root Nov 06 11:51:08 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-da376926-0827-456d-a54c-46b1c390be7d tempest-VolumeRetypeWithoutMigrationTest-1660436780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-7243360a-5233-4e4e-8824-a65bc5129f0a" returned: 0 in 0.416s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:51:08 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-da376926-0827-456d-a54c-46b1c390be7d tempest-VolumeRetypeWithoutMigrationTest-1660436780 None] Lock "cinder-quobyte-7243360a-5233-4e4e-8824-a65bc5129f0a" released by "delete_volume" :: held 0.975s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 11:51:08 devstack cinder-volume[87116]: WARNING cinder.quota [None req-da376926-0827-456d-a54c-46b1c390be7d tempest-VolumeRetypeWithoutMigrationTest-1660436780 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Nov 06 11:51:08 devstack cinder-volume[87116]: WARNING cinder.quota [None req-da376926-0827-456d-a54c-46b1c390be7d tempest-VolumeRetypeWithoutMigrationTest-1660436780 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Nov 06 11:51:08 devstack cinder-volume[87116]: DEBUG cinder.quota [None req-da376926-0827-456d-a54c-46b1c390be7d tempest-VolumeRetypeWithoutMigrationTest-1660436780 None] Created reservations ['cef58ec0-2f73-4eb6-b09b-7791a688ad5b', '0382d788-2599-48a2-816d-1485051cd716', '6e603327-30c0-425d-830a-2580a168be8f', '144b5aa3-9f4f-434c-a2ca-57edab9c8dba'] {{(pid=87116) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 11:51:09 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-da376926-0827-456d-a54c-46b1c390be7d tempest-VolumeRetypeWithoutMigrationTest-1660436780 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 11:51:09 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-da376926-0827-456d-a54c-46b1c390be7d tempest-VolumeRetypeWithoutMigrationTest-1660436780 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 11:51:09 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-da376926-0827-456d-a54c-46b1c390be7d tempest-VolumeRetypeWithoutMigrationTest-1660436780 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 11:51:09 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-da376926-0827-456d-a54c-46b1c390be7d tempest-VolumeRetypeWithoutMigrationTest-1660436780 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 11:51:09 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-da376926-0827-456d-a54c-46b1c390be7d tempest-VolumeRetypeWithoutMigrationTest-1660436780 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 11:51:09 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-da376926-0827-456d-a54c-46b1c390be7d tempest-VolumeRetypeWithoutMigrationTest-1660436780 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:51:09 devstack sudo[97467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756 Nov 06 11:51:09 devstack sudo[97467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:51:09 devstack cinder-volume[87116]: DEBUG cinder.volume.flows.manager.create_volume [None req-7508ffdc-d8d1-48f8-807d-4873fe0a3047 tempest-VolumesListTestJSON-920108207 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87116) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 11:51:09 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-7508ffdc-d8d1-48f8-807d-4873fe0a3047 tempest-VolumesListTestJSON-920108207 None] Flow 'volume_create_manager' (cdaa5517-6039-431f-bbc8-2b27ad53e589) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 11:51:09 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-7508ffdc-d8d1-48f8-807d-4873fe0a3047 tempest-VolumesListTestJSON-920108207 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6d1c45c6-aa23-4a4b-8494-89e49516ac9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:51:09 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-7508ffdc-d8d1-48f8-807d-4873fe0a3047 tempest-VolumesListTestJSON-920108207 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6d1c45c6-aa23-4a4b-8494-89e49516ac9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T10:51:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-189998830',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e05a7550-15c6-4cc1-8637-dde84d5f4f9b,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='dbbcf6116f0140eab870976e8cf091b5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T10:51:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T10:51:09Z,use_quota=True,user_id='a588beaf1076427392f90961dd90131a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(34d3b144-d9b7-480a-a2e3-01e45f3d54c1),volume_type_id=34d3b144-d9b7-480a-a2e3-01e45f3d54c1)' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:51:09 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-7508ffdc-d8d1-48f8-807d-4873fe0a3047 tempest-VolumesListTestJSON-920108207 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4c172249-5dbb-40c3-9189-3c30f048e2fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:51:09 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-7508ffdc-d8d1-48f8-807d-4873fe0a3047 tempest-VolumesListTestJSON-920108207 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4c172249-5dbb-40c3-9189-3c30f048e2fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:51:09 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-7508ffdc-d8d1-48f8-807d-4873fe0a3047 tempest-VolumesListTestJSON-920108207 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8100d3c4-c236-41b1-a08c-b69c4c311404) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:51:09 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-7508ffdc-d8d1-48f8-807d-4873fe0a3047 tempest-VolumesListTestJSON-920108207 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8100d3c4-c236-41b1-a08c-b69c4c311404) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e05a7550-15c6-4cc1-8637-dde84d5f4f9b', 'volume_name': 'volume-e05a7550-15c6-4cc1-8637-dde84d5f4f9b', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:51:09 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-7508ffdc-d8d1-48f8-807d-4873fe0a3047 tempest-VolumesListTestJSON-920108207 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (796416e1-fe75-4e1a-913c-1b3b5021daff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:51:09 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-7508ffdc-d8d1-48f8-807d-4873fe0a3047 tempest-VolumesListTestJSON-920108207 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (796416e1-fe75-4e1a-913c-1b3b5021daff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:51:09 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-7508ffdc-d8d1-48f8-807d-4873fe0a3047 tempest-VolumesListTestJSON-920108207 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1af73fb2-f414-43ab-b4b1-be71dfb97af9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:51:09 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-7508ffdc-d8d1-48f8-807d-4873fe0a3047 tempest-VolumesListTestJSON-920108207 None] Volume e05a7550-15c6-4cc1-8637-dde84d5f4f9b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e05a7550-15c6-4cc1-8637-dde84d5f4f9b', 'volume_size': 1} Nov 06 11:51:09 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-7508ffdc-d8d1-48f8-807d-4873fe0a3047 tempest-VolumesListTestJSON-920108207 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 11:51:09 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-7508ffdc-d8d1-48f8-807d-4873fe0a3047 tempest-VolumesListTestJSON-920108207 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 11:51:09 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-7508ffdc-d8d1-48f8-807d-4873fe0a3047 tempest-VolumesListTestJSON-920108207 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T10:51:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-189998830',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e05a7550-15c6-4cc1-8637-dde84d5f4f9b,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='dbbcf6116f0140eab870976e8cf091b5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T10:51:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T10:51:09Z,use_quota=True,user_id='a588beaf1076427392f90961dd90131a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(34d3b144-d9b7-480a-a2e3-01e45f3d54c1),volume_type_id=34d3b144-d9b7-480a-a2e3-01e45f3d54c1)}" {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 11:51:09 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-7508ffdc-d8d1-48f8-807d-4873fe0a3047 tempest-VolumesListTestJSON-920108207 None] Creating volume e05a7550-15c6-4cc1-8637-dde84d5f4f9b {{(pid=87116) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 11:51:09 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-7508ffdc-d8d1-48f8-807d-4873fe0a3047 tempest-VolumesListTestJSON-920108207 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 11:51:09 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-7508ffdc-d8d1-48f8-807d-4873fe0a3047 tempest-VolumesListTestJSON-920108207 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 11:51:09 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-7508ffdc-d8d1-48f8-807d-4873fe0a3047 tempest-VolumesListTestJSON-920108207 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 11:51:09 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-7508ffdc-d8d1-48f8-807d-4873fe0a3047 tempest-VolumesListTestJSON-920108207 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 11:51:09 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-7508ffdc-d8d1-48f8-807d-4873fe0a3047 tempest-VolumesListTestJSON-920108207 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 11:51:09 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-7508ffdc-d8d1-48f8-807d-4873fe0a3047 tempest-VolumesListTestJSON-920108207 None] Selected osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f as target Quobyte volume. {{(pid=87116) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 11:51:09 devstack cinder-volume[87116]: INFO cinder.volume.drivers.remotefs [None req-7508ffdc-d8d1-48f8-807d-4873fe0a3047 tempest-VolumesListTestJSON-920108207 None] casted to osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f Nov 06 11:51:09 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-7508ffdc-d8d1-48f8-807d-4873fe0a3047 tempest-VolumesListTestJSON-920108207 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-e05a7550-15c6-4cc1-8637-dde84d5f4f9b 1073741824 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:51:09 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-07e8c77b-a61a-4f40-a8f9-24e95c569d40 tempest-VolumeQuotasAdminTestJSON-730149219 None] Acquiring lock "cinder-e17a22d1-ae57-461a-a390-322e567433b4-delete_volume" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 11:51:09 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-07e8c77b-a61a-4f40-a8f9-24e95c569d40 tempest-VolumeQuotasAdminTestJSON-730149219 None] Lock "cinder-e17a22d1-ae57-461a-a390-322e567433b4-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 11:51:09 devstack sudo[97470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-e05a7550-15c6-4cc1-8637-dde84d5f4f9b 1073741824 Nov 06 11:51:09 devstack sudo[97470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:51:09 devstack sudo[97467]: pam_unix(sudo:session): session closed for user root Nov 06 11:51:09 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-da376926-0827-456d-a54c-46b1c390be7d tempest-VolumeRetypeWithoutMigrationTest-1660436780 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756" returned: 0 in 0.331s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:51:09 devstack cinder-volume[87116]: DEBUG cinder.manager [None req-da376926-0827-456d-a54c-46b1c390be7d tempest-VolumeRetypeWithoutMigrationTest-1660436780 None] Notifying Schedulers of capabilities ... {{(pid=87116) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 11:51:09 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-da376926-0827-456d-a54c-46b1c390be7d tempest-VolumeRetypeWithoutMigrationTest-1660436780 None] Deleted volume successfully. Nov 06 11:51:09 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-da376926-0827-456d-a54c-46b1c390be7d tempest-VolumeRetypeWithoutMigrationTest-1660436780 None] Lock "cinder-7243360a-5233-4e4e-8824-a65bc5129f0a-delete_volume" released by "delete_volume" :: held 1.667s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 11:51:09 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-07e8c77b-a61a-4f40-a8f9-24e95c569d40 tempest-VolumeQuotasAdminTestJSON-730149219 None] Acquiring lock "cinder-quobyte-e17a22d1-ae57-461a-a390-322e567433b4" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 11:51:09 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-07e8c77b-a61a-4f40-a8f9-24e95c569d40 tempest-VolumeQuotasAdminTestJSON-730149219 None] Lock "cinder-quobyte-e17a22d1-ae57-461a-a390-322e567433b4" acquired by "delete_volume" :: waited 0.021s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 11:51:09 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[1aa8573c-934c-4d21-9254-96623b09bb0a]: (4, 'qcow2') {{(pid=88420) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 11:51:09 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-07e8c77b-a61a-4f40-a8f9-24e95c569d40 tempest-VolumeQuotasAdminTestJSON-730149219 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-e17a22d1-ae57-461a-a390-322e567433b4 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:51:09 devstack sudo[97472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-e17a22d1-ae57-461a-a390-322e567433b4 Nov 06 11:51:09 devstack sudo[97472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:51:09 devstack sudo[97470]: pam_unix(sudo:session): session closed for user root Nov 06 11:51:09 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-7508ffdc-d8d1-48f8-807d-4873fe0a3047 tempest-VolumesListTestJSON-920108207 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-e05a7550-15c6-4cc1-8637-dde84d5f4f9b 1073741824" returned: 0 in 0.542s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:51:09 devstack sudo[97472]: pam_unix(sudo:session): session closed for user root Nov 06 11:51:09 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-07e8c77b-a61a-4f40-a8f9-24e95c569d40 tempest-VolumeQuotasAdminTestJSON-730149219 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-e17a22d1-ae57-461a-a390-322e567433b4" returned: 0 in 0.412s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:51:09 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-07e8c77b-a61a-4f40-a8f9-24e95c569d40 tempest-VolumeQuotasAdminTestJSON-730149219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-e17a22d1-ae57-461a-a390-322e567433b4 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:51:09 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-7508ffdc-d8d1-48f8-807d-4873fe0a3047 tempest-VolumesListTestJSON-920108207 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-e05a7550-15c6-4cc1-8637-dde84d5f4f9b {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:51:09 devstack sudo[97481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-e17a22d1-ae57-461a-a390-322e567433b4 Nov 06 11:51:09 devstack sudo[97481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:51:09 devstack sudo[97483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-e05a7550-15c6-4cc1-8637-dde84d5f4f9b Nov 06 11:51:09 devstack sudo[97483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:51:10 devstack sudo[97483]: pam_unix(sudo:session): session closed for user root Nov 06 11:51:10 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-7508ffdc-d8d1-48f8-807d-4873fe0a3047 tempest-VolumesListTestJSON-920108207 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-e05a7550-15c6-4cc1-8637-dde84d5f4f9b" returned: 0 in 0.274s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:51:10 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-7508ffdc-d8d1-48f8-807d-4873fe0a3047 tempest-VolumesListTestJSON-920108207 None] <== create_volume: return (883ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f'} {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 11:51:10 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-7508ffdc-d8d1-48f8-807d-4873fe0a3047 tempest-VolumesListTestJSON-920108207 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.887s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 11:51:10 devstack sudo[97481]: pam_unix(sudo:session): session closed for user root Nov 06 11:51:10 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-07e8c77b-a61a-4f40-a8f9-24e95c569d40 tempest-VolumeQuotasAdminTestJSON-730149219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-e17a22d1-ae57-461a-a390-322e567433b4" returned: 0 in 0.305s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:51:10 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-7508ffdc-d8d1-48f8-807d-4873fe0a3047 tempest-VolumesListTestJSON-920108207 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1af73fb2-f414-43ab-b4b1-be71dfb97af9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e05a7550-15c6-4cc1-8637-dde84d5f4f9b', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:51:10 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-7508ffdc-d8d1-48f8-807d-4873fe0a3047 tempest-VolumesListTestJSON-920108207 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (812d919b-b09f-4a0e-958c-727ba0743873) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:51:10 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-07e8c77b-a61a-4f40-a8f9-24e95c569d40 tempest-VolumeQuotasAdminTestJSON-730149219 None] Lock "cinder-quobyte-e17a22d1-ae57-461a-a390-322e567433b4" released by "delete_volume" :: held 0.781s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 11:51:10 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-7508ffdc-d8d1-48f8-807d-4873fe0a3047 tempest-VolumesListTestJSON-920108207 None] Volume volume-e05a7550-15c6-4cc1-8637-dde84d5f4f9b (e05a7550-15c6-4cc1-8637-dde84d5f4f9b): created successfully Nov 06 11:51:10 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-7508ffdc-d8d1-48f8-807d-4873fe0a3047 tempest-VolumesListTestJSON-920108207 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (812d919b-b09f-4a0e-958c-727ba0743873) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:51:10 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-7508ffdc-d8d1-48f8-807d-4873fe0a3047 tempest-VolumesListTestJSON-920108207 None] Flow 'volume_create_manager' (cdaa5517-6039-431f-bbc8-2b27ad53e589) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 11:51:10 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-7508ffdc-d8d1-48f8-807d-4873fe0a3047 tempest-VolumesListTestJSON-920108207 None] Created volume successfully. Nov 06 11:51:10 devstack cinder-volume[87116]: DEBUG cinder.quota [None req-07e8c77b-a61a-4f40-a8f9-24e95c569d40 tempest-VolumeQuotasAdminTestJSON-730149219 None] Created reservations ['49fed3f5-f429-4a13-8a49-6d756f273cc1', 'd3303018-6c63-4f18-98e4-e0f90baf30af', 'a07329fc-afcb-4e13-bf92-e8611a1db727', '6fedaf5a-0e1c-4b59-8f3e-c40f682c71a5'] {{(pid=87116) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 11:51:10 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-07e8c77b-a61a-4f40-a8f9-24e95c569d40 tempest-VolumeQuotasAdminTestJSON-730149219 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 11:51:10 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-07e8c77b-a61a-4f40-a8f9-24e95c569d40 tempest-VolumeQuotasAdminTestJSON-730149219 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 11:51:10 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-07e8c77b-a61a-4f40-a8f9-24e95c569d40 tempest-VolumeQuotasAdminTestJSON-730149219 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 11:51:10 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-07e8c77b-a61a-4f40-a8f9-24e95c569d40 tempest-VolumeQuotasAdminTestJSON-730149219 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 11:51:10 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-07e8c77b-a61a-4f40-a8f9-24e95c569d40 tempest-VolumeQuotasAdminTestJSON-730149219 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 11:51:10 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-07e8c77b-a61a-4f40-a8f9-24e95c569d40 tempest-VolumeQuotasAdminTestJSON-730149219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:51:10 devstack sudo[97487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756 Nov 06 11:51:10 devstack sudo[97487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:51:10 devstack sudo[97487]: pam_unix(sudo:session): session closed for user root Nov 06 11:51:10 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-07e8c77b-a61a-4f40-a8f9-24e95c569d40 tempest-VolumeQuotasAdminTestJSON-730149219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756" returned: 0 in 0.306s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:51:10 devstack cinder-volume[87116]: DEBUG cinder.manager [None req-07e8c77b-a61a-4f40-a8f9-24e95c569d40 tempest-VolumeQuotasAdminTestJSON-730149219 None] Notifying Schedulers of capabilities ... {{(pid=87116) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 11:51:10 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-07e8c77b-a61a-4f40-a8f9-24e95c569d40 tempest-VolumeQuotasAdminTestJSON-730149219 None] Deleted volume successfully. Nov 06 11:51:10 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-07e8c77b-a61a-4f40-a8f9-24e95c569d40 tempest-VolumeQuotasAdminTestJSON-730149219 None] Lock "cinder-e17a22d1-ae57-461a-a390-322e567433b4-delete_volume" released by "delete_volume" :: held 1.379s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 11:51:11 devstack cinder-volume[87116]: DEBUG cinder.volume.flows.manager.create_volume [None req-a5f5c791-c1d2-4628-8c7e-58c20ac4b19b tempest-VolumesListTestJSON-920108207 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87116) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 11:51:11 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-a5f5c791-c1d2-4628-8c7e-58c20ac4b19b tempest-VolumesListTestJSON-920108207 None] Flow 'volume_create_manager' (21a4e287-4f64-49f4-9b24-c7f5c6f11fb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 11:51:12 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-a5f5c791-c1d2-4628-8c7e-58c20ac4b19b tempest-VolumesListTestJSON-920108207 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (60938c49-6e38-48b1-8bef-29b7991d9d26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:51:12 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-a5f5c791-c1d2-4628-8c7e-58c20ac4b19b tempest-VolumesListTestJSON-920108207 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (60938c49-6e38-48b1-8bef-29b7991d9d26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T10:51:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1091247400',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2898c5ff-67d6-4fde-8a50-e027dd28960e,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='dbbcf6116f0140eab870976e8cf091b5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T10:51:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T10:51:12Z,use_quota=True,user_id='a588beaf1076427392f90961dd90131a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(34d3b144-d9b7-480a-a2e3-01e45f3d54c1),volume_type_id=34d3b144-d9b7-480a-a2e3-01e45f3d54c1)' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:51:12 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-a5f5c791-c1d2-4628-8c7e-58c20ac4b19b tempest-VolumesListTestJSON-920108207 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b7ed7a3-b093-4246-a489-bb4a66b23a79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:51:12 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-a5f5c791-c1d2-4628-8c7e-58c20ac4b19b tempest-VolumesListTestJSON-920108207 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b7ed7a3-b093-4246-a489-bb4a66b23a79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:51:12 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-a5f5c791-c1d2-4628-8c7e-58c20ac4b19b tempest-VolumesListTestJSON-920108207 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c0cdc5ab-9b91-4cd7-9410-dea7981ff4da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:51:12 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-a5f5c791-c1d2-4628-8c7e-58c20ac4b19b tempest-VolumesListTestJSON-920108207 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c0cdc5ab-9b91-4cd7-9410-dea7981ff4da) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2898c5ff-67d6-4fde-8a50-e027dd28960e', 'volume_name': 'volume-2898c5ff-67d6-4fde-8a50-e027dd28960e', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:51:12 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-a5f5c791-c1d2-4628-8c7e-58c20ac4b19b tempest-VolumesListTestJSON-920108207 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7bf6d931-8dd1-4e63-b50b-b3a24cba890d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:51:12 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-a5f5c791-c1d2-4628-8c7e-58c20ac4b19b tempest-VolumesListTestJSON-920108207 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7bf6d931-8dd1-4e63-b50b-b3a24cba890d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:51:12 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-a5f5c791-c1d2-4628-8c7e-58c20ac4b19b tempest-VolumesListTestJSON-920108207 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (678cd594-e6d7-4b12-9911-edc6184bf677) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:51:12 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-a5f5c791-c1d2-4628-8c7e-58c20ac4b19b tempest-VolumesListTestJSON-920108207 None] Volume 2898c5ff-67d6-4fde-8a50-e027dd28960e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2898c5ff-67d6-4fde-8a50-e027dd28960e', 'volume_size': 1} Nov 06 11:51:12 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-a5f5c791-c1d2-4628-8c7e-58c20ac4b19b tempest-VolumesListTestJSON-920108207 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 11:51:12 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-a5f5c791-c1d2-4628-8c7e-58c20ac4b19b tempest-VolumesListTestJSON-920108207 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 11:51:12 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-a5f5c791-c1d2-4628-8c7e-58c20ac4b19b tempest-VolumesListTestJSON-920108207 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T10:51:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1091247400',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2898c5ff-67d6-4fde-8a50-e027dd28960e,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='dbbcf6116f0140eab870976e8cf091b5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T10:51:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T10:51:12Z,use_quota=True,user_id='a588beaf1076427392f90961dd90131a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(34d3b144-d9b7-480a-a2e3-01e45f3d54c1),volume_type_id=34d3b144-d9b7-480a-a2e3-01e45f3d54c1)}" {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 11:51:12 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-a5f5c791-c1d2-4628-8c7e-58c20ac4b19b tempest-VolumesListTestJSON-920108207 None] Creating volume 2898c5ff-67d6-4fde-8a50-e027dd28960e {{(pid=87116) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 11:51:12 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-a5f5c791-c1d2-4628-8c7e-58c20ac4b19b tempest-VolumesListTestJSON-920108207 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 11:51:12 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-a5f5c791-c1d2-4628-8c7e-58c20ac4b19b tempest-VolumesListTestJSON-920108207 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 11:51:12 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-a5f5c791-c1d2-4628-8c7e-58c20ac4b19b tempest-VolumesListTestJSON-920108207 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 11:51:12 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-a5f5c791-c1d2-4628-8c7e-58c20ac4b19b tempest-VolumesListTestJSON-920108207 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 11:51:12 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-a5f5c791-c1d2-4628-8c7e-58c20ac4b19b tempest-VolumesListTestJSON-920108207 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 11:51:12 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-a5f5c791-c1d2-4628-8c7e-58c20ac4b19b tempest-VolumesListTestJSON-920108207 None] Selected osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f as target Quobyte volume. {{(pid=87116) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 11:51:12 devstack cinder-volume[87116]: INFO cinder.volume.drivers.remotefs [None req-a5f5c791-c1d2-4628-8c7e-58c20ac4b19b tempest-VolumesListTestJSON-920108207 None] casted to osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f Nov 06 11:51:12 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-a5f5c791-c1d2-4628-8c7e-58c20ac4b19b tempest-VolumesListTestJSON-920108207 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-2898c5ff-67d6-4fde-8a50-e027dd28960e 1073741824 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:51:12 devstack sudo[97490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-2898c5ff-67d6-4fde-8a50-e027dd28960e 1073741824 Nov 06 11:51:12 devstack sudo[97490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:51:12 devstack sudo[97490]: pam_unix(sudo:session): session closed for user root Nov 06 11:51:12 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-a5f5c791-c1d2-4628-8c7e-58c20ac4b19b tempest-VolumesListTestJSON-920108207 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-2898c5ff-67d6-4fde-8a50-e027dd28960e 1073741824" returned: 0 in 0.520s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:51:12 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-a5f5c791-c1d2-4628-8c7e-58c20ac4b19b tempest-VolumesListTestJSON-920108207 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-2898c5ff-67d6-4fde-8a50-e027dd28960e {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:51:12 devstack sudo[97497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-2898c5ff-67d6-4fde-8a50-e027dd28960e Nov 06 11:51:12 devstack sudo[97497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:51:13 devstack sudo[97497]: pam_unix(sudo:session): session closed for user root Nov 06 11:51:13 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-a5f5c791-c1d2-4628-8c7e-58c20ac4b19b tempest-VolumesListTestJSON-920108207 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-2898c5ff-67d6-4fde-8a50-e027dd28960e" returned: 0 in 0.376s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:51:13 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-a5f5c791-c1d2-4628-8c7e-58c20ac4b19b tempest-VolumesListTestJSON-920108207 None] <== create_volume: return (970ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f'} {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 11:51:13 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-a5f5c791-c1d2-4628-8c7e-58c20ac4b19b tempest-VolumesListTestJSON-920108207 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.973s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 11:51:13 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-a5f5c791-c1d2-4628-8c7e-58c20ac4b19b tempest-VolumesListTestJSON-920108207 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (678cd594-e6d7-4b12-9911-edc6184bf677) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2898c5ff-67d6-4fde-8a50-e027dd28960e', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:51:13 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-a5f5c791-c1d2-4628-8c7e-58c20ac4b19b tempest-VolumesListTestJSON-920108207 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (41877cfa-d3f3-443c-981c-da1e5b22f159) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:51:13 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-a5f5c791-c1d2-4628-8c7e-58c20ac4b19b tempest-VolumesListTestJSON-920108207 None] Volume volume-2898c5ff-67d6-4fde-8a50-e027dd28960e (2898c5ff-67d6-4fde-8a50-e027dd28960e): created successfully Nov 06 11:51:13 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-a5f5c791-c1d2-4628-8c7e-58c20ac4b19b tempest-VolumesListTestJSON-920108207 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (41877cfa-d3f3-443c-981c-da1e5b22f159) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:51:13 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-a5f5c791-c1d2-4628-8c7e-58c20ac4b19b tempest-VolumesListTestJSON-920108207 None] Flow 'volume_create_manager' (21a4e287-4f64-49f4-9b24-c7f5c6f11fb7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 11:51:13 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-a5f5c791-c1d2-4628-8c7e-58c20ac4b19b tempest-VolumesListTestJSON-920108207 None] Created volume successfully. Nov 06 11:51:16 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-83aa07bd-24b6-4e98-be6f-a4e837090e28 tempest-VolumesListTestJSON-920108207 None] Acquiring lock "cinder-2898c5ff-67d6-4fde-8a50-e027dd28960e-delete_volume" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 11:51:16 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-83aa07bd-24b6-4e98-be6f-a4e837090e28 tempest-VolumesListTestJSON-920108207 None] Lock "cinder-2898c5ff-67d6-4fde-8a50-e027dd28960e-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 11:51:16 devstack cinder-volume[87116]: DEBUG dbcounter [-] [87116] Writing DB stats cinder:UPDATE=156,cinder:SELECT=111,cinder:INSERT=34,cinder:DELETE=14 {{(pid=87116) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 11:51:16 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-83aa07bd-24b6-4e98-be6f-a4e837090e28 tempest-VolumesListTestJSON-920108207 None] Acquiring lock "cinder-quobyte-2898c5ff-67d6-4fde-8a50-e027dd28960e" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 11:51:16 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-83aa07bd-24b6-4e98-be6f-a4e837090e28 tempest-VolumesListTestJSON-920108207 None] Lock "cinder-quobyte-2898c5ff-67d6-4fde-8a50-e027dd28960e" acquired by "delete_volume" :: waited 0.022s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 11:51:17 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[3017ed7e-fad0-4a23-bb22-43ebaccbbfc4]: (4, 'qcow2') {{(pid=88420) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 11:51:17 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-83aa07bd-24b6-4e98-be6f-a4e837090e28 tempest-VolumesListTestJSON-920108207 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-2898c5ff-67d6-4fde-8a50-e027dd28960e {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:51:17 devstack sudo[97500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-2898c5ff-67d6-4fde-8a50-e027dd28960e Nov 06 11:51:17 devstack sudo[97500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:51:17 devstack sudo[97500]: pam_unix(sudo:session): session closed for user root Nov 06 11:51:17 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-83aa07bd-24b6-4e98-be6f-a4e837090e28 tempest-VolumesListTestJSON-920108207 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-2898c5ff-67d6-4fde-8a50-e027dd28960e" returned: 0 in 0.501s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:51:17 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-83aa07bd-24b6-4e98-be6f-a4e837090e28 tempest-VolumesListTestJSON-920108207 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-2898c5ff-67d6-4fde-8a50-e027dd28960e {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:51:17 devstack sudo[97505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-2898c5ff-67d6-4fde-8a50-e027dd28960e Nov 06 11:51:17 devstack sudo[97505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:51:17 devstack sudo[97505]: pam_unix(sudo:session): session closed for user root Nov 06 11:51:17 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-83aa07bd-24b6-4e98-be6f-a4e837090e28 tempest-VolumesListTestJSON-920108207 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-2898c5ff-67d6-4fde-8a50-e027dd28960e" returned: 0 in 0.350s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:51:17 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-83aa07bd-24b6-4e98-be6f-a4e837090e28 tempest-VolumesListTestJSON-920108207 None] Lock "cinder-quobyte-2898c5ff-67d6-4fde-8a50-e027dd28960e" released by "delete_volume" :: held 0.921s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 11:51:17 devstack cinder-volume[87116]: DEBUG cinder.quota [None req-83aa07bd-24b6-4e98-be6f-a4e837090e28 tempest-VolumesListTestJSON-920108207 None] Created reservations ['ba4599a9-cca7-4ef2-a414-edd68460e0e4', '1dab684e-8292-44fe-a0fe-3e7dd0194363', '4a938bf8-184b-4f3f-95f4-f28e1ef58d94', '4c272a81-e226-42ee-8410-f46a43439c06'] {{(pid=87116) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 11:51:18 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-83aa07bd-24b6-4e98-be6f-a4e837090e28 tempest-VolumesListTestJSON-920108207 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 11:51:18 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-83aa07bd-24b6-4e98-be6f-a4e837090e28 tempest-VolumesListTestJSON-920108207 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 11:51:18 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-83aa07bd-24b6-4e98-be6f-a4e837090e28 tempest-VolumesListTestJSON-920108207 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 11:51:18 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-83aa07bd-24b6-4e98-be6f-a4e837090e28 tempest-VolumesListTestJSON-920108207 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 11:51:18 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-83aa07bd-24b6-4e98-be6f-a4e837090e28 tempest-VolumesListTestJSON-920108207 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 11:51:18 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-83aa07bd-24b6-4e98-be6f-a4e837090e28 tempest-VolumesListTestJSON-920108207 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:51:18 devstack sudo[97508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756 Nov 06 11:51:18 devstack sudo[97508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:51:18 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-76c2684e-7ffb-4d6e-b880-4a183024f1d8 tempest-VolumesListTestJSON-920108207 None] Acquiring lock "cinder-e05a7550-15c6-4cc1-8637-dde84d5f4f9b-delete_volume" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 11:51:18 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-76c2684e-7ffb-4d6e-b880-4a183024f1d8 tempest-VolumesListTestJSON-920108207 None] Lock "cinder-e05a7550-15c6-4cc1-8637-dde84d5f4f9b-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 11:51:18 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-76c2684e-7ffb-4d6e-b880-4a183024f1d8 tempest-VolumesListTestJSON-920108207 None] Acquiring lock "cinder-quobyte-e05a7550-15c6-4cc1-8637-dde84d5f4f9b" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 11:51:18 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-76c2684e-7ffb-4d6e-b880-4a183024f1d8 tempest-VolumesListTestJSON-920108207 None] Lock "cinder-quobyte-e05a7550-15c6-4cc1-8637-dde84d5f4f9b" acquired by "delete_volume" :: waited 0.027s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 11:51:18 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[666d503d-fbec-4c6a-8e4f-d784e0fb9f7d]: (4, 'qcow2') {{(pid=88420) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 11:51:18 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-76c2684e-7ffb-4d6e-b880-4a183024f1d8 tempest-VolumesListTestJSON-920108207 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-e05a7550-15c6-4cc1-8637-dde84d5f4f9b {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:51:18 devstack sudo[97508]: pam_unix(sudo:session): session closed for user root Nov 06 11:51:18 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-83aa07bd-24b6-4e98-be6f-a4e837090e28 tempest-VolumesListTestJSON-920108207 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756" returned: 0 in 0.384s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:51:18 devstack cinder-volume[87116]: DEBUG cinder.manager [None req-83aa07bd-24b6-4e98-be6f-a4e837090e28 tempest-VolumesListTestJSON-920108207 None] Notifying Schedulers of capabilities ... {{(pid=87116) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 11:51:18 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-83aa07bd-24b6-4e98-be6f-a4e837090e28 tempest-VolumesListTestJSON-920108207 None] Deleted volume successfully. Nov 06 11:51:18 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-83aa07bd-24b6-4e98-be6f-a4e837090e28 tempest-VolumesListTestJSON-920108207 None] Lock "cinder-2898c5ff-67d6-4fde-8a50-e027dd28960e-delete_volume" released by "delete_volume" :: held 1.669s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 11:51:18 devstack sudo[97511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-e05a7550-15c6-4cc1-8637-dde84d5f4f9b Nov 06 11:51:18 devstack sudo[97511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:51:18 devstack sudo[97511]: pam_unix(sudo:session): session closed for user root Nov 06 11:51:18 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-76c2684e-7ffb-4d6e-b880-4a183024f1d8 tempest-VolumesListTestJSON-920108207 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-e05a7550-15c6-4cc1-8637-dde84d5f4f9b" returned: 0 in 0.514s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:51:18 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-76c2684e-7ffb-4d6e-b880-4a183024f1d8 tempest-VolumesListTestJSON-920108207 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-e05a7550-15c6-4cc1-8637-dde84d5f4f9b {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:51:18 devstack sudo[97517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-e05a7550-15c6-4cc1-8637-dde84d5f4f9b Nov 06 11:51:18 devstack sudo[97517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:51:19 devstack sudo[97517]: pam_unix(sudo:session): session closed for user root Nov 06 11:51:19 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-76c2684e-7ffb-4d6e-b880-4a183024f1d8 tempest-VolumesListTestJSON-920108207 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-e05a7550-15c6-4cc1-8637-dde84d5f4f9b" returned: 0 in 0.325s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:51:19 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-76c2684e-7ffb-4d6e-b880-4a183024f1d8 tempest-VolumesListTestJSON-920108207 None] Lock "cinder-quobyte-e05a7550-15c6-4cc1-8637-dde84d5f4f9b" released by "delete_volume" :: held 0.925s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 11:51:19 devstack cinder-volume[87116]: DEBUG cinder.quota [None req-76c2684e-7ffb-4d6e-b880-4a183024f1d8 tempest-VolumesListTestJSON-920108207 None] Created reservations ['d058cf85-0cf8-4217-9d7e-cc0b120412e0', 'ee8141fd-cf9a-4229-b892-9f42069706ad', 'b5443c52-3c4d-4ea7-8930-d40cd63dc64f', '86e2f768-7296-4145-a06f-945408f5e283'] {{(pid=87116) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 11:51:19 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-76c2684e-7ffb-4d6e-b880-4a183024f1d8 tempest-VolumesListTestJSON-920108207 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 11:51:19 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-76c2684e-7ffb-4d6e-b880-4a183024f1d8 tempest-VolumesListTestJSON-920108207 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 11:51:19 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-76c2684e-7ffb-4d6e-b880-4a183024f1d8 tempest-VolumesListTestJSON-920108207 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 11:51:19 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-76c2684e-7ffb-4d6e-b880-4a183024f1d8 tempest-VolumesListTestJSON-920108207 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 11:51:19 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-76c2684e-7ffb-4d6e-b880-4a183024f1d8 tempest-VolumesListTestJSON-920108207 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 11:51:19 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-76c2684e-7ffb-4d6e-b880-4a183024f1d8 tempest-VolumesListTestJSON-920108207 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:51:19 devstack sudo[97520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756 Nov 06 11:51:19 devstack sudo[97520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:51:19 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-abe1fcf6-d68e-4c2d-8f88-e6409438a70d tempest-VolumesListTestJSON-920108207 None] Acquiring lock "cinder-31905d79-a881-4485-a424-3b0ff32792c5-delete_volume" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 11:51:19 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-abe1fcf6-d68e-4c2d-8f88-e6409438a70d tempest-VolumesListTestJSON-920108207 None] Lock "cinder-31905d79-a881-4485-a424-3b0ff32792c5-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 11:51:19 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-abe1fcf6-d68e-4c2d-8f88-e6409438a70d tempest-VolumesListTestJSON-920108207 None] Acquiring lock "cinder-quobyte-31905d79-a881-4485-a424-3b0ff32792c5" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 11:51:19 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-abe1fcf6-d68e-4c2d-8f88-e6409438a70d tempest-VolumesListTestJSON-920108207 None] Lock "cinder-quobyte-31905d79-a881-4485-a424-3b0ff32792c5" acquired by "delete_volume" :: waited 0.024s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 11:51:19 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5f0de0e-cadd-48e9-bbe3-e9d36084c59e]: (4, 'qcow2') {{(pid=88420) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 11:51:19 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-abe1fcf6-d68e-4c2d-8f88-e6409438a70d tempest-VolumesListTestJSON-920108207 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-31905d79-a881-4485-a424-3b0ff32792c5 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:51:19 devstack sudo[97520]: pam_unix(sudo:session): session closed for user root Nov 06 11:51:19 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-76c2684e-7ffb-4d6e-b880-4a183024f1d8 tempest-VolumesListTestJSON-920108207 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756" returned: 0 in 0.422s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:51:19 devstack cinder-volume[87116]: DEBUG cinder.manager [None req-76c2684e-7ffb-4d6e-b880-4a183024f1d8 tempest-VolumesListTestJSON-920108207 None] Notifying Schedulers of capabilities ... {{(pid=87116) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 11:51:19 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-76c2684e-7ffb-4d6e-b880-4a183024f1d8 tempest-VolumesListTestJSON-920108207 None] Deleted volume successfully. Nov 06 11:51:19 devstack sudo[97522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-31905d79-a881-4485-a424-3b0ff32792c5 Nov 06 11:51:19 devstack sudo[97522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:51:19 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-76c2684e-7ffb-4d6e-b880-4a183024f1d8 tempest-VolumesListTestJSON-920108207 None] Lock "cinder-e05a7550-15c6-4cc1-8637-dde84d5f4f9b-delete_volume" released by "delete_volume" :: held 1.704s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 11:51:20 devstack sudo[97522]: pam_unix(sudo:session): session closed for user root Nov 06 11:51:20 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-abe1fcf6-d68e-4c2d-8f88-e6409438a70d tempest-VolumesListTestJSON-920108207 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-31905d79-a881-4485-a424-3b0ff32792c5" returned: 0 in 0.479s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:51:20 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-abe1fcf6-d68e-4c2d-8f88-e6409438a70d tempest-VolumesListTestJSON-920108207 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-31905d79-a881-4485-a424-3b0ff32792c5 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:51:20 devstack sudo[97529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-31905d79-a881-4485-a424-3b0ff32792c5 Nov 06 11:51:20 devstack sudo[97529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:51:20 devstack sudo[97529]: pam_unix(sudo:session): session closed for user root Nov 06 11:51:20 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-abe1fcf6-d68e-4c2d-8f88-e6409438a70d tempest-VolumesListTestJSON-920108207 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-31905d79-a881-4485-a424-3b0ff32792c5" returned: 0 in 0.298s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:51:20 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-abe1fcf6-d68e-4c2d-8f88-e6409438a70d tempest-VolumesListTestJSON-920108207 None] Lock "cinder-quobyte-31905d79-a881-4485-a424-3b0ff32792c5" released by "delete_volume" :: held 0.853s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 11:51:20 devstack cinder-volume[87116]: DEBUG cinder.quota [None req-abe1fcf6-d68e-4c2d-8f88-e6409438a70d tempest-VolumesListTestJSON-920108207 None] Created reservations ['0e12ebd2-660f-4756-adfe-0acea70d3ae8', '95b3c8a5-9771-4ed1-94cc-156a16fe5d68', '50e0bfd5-4a5a-49e4-9777-3192276e78f5', '717a766f-8c50-4a63-968b-cf7faa482e62'] {{(pid=87116) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 11:51:20 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-abe1fcf6-d68e-4c2d-8f88-e6409438a70d tempest-VolumesListTestJSON-920108207 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 11:51:20 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-abe1fcf6-d68e-4c2d-8f88-e6409438a70d tempest-VolumesListTestJSON-920108207 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 11:51:20 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-abe1fcf6-d68e-4c2d-8f88-e6409438a70d tempest-VolumesListTestJSON-920108207 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 11:51:20 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-abe1fcf6-d68e-4c2d-8f88-e6409438a70d tempest-VolumesListTestJSON-920108207 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 11:51:20 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-abe1fcf6-d68e-4c2d-8f88-e6409438a70d tempest-VolumesListTestJSON-920108207 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 11:51:20 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-abe1fcf6-d68e-4c2d-8f88-e6409438a70d tempest-VolumesListTestJSON-920108207 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:51:20 devstack sudo[97532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756 Nov 06 11:51:20 devstack sudo[97532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:51:21 devstack sudo[97532]: pam_unix(sudo:session): session closed for user root Nov 06 11:51:21 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-abe1fcf6-d68e-4c2d-8f88-e6409438a70d tempest-VolumesListTestJSON-920108207 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756" returned: 0 in 0.360s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:51:21 devstack cinder-volume[87116]: DEBUG cinder.manager [None req-abe1fcf6-d68e-4c2d-8f88-e6409438a70d tempest-VolumesListTestJSON-920108207 None] Notifying Schedulers of capabilities ... {{(pid=87116) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 11:51:21 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-abe1fcf6-d68e-4c2d-8f88-e6409438a70d tempest-VolumesListTestJSON-920108207 None] Deleted volume successfully. Nov 06 11:51:21 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-abe1fcf6-d68e-4c2d-8f88-e6409438a70d tempest-VolumesListTestJSON-920108207 None] Lock "cinder-31905d79-a881-4485-a424-3b0ff32792c5-delete_volume" released by "delete_volume" :: held 1.488s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 11:51:28 devstack cinder-volume[87116]: DEBUG dbcounter [-] [87116] Writing DB stats cinder:UPDATE=141,cinder:SELECT=112,cinder:INSERT=35,cinder:DELETE=12 {{(pid=87116) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 11:51:28 devstack cinder-volume[87116]: DEBUG cinder.volume.flows.manager.create_volume [None req-b00f9bfd-2755-4ec7-a578-1a01381096ae tempest-VolumesSnapshotNegativeTestJSON-1267713697 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87116) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 11:51:28 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-b00f9bfd-2755-4ec7-a578-1a01381096ae tempest-VolumesSnapshotNegativeTestJSON-1267713697 None] Flow 'volume_create_manager' (e2c8592f-c8c4-47e4-8e1a-1e12b199a414) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 11:51:28 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-b00f9bfd-2755-4ec7-a578-1a01381096ae tempest-VolumesSnapshotNegativeTestJSON-1267713697 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9b06ffcd-11ff-4ac6-ba49-ca91ed676d95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:51:28 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-b00f9bfd-2755-4ec7-a578-1a01381096ae tempest-VolumesSnapshotNegativeTestJSON-1267713697 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9b06ffcd-11ff-4ac6-ba49-ca91ed676d95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T10:51:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1109001441',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1e6ed515-0a4f-456f-815a-2fc9f07d62f6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='47d542b4f1b34795a3df8177c3afbdb1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T10:51:28Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T10:51:28Z,use_quota=True,user_id='e3564be26db841b5bec94518f9ff4ee3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(34d3b144-d9b7-480a-a2e3-01e45f3d54c1),volume_type_id=34d3b144-d9b7-480a-a2e3-01e45f3d54c1)' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:51:28 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-b00f9bfd-2755-4ec7-a578-1a01381096ae tempest-VolumesSnapshotNegativeTestJSON-1267713697 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b2cd9ab-bac4-4335-8e56-8fafebecdd20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:51:28 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-b00f9bfd-2755-4ec7-a578-1a01381096ae tempest-VolumesSnapshotNegativeTestJSON-1267713697 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b2cd9ab-bac4-4335-8e56-8fafebecdd20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:51:28 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-b00f9bfd-2755-4ec7-a578-1a01381096ae tempest-VolumesSnapshotNegativeTestJSON-1267713697 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f2474c92-ab6b-4321-a61e-e97f47fa843a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:51:28 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-b00f9bfd-2755-4ec7-a578-1a01381096ae tempest-VolumesSnapshotNegativeTestJSON-1267713697 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f2474c92-ab6b-4321-a61e-e97f47fa843a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1e6ed515-0a4f-456f-815a-2fc9f07d62f6', 'volume_name': 'volume-1e6ed515-0a4f-456f-815a-2fc9f07d62f6', 'volume_size': 2}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:51:28 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-b00f9bfd-2755-4ec7-a578-1a01381096ae tempest-VolumesSnapshotNegativeTestJSON-1267713697 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d1dcee26-fe17-4196-a99f-3abf02629703) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:51:28 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-b00f9bfd-2755-4ec7-a578-1a01381096ae tempest-VolumesSnapshotNegativeTestJSON-1267713697 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d1dcee26-fe17-4196-a99f-3abf02629703) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:51:28 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-b00f9bfd-2755-4ec7-a578-1a01381096ae tempest-VolumesSnapshotNegativeTestJSON-1267713697 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (75cade4e-ed5b-4ffa-a1cd-794077208664) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:51:28 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-b00f9bfd-2755-4ec7-a578-1a01381096ae tempest-VolumesSnapshotNegativeTestJSON-1267713697 None] Volume 1e6ed515-0a4f-456f-815a-2fc9f07d62f6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1e6ed515-0a4f-456f-815a-2fc9f07d62f6', 'volume_size': 2} Nov 06 11:51:28 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-b00f9bfd-2755-4ec7-a578-1a01381096ae tempest-VolumesSnapshotNegativeTestJSON-1267713697 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 11:51:28 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-b00f9bfd-2755-4ec7-a578-1a01381096ae tempest-VolumesSnapshotNegativeTestJSON-1267713697 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 11:51:28 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-b00f9bfd-2755-4ec7-a578-1a01381096ae tempest-VolumesSnapshotNegativeTestJSON-1267713697 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T10:51:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1109001441',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1e6ed515-0a4f-456f-815a-2fc9f07d62f6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='47d542b4f1b34795a3df8177c3afbdb1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T10:51:28Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T10:51:28Z,use_quota=True,user_id='e3564be26db841b5bec94518f9ff4ee3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(34d3b144-d9b7-480a-a2e3-01e45f3d54c1),volume_type_id=34d3b144-d9b7-480a-a2e3-01e45f3d54c1)}" {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 11:51:28 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-b00f9bfd-2755-4ec7-a578-1a01381096ae tempest-VolumesSnapshotNegativeTestJSON-1267713697 None] Creating volume 1e6ed515-0a4f-456f-815a-2fc9f07d62f6 {{(pid=87116) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 11:51:28 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-b00f9bfd-2755-4ec7-a578-1a01381096ae tempest-VolumesSnapshotNegativeTestJSON-1267713697 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 11:51:28 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-b00f9bfd-2755-4ec7-a578-1a01381096ae tempest-VolumesSnapshotNegativeTestJSON-1267713697 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 11:51:28 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-b00f9bfd-2755-4ec7-a578-1a01381096ae tempest-VolumesSnapshotNegativeTestJSON-1267713697 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 11:51:28 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-b00f9bfd-2755-4ec7-a578-1a01381096ae tempest-VolumesSnapshotNegativeTestJSON-1267713697 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 11:51:28 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-b00f9bfd-2755-4ec7-a578-1a01381096ae tempest-VolumesSnapshotNegativeTestJSON-1267713697 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 11:51:28 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-b00f9bfd-2755-4ec7-a578-1a01381096ae tempest-VolumesSnapshotNegativeTestJSON-1267713697 None] Selected osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f as target Quobyte volume. {{(pid=87116) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 11:51:28 devstack cinder-volume[87116]: INFO cinder.volume.drivers.remotefs [None req-b00f9bfd-2755-4ec7-a578-1a01381096ae tempest-VolumesSnapshotNegativeTestJSON-1267713697 None] casted to osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f Nov 06 11:51:28 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-b00f9bfd-2755-4ec7-a578-1a01381096ae tempest-VolumesSnapshotNegativeTestJSON-1267713697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-1e6ed515-0a4f-456f-815a-2fc9f07d62f6 2147483648 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:51:28 devstack sudo[97542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-1e6ed515-0a4f-456f-815a-2fc9f07d62f6 2147483648 Nov 06 11:51:28 devstack sudo[97542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:51:28 devstack sudo[97542]: pam_unix(sudo:session): session closed for user root Nov 06 11:51:28 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-b00f9bfd-2755-4ec7-a578-1a01381096ae tempest-VolumesSnapshotNegativeTestJSON-1267713697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-1e6ed515-0a4f-456f-815a-2fc9f07d62f6 2147483648" returned: 0 in 0.787s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:51:28 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-b00f9bfd-2755-4ec7-a578-1a01381096ae tempest-VolumesSnapshotNegativeTestJSON-1267713697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-1e6ed515-0a4f-456f-815a-2fc9f07d62f6 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:51:29 devstack sudo[97558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-1e6ed515-0a4f-456f-815a-2fc9f07d62f6 Nov 06 11:51:29 devstack sudo[97558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:51:29 devstack sudo[97558]: pam_unix(sudo:session): session closed for user root Nov 06 11:51:29 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-b00f9bfd-2755-4ec7-a578-1a01381096ae tempest-VolumesSnapshotNegativeTestJSON-1267713697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-1e6ed515-0a4f-456f-815a-2fc9f07d62f6" returned: 0 in 0.347s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:51:29 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-b00f9bfd-2755-4ec7-a578-1a01381096ae tempest-VolumesSnapshotNegativeTestJSON-1267713697 None] <== create_volume: return (1188ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f'} {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 11:51:29 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-b00f9bfd-2755-4ec7-a578-1a01381096ae tempest-VolumesSnapshotNegativeTestJSON-1267713697 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.191s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 11:51:29 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-b00f9bfd-2755-4ec7-a578-1a01381096ae tempest-VolumesSnapshotNegativeTestJSON-1267713697 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (75cade4e-ed5b-4ffa-a1cd-794077208664) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1e6ed515-0a4f-456f-815a-2fc9f07d62f6', 'volume_size': 2}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:51:29 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-b00f9bfd-2755-4ec7-a578-1a01381096ae tempest-VolumesSnapshotNegativeTestJSON-1267713697 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (79242370-50f0-4bcf-b764-19e50a330c4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:51:29 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-b00f9bfd-2755-4ec7-a578-1a01381096ae tempest-VolumesSnapshotNegativeTestJSON-1267713697 None] Volume volume-1e6ed515-0a4f-456f-815a-2fc9f07d62f6 (1e6ed515-0a4f-456f-815a-2fc9f07d62f6): created successfully Nov 06 11:51:29 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-b00f9bfd-2755-4ec7-a578-1a01381096ae tempest-VolumesSnapshotNegativeTestJSON-1267713697 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (79242370-50f0-4bcf-b764-19e50a330c4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:51:29 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-b00f9bfd-2755-4ec7-a578-1a01381096ae tempest-VolumesSnapshotNegativeTestJSON-1267713697 None] Flow 'volume_create_manager' (e2c8592f-c8c4-47e4-8e1a-1e12b199a414) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 11:51:29 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-b00f9bfd-2755-4ec7-a578-1a01381096ae tempest-VolumesSnapshotNegativeTestJSON-1267713697 None] Created volume successfully. Nov 06 11:51:30 devstack cinder-volume[87116]: DEBUG cinder.volume.flows.manager.create_volume [None req-e6c3dad0-e6c2-4870-b16a-76263dbb828e tempest-VolumeTypesAccessTest-299175799 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87116) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 11:51:30 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-e6c3dad0-e6c2-4870-b16a-76263dbb828e tempest-VolumeTypesAccessTest-299175799 None] Flow 'volume_create_manager' (45b4e851-4aa0-44a2-bd0e-dd21083e7085) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 11:51:30 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-e6c3dad0-e6c2-4870-b16a-76263dbb828e tempest-VolumeTypesAccessTest-299175799 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (990626ad-5c70-45c1-8977-40c799f83585) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:51:30 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-e6c3dad0-e6c2-4870-b16a-76263dbb828e tempest-VolumeTypesAccessTest-299175799 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (990626ad-5c70-45c1-8977-40c799f83585) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T10:51:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1036237725',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f5127dc0-b2f2-4bff-a049-5571f3fb1a20,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f5d7e31a01cc46828a174f5b8bbb171a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T10:51:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T10:51:30Z,use_quota=True,user_id='d56110dcbf1a446ba443402fff1c5484',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7d38a6d3-a350-4b03-be8f-fb879d808054),volume_type_id=7d38a6d3-a350-4b03-be8f-fb879d808054)' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:51:30 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-e6c3dad0-e6c2-4870-b16a-76263dbb828e tempest-VolumeTypesAccessTest-299175799 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (70433288-911d-43a1-be46-ed951ad01359) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:51:30 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-e6c3dad0-e6c2-4870-b16a-76263dbb828e tempest-VolumeTypesAccessTest-299175799 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (70433288-911d-43a1-be46-ed951ad01359) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:51:30 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-e6c3dad0-e6c2-4870-b16a-76263dbb828e tempest-VolumeTypesAccessTest-299175799 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f53a207d-9fda-4fab-b9bf-6752af42efbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:51:30 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-e6c3dad0-e6c2-4870-b16a-76263dbb828e tempest-VolumeTypesAccessTest-299175799 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f53a207d-9fda-4fab-b9bf-6752af42efbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f5127dc0-b2f2-4bff-a049-5571f3fb1a20', 'volume_name': 'volume-f5127dc0-b2f2-4bff-a049-5571f3fb1a20', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:51:30 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-e6c3dad0-e6c2-4870-b16a-76263dbb828e tempest-VolumeTypesAccessTest-299175799 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (af489880-6e82-4b4c-9f02-d7ce43d8ec6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:51:30 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-e6c3dad0-e6c2-4870-b16a-76263dbb828e tempest-VolumeTypesAccessTest-299175799 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (af489880-6e82-4b4c-9f02-d7ce43d8ec6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:51:30 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-e6c3dad0-e6c2-4870-b16a-76263dbb828e tempest-VolumeTypesAccessTest-299175799 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f8090f4f-cf8f-4afc-8c2e-e3ff3657643d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:51:30 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-e6c3dad0-e6c2-4870-b16a-76263dbb828e tempest-VolumeTypesAccessTest-299175799 None] Volume f5127dc0-b2f2-4bff-a049-5571f3fb1a20: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f5127dc0-b2f2-4bff-a049-5571f3fb1a20', 'volume_size': 1} Nov 06 11:51:30 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-e6c3dad0-e6c2-4870-b16a-76263dbb828e tempest-VolumeTypesAccessTest-299175799 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 11:51:30 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-e6c3dad0-e6c2-4870-b16a-76263dbb828e tempest-VolumeTypesAccessTest-299175799 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 11:51:30 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-e6c3dad0-e6c2-4870-b16a-76263dbb828e tempest-VolumeTypesAccessTest-299175799 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T10:51:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1036237725',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f5127dc0-b2f2-4bff-a049-5571f3fb1a20,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f5d7e31a01cc46828a174f5b8bbb171a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T10:51:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T10:51:30Z,use_quota=True,user_id='d56110dcbf1a446ba443402fff1c5484',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7d38a6d3-a350-4b03-be8f-fb879d808054),volume_type_id=7d38a6d3-a350-4b03-be8f-fb879d808054)}" {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 11:51:30 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-e6c3dad0-e6c2-4870-b16a-76263dbb828e tempest-VolumeTypesAccessTest-299175799 None] Creating volume f5127dc0-b2f2-4bff-a049-5571f3fb1a20 {{(pid=87116) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 11:51:30 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-e6c3dad0-e6c2-4870-b16a-76263dbb828e tempest-VolumeTypesAccessTest-299175799 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 11:51:30 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-e6c3dad0-e6c2-4870-b16a-76263dbb828e tempest-VolumeTypesAccessTest-299175799 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 11:51:30 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-e6c3dad0-e6c2-4870-b16a-76263dbb828e tempest-VolumeTypesAccessTest-299175799 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 11:51:30 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-e6c3dad0-e6c2-4870-b16a-76263dbb828e tempest-VolumeTypesAccessTest-299175799 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 11:51:30 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-e6c3dad0-e6c2-4870-b16a-76263dbb828e tempest-VolumeTypesAccessTest-299175799 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 11:51:30 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-e6c3dad0-e6c2-4870-b16a-76263dbb828e tempest-VolumeTypesAccessTest-299175799 None] Selected osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f as target Quobyte volume. {{(pid=87116) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 11:51:30 devstack cinder-volume[87116]: INFO cinder.volume.drivers.remotefs [None req-e6c3dad0-e6c2-4870-b16a-76263dbb828e tempest-VolumeTypesAccessTest-299175799 None] casted to osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f Nov 06 11:51:30 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-e6c3dad0-e6c2-4870-b16a-76263dbb828e tempest-VolumeTypesAccessTest-299175799 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-f5127dc0-b2f2-4bff-a049-5571f3fb1a20 1073741824 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:51:30 devstack sudo[97603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-f5127dc0-b2f2-4bff-a049-5571f3fb1a20 1073741824 Nov 06 11:51:30 devstack sudo[97603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:51:30 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-884da457-81c0-4579-91ae-94492e056405 tempest-VolumesSnapshotNegativeTestJSON-1267713697 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 11:51:31 devstack sudo[97603]: pam_unix(sudo:session): session closed for user root Nov 06 11:51:31 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-e6c3dad0-e6c2-4870-b16a-76263dbb828e tempest-VolumeTypesAccessTest-299175799 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-f5127dc0-b2f2-4bff-a049-5571f3fb1a20 1073741824" returned: 0 in 0.520s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:51:31 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-e6c3dad0-e6c2-4870-b16a-76263dbb828e tempest-VolumeTypesAccessTest-299175799 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-f5127dc0-b2f2-4bff-a049-5571f3fb1a20 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:51:31 devstack sudo[97609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-f5127dc0-b2f2-4bff-a049-5571f3fb1a20 Nov 06 11:51:31 devstack sudo[97609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:51:31 devstack sudo[97609]: pam_unix(sudo:session): session closed for user root Nov 06 11:51:31 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-e6c3dad0-e6c2-4870-b16a-76263dbb828e tempest-VolumeTypesAccessTest-299175799 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-f5127dc0-b2f2-4bff-a049-5571f3fb1a20" returned: 0 in 0.356s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:51:31 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-e6c3dad0-e6c2-4870-b16a-76263dbb828e tempest-VolumeTypesAccessTest-299175799 None] <== create_volume: return (925ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f'} {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 11:51:31 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-e6c3dad0-e6c2-4870-b16a-76263dbb828e tempest-VolumeTypesAccessTest-299175799 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.928s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 11:51:31 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-884da457-81c0-4579-91ae-94492e056405 tempest-VolumesSnapshotNegativeTestJSON-1267713697 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.881s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 11:51:31 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-e6c3dad0-e6c2-4870-b16a-76263dbb828e tempest-VolumeTypesAccessTest-299175799 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f8090f4f-cf8f-4afc-8c2e-e3ff3657643d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f5127dc0-b2f2-4bff-a049-5571f3fb1a20', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:51:31 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-e6c3dad0-e6c2-4870-b16a-76263dbb828e tempest-VolumeTypesAccessTest-299175799 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d99917b6-e481-4341-a8e6-dfc22dd0a49d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:51:31 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-884da457-81c0-4579-91ae-94492e056405 tempest-VolumesSnapshotNegativeTestJSON-1267713697 None] Creating offline snapshot 509c33ed-31cb-4df0-a72e-e5df82e9d1ad of volume 1e6ed515-0a4f-456f-815a-2fc9f07d62f6 {{(pid=87116) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 06 11:51:31 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-e6c3dad0-e6c2-4870-b16a-76263dbb828e tempest-VolumeTypesAccessTest-299175799 None] Volume volume-f5127dc0-b2f2-4bff-a049-5571f3fb1a20 (f5127dc0-b2f2-4bff-a049-5571f3fb1a20): created successfully Nov 06 11:51:31 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-e6c3dad0-e6c2-4870-b16a-76263dbb828e tempest-VolumeTypesAccessTest-299175799 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d99917b6-e481-4341-a8e6-dfc22dd0a49d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:51:31 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-e6c3dad0-e6c2-4870-b16a-76263dbb828e tempest-VolumeTypesAccessTest-299175799 None] Flow 'volume_create_manager' (45b4e851-4aa0-44a2-bd0e-dd21083e7085) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 11:51:31 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1ffa3ba-5038-493b-b40c-b5be4a1d2bf4]: (4, 'qcow2') {{(pid=88420) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 11:51:31 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-884da457-81c0-4579-91ae-94492e056405 tempest-VolumesSnapshotNegativeTestJSON-1267713697 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-1e6ed515-0a4f-456f-815a-2fc9f07d62f6 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:51:31 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-e6c3dad0-e6c2-4870-b16a-76263dbb828e tempest-VolumeTypesAccessTest-299175799 None] Created volume successfully. Nov 06 11:51:31 devstack sudo[97613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-1e6ed515-0a4f-456f-815a-2fc9f07d62f6 Nov 06 11:51:31 devstack sudo[97613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:51:31 devstack cinder-volume[87116]: DEBUG cinder.volume.flows.manager.create_volume [None req-f2fb3b2c-1e48-46f5-ac91-8d66c38bbf30 tempest-VolumesListAdminTestJSON-1254674282 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87116) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 11:51:31 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-f2fb3b2c-1e48-46f5-ac91-8d66c38bbf30 tempest-VolumesListAdminTestJSON-1254674282 None] Flow 'volume_create_manager' (3cbfecca-065e-428b-b83b-88f0f202bdbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 11:51:31 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-f2fb3b2c-1e48-46f5-ac91-8d66c38bbf30 tempest-VolumesListAdminTestJSON-1254674282 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2dddfc10-a010-4f58-8333-c080b676ab3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:51:31 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-f2fb3b2c-1e48-46f5-ac91-8d66c38bbf30 tempest-VolumesListAdminTestJSON-1254674282 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2dddfc10-a010-4f58-8333-c080b676ab3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T10:51:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-380705457',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8af229b3-6b42-4f2b-80fc-dc28e0323035,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b2d8b263f164935a7cf8437672ad6c4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T10:51:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T10:51:32Z,use_quota=True,user_id='799b237ce31c4910a3124c6c0825afc2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(34d3b144-d9b7-480a-a2e3-01e45f3d54c1),volume_type_id=34d3b144-d9b7-480a-a2e3-01e45f3d54c1)' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:51:31 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-f2fb3b2c-1e48-46f5-ac91-8d66c38bbf30 tempest-VolumesListAdminTestJSON-1254674282 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eda51ca7-ddcf-4f7b-8f0e-d6b792d4a1f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:51:31 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-f2fb3b2c-1e48-46f5-ac91-8d66c38bbf30 tempest-VolumesListAdminTestJSON-1254674282 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eda51ca7-ddcf-4f7b-8f0e-d6b792d4a1f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:51:31 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-f2fb3b2c-1e48-46f5-ac91-8d66c38bbf30 tempest-VolumesListAdminTestJSON-1254674282 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (94f51174-43d8-4d2e-a4ba-e511b158359d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:51:31 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-f2fb3b2c-1e48-46f5-ac91-8d66c38bbf30 tempest-VolumesListAdminTestJSON-1254674282 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (94f51174-43d8-4d2e-a4ba-e511b158359d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8af229b3-6b42-4f2b-80fc-dc28e0323035', 'volume_name': 'volume-8af229b3-6b42-4f2b-80fc-dc28e0323035', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:51:31 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-f2fb3b2c-1e48-46f5-ac91-8d66c38bbf30 tempest-VolumesListAdminTestJSON-1254674282 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d65b94ac-329c-47ce-8912-b2396641a410) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:51:31 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-f2fb3b2c-1e48-46f5-ac91-8d66c38bbf30 tempest-VolumesListAdminTestJSON-1254674282 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d65b94ac-329c-47ce-8912-b2396641a410) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:51:31 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-f2fb3b2c-1e48-46f5-ac91-8d66c38bbf30 tempest-VolumesListAdminTestJSON-1254674282 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (206ed052-737a-4cad-88e0-b36daf3e8c11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:51:31 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-f2fb3b2c-1e48-46f5-ac91-8d66c38bbf30 tempest-VolumesListAdminTestJSON-1254674282 None] Volume 8af229b3-6b42-4f2b-80fc-dc28e0323035: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8af229b3-6b42-4f2b-80fc-dc28e0323035', 'volume_size': 1} Nov 06 11:51:31 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-f2fb3b2c-1e48-46f5-ac91-8d66c38bbf30 tempest-VolumesListAdminTestJSON-1254674282 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 11:51:31 devstack sudo[97613]: pam_unix(sudo:session): session closed for user root Nov 06 11:51:31 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-884da457-81c0-4579-91ae-94492e056405 tempest-VolumesSnapshotNegativeTestJSON-1267713697 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-1e6ed515-0a4f-456f-815a-2fc9f07d62f6" returned: 0 in 0.418s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:51:31 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-884da457-81c0-4579-91ae-94492e056405 tempest-VolumesSnapshotNegativeTestJSON-1267713697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-1e6ed515-0a4f-456f-815a-2fc9f07d62f6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-1e6ed515-0a4f-456f-815a-2fc9f07d62f6.509c33ed-31cb-4df0-a72e-e5df82e9d1ad 2G {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:51:32 devstack sudo[97618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-1e6ed515-0a4f-456f-815a-2fc9f07d62f6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-1e6ed515-0a4f-456f-815a-2fc9f07d62f6.509c33ed-31cb-4df0-a72e-e5df82e9d1ad 2G Nov 06 11:51:32 devstack sudo[97618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:51:32 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-ba7e3c54-e180-475d-828d-643f9a43f134 tempest-VolumeTypesAccessTest-299175799 None] Acquiring lock "cinder-f5127dc0-b2f2-4bff-a049-5571f3fb1a20-delete_volume" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 11:51:32 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-ba7e3c54-e180-475d-828d-643f9a43f134 tempest-VolumeTypesAccessTest-299175799 None] Lock "cinder-f5127dc0-b2f2-4bff-a049-5571f3fb1a20-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 11:51:32 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-ba7e3c54-e180-475d-828d-643f9a43f134 tempest-VolumeTypesAccessTest-299175799 None] Acquiring lock "cinder-quobyte-f5127dc0-b2f2-4bff-a049-5571f3fb1a20" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 11:51:32 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-ba7e3c54-e180-475d-828d-643f9a43f134 tempest-VolumeTypesAccessTest-299175799 None] Lock "cinder-quobyte-f5127dc0-b2f2-4bff-a049-5571f3fb1a20" acquired by "delete_volume" :: waited 0.030s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 11:51:32 devstack sudo[97618]: pam_unix(sudo:session): session closed for user root Nov 06 11:51:32 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-884da457-81c0-4579-91ae-94492e056405 tempest-VolumesSnapshotNegativeTestJSON-1267713697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-1e6ed515-0a4f-456f-815a-2fc9f07d62f6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-1e6ed515-0a4f-456f-815a-2fc9f07d62f6.509c33ed-31cb-4df0-a72e-e5df82e9d1ad 2G" returned: 0 in 0.955s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:51:32 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-884da457-81c0-4579-91ae-94492e056405 tempest-VolumesSnapshotNegativeTestJSON-1267713697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1e6ed515-0a4f-456f-815a-2fc9f07d62f6 -F qcow2 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-1e6ed515-0a4f-456f-815a-2fc9f07d62f6.509c33ed-31cb-4df0-a72e-e5df82e9d1ad {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:51:32 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8b4f32d-10e2-446c-9bd5-ffaad42a6566]: (4, 'qcow2') {{(pid=88420) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 11:51:32 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-ba7e3c54-e180-475d-828d-643f9a43f134 tempest-VolumeTypesAccessTest-299175799 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-f5127dc0-b2f2-4bff-a049-5571f3fb1a20 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:51:32 devstack sudo[97686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1e6ed515-0a4f-456f-815a-2fc9f07d62f6 -F qcow2 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-1e6ed515-0a4f-456f-815a-2fc9f07d62f6.509c33ed-31cb-4df0-a72e-e5df82e9d1ad Nov 06 11:51:32 devstack sudo[97686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:51:33 devstack sudo[97687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-f5127dc0-b2f2-4bff-a049-5571f3fb1a20 Nov 06 11:51:33 devstack sudo[97687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:51:33 devstack sudo[97686]: pam_unix(sudo:session): session closed for user root Nov 06 11:51:33 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-884da457-81c0-4579-91ae-94492e056405 tempest-VolumesSnapshotNegativeTestJSON-1267713697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1e6ed515-0a4f-456f-815a-2fc9f07d62f6 -F qcow2 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-1e6ed515-0a4f-456f-815a-2fc9f07d62f6.509c33ed-31cb-4df0-a72e-e5df82e9d1ad" returned: 0 in 0.489s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:51:33 devstack cinder-volume[87116]: WARNING cinder.volume.drivers.remotefs [None req-884da457-81c0-4579-91ae-94492e056405 tempest-VolumesSnapshotNegativeTestJSON-1267713697 None] /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-1e6ed515-0a4f-456f-815a-2fc9f07d62f6.509c33ed-31cb-4df0-a72e-e5df82e9d1ad is being set with open permissions: ugo+rw Nov 06 11:51:33 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-884da457-81c0-4579-91ae-94492e056405 tempest-VolumesSnapshotNegativeTestJSON-1267713697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-1e6ed515-0a4f-456f-815a-2fc9f07d62f6.509c33ed-31cb-4df0-a72e-e5df82e9d1ad {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:51:33 devstack sudo[97697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-1e6ed515-0a4f-456f-815a-2fc9f07d62f6.509c33ed-31cb-4df0-a72e-e5df82e9d1ad Nov 06 11:51:33 devstack sudo[97697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:51:33 devstack sudo[97687]: pam_unix(sudo:session): session closed for user root Nov 06 11:51:33 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-ba7e3c54-e180-475d-828d-643f9a43f134 tempest-VolumeTypesAccessTest-299175799 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-f5127dc0-b2f2-4bff-a049-5571f3fb1a20" returned: 0 in 0.677s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:51:33 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-ba7e3c54-e180-475d-828d-643f9a43f134 tempest-VolumeTypesAccessTest-299175799 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-f5127dc0-b2f2-4bff-a049-5571f3fb1a20 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:51:33 devstack sudo[97704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-f5127dc0-b2f2-4bff-a049-5571f3fb1a20 Nov 06 11:51:33 devstack sudo[97704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:51:33 devstack sudo[97697]: pam_unix(sudo:session): session closed for user root Nov 06 11:51:33 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-884da457-81c0-4579-91ae-94492e056405 tempest-VolumesSnapshotNegativeTestJSON-1267713697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-1e6ed515-0a4f-456f-815a-2fc9f07d62f6.509c33ed-31cb-4df0-a72e-e5df82e9d1ad" returned: 0 in 0.347s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:51:33 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-884da457-81c0-4579-91ae-94492e056405 tempest-VolumesSnapshotNegativeTestJSON-1267713697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-1e6ed515-0a4f-456f-815a-2fc9f07d62f6.info {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:51:33 devstack sudo[97709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-1e6ed515-0a4f-456f-815a-2fc9f07d62f6.info Nov 06 11:51:33 devstack sudo[97709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:51:34 devstack sudo[97704]: pam_unix(sudo:session): session closed for user root Nov 06 11:51:34 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-ba7e3c54-e180-475d-828d-643f9a43f134 tempest-VolumeTypesAccessTest-299175799 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-f5127dc0-b2f2-4bff-a049-5571f3fb1a20" returned: 0 in 0.431s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:51:34 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-ba7e3c54-e180-475d-828d-643f9a43f134 tempest-VolumeTypesAccessTest-299175799 None] Lock "cinder-quobyte-f5127dc0-b2f2-4bff-a049-5571f3fb1a20" released by "delete_volume" :: held 1.190s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 11:51:34 devstack cinder-volume[87116]: WARNING cinder.quota [None req-ba7e3c54-e180-475d-828d-643f9a43f134 tempest-VolumeTypesAccessTest-299175799 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-1189868872 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-1189868872, it is now deprecated. Please use the default quota class for default quota. Nov 06 11:51:34 devstack cinder-volume[87116]: WARNING cinder.quota [None req-ba7e3c54-e180-475d-828d-643f9a43f134 tempest-VolumeTypesAccessTest-299175799 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-1189868872 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-1189868872, it is now deprecated. Please use the default quota class for default quota. Nov 06 11:51:34 devstack cinder-volume[87116]: DEBUG cinder.quota [None req-ba7e3c54-e180-475d-828d-643f9a43f134 tempest-VolumeTypesAccessTest-299175799 None] Created reservations ['d94b141b-c260-4ef3-8316-79c392924ef2', 'e727a7d1-002d-4503-8a1d-97a9c86cea5b', '41e16782-fc43-4c41-8d27-bc9908290082', '1a2160b7-8770-485d-a5f0-ab711da5cf3c'] {{(pid=87116) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 11:51:34 devstack sudo[97709]: pam_unix(sudo:session): session closed for user root Nov 06 11:51:34 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-884da457-81c0-4579-91ae-94492e056405 tempest-VolumesSnapshotNegativeTestJSON-1267713697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-1e6ed515-0a4f-456f-815a-2fc9f07d62f6.info" returned: 0 in 0.395s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:51:34 devstack cinder-volume[87116]: WARNING cinder.volume.drivers.remotefs [None req-884da457-81c0-4579-91ae-94492e056405 tempest-VolumesSnapshotNegativeTestJSON-1267713697 None] /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-1e6ed515-0a4f-456f-815a-2fc9f07d62f6.info is being set with open permissions: ugo+rw Nov 06 11:51:34 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-884da457-81c0-4579-91ae-94492e056405 tempest-VolumesSnapshotNegativeTestJSON-1267713697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-1e6ed515-0a4f-456f-815a-2fc9f07d62f6.info {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:51:34 devstack sudo[97713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-1e6ed515-0a4f-456f-815a-2fc9f07d62f6.info Nov 06 11:51:34 devstack sudo[97713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:51:34 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-ba7e3c54-e180-475d-828d-643f9a43f134 tempest-VolumeTypesAccessTest-299175799 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 11:51:34 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-ba7e3c54-e180-475d-828d-643f9a43f134 tempest-VolumeTypesAccessTest-299175799 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 11:51:34 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-ba7e3c54-e180-475d-828d-643f9a43f134 tempest-VolumeTypesAccessTest-299175799 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 11:51:34 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-ba7e3c54-e180-475d-828d-643f9a43f134 tempest-VolumeTypesAccessTest-299175799 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 11:51:34 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-ba7e3c54-e180-475d-828d-643f9a43f134 tempest-VolumeTypesAccessTest-299175799 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 11:51:34 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-ba7e3c54-e180-475d-828d-643f9a43f134 tempest-VolumeTypesAccessTest-299175799 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:51:34 devstack sudo[97715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756 Nov 06 11:51:34 devstack sudo[97715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:51:34 devstack sudo[97713]: pam_unix(sudo:session): session closed for user root Nov 06 11:51:34 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-884da457-81c0-4579-91ae-94492e056405 tempest-VolumesSnapshotNegativeTestJSON-1267713697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-1e6ed515-0a4f-456f-815a-2fc9f07d62f6.info" returned: 0 in 0.323s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:51:34 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-884da457-81c0-4579-91ae-94492e056405 tempest-VolumesSnapshotNegativeTestJSON-1267713697 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.118s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 11:51:34 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-f2fb3b2c-1e48-46f5-ac91-8d66c38bbf30 tempest-VolumesListAdminTestJSON-1254674282 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.776s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 11:51:34 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-f2fb3b2c-1e48-46f5-ac91-8d66c38bbf30 tempest-VolumesListAdminTestJSON-1254674282 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T10:51:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-380705457',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8af229b3-6b42-4f2b-80fc-dc28e0323035,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b2d8b263f164935a7cf8437672ad6c4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T10:51:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T10:51:32Z,use_quota=True,user_id='799b237ce31c4910a3124c6c0825afc2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(34d3b144-d9b7-480a-a2e3-01e45f3d54c1),volume_type_id=34d3b144-d9b7-480a-a2e3-01e45f3d54c1)}" {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 11:51:34 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-f2fb3b2c-1e48-46f5-ac91-8d66c38bbf30 tempest-VolumesListAdminTestJSON-1254674282 None] Creating volume 8af229b3-6b42-4f2b-80fc-dc28e0323035 {{(pid=87116) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 11:51:34 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-f2fb3b2c-1e48-46f5-ac91-8d66c38bbf30 tempest-VolumesListAdminTestJSON-1254674282 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 11:51:34 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-f2fb3b2c-1e48-46f5-ac91-8d66c38bbf30 tempest-VolumesListAdminTestJSON-1254674282 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 11:51:34 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-f2fb3b2c-1e48-46f5-ac91-8d66c38bbf30 tempest-VolumesListAdminTestJSON-1254674282 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 11:51:34 devstack sudo[97715]: pam_unix(sudo:session): session closed for user root Nov 06 11:51:34 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-f2fb3b2c-1e48-46f5-ac91-8d66c38bbf30 tempest-VolumesListAdminTestJSON-1254674282 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 11:51:34 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-f2fb3b2c-1e48-46f5-ac91-8d66c38bbf30 tempest-VolumesListAdminTestJSON-1254674282 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 11:51:34 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-f2fb3b2c-1e48-46f5-ac91-8d66c38bbf30 tempest-VolumesListAdminTestJSON-1254674282 None] Selected osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f as target Quobyte volume. {{(pid=87116) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 11:51:34 devstack cinder-volume[87116]: INFO cinder.volume.drivers.remotefs [None req-f2fb3b2c-1e48-46f5-ac91-8d66c38bbf30 tempest-VolumesListAdminTestJSON-1254674282 None] casted to osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f Nov 06 11:51:34 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-f2fb3b2c-1e48-46f5-ac91-8d66c38bbf30 tempest-VolumesListAdminTestJSON-1254674282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-8af229b3-6b42-4f2b-80fc-dc28e0323035 1073741824 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:51:34 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-ba7e3c54-e180-475d-828d-643f9a43f134 tempest-VolumeTypesAccessTest-299175799 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756" returned: 0 in 0.334s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:51:34 devstack cinder-volume[87116]: DEBUG cinder.manager [None req-ba7e3c54-e180-475d-828d-643f9a43f134 tempest-VolumeTypesAccessTest-299175799 None] Notifying Schedulers of capabilities ... {{(pid=87116) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 11:51:34 devstack sudo[97719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-8af229b3-6b42-4f2b-80fc-dc28e0323035 1073741824 Nov 06 11:51:34 devstack sudo[97719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:51:34 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-ba7e3c54-e180-475d-828d-643f9a43f134 tempest-VolumeTypesAccessTest-299175799 None] Deleted volume successfully. Nov 06 11:51:34 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-884da457-81c0-4579-91ae-94492e056405 tempest-VolumesSnapshotNegativeTestJSON-1267713697 None] Create snapshot completed successfully Nov 06 11:51:34 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-ba7e3c54-e180-475d-828d-643f9a43f134 tempest-VolumeTypesAccessTest-299175799 None] Lock "cinder-f5127dc0-b2f2-4bff-a049-5571f3fb1a20-delete_volume" released by "delete_volume" :: held 1.912s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 11:51:34 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-1eb394fd-7955-40b3-9e5e-553b3a72bfc1 tempest-VolumesSnapshotNegativeTestJSON-1267713697 None] Acquiring lock "cinder-509c33ed-31cb-4df0-a72e-e5df82e9d1ad-delete_snapshot" by "delete_snapshot" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 11:51:34 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-1eb394fd-7955-40b3-9e5e-553b3a72bfc1 tempest-VolumesSnapshotNegativeTestJSON-1267713697 None] Lock "cinder-509c33ed-31cb-4df0-a72e-e5df82e9d1ad-delete_snapshot" acquired by "delete_snapshot" :: waited 0.038s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 11:51:34 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-1eb394fd-7955-40b3-9e5e-553b3a72bfc1 tempest-VolumesSnapshotNegativeTestJSON-1267713697 None] Acquiring lock "cinder-quobyte-1e6ed515-0a4f-456f-815a-2fc9f07d62f6" by "delete_snapshot" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 11:51:35 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-1eb394fd-7955-40b3-9e5e-553b3a72bfc1 tempest-VolumesSnapshotNegativeTestJSON-1267713697 None] Lock "cinder-quobyte-1e6ed515-0a4f-456f-815a-2fc9f07d62f6" acquired by "delete_snapshot" :: waited 0.044s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 11:51:35 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-1eb394fd-7955-40b3-9e5e-553b3a72bfc1 tempest-VolumesSnapshotNegativeTestJSON-1267713697 None] Acquiring lock "cinder-quobyte-509c33ed-31cb-4df0-a72e-e5df82e9d1ad" by "_delete_snapshot" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 11:51:35 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-1eb394fd-7955-40b3-9e5e-553b3a72bfc1 tempest-VolumesSnapshotNegativeTestJSON-1267713697 None] Lock "cinder-quobyte-509c33ed-31cb-4df0-a72e-e5df82e9d1ad" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 11:51:35 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-1eb394fd-7955-40b3-9e5e-553b3a72bfc1 tempest-VolumesSnapshotNegativeTestJSON-1267713697 None] Deleting offline snapshot 509c33ed-31cb-4df0-a72e-e5df82e9d1ad of volume 1e6ed515-0a4f-456f-815a-2fc9f07d62f6 {{(pid=87116) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 06 11:51:35 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-1eb394fd-7955-40b3-9e5e-553b3a72bfc1 tempest-VolumesSnapshotNegativeTestJSON-1267713697 None] snapshot_file for this snap is: volume-1e6ed515-0a4f-456f-815a-2fc9f07d62f6.509c33ed-31cb-4df0-a72e-e5df82e9d1ad {{(pid=87116) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 06 11:51:35 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[eabc2d6f-21b3-4f0f-88b5-6b5fea777347]: (4, 'qcow2') {{(pid=88420) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 11:51:35 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-1eb394fd-7955-40b3-9e5e-553b3a72bfc1 tempest-VolumesSnapshotNegativeTestJSON-1267713697 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-1e6ed515-0a4f-456f-815a-2fc9f07d62f6.509c33ed-31cb-4df0-a72e-e5df82e9d1ad {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:51:35 devstack sudo[97724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-1e6ed515-0a4f-456f-815a-2fc9f07d62f6.509c33ed-31cb-4df0-a72e-e5df82e9d1ad Nov 06 11:51:35 devstack sudo[97724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:51:35 devstack sudo[97719]: pam_unix(sudo:session): session closed for user root Nov 06 11:51:35 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-f2fb3b2c-1e48-46f5-ac91-8d66c38bbf30 tempest-VolumesListAdminTestJSON-1254674282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-8af229b3-6b42-4f2b-80fc-dc28e0323035 1073741824" returned: 0 in 0.815s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:51:35 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-f2fb3b2c-1e48-46f5-ac91-8d66c38bbf30 tempest-VolumesListAdminTestJSON-1254674282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-8af229b3-6b42-4f2b-80fc-dc28e0323035 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:51:35 devstack sudo[97727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-8af229b3-6b42-4f2b-80fc-dc28e0323035 Nov 06 11:51:35 devstack sudo[97727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:51:35 devstack sudo[97724]: pam_unix(sudo:session): session closed for user root Nov 06 11:51:35 devstack sudo[97727]: pam_unix(sudo:session): session closed for user root Nov 06 11:51:35 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-1eb394fd-7955-40b3-9e5e-553b3a72bfc1 tempest-VolumesSnapshotNegativeTestJSON-1267713697 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-1e6ed515-0a4f-456f-815a-2fc9f07d62f6.509c33ed-31cb-4df0-a72e-e5df82e9d1ad" returned: 0 in 0.750s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:51:35 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-1eb394fd-7955-40b3-9e5e-553b3a72bfc1 tempest-VolumesSnapshotNegativeTestJSON-1267713697 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1e6ed515-0a4f-456f-815a-2fc9f07d62f6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87116) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 11:51:35 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-f2fb3b2c-1e48-46f5-ac91-8d66c38bbf30 tempest-VolumesListAdminTestJSON-1254674282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-8af229b3-6b42-4f2b-80fc-dc28e0323035" returned: 0 in 0.364s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:51:35 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-f2fb3b2c-1e48-46f5-ac91-8d66c38bbf30 tempest-VolumesListAdminTestJSON-1254674282 None] <== create_volume: return (1276ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f'} {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 11:51:35 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-f2fb3b2c-1e48-46f5-ac91-8d66c38bbf30 tempest-VolumesListAdminTestJSON-1254674282 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.282s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 11:51:35 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[efe01704-b874-4928-8509-aa4e462f5684]: (4, 'qcow2') {{(pid=88420) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 11:51:35 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-1eb394fd-7955-40b3-9e5e-553b3a72bfc1 tempest-VolumesSnapshotNegativeTestJSON-1267713697 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-1e6ed515-0a4f-456f-815a-2fc9f07d62f6 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:51:35 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-f2fb3b2c-1e48-46f5-ac91-8d66c38bbf30 tempest-VolumesListAdminTestJSON-1254674282 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (206ed052-737a-4cad-88e0-b36daf3e8c11) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8af229b3-6b42-4f2b-80fc-dc28e0323035', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:51:35 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-f2fb3b2c-1e48-46f5-ac91-8d66c38bbf30 tempest-VolumesListAdminTestJSON-1254674282 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (99442a44-8158-4121-9489-866f6aafe534) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:51:36 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-f2fb3b2c-1e48-46f5-ac91-8d66c38bbf30 tempest-VolumesListAdminTestJSON-1254674282 None] Volume volume-8af229b3-6b42-4f2b-80fc-dc28e0323035 (8af229b3-6b42-4f2b-80fc-dc28e0323035): created successfully Nov 06 11:51:36 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-f2fb3b2c-1e48-46f5-ac91-8d66c38bbf30 tempest-VolumesListAdminTestJSON-1254674282 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (99442a44-8158-4121-9489-866f6aafe534) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:51:36 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-f2fb3b2c-1e48-46f5-ac91-8d66c38bbf30 tempest-VolumesListAdminTestJSON-1254674282 None] Flow 'volume_create_manager' (3cbfecca-065e-428b-b83b-88f0f202bdbe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 11:51:36 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-f2fb3b2c-1e48-46f5-ac91-8d66c38bbf30 tempest-VolumesListAdminTestJSON-1254674282 None] Created volume successfully. Nov 06 11:51:36 devstack sudo[97733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-1e6ed515-0a4f-456f-815a-2fc9f07d62f6 Nov 06 11:51:36 devstack sudo[97733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:51:36 devstack sudo[97733]: pam_unix(sudo:session): session closed for user root Nov 06 11:51:36 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-1eb394fd-7955-40b3-9e5e-553b3a72bfc1 tempest-VolumesSnapshotNegativeTestJSON-1267713697 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-1e6ed515-0a4f-456f-815a-2fc9f07d62f6" returned: 0 in 0.760s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:51:36 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-1eb394fd-7955-40b3-9e5e-553b3a72bfc1 tempest-VolumesSnapshotNegativeTestJSON-1267713697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-1e6ed515-0a4f-456f-815a-2fc9f07d62f6.509c33ed-31cb-4df0-a72e-e5df82e9d1ad {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:51:36 devstack sudo[97739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-1e6ed515-0a4f-456f-815a-2fc9f07d62f6.509c33ed-31cb-4df0-a72e-e5df82e9d1ad Nov 06 11:51:36 devstack sudo[97739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:51:37 devstack sudo[97739]: pam_unix(sudo:session): session closed for user root Nov 06 11:51:37 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-1eb394fd-7955-40b3-9e5e-553b3a72bfc1 tempest-VolumesSnapshotNegativeTestJSON-1267713697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-1e6ed515-0a4f-456f-815a-2fc9f07d62f6.509c33ed-31cb-4df0-a72e-e5df82e9d1ad" returned: 0 in 0.459s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:51:37 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-1eb394fd-7955-40b3-9e5e-553b3a72bfc1 tempest-VolumesSnapshotNegativeTestJSON-1267713697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-1e6ed515-0a4f-456f-815a-2fc9f07d62f6.509c33ed-31cb-4df0-a72e-e5df82e9d1ad {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:51:37 devstack sudo[97745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-1e6ed515-0a4f-456f-815a-2fc9f07d62f6.509c33ed-31cb-4df0-a72e-e5df82e9d1ad Nov 06 11:51:37 devstack sudo[97745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:51:37 devstack cinder-volume[87116]: DEBUG cinder.volume.flows.manager.create_volume [None req-5df9f30a-7ed3-4033-9088-3563294febcb tempest-VolumesListAdminTestJSON-1254674282 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87116) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 11:51:37 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-5df9f30a-7ed3-4033-9088-3563294febcb tempest-VolumesListAdminTestJSON-1254674282 None] Flow 'volume_create_manager' (1a23ecb8-3cdc-4a0c-833c-3d571911df1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 11:51:37 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-5df9f30a-7ed3-4033-9088-3563294febcb tempest-VolumesListAdminTestJSON-1254674282 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e189d152-dfbe-4adc-a17f-5332f7499658) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:51:37 devstack sudo[97745]: pam_unix(sudo:session): session closed for user root Nov 06 11:51:37 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-5df9f30a-7ed3-4033-9088-3563294febcb tempest-VolumesListAdminTestJSON-1254674282 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e189d152-dfbe-4adc-a17f-5332f7499658) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T10:51:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1722255333',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4bae6287-38a9-4e96-b05f-17bbfd548d03,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b2d8b263f164935a7cf8437672ad6c4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T10:51:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T10:51:37Z,use_quota=True,user_id='799b237ce31c4910a3124c6c0825afc2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(34d3b144-d9b7-480a-a2e3-01e45f3d54c1),volume_type_id=34d3b144-d9b7-480a-a2e3-01e45f3d54c1)' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:51:37 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-5df9f30a-7ed3-4033-9088-3563294febcb tempest-VolumesListAdminTestJSON-1254674282 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (14d91d9c-9e56-4216-9d63-f10819bf9e52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:51:37 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-5df9f30a-7ed3-4033-9088-3563294febcb tempest-VolumesListAdminTestJSON-1254674282 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (14d91d9c-9e56-4216-9d63-f10819bf9e52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:51:37 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-5df9f30a-7ed3-4033-9088-3563294febcb tempest-VolumesListAdminTestJSON-1254674282 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (422f3d11-bc43-458f-bebf-11d76d6eefbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:51:37 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-5df9f30a-7ed3-4033-9088-3563294febcb tempest-VolumesListAdminTestJSON-1254674282 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (422f3d11-bc43-458f-bebf-11d76d6eefbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4bae6287-38a9-4e96-b05f-17bbfd548d03', 'volume_name': 'volume-4bae6287-38a9-4e96-b05f-17bbfd548d03', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:51:37 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-5df9f30a-7ed3-4033-9088-3563294febcb tempest-VolumesListAdminTestJSON-1254674282 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a731e087-bd6b-4db8-a549-4e8f7eecf5fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:51:37 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-5df9f30a-7ed3-4033-9088-3563294febcb tempest-VolumesListAdminTestJSON-1254674282 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a731e087-bd6b-4db8-a549-4e8f7eecf5fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:51:37 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-5df9f30a-7ed3-4033-9088-3563294febcb tempest-VolumesListAdminTestJSON-1254674282 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f0875163-21f2-4a86-aa24-4f9b9415020f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:51:37 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-5df9f30a-7ed3-4033-9088-3563294febcb tempest-VolumesListAdminTestJSON-1254674282 None] Volume 4bae6287-38a9-4e96-b05f-17bbfd548d03: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4bae6287-38a9-4e96-b05f-17bbfd548d03', 'volume_size': 1} Nov 06 11:51:37 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-5df9f30a-7ed3-4033-9088-3563294febcb tempest-VolumesListAdminTestJSON-1254674282 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 11:51:37 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-5df9f30a-7ed3-4033-9088-3563294febcb tempest-VolumesListAdminTestJSON-1254674282 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 11:51:37 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-5df9f30a-7ed3-4033-9088-3563294febcb tempest-VolumesListAdminTestJSON-1254674282 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T10:51:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1722255333',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4bae6287-38a9-4e96-b05f-17bbfd548d03,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b2d8b263f164935a7cf8437672ad6c4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T10:51:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T10:51:37Z,use_quota=True,user_id='799b237ce31c4910a3124c6c0825afc2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(34d3b144-d9b7-480a-a2e3-01e45f3d54c1),volume_type_id=34d3b144-d9b7-480a-a2e3-01e45f3d54c1)}" {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 11:51:37 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-5df9f30a-7ed3-4033-9088-3563294febcb tempest-VolumesListAdminTestJSON-1254674282 None] Creating volume 4bae6287-38a9-4e96-b05f-17bbfd548d03 {{(pid=87116) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 11:51:37 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-5df9f30a-7ed3-4033-9088-3563294febcb tempest-VolumesListAdminTestJSON-1254674282 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 11:51:37 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-5df9f30a-7ed3-4033-9088-3563294febcb tempest-VolumesListAdminTestJSON-1254674282 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 11:51:37 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-5df9f30a-7ed3-4033-9088-3563294febcb tempest-VolumesListAdminTestJSON-1254674282 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 11:51:37 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-5df9f30a-7ed3-4033-9088-3563294febcb tempest-VolumesListAdminTestJSON-1254674282 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 11:51:37 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-5df9f30a-7ed3-4033-9088-3563294febcb tempest-VolumesListAdminTestJSON-1254674282 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 11:51:37 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-5df9f30a-7ed3-4033-9088-3563294febcb tempest-VolumesListAdminTestJSON-1254674282 None] Selected osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f as target Quobyte volume. {{(pid=87116) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 11:51:37 devstack cinder-volume[87116]: INFO cinder.volume.drivers.remotefs [None req-5df9f30a-7ed3-4033-9088-3563294febcb tempest-VolumesListAdminTestJSON-1254674282 None] casted to osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f Nov 06 11:51:37 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-5df9f30a-7ed3-4033-9088-3563294febcb tempest-VolumesListAdminTestJSON-1254674282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-4bae6287-38a9-4e96-b05f-17bbfd548d03 1073741824 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:51:37 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-1eb394fd-7955-40b3-9e5e-553b3a72bfc1 tempest-VolumesSnapshotNegativeTestJSON-1267713697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-1e6ed515-0a4f-456f-815a-2fc9f07d62f6.509c33ed-31cb-4df0-a72e-e5df82e9d1ad" returned: 0 in 0.521s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:51:37 devstack sudo[97755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-4bae6287-38a9-4e96-b05f-17bbfd548d03 1073741824 Nov 06 11:51:37 devstack sudo[97755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:51:37 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-1eb394fd-7955-40b3-9e5e-553b3a72bfc1 tempest-VolumesSnapshotNegativeTestJSON-1267713697 None] Lock "cinder-quobyte-509c33ed-31cb-4df0-a72e-e5df82e9d1ad" released by "_delete_snapshot" :: held 2.694s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 11:51:37 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-1eb394fd-7955-40b3-9e5e-553b3a72bfc1 tempest-VolumesSnapshotNegativeTestJSON-1267713697 None] Lock "cinder-quobyte-1e6ed515-0a4f-456f-815a-2fc9f07d62f6" released by "delete_snapshot" :: held 2.751s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 11:51:37 devstack cinder-volume[87116]: DEBUG cinder.quota [None req-1eb394fd-7955-40b3-9e5e-553b3a72bfc1 tempest-VolumesSnapshotNegativeTestJSON-1267713697 None] Created reservations ['b6f9893b-ceb5-4a3b-a894-898e3d282000', '940f0039-9fad-45a6-ba0f-fd4971931343', '0a4bc813-bac5-44a8-b591-d9dd8c2490da', '1c9d74b1-f259-455a-ae75-86766976799e'] {{(pid=87116) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 11:51:38 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-1eb394fd-7955-40b3-9e5e-553b3a72bfc1 tempest-VolumesSnapshotNegativeTestJSON-1267713697 None] Delete snapshot completed successfully. Nov 06 11:51:38 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-1eb394fd-7955-40b3-9e5e-553b3a72bfc1 tempest-VolumesSnapshotNegativeTestJSON-1267713697 None] Lock "cinder-509c33ed-31cb-4df0-a72e-e5df82e9d1ad-delete_snapshot" released by "delete_snapshot" :: held 3.237s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 11:51:38 devstack sudo[97755]: pam_unix(sudo:session): session closed for user root Nov 06 11:51:38 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-5df9f30a-7ed3-4033-9088-3563294febcb tempest-VolumesListAdminTestJSON-1254674282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-4bae6287-38a9-4e96-b05f-17bbfd548d03 1073741824" returned: 0 in 0.704s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:51:38 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-01a669f5-aa38-449c-a56a-ada3711ad8c1 tempest-VolumesSnapshotNegativeTestJSON-1267713697 None] Acquiring lock "cinder-1e6ed515-0a4f-456f-815a-2fc9f07d62f6-delete_volume" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 11:51:38 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-5df9f30a-7ed3-4033-9088-3563294febcb tempest-VolumesListAdminTestJSON-1254674282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-4bae6287-38a9-4e96-b05f-17bbfd548d03 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:51:38 devstack sudo[97760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-4bae6287-38a9-4e96-b05f-17bbfd548d03 Nov 06 11:51:38 devstack sudo[97760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:51:38 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-01a669f5-aa38-449c-a56a-ada3711ad8c1 tempest-VolumesSnapshotNegativeTestJSON-1267713697 None] Lock "cinder-1e6ed515-0a4f-456f-815a-2fc9f07d62f6-delete_volume" acquired by "delete_volume" :: waited 0.072s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 11:51:38 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-01a669f5-aa38-449c-a56a-ada3711ad8c1 tempest-VolumesSnapshotNegativeTestJSON-1267713697 None] Acquiring lock "cinder-quobyte-1e6ed515-0a4f-456f-815a-2fc9f07d62f6" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 11:51:38 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-01a669f5-aa38-449c-a56a-ada3711ad8c1 tempest-VolumesSnapshotNegativeTestJSON-1267713697 None] Lock "cinder-quobyte-1e6ed515-0a4f-456f-815a-2fc9f07d62f6" acquired by "delete_volume" :: waited 0.022s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 11:51:38 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[4402b4ee-b080-45b2-bb8b-abd6c61dabb4]: (4, 'qcow2') {{(pid=88420) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 11:51:38 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-01a669f5-aa38-449c-a56a-ada3711ad8c1 tempest-VolumesSnapshotNegativeTestJSON-1267713697 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-1e6ed515-0a4f-456f-815a-2fc9f07d62f6 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:51:38 devstack sudo[97760]: pam_unix(sudo:session): session closed for user root Nov 06 11:51:38 devstack sudo[97762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-1e6ed515-0a4f-456f-815a-2fc9f07d62f6 Nov 06 11:51:38 devstack sudo[97762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:51:38 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-5df9f30a-7ed3-4033-9088-3563294febcb tempest-VolumesListAdminTestJSON-1254674282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-4bae6287-38a9-4e96-b05f-17bbfd548d03" returned: 0 in 0.334s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:51:38 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-5df9f30a-7ed3-4033-9088-3563294febcb tempest-VolumesListAdminTestJSON-1254674282 None] <== create_volume: return (1294ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f'} {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 11:51:38 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-5df9f30a-7ed3-4033-9088-3563294febcb tempest-VolumesListAdminTestJSON-1254674282 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.299s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 11:51:38 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-5df9f30a-7ed3-4033-9088-3563294febcb tempest-VolumesListAdminTestJSON-1254674282 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f0875163-21f2-4a86-aa24-4f9b9415020f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4bae6287-38a9-4e96-b05f-17bbfd548d03', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:51:38 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-5df9f30a-7ed3-4033-9088-3563294febcb tempest-VolumesListAdminTestJSON-1254674282 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (49e98512-fb41-4b0a-bfe4-9a49df0ec40b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:51:38 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-5df9f30a-7ed3-4033-9088-3563294febcb tempest-VolumesListAdminTestJSON-1254674282 None] Volume volume-4bae6287-38a9-4e96-b05f-17bbfd548d03 (4bae6287-38a9-4e96-b05f-17bbfd548d03): created successfully Nov 06 11:51:38 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-5df9f30a-7ed3-4033-9088-3563294febcb tempest-VolumesListAdminTestJSON-1254674282 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (49e98512-fb41-4b0a-bfe4-9a49df0ec40b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:51:38 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-5df9f30a-7ed3-4033-9088-3563294febcb tempest-VolumesListAdminTestJSON-1254674282 None] Flow 'volume_create_manager' (1a23ecb8-3cdc-4a0c-833c-3d571911df1b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 11:51:39 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-5df9f30a-7ed3-4033-9088-3563294febcb tempest-VolumesListAdminTestJSON-1254674282 None] Created volume successfully. Nov 06 11:51:39 devstack sudo[97762]: pam_unix(sudo:session): session closed for user root Nov 06 11:51:39 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-01a669f5-aa38-449c-a56a-ada3711ad8c1 tempest-VolumesSnapshotNegativeTestJSON-1267713697 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-1e6ed515-0a4f-456f-815a-2fc9f07d62f6" returned: 0 in 0.416s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:51:39 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-01a669f5-aa38-449c-a56a-ada3711ad8c1 tempest-VolumesSnapshotNegativeTestJSON-1267713697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-1e6ed515-0a4f-456f-815a-2fc9f07d62f6 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:51:39 devstack sudo[97768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-1e6ed515-0a4f-456f-815a-2fc9f07d62f6 Nov 06 11:51:39 devstack sudo[97768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:51:39 devstack sudo[97768]: pam_unix(sudo:session): session closed for user root Nov 06 11:51:39 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-01a669f5-aa38-449c-a56a-ada3711ad8c1 tempest-VolumesSnapshotNegativeTestJSON-1267713697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-1e6ed515-0a4f-456f-815a-2fc9f07d62f6" returned: 0 in 0.392s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:51:39 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-01a669f5-aa38-449c-a56a-ada3711ad8c1 tempest-VolumesSnapshotNegativeTestJSON-1267713697 None] Lock "cinder-quobyte-1e6ed515-0a4f-456f-815a-2fc9f07d62f6" released by "delete_volume" :: held 0.901s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 11:51:39 devstack cinder-volume[87116]: DEBUG cinder.quota [None req-01a669f5-aa38-449c-a56a-ada3711ad8c1 tempest-VolumesSnapshotNegativeTestJSON-1267713697 None] Created reservations ['1f7d7f2a-28e6-4c4b-9019-a6ee5312f60c', '2020b8e0-befe-44c2-9924-cdae01f9ce38', '5b8a437e-90d8-47cc-acbc-d50f5d508b60', '468043cc-3a26-43e1-aa71-1ec7bca0bb51'] {{(pid=87116) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 11:51:39 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-01a669f5-aa38-449c-a56a-ada3711ad8c1 tempest-VolumesSnapshotNegativeTestJSON-1267713697 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 11:51:39 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-01a669f5-aa38-449c-a56a-ada3711ad8c1 tempest-VolumesSnapshotNegativeTestJSON-1267713697 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 11:51:39 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-01a669f5-aa38-449c-a56a-ada3711ad8c1 tempest-VolumesSnapshotNegativeTestJSON-1267713697 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 11:51:39 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-01a669f5-aa38-449c-a56a-ada3711ad8c1 tempest-VolumesSnapshotNegativeTestJSON-1267713697 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 11:51:39 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-01a669f5-aa38-449c-a56a-ada3711ad8c1 tempest-VolumesSnapshotNegativeTestJSON-1267713697 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 11:51:39 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-01a669f5-aa38-449c-a56a-ada3711ad8c1 tempest-VolumesSnapshotNegativeTestJSON-1267713697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:51:39 devstack cinder-volume[87116]: DEBUG oslo_service.periodic_task [None req-4fab4816-ec2b-4b19-b2ff-8548f2084354 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87116) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 11:51:39 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-4fab4816-ec2b-4b19-b2ff-8548f2084354 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 11:51:39 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-4fab4816-ec2b-4b19-b2ff-8548f2084354 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 11:51:39 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-4fab4816-ec2b-4b19-b2ff-8548f2084354 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 11:51:39 devstack sudo[97771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756 Nov 06 11:51:39 devstack sudo[97771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:51:39 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-4fab4816-ec2b-4b19-b2ff-8548f2084354 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 11:51:39 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-4fab4816-ec2b-4b19-b2ff-8548f2084354 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 11:51:39 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-4fab4816-ec2b-4b19-b2ff-8548f2084354 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:51:39 devstack sudo[97773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756 Nov 06 11:51:39 devstack sudo[97773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:51:40 devstack sudo[97771]: pam_unix(sudo:session): session closed for user root Nov 06 11:51:40 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-01a669f5-aa38-449c-a56a-ada3711ad8c1 tempest-VolumesSnapshotNegativeTestJSON-1267713697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756" returned: 0 in 0.561s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:51:40 devstack cinder-volume[87116]: DEBUG cinder.manager [None req-01a669f5-aa38-449c-a56a-ada3711ad8c1 tempest-VolumesSnapshotNegativeTestJSON-1267713697 None] Notifying Schedulers of capabilities ... {{(pid=87116) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 11:51:40 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-01a669f5-aa38-449c-a56a-ada3711ad8c1 tempest-VolumesSnapshotNegativeTestJSON-1267713697 None] Deleted volume successfully. Nov 06 11:51:40 devstack sudo[97773]: pam_unix(sudo:session): session closed for user root Nov 06 11:51:40 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-4fab4816-ec2b-4b19-b2ff-8548f2084354 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756" returned: 0 in 0.517s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:51:40 devstack cinder-volume[87116]: DEBUG cinder.manager [None req-4fab4816-ec2b-4b19-b2ff-8548f2084354 None None] Notifying Schedulers of capabilities ... {{(pid=87116) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 11:51:40 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-01a669f5-aa38-449c-a56a-ada3711ad8c1 tempest-VolumesSnapshotNegativeTestJSON-1267713697 None] Lock "cinder-1e6ed515-0a4f-456f-815a-2fc9f07d62f6-delete_volume" released by "delete_volume" :: held 1.784s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 11:51:40 devstack cinder-volume[87116]: DEBUG oslo_service.periodic_task [None req-4fab4816-ec2b-4b19-b2ff-8548f2084354 None None] Running periodic task VolumeManager._thread_info {{(pid=87116) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 11:51:40 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-4fab4816-ec2b-4b19-b2ff-8548f2084354 None None] thread count: 28 {{(pid=87116) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 06 11:51:40 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-4fab4816-ec2b-4b19-b2ff-8548f2084354 None None] thread info: [<_MainThread(MainThread, started 131399520669824)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87116) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 06 11:51:40 devstack cinder-volume[87116]: DEBUG cinder.volume.flows.manager.create_volume [None req-62d59ac7-7c45-4f85-bb9c-9cfc0d73456b tempest-VolumesListAdminTestJSON-1254674282 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87116) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 11:51:40 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-62d59ac7-7c45-4f85-bb9c-9cfc0d73456b tempest-VolumesListAdminTestJSON-1254674282 None] Flow 'volume_create_manager' (a7b8b16b-72e7-4437-aafa-b582d1d2b6ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 11:51:40 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-62d59ac7-7c45-4f85-bb9c-9cfc0d73456b tempest-VolumesListAdminTestJSON-1254674282 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (538a82b3-3eb1-44cb-bec0-10fac08ef474) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:51:40 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-62d59ac7-7c45-4f85-bb9c-9cfc0d73456b tempest-VolumesListAdminTestJSON-1254674282 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (538a82b3-3eb1-44cb-bec0-10fac08ef474) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T10:51:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1147752938',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d709d6ce-3182-46f7-9914-517722d833a8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b2d8b263f164935a7cf8437672ad6c4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T10:51:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T10:51:41Z,use_quota=True,user_id='799b237ce31c4910a3124c6c0825afc2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(34d3b144-d9b7-480a-a2e3-01e45f3d54c1),volume_type_id=34d3b144-d9b7-480a-a2e3-01e45f3d54c1)' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:51:40 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-62d59ac7-7c45-4f85-bb9c-9cfc0d73456b tempest-VolumesListAdminTestJSON-1254674282 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ca8a8f4-8e40-423f-b1a9-7df77008da7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:51:40 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-62d59ac7-7c45-4f85-bb9c-9cfc0d73456b tempest-VolumesListAdminTestJSON-1254674282 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ca8a8f4-8e40-423f-b1a9-7df77008da7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:51:40 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-62d59ac7-7c45-4f85-bb9c-9cfc0d73456b tempest-VolumesListAdminTestJSON-1254674282 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5649e17c-e008-4e6c-8753-63fae7951e51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:51:40 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-62d59ac7-7c45-4f85-bb9c-9cfc0d73456b tempest-VolumesListAdminTestJSON-1254674282 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5649e17c-e008-4e6c-8753-63fae7951e51) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd709d6ce-3182-46f7-9914-517722d833a8', 'volume_name': 'volume-d709d6ce-3182-46f7-9914-517722d833a8', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:51:40 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-62d59ac7-7c45-4f85-bb9c-9cfc0d73456b tempest-VolumesListAdminTestJSON-1254674282 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (697389e6-a304-44c2-b638-0cdba7986607) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:51:40 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-62d59ac7-7c45-4f85-bb9c-9cfc0d73456b tempest-VolumesListAdminTestJSON-1254674282 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (697389e6-a304-44c2-b638-0cdba7986607) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:51:40 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-62d59ac7-7c45-4f85-bb9c-9cfc0d73456b tempest-VolumesListAdminTestJSON-1254674282 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7330afc6-ab47-4cec-93bf-90ce2ad0a473) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:51:40 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-62d59ac7-7c45-4f85-bb9c-9cfc0d73456b tempest-VolumesListAdminTestJSON-1254674282 None] Volume d709d6ce-3182-46f7-9914-517722d833a8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d709d6ce-3182-46f7-9914-517722d833a8', 'volume_size': 1} Nov 06 11:51:40 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-62d59ac7-7c45-4f85-bb9c-9cfc0d73456b tempest-VolumesListAdminTestJSON-1254674282 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 11:51:40 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-62d59ac7-7c45-4f85-bb9c-9cfc0d73456b tempest-VolumesListAdminTestJSON-1254674282 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 11:51:40 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-62d59ac7-7c45-4f85-bb9c-9cfc0d73456b tempest-VolumesListAdminTestJSON-1254674282 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T10:51:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1147752938',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d709d6ce-3182-46f7-9914-517722d833a8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b2d8b263f164935a7cf8437672ad6c4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T10:51:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T10:51:41Z,use_quota=True,user_id='799b237ce31c4910a3124c6c0825afc2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(34d3b144-d9b7-480a-a2e3-01e45f3d54c1),volume_type_id=34d3b144-d9b7-480a-a2e3-01e45f3d54c1)}" {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 11:51:40 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-62d59ac7-7c45-4f85-bb9c-9cfc0d73456b tempest-VolumesListAdminTestJSON-1254674282 None] Creating volume d709d6ce-3182-46f7-9914-517722d833a8 {{(pid=87116) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 11:51:40 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-62d59ac7-7c45-4f85-bb9c-9cfc0d73456b tempest-VolumesListAdminTestJSON-1254674282 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 11:51:40 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-62d59ac7-7c45-4f85-bb9c-9cfc0d73456b tempest-VolumesListAdminTestJSON-1254674282 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 11:51:40 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-62d59ac7-7c45-4f85-bb9c-9cfc0d73456b tempest-VolumesListAdminTestJSON-1254674282 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 11:51:40 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-62d59ac7-7c45-4f85-bb9c-9cfc0d73456b tempest-VolumesListAdminTestJSON-1254674282 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 11:51:40 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-62d59ac7-7c45-4f85-bb9c-9cfc0d73456b tempest-VolumesListAdminTestJSON-1254674282 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 11:51:40 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-62d59ac7-7c45-4f85-bb9c-9cfc0d73456b tempest-VolumesListAdminTestJSON-1254674282 None] Selected osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f as target Quobyte volume. {{(pid=87116) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 11:51:40 devstack cinder-volume[87116]: INFO cinder.volume.drivers.remotefs [None req-62d59ac7-7c45-4f85-bb9c-9cfc0d73456b tempest-VolumesListAdminTestJSON-1254674282 None] casted to osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f Nov 06 11:51:40 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-62d59ac7-7c45-4f85-bb9c-9cfc0d73456b tempest-VolumesListAdminTestJSON-1254674282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-d709d6ce-3182-46f7-9914-517722d833a8 1073741824 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:51:40 devstack sudo[97777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-d709d6ce-3182-46f7-9914-517722d833a8 1073741824 Nov 06 11:51:40 devstack sudo[97777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:51:41 devstack sudo[97777]: pam_unix(sudo:session): session closed for user root Nov 06 11:51:41 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-62d59ac7-7c45-4f85-bb9c-9cfc0d73456b tempest-VolumesListAdminTestJSON-1254674282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-d709d6ce-3182-46f7-9914-517722d833a8 1073741824" returned: 0 in 0.605s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:51:41 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-62d59ac7-7c45-4f85-bb9c-9cfc0d73456b tempest-VolumesListAdminTestJSON-1254674282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-d709d6ce-3182-46f7-9914-517722d833a8 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:51:41 devstack sudo[97783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-d709d6ce-3182-46f7-9914-517722d833a8 Nov 06 11:51:41 devstack sudo[97783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:51:41 devstack sudo[97783]: pam_unix(sudo:session): session closed for user root Nov 06 11:51:41 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-62d59ac7-7c45-4f85-bb9c-9cfc0d73456b tempest-VolumesListAdminTestJSON-1254674282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-d709d6ce-3182-46f7-9914-517722d833a8" returned: 0 in 0.362s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:51:41 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-62d59ac7-7c45-4f85-bb9c-9cfc0d73456b tempest-VolumesListAdminTestJSON-1254674282 None] <== create_volume: return (1036ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f'} {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 11:51:41 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-62d59ac7-7c45-4f85-bb9c-9cfc0d73456b tempest-VolumesListAdminTestJSON-1254674282 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.038s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 11:51:41 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-62d59ac7-7c45-4f85-bb9c-9cfc0d73456b tempest-VolumesListAdminTestJSON-1254674282 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7330afc6-ab47-4cec-93bf-90ce2ad0a473) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d709d6ce-3182-46f7-9914-517722d833a8', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:51:41 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-62d59ac7-7c45-4f85-bb9c-9cfc0d73456b tempest-VolumesListAdminTestJSON-1254674282 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (845911a7-e209-4df3-9a9a-2552d1d28864) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:51:41 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-62d59ac7-7c45-4f85-bb9c-9cfc0d73456b tempest-VolumesListAdminTestJSON-1254674282 None] Volume volume-d709d6ce-3182-46f7-9914-517722d833a8 (d709d6ce-3182-46f7-9914-517722d833a8): created successfully Nov 06 11:51:41 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-62d59ac7-7c45-4f85-bb9c-9cfc0d73456b tempest-VolumesListAdminTestJSON-1254674282 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (845911a7-e209-4df3-9a9a-2552d1d28864) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:51:41 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-62d59ac7-7c45-4f85-bb9c-9cfc0d73456b tempest-VolumesListAdminTestJSON-1254674282 None] Flow 'volume_create_manager' (a7b8b16b-72e7-4437-aafa-b582d1d2b6ba) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 11:51:41 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-62d59ac7-7c45-4f85-bb9c-9cfc0d73456b tempest-VolumesListAdminTestJSON-1254674282 None] Created volume successfully. Nov 06 11:51:43 devstack cinder-volume[87116]: DEBUG cinder.volume.flows.manager.create_volume [None req-44fa5694-ac57-453b-a444-ecc0735ee33b tempest-VolumesListAdminTestJSON-1549595569 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87116) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 11:51:43 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-44fa5694-ac57-453b-a444-ecc0735ee33b tempest-VolumesListAdminTestJSON-1549595569 None] Flow 'volume_create_manager' (8637fe33-b8b8-4337-b7f0-1063c775208c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 11:51:43 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-44fa5694-ac57-453b-a444-ecc0735ee33b tempest-VolumesListAdminTestJSON-1549595569 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (66e7eb2e-adad-41a9-868d-1e97e3e01bc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:51:43 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-44fa5694-ac57-453b-a444-ecc0735ee33b tempest-VolumesListAdminTestJSON-1549595569 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (66e7eb2e-adad-41a9-868d-1e97e3e01bc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T10:51:43Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6b3a6f3e-c471-45b8-afee-5ef28a1ea487,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9d55c31b98644d2cafa7ace0d9866459',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T10:51:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T10:51:44Z,use_quota=True,user_id='1a98323b15004a87b91e0d8184db946a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(34d3b144-d9b7-480a-a2e3-01e45f3d54c1),volume_type_id=34d3b144-d9b7-480a-a2e3-01e45f3d54c1)' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:51:43 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-44fa5694-ac57-453b-a444-ecc0735ee33b tempest-VolumesListAdminTestJSON-1549595569 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f4c01357-df9c-4b52-9d54-517abea27498) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:51:43 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-44fa5694-ac57-453b-a444-ecc0735ee33b tempest-VolumesListAdminTestJSON-1549595569 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f4c01357-df9c-4b52-9d54-517abea27498) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:51:43 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-44fa5694-ac57-453b-a444-ecc0735ee33b tempest-VolumesListAdminTestJSON-1549595569 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (927f1363-05bf-4168-b69a-c0caa9b44ce5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:51:43 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-44fa5694-ac57-453b-a444-ecc0735ee33b tempest-VolumesListAdminTestJSON-1549595569 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (927f1363-05bf-4168-b69a-c0caa9b44ce5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6b3a6f3e-c471-45b8-afee-5ef28a1ea487', 'volume_name': 'volume-6b3a6f3e-c471-45b8-afee-5ef28a1ea487', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:51:43 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-44fa5694-ac57-453b-a444-ecc0735ee33b tempest-VolumesListAdminTestJSON-1549595569 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e1fcaf59-32ba-4dd6-a1b2-7dd292949021) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:51:43 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-44fa5694-ac57-453b-a444-ecc0735ee33b tempest-VolumesListAdminTestJSON-1549595569 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e1fcaf59-32ba-4dd6-a1b2-7dd292949021) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:51:43 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-44fa5694-ac57-453b-a444-ecc0735ee33b tempest-VolumesListAdminTestJSON-1549595569 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cdb32f04-9d00-4eb0-b0ee-3e6d2af9b1ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:51:43 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-44fa5694-ac57-453b-a444-ecc0735ee33b tempest-VolumesListAdminTestJSON-1549595569 None] Volume 6b3a6f3e-c471-45b8-afee-5ef28a1ea487: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6b3a6f3e-c471-45b8-afee-5ef28a1ea487', 'volume_size': 1} Nov 06 11:51:43 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-44fa5694-ac57-453b-a444-ecc0735ee33b tempest-VolumesListAdminTestJSON-1549595569 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 11:51:43 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-44fa5694-ac57-453b-a444-ecc0735ee33b tempest-VolumesListAdminTestJSON-1549595569 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 11:51:43 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-44fa5694-ac57-453b-a444-ecc0735ee33b tempest-VolumesListAdminTestJSON-1549595569 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T10:51:43Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6b3a6f3e-c471-45b8-afee-5ef28a1ea487,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9d55c31b98644d2cafa7ace0d9866459',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T10:51:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T10:51:44Z,use_quota=True,user_id='1a98323b15004a87b91e0d8184db946a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(34d3b144-d9b7-480a-a2e3-01e45f3d54c1),volume_type_id=34d3b144-d9b7-480a-a2e3-01e45f3d54c1)}" {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 11:51:43 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-44fa5694-ac57-453b-a444-ecc0735ee33b tempest-VolumesListAdminTestJSON-1549595569 None] Creating volume 6b3a6f3e-c471-45b8-afee-5ef28a1ea487 {{(pid=87116) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 11:51:43 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-44fa5694-ac57-453b-a444-ecc0735ee33b tempest-VolumesListAdminTestJSON-1549595569 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 11:51:43 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-44fa5694-ac57-453b-a444-ecc0735ee33b tempest-VolumesListAdminTestJSON-1549595569 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 11:51:43 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-44fa5694-ac57-453b-a444-ecc0735ee33b tempest-VolumesListAdminTestJSON-1549595569 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 11:51:43 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-44fa5694-ac57-453b-a444-ecc0735ee33b tempest-VolumesListAdminTestJSON-1549595569 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 11:51:43 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-44fa5694-ac57-453b-a444-ecc0735ee33b tempest-VolumesListAdminTestJSON-1549595569 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 11:51:43 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-44fa5694-ac57-453b-a444-ecc0735ee33b tempest-VolumesListAdminTestJSON-1549595569 None] Selected osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f as target Quobyte volume. {{(pid=87116) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 11:51:43 devstack cinder-volume[87116]: INFO cinder.volume.drivers.remotefs [None req-44fa5694-ac57-453b-a444-ecc0735ee33b tempest-VolumesListAdminTestJSON-1549595569 None] casted to osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f Nov 06 11:51:43 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-44fa5694-ac57-453b-a444-ecc0735ee33b tempest-VolumesListAdminTestJSON-1549595569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-6b3a6f3e-c471-45b8-afee-5ef28a1ea487 1073741824 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:51:43 devstack sudo[97788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-6b3a6f3e-c471-45b8-afee-5ef28a1ea487 1073741824 Nov 06 11:51:43 devstack sudo[97788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:51:44 devstack sudo[97788]: pam_unix(sudo:session): session closed for user root Nov 06 11:51:44 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-44fa5694-ac57-453b-a444-ecc0735ee33b tempest-VolumesListAdminTestJSON-1549595569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-6b3a6f3e-c471-45b8-afee-5ef28a1ea487 1073741824" returned: 0 in 0.723s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:51:44 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-44fa5694-ac57-453b-a444-ecc0735ee33b tempest-VolumesListAdminTestJSON-1549595569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-6b3a6f3e-c471-45b8-afee-5ef28a1ea487 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:51:44 devstack sudo[97795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-6b3a6f3e-c471-45b8-afee-5ef28a1ea487 Nov 06 11:51:44 devstack sudo[97795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:51:45 devstack sudo[97795]: pam_unix(sudo:session): session closed for user root Nov 06 11:51:45 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-44fa5694-ac57-453b-a444-ecc0735ee33b tempest-VolumesListAdminTestJSON-1549595569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-6b3a6f3e-c471-45b8-afee-5ef28a1ea487" returned: 0 in 0.409s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:51:45 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-44fa5694-ac57-453b-a444-ecc0735ee33b tempest-VolumesListAdminTestJSON-1549595569 None] <== create_volume: return (1221ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f'} {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 11:51:45 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-44fa5694-ac57-453b-a444-ecc0735ee33b tempest-VolumesListAdminTestJSON-1549595569 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.227s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 11:51:45 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-44fa5694-ac57-453b-a444-ecc0735ee33b tempest-VolumesListAdminTestJSON-1549595569 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cdb32f04-9d00-4eb0-b0ee-3e6d2af9b1ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6b3a6f3e-c471-45b8-afee-5ef28a1ea487', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:51:45 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-44fa5694-ac57-453b-a444-ecc0735ee33b tempest-VolumesListAdminTestJSON-1549595569 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a3d38a4d-eff8-4dd3-b6ab-27e3ed0f7009) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:51:45 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-44fa5694-ac57-453b-a444-ecc0735ee33b tempest-VolumesListAdminTestJSON-1549595569 None] Volume volume-6b3a6f3e-c471-45b8-afee-5ef28a1ea487 (6b3a6f3e-c471-45b8-afee-5ef28a1ea487): created successfully Nov 06 11:51:45 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-44fa5694-ac57-453b-a444-ecc0735ee33b tempest-VolumesListAdminTestJSON-1549595569 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a3d38a4d-eff8-4dd3-b6ab-27e3ed0f7009) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:51:45 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-44fa5694-ac57-453b-a444-ecc0735ee33b tempest-VolumesListAdminTestJSON-1549595569 None] Flow 'volume_create_manager' (8637fe33-b8b8-4337-b7f0-1063c775208c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 11:51:45 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-44fa5694-ac57-453b-a444-ecc0735ee33b tempest-VolumesListAdminTestJSON-1549595569 None] Created volume successfully. Nov 06 11:51:45 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-41538e8f-cb56-41b3-b4e9-8f47c7a48950 tempest-VolumesListAdminTestJSON-1549595569 None] Acquiring lock "cinder-6b3a6f3e-c471-45b8-afee-5ef28a1ea487-delete_volume" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 11:51:45 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-41538e8f-cb56-41b3-b4e9-8f47c7a48950 tempest-VolumesListAdminTestJSON-1549595569 None] Lock "cinder-6b3a6f3e-c471-45b8-afee-5ef28a1ea487-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 11:51:46 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-41538e8f-cb56-41b3-b4e9-8f47c7a48950 tempest-VolumesListAdminTestJSON-1549595569 None] Acquiring lock "cinder-quobyte-6b3a6f3e-c471-45b8-afee-5ef28a1ea487" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 11:51:46 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-41538e8f-cb56-41b3-b4e9-8f47c7a48950 tempest-VolumesListAdminTestJSON-1549595569 None] Lock "cinder-quobyte-6b3a6f3e-c471-45b8-afee-5ef28a1ea487" acquired by "delete_volume" :: waited 0.028s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 11:51:46 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d62adde-53c5-43c7-855a-bf262be97971]: (4, 'qcow2') {{(pid=88420) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 11:51:46 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-41538e8f-cb56-41b3-b4e9-8f47c7a48950 tempest-VolumesListAdminTestJSON-1549595569 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-6b3a6f3e-c471-45b8-afee-5ef28a1ea487 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:51:46 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-1fbbcf12-be35-40e1-b75a-d68213122238 tempest-VolumesListAdminTestJSON-1254674282 None] Acquiring lock "cinder-d709d6ce-3182-46f7-9914-517722d833a8-delete_volume" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 11:51:46 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-1fbbcf12-be35-40e1-b75a-d68213122238 tempest-VolumesListAdminTestJSON-1254674282 None] Lock "cinder-d709d6ce-3182-46f7-9914-517722d833a8-delete_volume" acquired by "delete_volume" :: waited 0.054s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 11:51:46 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-1fbbcf12-be35-40e1-b75a-d68213122238 tempest-VolumesListAdminTestJSON-1254674282 None] Acquiring lock "cinder-quobyte-d709d6ce-3182-46f7-9914-517722d833a8" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 11:51:46 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-1fbbcf12-be35-40e1-b75a-d68213122238 tempest-VolumesListAdminTestJSON-1254674282 None] Lock "cinder-quobyte-d709d6ce-3182-46f7-9914-517722d833a8" acquired by "delete_volume" :: waited 0.034s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 11:51:46 devstack sudo[97799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-6b3a6f3e-c471-45b8-afee-5ef28a1ea487 Nov 06 11:51:46 devstack sudo[97799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:51:46 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e8f94c2-59cb-49f4-87f5-84f80cb096f5]: (4, 'qcow2') {{(pid=88420) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 11:51:46 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-1fbbcf12-be35-40e1-b75a-d68213122238 tempest-VolumesListAdminTestJSON-1254674282 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-d709d6ce-3182-46f7-9914-517722d833a8 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:51:46 devstack sudo[97801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-d709d6ce-3182-46f7-9914-517722d833a8 Nov 06 11:51:46 devstack sudo[97801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:51:46 devstack sudo[97799]: pam_unix(sudo:session): session closed for user root Nov 06 11:51:46 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-41538e8f-cb56-41b3-b4e9-8f47c7a48950 tempest-VolumesListAdminTestJSON-1549595569 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-6b3a6f3e-c471-45b8-afee-5ef28a1ea487" returned: 0 in 0.731s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:51:46 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-41538e8f-cb56-41b3-b4e9-8f47c7a48950 tempest-VolumesListAdminTestJSON-1549595569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-6b3a6f3e-c471-45b8-afee-5ef28a1ea487 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:51:46 devstack sudo[97820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-6b3a6f3e-c471-45b8-afee-5ef28a1ea487 Nov 06 11:51:46 devstack sudo[97820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:51:46 devstack sudo[97801]: pam_unix(sudo:session): session closed for user root Nov 06 11:51:46 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-1fbbcf12-be35-40e1-b75a-d68213122238 tempest-VolumesListAdminTestJSON-1254674282 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-d709d6ce-3182-46f7-9914-517722d833a8" returned: 0 in 0.518s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:51:46 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-1fbbcf12-be35-40e1-b75a-d68213122238 tempest-VolumesListAdminTestJSON-1254674282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-d709d6ce-3182-46f7-9914-517722d833a8 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:51:46 devstack sudo[97822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-d709d6ce-3182-46f7-9914-517722d833a8 Nov 06 11:51:46 devstack sudo[97822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:51:47 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-41538e8f-cb56-41b3-b4e9-8f47c7a48950 tempest-VolumesListAdminTestJSON-1549595569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-6b3a6f3e-c471-45b8-afee-5ef28a1ea487" returned: 0 in 0.383s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:51:47 devstack sudo[97820]: pam_unix(sudo:session): session closed for user root Nov 06 11:51:47 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-41538e8f-cb56-41b3-b4e9-8f47c7a48950 tempest-VolumesListAdminTestJSON-1549595569 None] Lock "cinder-quobyte-6b3a6f3e-c471-45b8-afee-5ef28a1ea487" released by "delete_volume" :: held 1.201s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 11:51:47 devstack cinder-volume[87116]: DEBUG cinder.quota [None req-41538e8f-cb56-41b3-b4e9-8f47c7a48950 tempest-VolumesListAdminTestJSON-1549595569 None] Created reservations ['24f0df45-f6d2-4273-a13f-3b0700a48917', '0212dd74-4233-4cb2-97a1-87a207c739f9', '4e4a7231-c882-43ad-8b00-66a4cd1a4529', '4ddd9dd3-0d5e-4472-97a6-c31ebf5ab9fd'] {{(pid=87116) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 11:51:47 devstack sudo[97822]: pam_unix(sudo:session): session closed for user root Nov 06 11:51:47 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-1fbbcf12-be35-40e1-b75a-d68213122238 tempest-VolumesListAdminTestJSON-1254674282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-d709d6ce-3182-46f7-9914-517722d833a8" returned: 0 in 0.443s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:51:47 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-1fbbcf12-be35-40e1-b75a-d68213122238 tempest-VolumesListAdminTestJSON-1254674282 None] Lock "cinder-quobyte-d709d6ce-3182-46f7-9914-517722d833a8" released by "delete_volume" :: held 1.068s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 11:51:47 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-41538e8f-cb56-41b3-b4e9-8f47c7a48950 tempest-VolumesListAdminTestJSON-1549595569 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 11:51:47 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-41538e8f-cb56-41b3-b4e9-8f47c7a48950 tempest-VolumesListAdminTestJSON-1549595569 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 11:51:47 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-41538e8f-cb56-41b3-b4e9-8f47c7a48950 tempest-VolumesListAdminTestJSON-1549595569 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 11:51:47 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-41538e8f-cb56-41b3-b4e9-8f47c7a48950 tempest-VolumesListAdminTestJSON-1549595569 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 11:51:47 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-41538e8f-cb56-41b3-b4e9-8f47c7a48950 tempest-VolumesListAdminTestJSON-1549595569 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 11:51:47 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-41538e8f-cb56-41b3-b4e9-8f47c7a48950 tempest-VolumesListAdminTestJSON-1549595569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:51:47 devstack cinder-volume[87116]: DEBUG cinder.quota [None req-1fbbcf12-be35-40e1-b75a-d68213122238 tempest-VolumesListAdminTestJSON-1254674282 None] Created reservations ['69c6e7f6-d606-48e1-8541-b1eaf0631059', '7be35a6d-3a33-461c-a429-979180c1c854', '474e5e31-f713-42e5-98ee-cbe2540643b6', '2ca05328-9243-472f-8302-9136e776cdda'] {{(pid=87116) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 11:51:47 devstack sudo[97826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756 Nov 06 11:51:47 devstack sudo[97826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:51:47 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-1fbbcf12-be35-40e1-b75a-d68213122238 tempest-VolumesListAdminTestJSON-1254674282 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 11:51:47 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-1fbbcf12-be35-40e1-b75a-d68213122238 tempest-VolumesListAdminTestJSON-1254674282 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 11:51:47 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-1fbbcf12-be35-40e1-b75a-d68213122238 tempest-VolumesListAdminTestJSON-1254674282 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 11:51:47 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-1fbbcf12-be35-40e1-b75a-d68213122238 tempest-VolumesListAdminTestJSON-1254674282 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 11:51:47 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-1fbbcf12-be35-40e1-b75a-d68213122238 tempest-VolumesListAdminTestJSON-1254674282 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 11:51:47 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-1fbbcf12-be35-40e1-b75a-d68213122238 tempest-VolumesListAdminTestJSON-1254674282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:51:47 devstack sudo[97828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756 Nov 06 11:51:47 devstack sudo[97828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:51:47 devstack sudo[97826]: pam_unix(sudo:session): session closed for user root Nov 06 11:51:47 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-41538e8f-cb56-41b3-b4e9-8f47c7a48950 tempest-VolumesListAdminTestJSON-1549595569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756" returned: 0 in 0.300s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:51:47 devstack cinder-volume[87116]: DEBUG cinder.manager [None req-41538e8f-cb56-41b3-b4e9-8f47c7a48950 tempest-VolumesListAdminTestJSON-1549595569 None] Notifying Schedulers of capabilities ... {{(pid=87116) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 11:51:47 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-41538e8f-cb56-41b3-b4e9-8f47c7a48950 tempest-VolumesListAdminTestJSON-1549595569 None] Deleted volume successfully. Nov 06 11:51:47 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-41538e8f-cb56-41b3-b4e9-8f47c7a48950 tempest-VolumesListAdminTestJSON-1549595569 None] Lock "cinder-6b3a6f3e-c471-45b8-afee-5ef28a1ea487-delete_volume" released by "delete_volume" :: held 1.884s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 11:51:47 devstack sudo[97828]: pam_unix(sudo:session): session closed for user root Nov 06 11:51:47 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-1fbbcf12-be35-40e1-b75a-d68213122238 tempest-VolumesListAdminTestJSON-1254674282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756" returned: 0 in 0.295s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:51:47 devstack cinder-volume[87116]: DEBUG cinder.manager [None req-1fbbcf12-be35-40e1-b75a-d68213122238 tempest-VolumesListAdminTestJSON-1254674282 None] Notifying Schedulers of capabilities ... {{(pid=87116) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 11:51:48 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-1fbbcf12-be35-40e1-b75a-d68213122238 tempest-VolumesListAdminTestJSON-1254674282 None] Deleted volume successfully. Nov 06 11:51:48 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-1fbbcf12-be35-40e1-b75a-d68213122238 tempest-VolumesListAdminTestJSON-1254674282 None] Lock "cinder-d709d6ce-3182-46f7-9914-517722d833a8-delete_volume" released by "delete_volume" :: held 1.780s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 11:51:48 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-dc1ffe01-27e1-45ab-ac31-85bd7f8b7baf tempest-VolumesListAdminTestJSON-1254674282 None] Acquiring lock "cinder-4bae6287-38a9-4e96-b05f-17bbfd548d03-delete_volume" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 11:51:48 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-dc1ffe01-27e1-45ab-ac31-85bd7f8b7baf tempest-VolumesListAdminTestJSON-1254674282 None] Lock "cinder-4bae6287-38a9-4e96-b05f-17bbfd548d03-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 11:51:48 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-dc1ffe01-27e1-45ab-ac31-85bd7f8b7baf tempest-VolumesListAdminTestJSON-1254674282 None] Acquiring lock "cinder-quobyte-4bae6287-38a9-4e96-b05f-17bbfd548d03" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 11:51:48 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-dc1ffe01-27e1-45ab-ac31-85bd7f8b7baf tempest-VolumesListAdminTestJSON-1254674282 None] Lock "cinder-quobyte-4bae6287-38a9-4e96-b05f-17bbfd548d03" acquired by "delete_volume" :: waited 0.025s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 11:51:48 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9fe1158-4b49-4ba7-8e03-356dfe520ad6]: (4, 'qcow2') {{(pid=88420) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 11:51:48 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-dc1ffe01-27e1-45ab-ac31-85bd7f8b7baf tempest-VolumesListAdminTestJSON-1254674282 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-4bae6287-38a9-4e96-b05f-17bbfd548d03 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:51:49 devstack sudo[97832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-4bae6287-38a9-4e96-b05f-17bbfd548d03 Nov 06 11:51:49 devstack sudo[97832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:51:49 devstack sudo[97832]: pam_unix(sudo:session): session closed for user root Nov 06 11:51:49 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-dc1ffe01-27e1-45ab-ac31-85bd7f8b7baf tempest-VolumesListAdminTestJSON-1254674282 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-4bae6287-38a9-4e96-b05f-17bbfd548d03" returned: 0 in 0.459s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:51:49 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-dc1ffe01-27e1-45ab-ac31-85bd7f8b7baf tempest-VolumesListAdminTestJSON-1254674282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-4bae6287-38a9-4e96-b05f-17bbfd548d03 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:51:49 devstack sudo[97838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-4bae6287-38a9-4e96-b05f-17bbfd548d03 Nov 06 11:51:49 devstack sudo[97838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:51:49 devstack sudo[97838]: pam_unix(sudo:session): session closed for user root Nov 06 11:51:49 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-dc1ffe01-27e1-45ab-ac31-85bd7f8b7baf tempest-VolumesListAdminTestJSON-1254674282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-4bae6287-38a9-4e96-b05f-17bbfd548d03" returned: 0 in 0.323s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:51:49 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-dc1ffe01-27e1-45ab-ac31-85bd7f8b7baf tempest-VolumesListAdminTestJSON-1254674282 None] Lock "cinder-quobyte-4bae6287-38a9-4e96-b05f-17bbfd548d03" released by "delete_volume" :: held 0.837s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 11:51:49 devstack cinder-volume[87116]: DEBUG cinder.quota [None req-dc1ffe01-27e1-45ab-ac31-85bd7f8b7baf tempest-VolumesListAdminTestJSON-1254674282 None] Created reservations ['591c1a54-289a-49bb-b76f-b0ac88a5417d', '1c4b8fc5-6cec-4633-87ae-edfbdb980f47', '3a3e86be-43fe-4767-b55e-21c57de8df0b', 'e002dbbd-d82e-43e1-afa9-dda296fc2da6'] {{(pid=87116) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 11:51:49 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-dc1ffe01-27e1-45ab-ac31-85bd7f8b7baf tempest-VolumesListAdminTestJSON-1254674282 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 11:51:49 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-dc1ffe01-27e1-45ab-ac31-85bd7f8b7baf tempest-VolumesListAdminTestJSON-1254674282 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 11:51:49 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-dc1ffe01-27e1-45ab-ac31-85bd7f8b7baf tempest-VolumesListAdminTestJSON-1254674282 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 11:51:49 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-dc1ffe01-27e1-45ab-ac31-85bd7f8b7baf tempest-VolumesListAdminTestJSON-1254674282 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 11:51:49 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-dc1ffe01-27e1-45ab-ac31-85bd7f8b7baf tempest-VolumesListAdminTestJSON-1254674282 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 11:51:49 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-dc1ffe01-27e1-45ab-ac31-85bd7f8b7baf tempest-VolumesListAdminTestJSON-1254674282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:51:49 devstack sudo[97841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756 Nov 06 11:51:49 devstack sudo[97841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:51:50 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-1bfae5e9-9c9a-47f6-947e-ecfe2fd5325b tempest-VolumesListAdminTestJSON-1254674282 None] Acquiring lock "cinder-8af229b3-6b42-4f2b-80fc-dc28e0323035-delete_volume" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 11:51:50 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-1bfae5e9-9c9a-47f6-947e-ecfe2fd5325b tempest-VolumesListAdminTestJSON-1254674282 None] Lock "cinder-8af229b3-6b42-4f2b-80fc-dc28e0323035-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 11:51:50 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-1bfae5e9-9c9a-47f6-947e-ecfe2fd5325b tempest-VolumesListAdminTestJSON-1254674282 None] Acquiring lock "cinder-quobyte-8af229b3-6b42-4f2b-80fc-dc28e0323035" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 11:51:50 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-1bfae5e9-9c9a-47f6-947e-ecfe2fd5325b tempest-VolumesListAdminTestJSON-1254674282 None] Lock "cinder-quobyte-8af229b3-6b42-4f2b-80fc-dc28e0323035" acquired by "delete_volume" :: waited 0.022s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 11:51:50 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[e79449f1-bc17-4a49-a7dd-064dcad1c470]: (4, 'qcow2') {{(pid=88420) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 11:51:50 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-1bfae5e9-9c9a-47f6-947e-ecfe2fd5325b tempest-VolumesListAdminTestJSON-1254674282 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-8af229b3-6b42-4f2b-80fc-dc28e0323035 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:51:50 devstack sudo[97841]: pam_unix(sudo:session): session closed for user root Nov 06 11:51:50 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-dc1ffe01-27e1-45ab-ac31-85bd7f8b7baf tempest-VolumesListAdminTestJSON-1254674282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756" returned: 0 in 0.439s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:51:50 devstack cinder-volume[87116]: DEBUG cinder.manager [None req-dc1ffe01-27e1-45ab-ac31-85bd7f8b7baf tempest-VolumesListAdminTestJSON-1254674282 None] Notifying Schedulers of capabilities ... {{(pid=87116) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 11:51:50 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-dc1ffe01-27e1-45ab-ac31-85bd7f8b7baf tempest-VolumesListAdminTestJSON-1254674282 None] Deleted volume successfully. Nov 06 11:51:50 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-dc1ffe01-27e1-45ab-ac31-85bd7f8b7baf tempest-VolumesListAdminTestJSON-1254674282 None] Lock "cinder-4bae6287-38a9-4e96-b05f-17bbfd548d03-delete_volume" released by "delete_volume" :: held 1.544s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 11:51:50 devstack sudo[97844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-8af229b3-6b42-4f2b-80fc-dc28e0323035 Nov 06 11:51:50 devstack sudo[97844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:51:50 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-1bfae5e9-9c9a-47f6-947e-ecfe2fd5325b tempest-VolumesListAdminTestJSON-1254674282 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-8af229b3-6b42-4f2b-80fc-dc28e0323035" returned: 0 in 0.474s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:51:50 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-1bfae5e9-9c9a-47f6-947e-ecfe2fd5325b tempest-VolumesListAdminTestJSON-1254674282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-8af229b3-6b42-4f2b-80fc-dc28e0323035 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:51:50 devstack sudo[97844]: pam_unix(sudo:session): session closed for user root Nov 06 11:51:50 devstack sudo[97850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-8af229b3-6b42-4f2b-80fc-dc28e0323035 Nov 06 11:51:50 devstack sudo[97850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:51:51 devstack sudo[97850]: pam_unix(sudo:session): session closed for user root Nov 06 11:51:51 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-1bfae5e9-9c9a-47f6-947e-ecfe2fd5325b tempest-VolumesListAdminTestJSON-1254674282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-8af229b3-6b42-4f2b-80fc-dc28e0323035" returned: 0 in 0.356s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:51:51 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-1bfae5e9-9c9a-47f6-947e-ecfe2fd5325b tempest-VolumesListAdminTestJSON-1254674282 None] Lock "cinder-quobyte-8af229b3-6b42-4f2b-80fc-dc28e0323035" released by "delete_volume" :: held 0.921s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 11:51:51 devstack cinder-volume[87116]: DEBUG cinder.quota [None req-1bfae5e9-9c9a-47f6-947e-ecfe2fd5325b tempest-VolumesListAdminTestJSON-1254674282 None] Created reservations ['f9bf1639-d1f6-4029-ad18-b876c98bb007', 'cfed36c2-f1ea-4647-bf8c-5c5ba68dee2a', '86768385-c1df-4d50-b58e-3bc3f818cd6c', '6f6f4eb5-5800-41da-864c-4efb34245e4c'] {{(pid=87116) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 11:51:51 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-1bfae5e9-9c9a-47f6-947e-ecfe2fd5325b tempest-VolumesListAdminTestJSON-1254674282 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 11:51:51 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-1bfae5e9-9c9a-47f6-947e-ecfe2fd5325b tempest-VolumesListAdminTestJSON-1254674282 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 11:51:51 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-1bfae5e9-9c9a-47f6-947e-ecfe2fd5325b tempest-VolumesListAdminTestJSON-1254674282 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 11:51:51 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-1bfae5e9-9c9a-47f6-947e-ecfe2fd5325b tempest-VolumesListAdminTestJSON-1254674282 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 11:51:51 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-1bfae5e9-9c9a-47f6-947e-ecfe2fd5325b tempest-VolumesListAdminTestJSON-1254674282 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 11:51:51 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-1bfae5e9-9c9a-47f6-947e-ecfe2fd5325b tempest-VolumesListAdminTestJSON-1254674282 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:51:51 devstack sudo[97853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756 Nov 06 11:51:51 devstack sudo[97853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:51:51 devstack sudo[97853]: pam_unix(sudo:session): session closed for user root Nov 06 11:51:51 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-1bfae5e9-9c9a-47f6-947e-ecfe2fd5325b tempest-VolumesListAdminTestJSON-1254674282 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756" returned: 0 in 0.418s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:51:51 devstack cinder-volume[87116]: DEBUG cinder.manager [None req-1bfae5e9-9c9a-47f6-947e-ecfe2fd5325b tempest-VolumesListAdminTestJSON-1254674282 None] Notifying Schedulers of capabilities ... {{(pid=87116) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 11:51:51 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-1bfae5e9-9c9a-47f6-947e-ecfe2fd5325b tempest-VolumesListAdminTestJSON-1254674282 None] Deleted volume successfully. Nov 06 11:51:51 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-1bfae5e9-9c9a-47f6-947e-ecfe2fd5325b tempest-VolumesListAdminTestJSON-1254674282 None] Lock "cinder-8af229b3-6b42-4f2b-80fc-dc28e0323035-delete_volume" released by "delete_volume" :: held 1.648s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 11:51:58 devstack cinder-volume[87116]: DEBUG cinder.volume.flows.manager.create_volume [None req-4e479819-6b5c-486e-b352-83cec312708c tempest-TestServerVolumeAttachScenarioOldVersion-1900847762 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87116) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 11:51:58 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-4e479819-6b5c-486e-b352-83cec312708c tempest-TestServerVolumeAttachScenarioOldVersion-1900847762 None] Flow 'volume_create_manager' (c38a4332-11e1-43cf-b782-e13d9d83c682) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 11:51:58 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-4e479819-6b5c-486e-b352-83cec312708c tempest-TestServerVolumeAttachScenarioOldVersion-1900847762 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c7a21bdf-952e-4024-a097-bc002560307c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:51:58 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-4e479819-6b5c-486e-b352-83cec312708c tempest-TestServerVolumeAttachScenarioOldVersion-1900847762 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c7a21bdf-952e-4024-a097-bc002560307c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T10:51:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-755957644',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=61433822-6193-4a1a-8952-025dd5af81a7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5e2d839bef8c45ab8c4288dece1d3881',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T10:51:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T10:51:58Z,use_quota=True,user_id='073c7ad4510f42fcb202e2114047e8d8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(34d3b144-d9b7-480a-a2e3-01e45f3d54c1),volume_type_id=34d3b144-d9b7-480a-a2e3-01e45f3d54c1)' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:51:58 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-4e479819-6b5c-486e-b352-83cec312708c tempest-TestServerVolumeAttachScenarioOldVersion-1900847762 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (844512ee-5ba1-4afe-bd29-90cf1536db18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:51:58 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-4e479819-6b5c-486e-b352-83cec312708c tempest-TestServerVolumeAttachScenarioOldVersion-1900847762 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (844512ee-5ba1-4afe-bd29-90cf1536db18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:51:58 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-4e479819-6b5c-486e-b352-83cec312708c tempest-TestServerVolumeAttachScenarioOldVersion-1900847762 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (88e4bccc-f96c-4552-8e0f-7254092b59f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:51:58 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-4e479819-6b5c-486e-b352-83cec312708c tempest-TestServerVolumeAttachScenarioOldVersion-1900847762 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (88e4bccc-f96c-4552-8e0f-7254092b59f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '61433822-6193-4a1a-8952-025dd5af81a7', 'volume_name': 'volume-61433822-6193-4a1a-8952-025dd5af81a7', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:51:58 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-4e479819-6b5c-486e-b352-83cec312708c tempest-TestServerVolumeAttachScenarioOldVersion-1900847762 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3771ff2e-2a17-427c-8c3f-17185d2cfd10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:51:58 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-4e479819-6b5c-486e-b352-83cec312708c tempest-TestServerVolumeAttachScenarioOldVersion-1900847762 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3771ff2e-2a17-427c-8c3f-17185d2cfd10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:51:58 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-4e479819-6b5c-486e-b352-83cec312708c tempest-TestServerVolumeAttachScenarioOldVersion-1900847762 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1346e200-75df-4cc5-8e28-05b8eca47567) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:51:58 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-4e479819-6b5c-486e-b352-83cec312708c tempest-TestServerVolumeAttachScenarioOldVersion-1900847762 None] Volume 61433822-6193-4a1a-8952-025dd5af81a7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-61433822-6193-4a1a-8952-025dd5af81a7', 'volume_size': 1} Nov 06 11:51:58 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-4e479819-6b5c-486e-b352-83cec312708c tempest-TestServerVolumeAttachScenarioOldVersion-1900847762 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 11:51:58 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-4e479819-6b5c-486e-b352-83cec312708c tempest-TestServerVolumeAttachScenarioOldVersion-1900847762 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 11:51:58 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-4e479819-6b5c-486e-b352-83cec312708c tempest-TestServerVolumeAttachScenarioOldVersion-1900847762 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T10:51:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-755957644',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=61433822-6193-4a1a-8952-025dd5af81a7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5e2d839bef8c45ab8c4288dece1d3881',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T10:51:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T10:51:58Z,use_quota=True,user_id='073c7ad4510f42fcb202e2114047e8d8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(34d3b144-d9b7-480a-a2e3-01e45f3d54c1),volume_type_id=34d3b144-d9b7-480a-a2e3-01e45f3d54c1)}" {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 11:51:58 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-4e479819-6b5c-486e-b352-83cec312708c tempest-TestServerVolumeAttachScenarioOldVersion-1900847762 None] Creating volume 61433822-6193-4a1a-8952-025dd5af81a7 {{(pid=87116) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 11:51:58 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-4e479819-6b5c-486e-b352-83cec312708c tempest-TestServerVolumeAttachScenarioOldVersion-1900847762 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 11:51:58 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-4e479819-6b5c-486e-b352-83cec312708c tempest-TestServerVolumeAttachScenarioOldVersion-1900847762 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 11:51:58 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-4e479819-6b5c-486e-b352-83cec312708c tempest-TestServerVolumeAttachScenarioOldVersion-1900847762 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 11:51:58 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-4e479819-6b5c-486e-b352-83cec312708c tempest-TestServerVolumeAttachScenarioOldVersion-1900847762 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 11:51:58 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-4e479819-6b5c-486e-b352-83cec312708c tempest-TestServerVolumeAttachScenarioOldVersion-1900847762 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 11:51:58 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-4e479819-6b5c-486e-b352-83cec312708c tempest-TestServerVolumeAttachScenarioOldVersion-1900847762 None] Selected osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f as target Quobyte volume. {{(pid=87116) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 11:51:58 devstack cinder-volume[87116]: INFO cinder.volume.drivers.remotefs [None req-4e479819-6b5c-486e-b352-83cec312708c tempest-TestServerVolumeAttachScenarioOldVersion-1900847762 None] casted to osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f Nov 06 11:51:58 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-4e479819-6b5c-486e-b352-83cec312708c tempest-TestServerVolumeAttachScenarioOldVersion-1900847762 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-61433822-6193-4a1a-8952-025dd5af81a7 1073741824 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:51:58 devstack sudo[97859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-61433822-6193-4a1a-8952-025dd5af81a7 1073741824 Nov 06 11:51:58 devstack sudo[97859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:51:58 devstack cinder-volume[87116]: DEBUG cinder.volume.flows.manager.create_volume [None req-53550b1c-0c91-4334-923f-aea5ef7e7069 tempest-SnapshotMetadataTestJSON-1274001956 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87116) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 11:51:58 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-53550b1c-0c91-4334-923f-aea5ef7e7069 tempest-SnapshotMetadataTestJSON-1274001956 None] Flow 'volume_create_manager' (3206013d-e716-4843-941a-f9561a6c98dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 11:51:58 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-53550b1c-0c91-4334-923f-aea5ef7e7069 tempest-SnapshotMetadataTestJSON-1274001956 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (530bf0db-75c9-41a7-9f05-64e624687b8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:51:59 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-53550b1c-0c91-4334-923f-aea5ef7e7069 tempest-SnapshotMetadataTestJSON-1274001956 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (530bf0db-75c9-41a7-9f05-64e624687b8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T10:51:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1738156066',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b620a51c-ef71-4e31-861e-0aefbd75171c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2d1ce74244204a078b0c46f2cdff527c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T10:51:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T10:51:59Z,use_quota=True,user_id='8e72744e9bcf416ab93b1ac9bed6a5a8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(34d3b144-d9b7-480a-a2e3-01e45f3d54c1),volume_type_id=34d3b144-d9b7-480a-a2e3-01e45f3d54c1)' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:51:59 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-53550b1c-0c91-4334-923f-aea5ef7e7069 tempest-SnapshotMetadataTestJSON-1274001956 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e8e6a291-4eef-47da-95c5-a859ac367603) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:51:59 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-53550b1c-0c91-4334-923f-aea5ef7e7069 tempest-SnapshotMetadataTestJSON-1274001956 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e8e6a291-4eef-47da-95c5-a859ac367603) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:51:59 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-53550b1c-0c91-4334-923f-aea5ef7e7069 tempest-SnapshotMetadataTestJSON-1274001956 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (01e622cb-40d7-4b86-b182-54d25c5f58b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:51:59 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-53550b1c-0c91-4334-923f-aea5ef7e7069 tempest-SnapshotMetadataTestJSON-1274001956 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (01e622cb-40d7-4b86-b182-54d25c5f58b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b620a51c-ef71-4e31-861e-0aefbd75171c', 'volume_name': 'volume-b620a51c-ef71-4e31-861e-0aefbd75171c', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:51:59 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-53550b1c-0c91-4334-923f-aea5ef7e7069 tempest-SnapshotMetadataTestJSON-1274001956 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2083e360-a52e-4c1f-93e3-58f71a11633d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:51:59 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-53550b1c-0c91-4334-923f-aea5ef7e7069 tempest-SnapshotMetadataTestJSON-1274001956 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2083e360-a52e-4c1f-93e3-58f71a11633d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:51:59 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-53550b1c-0c91-4334-923f-aea5ef7e7069 tempest-SnapshotMetadataTestJSON-1274001956 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a8605775-cb08-4182-a461-a7c5b28a8681) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:51:59 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-53550b1c-0c91-4334-923f-aea5ef7e7069 tempest-SnapshotMetadataTestJSON-1274001956 None] Volume b620a51c-ef71-4e31-861e-0aefbd75171c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b620a51c-ef71-4e31-861e-0aefbd75171c', 'volume_size': 1} Nov 06 11:51:59 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-53550b1c-0c91-4334-923f-aea5ef7e7069 tempest-SnapshotMetadataTestJSON-1274001956 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 11:51:59 devstack sudo[97859]: pam_unix(sudo:session): session closed for user root Nov 06 11:51:59 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-4e479819-6b5c-486e-b352-83cec312708c tempest-TestServerVolumeAttachScenarioOldVersion-1900847762 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-61433822-6193-4a1a-8952-025dd5af81a7 1073741824" returned: 0 in 0.606s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:51:59 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-4e479819-6b5c-486e-b352-83cec312708c tempest-TestServerVolumeAttachScenarioOldVersion-1900847762 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-61433822-6193-4a1a-8952-025dd5af81a7 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:51:59 devstack sudo[97865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-61433822-6193-4a1a-8952-025dd5af81a7 Nov 06 11:51:59 devstack sudo[97865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:51:59 devstack sudo[97865]: pam_unix(sudo:session): session closed for user root Nov 06 11:51:59 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-4e479819-6b5c-486e-b352-83cec312708c tempest-TestServerVolumeAttachScenarioOldVersion-1900847762 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-61433822-6193-4a1a-8952-025dd5af81a7" returned: 0 in 0.341s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:51:59 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-4e479819-6b5c-486e-b352-83cec312708c tempest-TestServerVolumeAttachScenarioOldVersion-1900847762 None] <== create_volume: return (1111ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f'} {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 11:51:59 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-4e479819-6b5c-486e-b352-83cec312708c tempest-TestServerVolumeAttachScenarioOldVersion-1900847762 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.120s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 11:51:59 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-53550b1c-0c91-4334-923f-aea5ef7e7069 tempest-SnapshotMetadataTestJSON-1274001956 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.692s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 11:51:59 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-53550b1c-0c91-4334-923f-aea5ef7e7069 tempest-SnapshotMetadataTestJSON-1274001956 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T10:51:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1738156066',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b620a51c-ef71-4e31-861e-0aefbd75171c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2d1ce74244204a078b0c46f2cdff527c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T10:51:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T10:51:59Z,use_quota=True,user_id='8e72744e9bcf416ab93b1ac9bed6a5a8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(34d3b144-d9b7-480a-a2e3-01e45f3d54c1),volume_type_id=34d3b144-d9b7-480a-a2e3-01e45f3d54c1)}" {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 11:51:59 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-53550b1c-0c91-4334-923f-aea5ef7e7069 tempest-SnapshotMetadataTestJSON-1274001956 None] Creating volume b620a51c-ef71-4e31-861e-0aefbd75171c {{(pid=87116) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 11:51:59 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-53550b1c-0c91-4334-923f-aea5ef7e7069 tempest-SnapshotMetadataTestJSON-1274001956 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 11:51:59 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-53550b1c-0c91-4334-923f-aea5ef7e7069 tempest-SnapshotMetadataTestJSON-1274001956 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 11:51:59 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-53550b1c-0c91-4334-923f-aea5ef7e7069 tempest-SnapshotMetadataTestJSON-1274001956 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 11:51:59 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-53550b1c-0c91-4334-923f-aea5ef7e7069 tempest-SnapshotMetadataTestJSON-1274001956 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 11:51:59 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-53550b1c-0c91-4334-923f-aea5ef7e7069 tempest-SnapshotMetadataTestJSON-1274001956 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 11:51:59 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-53550b1c-0c91-4334-923f-aea5ef7e7069 tempest-SnapshotMetadataTestJSON-1274001956 None] Selected osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f as target Quobyte volume. {{(pid=87116) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 11:51:59 devstack cinder-volume[87116]: INFO cinder.volume.drivers.remotefs [None req-53550b1c-0c91-4334-923f-aea5ef7e7069 tempest-SnapshotMetadataTestJSON-1274001956 None] casted to osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f Nov 06 11:51:59 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-53550b1c-0c91-4334-923f-aea5ef7e7069 tempest-SnapshotMetadataTestJSON-1274001956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-b620a51c-ef71-4e31-861e-0aefbd75171c 1073741824 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:51:59 devstack sudo[97868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-b620a51c-ef71-4e31-861e-0aefbd75171c 1073741824 Nov 06 11:51:59 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-4e479819-6b5c-486e-b352-83cec312708c tempest-TestServerVolumeAttachScenarioOldVersion-1900847762 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1346e200-75df-4cc5-8e28-05b8eca47567) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-61433822-6193-4a1a-8952-025dd5af81a7', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:51:59 devstack sudo[97868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:51:59 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-4e479819-6b5c-486e-b352-83cec312708c tempest-TestServerVolumeAttachScenarioOldVersion-1900847762 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (671ffa81-dbfd-4699-97d7-fdc8a7ee8f44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:51:59 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-4e479819-6b5c-486e-b352-83cec312708c tempest-TestServerVolumeAttachScenarioOldVersion-1900847762 None] Volume volume-61433822-6193-4a1a-8952-025dd5af81a7 (61433822-6193-4a1a-8952-025dd5af81a7): created successfully Nov 06 11:51:59 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-4e479819-6b5c-486e-b352-83cec312708c tempest-TestServerVolumeAttachScenarioOldVersion-1900847762 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (671ffa81-dbfd-4699-97d7-fdc8a7ee8f44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:51:59 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-4e479819-6b5c-486e-b352-83cec312708c tempest-TestServerVolumeAttachScenarioOldVersion-1900847762 None] Flow 'volume_create_manager' (c38a4332-11e1-43cf-b782-e13d9d83c682) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 11:51:59 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-4e479819-6b5c-486e-b352-83cec312708c tempest-TestServerVolumeAttachScenarioOldVersion-1900847762 None] Created volume successfully. Nov 06 11:52:00 devstack sudo[97868]: pam_unix(sudo:session): session closed for user root Nov 06 11:52:00 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-53550b1c-0c91-4334-923f-aea5ef7e7069 tempest-SnapshotMetadataTestJSON-1274001956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-b620a51c-ef71-4e31-861e-0aefbd75171c 1073741824" returned: 0 in 0.569s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:52:00 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-53550b1c-0c91-4334-923f-aea5ef7e7069 tempest-SnapshotMetadataTestJSON-1274001956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-b620a51c-ef71-4e31-861e-0aefbd75171c {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:52:00 devstack sudo[97874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-b620a51c-ef71-4e31-861e-0aefbd75171c Nov 06 11:52:00 devstack sudo[97874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:52:00 devstack sudo[97874]: pam_unix(sudo:session): session closed for user root Nov 06 11:52:00 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-53550b1c-0c91-4334-923f-aea5ef7e7069 tempest-SnapshotMetadataTestJSON-1274001956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-b620a51c-ef71-4e31-861e-0aefbd75171c" returned: 0 in 0.425s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:52:00 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-53550b1c-0c91-4334-923f-aea5ef7e7069 tempest-SnapshotMetadataTestJSON-1274001956 None] <== create_volume: return (1055ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f'} {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 11:52:00 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-53550b1c-0c91-4334-923f-aea5ef7e7069 tempest-SnapshotMetadataTestJSON-1274001956 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.058s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 11:52:00 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-53550b1c-0c91-4334-923f-aea5ef7e7069 tempest-SnapshotMetadataTestJSON-1274001956 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a8605775-cb08-4182-a461-a7c5b28a8681) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b620a51c-ef71-4e31-861e-0aefbd75171c', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:52:00 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-53550b1c-0c91-4334-923f-aea5ef7e7069 tempest-SnapshotMetadataTestJSON-1274001956 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3d9db60b-24f3-41d1-af15-06808169440b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:52:00 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-53550b1c-0c91-4334-923f-aea5ef7e7069 tempest-SnapshotMetadataTestJSON-1274001956 None] Volume volume-b620a51c-ef71-4e31-861e-0aefbd75171c (b620a51c-ef71-4e31-861e-0aefbd75171c): created successfully Nov 06 11:52:00 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-53550b1c-0c91-4334-923f-aea5ef7e7069 tempest-SnapshotMetadataTestJSON-1274001956 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3d9db60b-24f3-41d1-af15-06808169440b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:52:00 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-53550b1c-0c91-4334-923f-aea5ef7e7069 tempest-SnapshotMetadataTestJSON-1274001956 None] Flow 'volume_create_manager' (3206013d-e716-4843-941a-f9561a6c98dd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 11:52:00 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-53550b1c-0c91-4334-923f-aea5ef7e7069 tempest-SnapshotMetadataTestJSON-1274001956 None] Created volume successfully. Nov 06 11:52:01 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-b38242d9-ee19-4565-9b81-d4d96f8265e6 tempest-SnapshotMetadataTestJSON-1274001956 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 11:52:01 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-b38242d9-ee19-4565-9b81-d4d96f8265e6 tempest-SnapshotMetadataTestJSON-1274001956 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 11:52:01 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-b38242d9-ee19-4565-9b81-d4d96f8265e6 tempest-SnapshotMetadataTestJSON-1274001956 None] Creating offline snapshot 9d0536b6-fb29-4e2b-b493-571bb5950294 of volume b620a51c-ef71-4e31-861e-0aefbd75171c {{(pid=87116) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 06 11:52:01 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[80144f2a-def9-42c2-a5e9-111d2a8ac48d]: (4, 'qcow2') {{(pid=88420) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 11:52:01 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-b38242d9-ee19-4565-9b81-d4d96f8265e6 tempest-SnapshotMetadataTestJSON-1274001956 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-b620a51c-ef71-4e31-861e-0aefbd75171c {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:52:01 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [req-f71a9494-408f-43bc-a00d-bdda7f2751b4 req-4597ac41-3ad0-45bc-adb7-5c57c603e302 tempest-TestServerVolumeAttachScenarioOldVersion-1900847762 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 11:52:01 devstack sudo[97888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-b620a51c-ef71-4e31-861e-0aefbd75171c Nov 06 11:52:01 devstack sudo[97888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:52:01 devstack sudo[97888]: pam_unix(sudo:session): session closed for user root Nov 06 11:52:01 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-b38242d9-ee19-4565-9b81-d4d96f8265e6 tempest-SnapshotMetadataTestJSON-1274001956 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-b620a51c-ef71-4e31-861e-0aefbd75171c" returned: 0 in 0.508s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:52:01 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-b38242d9-ee19-4565-9b81-d4d96f8265e6 tempest-SnapshotMetadataTestJSON-1274001956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-b620a51c-ef71-4e31-861e-0aefbd75171c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-b620a51c-ef71-4e31-861e-0aefbd75171c.9d0536b6-fb29-4e2b-b493-571bb5950294 1G {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:52:01 devstack sudo[97893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-b620a51c-ef71-4e31-861e-0aefbd75171c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-b620a51c-ef71-4e31-861e-0aefbd75171c.9d0536b6-fb29-4e2b-b493-571bb5950294 1G Nov 06 11:52:01 devstack sudo[97893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:52:02 devstack sudo[97893]: pam_unix(sudo:session): session closed for user root Nov 06 11:52:02 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-b38242d9-ee19-4565-9b81-d4d96f8265e6 tempest-SnapshotMetadataTestJSON-1274001956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-b620a51c-ef71-4e31-861e-0aefbd75171c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-b620a51c-ef71-4e31-861e-0aefbd75171c.9d0536b6-fb29-4e2b-b493-571bb5950294 1G" returned: 0 in 0.498s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:52:02 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-b38242d9-ee19-4565-9b81-d4d96f8265e6 tempest-SnapshotMetadataTestJSON-1274001956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b620a51c-ef71-4e31-861e-0aefbd75171c -F qcow2 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-b620a51c-ef71-4e31-861e-0aefbd75171c.9d0536b6-fb29-4e2b-b493-571bb5950294 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:52:02 devstack sudo[97900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b620a51c-ef71-4e31-861e-0aefbd75171c -F qcow2 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-b620a51c-ef71-4e31-861e-0aefbd75171c.9d0536b6-fb29-4e2b-b493-571bb5950294 Nov 06 11:52:02 devstack sudo[97900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:52:02 devstack sudo[97900]: pam_unix(sudo:session): session closed for user root Nov 06 11:52:02 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-b38242d9-ee19-4565-9b81-d4d96f8265e6 tempest-SnapshotMetadataTestJSON-1274001956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b620a51c-ef71-4e31-861e-0aefbd75171c -F qcow2 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-b620a51c-ef71-4e31-861e-0aefbd75171c.9d0536b6-fb29-4e2b-b493-571bb5950294" returned: 0 in 0.347s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:52:02 devstack cinder-volume[87116]: WARNING cinder.volume.drivers.remotefs [None req-b38242d9-ee19-4565-9b81-d4d96f8265e6 tempest-SnapshotMetadataTestJSON-1274001956 None] /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-b620a51c-ef71-4e31-861e-0aefbd75171c.9d0536b6-fb29-4e2b-b493-571bb5950294 is being set with open permissions: ugo+rw Nov 06 11:52:02 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-b38242d9-ee19-4565-9b81-d4d96f8265e6 tempest-SnapshotMetadataTestJSON-1274001956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-b620a51c-ef71-4e31-861e-0aefbd75171c.9d0536b6-fb29-4e2b-b493-571bb5950294 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:52:02 devstack sudo[97905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-b620a51c-ef71-4e31-861e-0aefbd75171c.9d0536b6-fb29-4e2b-b493-571bb5950294 Nov 06 11:52:02 devstack sudo[97905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:52:03 devstack sudo[97905]: pam_unix(sudo:session): session closed for user root Nov 06 11:52:03 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-b38242d9-ee19-4565-9b81-d4d96f8265e6 tempest-SnapshotMetadataTestJSON-1274001956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-b620a51c-ef71-4e31-861e-0aefbd75171c.9d0536b6-fb29-4e2b-b493-571bb5950294" returned: 0 in 0.361s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:52:03 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-b38242d9-ee19-4565-9b81-d4d96f8265e6 tempest-SnapshotMetadataTestJSON-1274001956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-b620a51c-ef71-4e31-861e-0aefbd75171c.info {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:52:03 devstack sudo[97908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-b620a51c-ef71-4e31-861e-0aefbd75171c.info Nov 06 11:52:03 devstack sudo[97908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:52:03 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-b38242d9-ee19-4565-9b81-d4d96f8265e6 tempest-SnapshotMetadataTestJSON-1274001956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-b620a51c-ef71-4e31-861e-0aefbd75171c.info" returned: 0 in 0.323s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:52:03 devstack cinder-volume[87116]: WARNING cinder.volume.drivers.remotefs [None req-b38242d9-ee19-4565-9b81-d4d96f8265e6 tempest-SnapshotMetadataTestJSON-1274001956 None] /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-b620a51c-ef71-4e31-861e-0aefbd75171c.info is being set with open permissions: ugo+rw Nov 06 11:52:03 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-b38242d9-ee19-4565-9b81-d4d96f8265e6 tempest-SnapshotMetadataTestJSON-1274001956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-b620a51c-ef71-4e31-861e-0aefbd75171c.info {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:52:03 devstack sudo[97908]: pam_unix(sudo:session): session closed for user root Nov 06 11:52:03 devstack sudo[97913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-b620a51c-ef71-4e31-861e-0aefbd75171c.info Nov 06 11:52:03 devstack sudo[97913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:52:03 devstack sudo[97913]: pam_unix(sudo:session): session closed for user root Nov 06 11:52:03 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-b38242d9-ee19-4565-9b81-d4d96f8265e6 tempest-SnapshotMetadataTestJSON-1274001956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-b620a51c-ef71-4e31-861e-0aefbd75171c.info" returned: 0 in 0.369s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:52:03 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-b38242d9-ee19-4565-9b81-d4d96f8265e6 tempest-SnapshotMetadataTestJSON-1274001956 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.538s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 11:52:03 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [req-f71a9494-408f-43bc-a00d-bdda7f2751b4 req-4597ac41-3ad0-45bc-adb7-5c57c603e302 tempest-TestServerVolumeAttachScenarioOldVersion-1900847762 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 2.305s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 11:52:03 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [req-f71a9494-408f-43bc-a00d-bdda7f2751b4 req-4597ac41-3ad0-45bc-adb7-5c57c603e302 tempest-TestServerVolumeAttachScenarioOldVersion-1900847762 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.029s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 11:52:03 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-b38242d9-ee19-4565-9b81-d4d96f8265e6 tempest-SnapshotMetadataTestJSON-1274001956 None] Create snapshot completed successfully Nov 06 11:52:03 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [req-f71a9494-408f-43bc-a00d-bdda7f2751b4 req-4597ac41-3ad0-45bc-adb7-5c57c603e302 tempest-TestServerVolumeAttachScenarioOldVersion-1900847762 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f', 'name': 'volume-61433822-6193-4a1a-8952-025dd5af81a7', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '1896b4fd-85e0-4fa1-a1e6-ebc2dc082020', 'enforce_multipath': True} {{(pid=87116) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 06 11:52:04 devstack cinder-volume[87116]: INFO cinder.volume.manager [req-f71a9494-408f-43bc-a00d-bdda7f2751b4 req-4597ac41-3ad0-45bc-adb7-5c57c603e302 tempest-TestServerVolumeAttachScenarioOldVersion-1900847762 None] attachment_update completed successfully. Nov 06 11:52:06 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-8d9ae24a-2d88-49a6-97f2-8fefa89570c9 tempest-SnapshotMetadataTestJSON-1274001956 None] Acquiring lock "cinder-9d0536b6-fb29-4e2b-b493-571bb5950294-delete_snapshot" by "delete_snapshot" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 11:52:06 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-8d9ae24a-2d88-49a6-97f2-8fefa89570c9 tempest-SnapshotMetadataTestJSON-1274001956 None] Lock "cinder-9d0536b6-fb29-4e2b-b493-571bb5950294-delete_snapshot" acquired by "delete_snapshot" :: waited 0.034s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 11:52:06 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-8d9ae24a-2d88-49a6-97f2-8fefa89570c9 tempest-SnapshotMetadataTestJSON-1274001956 None] Acquiring lock "cinder-quobyte-b620a51c-ef71-4e31-861e-0aefbd75171c" by "delete_snapshot" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 11:52:06 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-8d9ae24a-2d88-49a6-97f2-8fefa89570c9 tempest-SnapshotMetadataTestJSON-1274001956 None] Lock "cinder-quobyte-b620a51c-ef71-4e31-861e-0aefbd75171c" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 11:52:06 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-8d9ae24a-2d88-49a6-97f2-8fefa89570c9 tempest-SnapshotMetadataTestJSON-1274001956 None] Acquiring lock "cinder-quobyte-9d0536b6-fb29-4e2b-b493-571bb5950294" by "_delete_snapshot" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 11:52:06 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-8d9ae24a-2d88-49a6-97f2-8fefa89570c9 tempest-SnapshotMetadataTestJSON-1274001956 None] Lock "cinder-quobyte-9d0536b6-fb29-4e2b-b493-571bb5950294" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 11:52:06 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-8d9ae24a-2d88-49a6-97f2-8fefa89570c9 tempest-SnapshotMetadataTestJSON-1274001956 None] Deleting offline snapshot 9d0536b6-fb29-4e2b-b493-571bb5950294 of volume b620a51c-ef71-4e31-861e-0aefbd75171c {{(pid=87116) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 06 11:52:06 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-8d9ae24a-2d88-49a6-97f2-8fefa89570c9 tempest-SnapshotMetadataTestJSON-1274001956 None] snapshot_file for this snap is: volume-b620a51c-ef71-4e31-861e-0aefbd75171c.9d0536b6-fb29-4e2b-b493-571bb5950294 {{(pid=87116) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 06 11:52:06 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[37d6662c-2627-4995-81fc-e962d72dcfcc]: (4, 'qcow2') {{(pid=88420) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 11:52:06 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-8d9ae24a-2d88-49a6-97f2-8fefa89570c9 tempest-SnapshotMetadataTestJSON-1274001956 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-b620a51c-ef71-4e31-861e-0aefbd75171c.9d0536b6-fb29-4e2b-b493-571bb5950294 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:52:06 devstack sudo[98332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-b620a51c-ef71-4e31-861e-0aefbd75171c.9d0536b6-fb29-4e2b-b493-571bb5950294 Nov 06 11:52:06 devstack sudo[98332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:52:06 devstack sudo[98332]: pam_unix(sudo:session): session closed for user root Nov 06 11:52:06 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-8d9ae24a-2d88-49a6-97f2-8fefa89570c9 tempest-SnapshotMetadataTestJSON-1274001956 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-b620a51c-ef71-4e31-861e-0aefbd75171c.9d0536b6-fb29-4e2b-b493-571bb5950294" returned: 0 in 0.530s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:52:06 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-8d9ae24a-2d88-49a6-97f2-8fefa89570c9 tempest-SnapshotMetadataTestJSON-1274001956 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b620a51c-ef71-4e31-861e-0aefbd75171c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87116) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 11:52:06 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5a2202c-9b27-425b-8170-5b1e8393b5f2]: (4, 'qcow2') {{(pid=88420) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 11:52:06 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-8d9ae24a-2d88-49a6-97f2-8fefa89570c9 tempest-SnapshotMetadataTestJSON-1274001956 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-b620a51c-ef71-4e31-861e-0aefbd75171c {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:52:06 devstack sudo[98337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-b620a51c-ef71-4e31-861e-0aefbd75171c Nov 06 11:52:06 devstack sudo[98337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:52:07 devstack sudo[98337]: pam_unix(sudo:session): session closed for user root Nov 06 11:52:07 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-8d9ae24a-2d88-49a6-97f2-8fefa89570c9 tempest-SnapshotMetadataTestJSON-1274001956 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-b620a51c-ef71-4e31-861e-0aefbd75171c" returned: 0 in 0.464s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:52:07 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-8d9ae24a-2d88-49a6-97f2-8fefa89570c9 tempest-SnapshotMetadataTestJSON-1274001956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-b620a51c-ef71-4e31-861e-0aefbd75171c.9d0536b6-fb29-4e2b-b493-571bb5950294 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:52:07 devstack sudo[98343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-b620a51c-ef71-4e31-861e-0aefbd75171c.9d0536b6-fb29-4e2b-b493-571bb5950294 Nov 06 11:52:07 devstack sudo[98343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:52:07 devstack cinder-volume[87116]: DEBUG cinder.volume.flows.manager.create_volume [None req-fc87b2c0-3166-4d0e-9d6b-4aced554e879 tempest-VolumesDeleteCascade-915753827 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87116) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 11:52:07 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-fc87b2c0-3166-4d0e-9d6b-4aced554e879 tempest-VolumesDeleteCascade-915753827 None] Flow 'volume_create_manager' (8c744fef-a370-467f-afc6-fbcb49b48a59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 11:52:07 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-fc87b2c0-3166-4d0e-9d6b-4aced554e879 tempest-VolumesDeleteCascade-915753827 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8c4a6a5a-9a0f-41b1-9375-2ea331ccb8d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:52:07 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-fc87b2c0-3166-4d0e-9d6b-4aced554e879 tempest-VolumesDeleteCascade-915753827 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8c4a6a5a-9a0f-41b1-9375-2ea331ccb8d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T10:52:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-186915461',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8e620ca1-0a83-40b1-aa6f-7a446a8b3b2e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='133403ef419b401eb13cf042dad32417',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T10:52:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T10:52:08Z,use_quota=True,user_id='48c070f7f6e344b0a2467bfd96d154fc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(34d3b144-d9b7-480a-a2e3-01e45f3d54c1),volume_type_id=34d3b144-d9b7-480a-a2e3-01e45f3d54c1)' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:52:07 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-fc87b2c0-3166-4d0e-9d6b-4aced554e879 tempest-VolumesDeleteCascade-915753827 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (03e06daf-3afb-48ff-95ab-989f10112dbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:52:07 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-fc87b2c0-3166-4d0e-9d6b-4aced554e879 tempest-VolumesDeleteCascade-915753827 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (03e06daf-3afb-48ff-95ab-989f10112dbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:52:07 devstack sudo[98343]: pam_unix(sudo:session): session closed for user root Nov 06 11:52:07 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-fc87b2c0-3166-4d0e-9d6b-4aced554e879 tempest-VolumesDeleteCascade-915753827 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fce3405d-6e79-467e-bb86-de8f445111c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:52:07 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-fc87b2c0-3166-4d0e-9d6b-4aced554e879 tempest-VolumesDeleteCascade-915753827 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fce3405d-6e79-467e-bb86-de8f445111c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8e620ca1-0a83-40b1-aa6f-7a446a8b3b2e', 'volume_name': 'volume-8e620ca1-0a83-40b1-aa6f-7a446a8b3b2e', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:52:07 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-fc87b2c0-3166-4d0e-9d6b-4aced554e879 tempest-VolumesDeleteCascade-915753827 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (00f988e4-3789-467f-85d4-43da6d7e1e9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:52:07 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-fc87b2c0-3166-4d0e-9d6b-4aced554e879 tempest-VolumesDeleteCascade-915753827 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (00f988e4-3789-467f-85d4-43da6d7e1e9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:52:07 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-fc87b2c0-3166-4d0e-9d6b-4aced554e879 tempest-VolumesDeleteCascade-915753827 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7850cc06-79a9-45c8-986f-6df8d4a68ab8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:52:07 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-fc87b2c0-3166-4d0e-9d6b-4aced554e879 tempest-VolumesDeleteCascade-915753827 None] Volume 8e620ca1-0a83-40b1-aa6f-7a446a8b3b2e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8e620ca1-0a83-40b1-aa6f-7a446a8b3b2e', 'volume_size': 1} Nov 06 11:52:07 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-fc87b2c0-3166-4d0e-9d6b-4aced554e879 tempest-VolumesDeleteCascade-915753827 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 11:52:07 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-fc87b2c0-3166-4d0e-9d6b-4aced554e879 tempest-VolumesDeleteCascade-915753827 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 11:52:07 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-fc87b2c0-3166-4d0e-9d6b-4aced554e879 tempest-VolumesDeleteCascade-915753827 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T10:52:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-186915461',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8e620ca1-0a83-40b1-aa6f-7a446a8b3b2e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='133403ef419b401eb13cf042dad32417',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T10:52:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T10:52:08Z,use_quota=True,user_id='48c070f7f6e344b0a2467bfd96d154fc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(34d3b144-d9b7-480a-a2e3-01e45f3d54c1),volume_type_id=34d3b144-d9b7-480a-a2e3-01e45f3d54c1)}" {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 11:52:07 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-fc87b2c0-3166-4d0e-9d6b-4aced554e879 tempest-VolumesDeleteCascade-915753827 None] Creating volume 8e620ca1-0a83-40b1-aa6f-7a446a8b3b2e {{(pid=87116) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 11:52:07 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-fc87b2c0-3166-4d0e-9d6b-4aced554e879 tempest-VolumesDeleteCascade-915753827 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 11:52:07 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-fc87b2c0-3166-4d0e-9d6b-4aced554e879 tempest-VolumesDeleteCascade-915753827 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 11:52:07 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-fc87b2c0-3166-4d0e-9d6b-4aced554e879 tempest-VolumesDeleteCascade-915753827 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 11:52:07 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-fc87b2c0-3166-4d0e-9d6b-4aced554e879 tempest-VolumesDeleteCascade-915753827 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 11:52:07 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-fc87b2c0-3166-4d0e-9d6b-4aced554e879 tempest-VolumesDeleteCascade-915753827 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 11:52:07 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-fc87b2c0-3166-4d0e-9d6b-4aced554e879 tempest-VolumesDeleteCascade-915753827 None] Selected osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f as target Quobyte volume. {{(pid=87116) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 11:52:07 devstack cinder-volume[87116]: INFO cinder.volume.drivers.remotefs [None req-fc87b2c0-3166-4d0e-9d6b-4aced554e879 tempest-VolumesDeleteCascade-915753827 None] casted to osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f Nov 06 11:52:07 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-fc87b2c0-3166-4d0e-9d6b-4aced554e879 tempest-VolumesDeleteCascade-915753827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-8e620ca1-0a83-40b1-aa6f-7a446a8b3b2e 1073741824 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:52:07 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-8d9ae24a-2d88-49a6-97f2-8fefa89570c9 tempest-SnapshotMetadataTestJSON-1274001956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-b620a51c-ef71-4e31-861e-0aefbd75171c.9d0536b6-fb29-4e2b-b493-571bb5950294" returned: 0 in 0.495s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:52:07 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-8d9ae24a-2d88-49a6-97f2-8fefa89570c9 tempest-SnapshotMetadataTestJSON-1274001956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-b620a51c-ef71-4e31-861e-0aefbd75171c.9d0536b6-fb29-4e2b-b493-571bb5950294 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:52:07 devstack sudo[98348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-8e620ca1-0a83-40b1-aa6f-7a446a8b3b2e 1073741824 Nov 06 11:52:07 devstack sudo[98348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:52:07 devstack sudo[98349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-b620a51c-ef71-4e31-861e-0aefbd75171c.9d0536b6-fb29-4e2b-b493-571bb5950294 Nov 06 11:52:07 devstack sudo[98349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:52:08 devstack cinder-volume[87116]: INFO cinder.volume.manager [req-0d172495-c58d-4df1-a162-14619dda022b req-68d73b6d-467a-4f1e-9fbb-cb6b7088c50e tempest-TestServerVolumeAttachScenarioOldVersion-1900847762 None] Terminate volume connection completed successfully. Nov 06 11:52:08 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [req-0d172495-c58d-4df1-a162-14619dda022b req-68d73b6d-467a-4f1e-9fbb-cb6b7088c50e tempest-TestServerVolumeAttachScenarioOldVersion-1900847762 None] Deleting attachment 1896b4fd-85e0-4fa1-a1e6-ebc2dc082020. {{(pid=87116) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 06 11:52:08 devstack sudo[98349]: pam_unix(sudo:session): session closed for user root Nov 06 11:52:08 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-8d9ae24a-2d88-49a6-97f2-8fefa89570c9 tempest-SnapshotMetadataTestJSON-1274001956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-b620a51c-ef71-4e31-861e-0aefbd75171c.9d0536b6-fb29-4e2b-b493-571bb5950294" returned: 0 in 0.430s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:52:08 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-8d9ae24a-2d88-49a6-97f2-8fefa89570c9 tempest-SnapshotMetadataTestJSON-1274001956 None] Lock "cinder-quobyte-9d0536b6-fb29-4e2b-b493-571bb5950294" released by "_delete_snapshot" :: held 2.118s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 11:52:08 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-8d9ae24a-2d88-49a6-97f2-8fefa89570c9 tempest-SnapshotMetadataTestJSON-1274001956 None] Lock "cinder-quobyte-b620a51c-ef71-4e31-861e-0aefbd75171c" released by "delete_snapshot" :: held 2.144s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 11:52:08 devstack cinder-volume[87116]: DEBUG cinder.quota [None req-8d9ae24a-2d88-49a6-97f2-8fefa89570c9 tempest-SnapshotMetadataTestJSON-1274001956 None] Created reservations ['368fe918-fc81-4a4c-b099-5fcfb037ba20', 'a5b1ba4f-c8bd-4e69-8af2-e105bcd7348c', 'c2c4ae17-fa45-4371-8db8-043490fe4332', 'fc594831-dde7-41d0-9e2a-1499a5c1c2e2'] {{(pid=87116) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 11:52:08 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-8d9ae24a-2d88-49a6-97f2-8fefa89570c9 tempest-SnapshotMetadataTestJSON-1274001956 None] Delete snapshot completed successfully. Nov 06 11:52:08 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-8d9ae24a-2d88-49a6-97f2-8fefa89570c9 tempest-SnapshotMetadataTestJSON-1274001956 None] Lock "cinder-9d0536b6-fb29-4e2b-b493-571bb5950294-delete_snapshot" released by "delete_snapshot" :: held 2.374s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 11:52:08 devstack sudo[98348]: pam_unix(sudo:session): session closed for user root Nov 06 11:52:08 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-fc87b2c0-3166-4d0e-9d6b-4aced554e879 tempest-VolumesDeleteCascade-915753827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-8e620ca1-0a83-40b1-aa6f-7a446a8b3b2e 1073741824" returned: 0 in 0.828s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:52:08 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-fc87b2c0-3166-4d0e-9d6b-4aced554e879 tempest-VolumesDeleteCascade-915753827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-8e620ca1-0a83-40b1-aa6f-7a446a8b3b2e {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:52:08 devstack sudo[98384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-8e620ca1-0a83-40b1-aa6f-7a446a8b3b2e Nov 06 11:52:08 devstack sudo[98384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:52:08 devstack sudo[98384]: pam_unix(sudo:session): session closed for user root Nov 06 11:52:08 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-fc87b2c0-3166-4d0e-9d6b-4aced554e879 tempest-VolumesDeleteCascade-915753827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-8e620ca1-0a83-40b1-aa6f-7a446a8b3b2e" returned: 0 in 0.270s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:52:08 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-fc87b2c0-3166-4d0e-9d6b-4aced554e879 tempest-VolumesDeleteCascade-915753827 None] <== create_volume: return (1160ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f'} {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 11:52:08 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-fc87b2c0-3166-4d0e-9d6b-4aced554e879 tempest-VolumesDeleteCascade-915753827 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.166s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 11:52:08 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-fc87b2c0-3166-4d0e-9d6b-4aced554e879 tempest-VolumesDeleteCascade-915753827 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7850cc06-79a9-45c8-986f-6df8d4a68ab8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8e620ca1-0a83-40b1-aa6f-7a446a8b3b2e', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:52:08 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-fc87b2c0-3166-4d0e-9d6b-4aced554e879 tempest-VolumesDeleteCascade-915753827 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (84203963-4037-4768-90fb-ede54ec98dfe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:52:08 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-fc87b2c0-3166-4d0e-9d6b-4aced554e879 tempest-VolumesDeleteCascade-915753827 None] Volume volume-8e620ca1-0a83-40b1-aa6f-7a446a8b3b2e (8e620ca1-0a83-40b1-aa6f-7a446a8b3b2e): created successfully Nov 06 11:52:08 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-fc87b2c0-3166-4d0e-9d6b-4aced554e879 tempest-VolumesDeleteCascade-915753827 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (84203963-4037-4768-90fb-ede54ec98dfe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:52:09 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-fc87b2c0-3166-4d0e-9d6b-4aced554e879 tempest-VolumesDeleteCascade-915753827 None] Flow 'volume_create_manager' (8c744fef-a370-467f-afc6-fbcb49b48a59) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 11:52:09 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-d2c80f10-df1a-4186-a1fb-e4265ff0ff60 tempest-TestServerVolumeAttachScenarioOldVersion-1900847762 None] Acquiring lock "cinder-61433822-6193-4a1a-8952-025dd5af81a7-delete_volume" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 11:52:09 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-fc87b2c0-3166-4d0e-9d6b-4aced554e879 tempest-VolumesDeleteCascade-915753827 None] Created volume successfully. Nov 06 11:52:09 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-d2c80f10-df1a-4186-a1fb-e4265ff0ff60 tempest-TestServerVolumeAttachScenarioOldVersion-1900847762 None] Lock "cinder-61433822-6193-4a1a-8952-025dd5af81a7-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 11:52:09 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-d2c80f10-df1a-4186-a1fb-e4265ff0ff60 tempest-TestServerVolumeAttachScenarioOldVersion-1900847762 None] Acquiring lock "cinder-quobyte-61433822-6193-4a1a-8952-025dd5af81a7" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 11:52:09 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-d2c80f10-df1a-4186-a1fb-e4265ff0ff60 tempest-TestServerVolumeAttachScenarioOldVersion-1900847762 None] Lock "cinder-quobyte-61433822-6193-4a1a-8952-025dd5af81a7" acquired by "delete_volume" :: waited 0.019s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 11:52:09 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9772c25-7e21-4729-8ac9-3d16c4e1a3e1]: (4, 'qcow2') {{(pid=88420) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 11:52:09 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-d2c80f10-df1a-4186-a1fb-e4265ff0ff60 tempest-TestServerVolumeAttachScenarioOldVersion-1900847762 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-61433822-6193-4a1a-8952-025dd5af81a7 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:52:09 devstack sudo[98387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-61433822-6193-4a1a-8952-025dd5af81a7 Nov 06 11:52:09 devstack sudo[98387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:52:09 devstack sudo[98387]: pam_unix(sudo:session): session closed for user root Nov 06 11:52:09 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-d2c80f10-df1a-4186-a1fb-e4265ff0ff60 tempest-TestServerVolumeAttachScenarioOldVersion-1900847762 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-61433822-6193-4a1a-8952-025dd5af81a7" returned: 0 in 0.417s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:52:09 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-d2c80f10-df1a-4186-a1fb-e4265ff0ff60 tempest-TestServerVolumeAttachScenarioOldVersion-1900847762 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-61433822-6193-4a1a-8952-025dd5af81a7 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:52:09 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-0626dc12-311a-4a3e-83d9-ee868598a1c7 tempest-SnapshotMetadataTestJSON-1274001956 None] Acquiring lock "cinder-b620a51c-ef71-4e31-861e-0aefbd75171c-delete_volume" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 11:52:09 devstack sudo[98392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-61433822-6193-4a1a-8952-025dd5af81a7 Nov 06 11:52:09 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-0626dc12-311a-4a3e-83d9-ee868598a1c7 tempest-SnapshotMetadataTestJSON-1274001956 None] Lock "cinder-b620a51c-ef71-4e31-861e-0aefbd75171c-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 11:52:09 devstack sudo[98392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:52:09 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-0626dc12-311a-4a3e-83d9-ee868598a1c7 tempest-SnapshotMetadataTestJSON-1274001956 None] Acquiring lock "cinder-quobyte-b620a51c-ef71-4e31-861e-0aefbd75171c" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 11:52:09 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-0626dc12-311a-4a3e-83d9-ee868598a1c7 tempest-SnapshotMetadataTestJSON-1274001956 None] Lock "cinder-quobyte-b620a51c-ef71-4e31-861e-0aefbd75171c" acquired by "delete_volume" :: waited 0.024s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 11:52:09 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e356619-f270-4af9-9c74-38a8efb7655b]: (4, 'qcow2') {{(pid=88420) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 11:52:09 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-0626dc12-311a-4a3e-83d9-ee868598a1c7 tempest-SnapshotMetadataTestJSON-1274001956 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-b620a51c-ef71-4e31-861e-0aefbd75171c {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:52:09 devstack sudo[98392]: pam_unix(sudo:session): session closed for user root Nov 06 11:52:09 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-d2c80f10-df1a-4186-a1fb-e4265ff0ff60 tempest-TestServerVolumeAttachScenarioOldVersion-1900847762 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-61433822-6193-4a1a-8952-025dd5af81a7" returned: 0 in 0.377s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:52:09 devstack sudo[98394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-b620a51c-ef71-4e31-861e-0aefbd75171c Nov 06 11:52:09 devstack sudo[98394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:52:09 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-d2c80f10-df1a-4186-a1fb-e4265ff0ff60 tempest-TestServerVolumeAttachScenarioOldVersion-1900847762 None] Lock "cinder-quobyte-61433822-6193-4a1a-8952-025dd5af81a7" released by "delete_volume" :: held 0.847s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 11:52:10 devstack cinder-volume[87116]: DEBUG cinder.quota [None req-d2c80f10-df1a-4186-a1fb-e4265ff0ff60 tempest-TestServerVolumeAttachScenarioOldVersion-1900847762 None] Created reservations ['3d2eaa85-e51d-4eae-830c-1c646685dd54', 'e346d72f-8ca1-4033-8a35-a30d01e7c41d', '03fa985b-616b-496d-9c53-aa276de54610', '9e8fca29-d82b-443c-a9a0-ba34fed3b1ad'] {{(pid=87116) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 11:52:10 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-b690176c-a371-4089-a393-ce7efd6a3ca3 tempest-VolumesDeleteCascade-915753827 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 11:52:10 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-b690176c-a371-4089-a393-ce7efd6a3ca3 tempest-VolumesDeleteCascade-915753827 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 11:52:10 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-b690176c-a371-4089-a393-ce7efd6a3ca3 tempest-VolumesDeleteCascade-915753827 None] Creating offline snapshot 067eee10-786e-4c21-831c-faec938ed3cc of volume 8e620ca1-0a83-40b1-aa6f-7a446a8b3b2e {{(pid=87116) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 06 11:52:10 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[61b2b9c9-b8f1-46a3-857f-43c977d7e4c8]: (4, 'qcow2') {{(pid=88420) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 11:52:10 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-b690176c-a371-4089-a393-ce7efd6a3ca3 tempest-VolumesDeleteCascade-915753827 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-8e620ca1-0a83-40b1-aa6f-7a446a8b3b2e {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:52:10 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-d2c80f10-df1a-4186-a1fb-e4265ff0ff60 tempest-TestServerVolumeAttachScenarioOldVersion-1900847762 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 11:52:10 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-d2c80f10-df1a-4186-a1fb-e4265ff0ff60 tempest-TestServerVolumeAttachScenarioOldVersion-1900847762 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 11:52:10 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-d2c80f10-df1a-4186-a1fb-e4265ff0ff60 tempest-TestServerVolumeAttachScenarioOldVersion-1900847762 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 11:52:10 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-d2c80f10-df1a-4186-a1fb-e4265ff0ff60 tempest-TestServerVolumeAttachScenarioOldVersion-1900847762 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 11:52:10 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-d2c80f10-df1a-4186-a1fb-e4265ff0ff60 tempest-TestServerVolumeAttachScenarioOldVersion-1900847762 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 11:52:10 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-d2c80f10-df1a-4186-a1fb-e4265ff0ff60 tempest-TestServerVolumeAttachScenarioOldVersion-1900847762 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:52:10 devstack sudo[98400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756 Nov 06 11:52:10 devstack sudo[98400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:52:10 devstack sudo[98397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-8e620ca1-0a83-40b1-aa6f-7a446a8b3b2e Nov 06 11:52:10 devstack sudo[98397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:52:10 devstack sudo[98394]: pam_unix(sudo:session): session closed for user root Nov 06 11:52:10 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-0626dc12-311a-4a3e-83d9-ee868598a1c7 tempest-SnapshotMetadataTestJSON-1274001956 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-b620a51c-ef71-4e31-861e-0aefbd75171c" returned: 0 in 0.603s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:52:10 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-0626dc12-311a-4a3e-83d9-ee868598a1c7 tempest-SnapshotMetadataTestJSON-1274001956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-b620a51c-ef71-4e31-861e-0aefbd75171c {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:52:10 devstack sudo[98404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-b620a51c-ef71-4e31-861e-0aefbd75171c Nov 06 11:52:10 devstack sudo[98404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:52:10 devstack sudo[98400]: pam_unix(sudo:session): session closed for user root Nov 06 11:52:10 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-d2c80f10-df1a-4186-a1fb-e4265ff0ff60 tempest-TestServerVolumeAttachScenarioOldVersion-1900847762 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756" returned: 0 in 0.413s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:52:10 devstack cinder-volume[87116]: DEBUG cinder.manager [None req-d2c80f10-df1a-4186-a1fb-e4265ff0ff60 tempest-TestServerVolumeAttachScenarioOldVersion-1900847762 None] Notifying Schedulers of capabilities ... {{(pid=87116) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 11:52:10 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-d2c80f10-df1a-4186-a1fb-e4265ff0ff60 tempest-TestServerVolumeAttachScenarioOldVersion-1900847762 None] Deleted volume successfully. Nov 06 11:52:10 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-d2c80f10-df1a-4186-a1fb-e4265ff0ff60 tempest-TestServerVolumeAttachScenarioOldVersion-1900847762 None] Lock "cinder-61433822-6193-4a1a-8952-025dd5af81a7-delete_volume" released by "delete_volume" :: held 1.676s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 11:52:10 devstack sudo[98404]: pam_unix(sudo:session): session closed for user root Nov 06 11:52:10 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-0626dc12-311a-4a3e-83d9-ee868598a1c7 tempest-SnapshotMetadataTestJSON-1274001956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-b620a51c-ef71-4e31-861e-0aefbd75171c" returned: 0 in 0.400s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:52:10 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-0626dc12-311a-4a3e-83d9-ee868598a1c7 tempest-SnapshotMetadataTestJSON-1274001956 None] Lock "cinder-quobyte-b620a51c-ef71-4e31-861e-0aefbd75171c" released by "delete_volume" :: held 1.143s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 11:52:10 devstack sudo[98397]: pam_unix(sudo:session): session closed for user root Nov 06 11:52:10 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-b690176c-a371-4089-a393-ce7efd6a3ca3 tempest-VolumesDeleteCascade-915753827 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-8e620ca1-0a83-40b1-aa6f-7a446a8b3b2e" returned: 0 in 0.748s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:52:10 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-b690176c-a371-4089-a393-ce7efd6a3ca3 tempest-VolumesDeleteCascade-915753827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-8e620ca1-0a83-40b1-aa6f-7a446a8b3b2e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-8e620ca1-0a83-40b1-aa6f-7a446a8b3b2e.067eee10-786e-4c21-831c-faec938ed3cc 1G {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:52:10 devstack cinder-volume[87116]: DEBUG cinder.quota [None req-0626dc12-311a-4a3e-83d9-ee868598a1c7 tempest-SnapshotMetadataTestJSON-1274001956 None] Created reservations ['231ccfc2-c544-4115-9216-cfe273c57b9d', '09de9065-e8af-4dbd-811b-093cb996b39c', '89247262-5551-4870-8b8b-d90fdf5eb32b', '02e78718-44bf-4738-9cdf-89c31b9d3d1b'] {{(pid=87116) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 11:52:10 devstack sudo[98415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-8e620ca1-0a83-40b1-aa6f-7a446a8b3b2e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-8e620ca1-0a83-40b1-aa6f-7a446a8b3b2e.067eee10-786e-4c21-831c-faec938ed3cc 1G Nov 06 11:52:10 devstack sudo[98415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:52:11 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-0626dc12-311a-4a3e-83d9-ee868598a1c7 tempest-SnapshotMetadataTestJSON-1274001956 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 11:52:11 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-0626dc12-311a-4a3e-83d9-ee868598a1c7 tempest-SnapshotMetadataTestJSON-1274001956 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 11:52:11 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-0626dc12-311a-4a3e-83d9-ee868598a1c7 tempest-SnapshotMetadataTestJSON-1274001956 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 11:52:11 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-0626dc12-311a-4a3e-83d9-ee868598a1c7 tempest-SnapshotMetadataTestJSON-1274001956 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 11:52:11 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-0626dc12-311a-4a3e-83d9-ee868598a1c7 tempest-SnapshotMetadataTestJSON-1274001956 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 11:52:11 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-0626dc12-311a-4a3e-83d9-ee868598a1c7 tempest-SnapshotMetadataTestJSON-1274001956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:52:11 devstack sudo[98428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756 Nov 06 11:52:11 devstack sudo[98428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:52:11 devstack sudo[98428]: pam_unix(sudo:session): session closed for user root Nov 06 11:52:11 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-0626dc12-311a-4a3e-83d9-ee868598a1c7 tempest-SnapshotMetadataTestJSON-1274001956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756" returned: 0 in 0.440s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:52:11 devstack cinder-volume[87116]: DEBUG cinder.manager [None req-0626dc12-311a-4a3e-83d9-ee868598a1c7 tempest-SnapshotMetadataTestJSON-1274001956 None] Notifying Schedulers of capabilities ... {{(pid=87116) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 11:52:11 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-0626dc12-311a-4a3e-83d9-ee868598a1c7 tempest-SnapshotMetadataTestJSON-1274001956 None] Deleted volume successfully. Nov 06 11:52:11 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-0626dc12-311a-4a3e-83d9-ee868598a1c7 tempest-SnapshotMetadataTestJSON-1274001956 None] Lock "cinder-b620a51c-ef71-4e31-861e-0aefbd75171c-delete_volume" released by "delete_volume" :: held 2.076s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 11:52:11 devstack sudo[98415]: pam_unix(sudo:session): session closed for user root Nov 06 11:52:11 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-b690176c-a371-4089-a393-ce7efd6a3ca3 tempest-VolumesDeleteCascade-915753827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-8e620ca1-0a83-40b1-aa6f-7a446a8b3b2e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-8e620ca1-0a83-40b1-aa6f-7a446a8b3b2e.067eee10-786e-4c21-831c-faec938ed3cc 1G" returned: 0 in 0.903s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:52:11 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-b690176c-a371-4089-a393-ce7efd6a3ca3 tempest-VolumesDeleteCascade-915753827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8e620ca1-0a83-40b1-aa6f-7a446a8b3b2e -F qcow2 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-8e620ca1-0a83-40b1-aa6f-7a446a8b3b2e.067eee10-786e-4c21-831c-faec938ed3cc {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:52:11 devstack sudo[98440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8e620ca1-0a83-40b1-aa6f-7a446a8b3b2e -F qcow2 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-8e620ca1-0a83-40b1-aa6f-7a446a8b3b2e.067eee10-786e-4c21-831c-faec938ed3cc Nov 06 11:52:11 devstack sudo[98440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:52:12 devstack sudo[98440]: pam_unix(sudo:session): session closed for user root Nov 06 11:52:12 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-b690176c-a371-4089-a393-ce7efd6a3ca3 tempest-VolumesDeleteCascade-915753827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8e620ca1-0a83-40b1-aa6f-7a446a8b3b2e -F qcow2 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-8e620ca1-0a83-40b1-aa6f-7a446a8b3b2e.067eee10-786e-4c21-831c-faec938ed3cc" returned: 0 in 0.465s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:52:12 devstack cinder-volume[87116]: WARNING cinder.volume.drivers.remotefs [None req-b690176c-a371-4089-a393-ce7efd6a3ca3 tempest-VolumesDeleteCascade-915753827 None] /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-8e620ca1-0a83-40b1-aa6f-7a446a8b3b2e.067eee10-786e-4c21-831c-faec938ed3cc is being set with open permissions: ugo+rw Nov 06 11:52:12 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-b690176c-a371-4089-a393-ce7efd6a3ca3 tempest-VolumesDeleteCascade-915753827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-8e620ca1-0a83-40b1-aa6f-7a446a8b3b2e.067eee10-786e-4c21-831c-faec938ed3cc {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:52:12 devstack sudo[98445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-8e620ca1-0a83-40b1-aa6f-7a446a8b3b2e.067eee10-786e-4c21-831c-faec938ed3cc Nov 06 11:52:12 devstack sudo[98445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:52:12 devstack sudo[98445]: pam_unix(sudo:session): session closed for user root Nov 06 11:52:12 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-b690176c-a371-4089-a393-ce7efd6a3ca3 tempest-VolumesDeleteCascade-915753827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-8e620ca1-0a83-40b1-aa6f-7a446a8b3b2e.067eee10-786e-4c21-831c-faec938ed3cc" returned: 0 in 0.360s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:52:12 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-b690176c-a371-4089-a393-ce7efd6a3ca3 tempest-VolumesDeleteCascade-915753827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-8e620ca1-0a83-40b1-aa6f-7a446a8b3b2e.info {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:52:12 devstack sudo[98450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-8e620ca1-0a83-40b1-aa6f-7a446a8b3b2e.info Nov 06 11:52:12 devstack sudo[98450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:52:12 devstack sudo[98450]: pam_unix(sudo:session): session closed for user root Nov 06 11:52:12 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-b690176c-a371-4089-a393-ce7efd6a3ca3 tempest-VolumesDeleteCascade-915753827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-8e620ca1-0a83-40b1-aa6f-7a446a8b3b2e.info" returned: 0 in 0.324s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:52:12 devstack cinder-volume[87116]: WARNING cinder.volume.drivers.remotefs [None req-b690176c-a371-4089-a393-ce7efd6a3ca3 tempest-VolumesDeleteCascade-915753827 None] /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-8e620ca1-0a83-40b1-aa6f-7a446a8b3b2e.info is being set with open permissions: ugo+rw Nov 06 11:52:12 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-b690176c-a371-4089-a393-ce7efd6a3ca3 tempest-VolumesDeleteCascade-915753827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-8e620ca1-0a83-40b1-aa6f-7a446a8b3b2e.info {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:52:13 devstack sudo[98453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-8e620ca1-0a83-40b1-aa6f-7a446a8b3b2e.info Nov 06 11:52:13 devstack sudo[98453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:52:13 devstack sudo[98453]: pam_unix(sudo:session): session closed for user root Nov 06 11:52:13 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-b690176c-a371-4089-a393-ce7efd6a3ca3 tempest-VolumesDeleteCascade-915753827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-8e620ca1-0a83-40b1-aa6f-7a446a8b3b2e.info" returned: 0 in 0.297s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:52:13 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-b690176c-a371-4089-a393-ce7efd6a3ca3 tempest-VolumesDeleteCascade-915753827 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.261s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 11:52:13 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-b690176c-a371-4089-a393-ce7efd6a3ca3 tempest-VolumesDeleteCascade-915753827 None] Create snapshot completed successfully Nov 06 11:52:14 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-c4e32feb-2dec-4aa5-8192-65a11754a1c9 tempest-VolumesDeleteCascade-915753827 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 11:52:14 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-c4e32feb-2dec-4aa5-8192-65a11754a1c9 tempest-VolumesDeleteCascade-915753827 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 11:52:14 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-c4e32feb-2dec-4aa5-8192-65a11754a1c9 tempest-VolumesDeleteCascade-915753827 None] Creating offline snapshot 562ae9f5-e42a-4fc1-807d-20a870bcfa35 of volume 8e620ca1-0a83-40b1-aa6f-7a446a8b3b2e {{(pid=87116) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 06 11:52:14 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[422f9142-bde9-43b3-b672-600bcffd2f08]: (4, 'qcow2') {{(pid=88420) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 11:52:14 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-c4e32feb-2dec-4aa5-8192-65a11754a1c9 tempest-VolumesDeleteCascade-915753827 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-8e620ca1-0a83-40b1-aa6f-7a446a8b3b2e.067eee10-786e-4c21-831c-faec938ed3cc {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:52:15 devstack sudo[98458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-8e620ca1-0a83-40b1-aa6f-7a446a8b3b2e.067eee10-786e-4c21-831c-faec938ed3cc Nov 06 11:52:15 devstack sudo[98458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:52:15 devstack sudo[98458]: pam_unix(sudo:session): session closed for user root Nov 06 11:52:15 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-c4e32feb-2dec-4aa5-8192-65a11754a1c9 tempest-VolumesDeleteCascade-915753827 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-8e620ca1-0a83-40b1-aa6f-7a446a8b3b2e.067eee10-786e-4c21-831c-faec938ed3cc" returned: 0 in 0.545s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:52:15 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-c4e32feb-2dec-4aa5-8192-65a11754a1c9 tempest-VolumesDeleteCascade-915753827 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8e620ca1-0a83-40b1-aa6f-7a446a8b3b2e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87116) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 11:52:15 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-c4e32feb-2dec-4aa5-8192-65a11754a1c9 tempest-VolumesDeleteCascade-915753827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-8e620ca1-0a83-40b1-aa6f-7a446a8b3b2e.067eee10-786e-4c21-831c-faec938ed3cc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-8e620ca1-0a83-40b1-aa6f-7a446a8b3b2e.562ae9f5-e42a-4fc1-807d-20a870bcfa35 1G {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:52:15 devstack sudo[98463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-8e620ca1-0a83-40b1-aa6f-7a446a8b3b2e.067eee10-786e-4c21-831c-faec938ed3cc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-8e620ca1-0a83-40b1-aa6f-7a446a8b3b2e.562ae9f5-e42a-4fc1-807d-20a870bcfa35 1G Nov 06 11:52:15 devstack sudo[98463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:52:16 devstack sudo[98463]: pam_unix(sudo:session): session closed for user root Nov 06 11:52:16 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-c4e32feb-2dec-4aa5-8192-65a11754a1c9 tempest-VolumesDeleteCascade-915753827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-8e620ca1-0a83-40b1-aa6f-7a446a8b3b2e.067eee10-786e-4c21-831c-faec938ed3cc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-8e620ca1-0a83-40b1-aa6f-7a446a8b3b2e.562ae9f5-e42a-4fc1-807d-20a870bcfa35 1G" returned: 0 in 0.613s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:52:16 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-c4e32feb-2dec-4aa5-8192-65a11754a1c9 tempest-VolumesDeleteCascade-915753827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8e620ca1-0a83-40b1-aa6f-7a446a8b3b2e.067eee10-786e-4c21-831c-faec938ed3cc -F qcow2 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-8e620ca1-0a83-40b1-aa6f-7a446a8b3b2e.562ae9f5-e42a-4fc1-807d-20a870bcfa35 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:52:16 devstack sudo[98472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8e620ca1-0a83-40b1-aa6f-7a446a8b3b2e.067eee10-786e-4c21-831c-faec938ed3cc -F qcow2 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-8e620ca1-0a83-40b1-aa6f-7a446a8b3b2e.562ae9f5-e42a-4fc1-807d-20a870bcfa35 Nov 06 11:52:16 devstack sudo[98472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:52:16 devstack sudo[98472]: pam_unix(sudo:session): session closed for user root Nov 06 11:52:16 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-c4e32feb-2dec-4aa5-8192-65a11754a1c9 tempest-VolumesDeleteCascade-915753827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8e620ca1-0a83-40b1-aa6f-7a446a8b3b2e.067eee10-786e-4c21-831c-faec938ed3cc -F qcow2 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-8e620ca1-0a83-40b1-aa6f-7a446a8b3b2e.562ae9f5-e42a-4fc1-807d-20a870bcfa35" returned: 0 in 0.441s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:52:16 devstack cinder-volume[87116]: WARNING cinder.volume.drivers.remotefs [None req-c4e32feb-2dec-4aa5-8192-65a11754a1c9 tempest-VolumesDeleteCascade-915753827 None] /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-8e620ca1-0a83-40b1-aa6f-7a446a8b3b2e.562ae9f5-e42a-4fc1-807d-20a870bcfa35 is being set with open permissions: ugo+rw Nov 06 11:52:16 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-c4e32feb-2dec-4aa5-8192-65a11754a1c9 tempest-VolumesDeleteCascade-915753827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-8e620ca1-0a83-40b1-aa6f-7a446a8b3b2e.562ae9f5-e42a-4fc1-807d-20a870bcfa35 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:52:16 devstack sudo[98477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-8e620ca1-0a83-40b1-aa6f-7a446a8b3b2e.562ae9f5-e42a-4fc1-807d-20a870bcfa35 Nov 06 11:52:16 devstack sudo[98477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:52:16 devstack sudo[98477]: pam_unix(sudo:session): session closed for user root Nov 06 11:52:16 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-c4e32feb-2dec-4aa5-8192-65a11754a1c9 tempest-VolumesDeleteCascade-915753827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-8e620ca1-0a83-40b1-aa6f-7a446a8b3b2e.562ae9f5-e42a-4fc1-807d-20a870bcfa35" returned: 0 in 0.348s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:52:16 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-c4e32feb-2dec-4aa5-8192-65a11754a1c9 tempest-VolumesDeleteCascade-915753827 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.175s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 11:52:16 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-c4e32feb-2dec-4aa5-8192-65a11754a1c9 tempest-VolumesDeleteCascade-915753827 None] Create snapshot completed successfully Nov 06 11:52:17 devstack cinder-volume[87116]: DEBUG dbcounter [-] [87116] Writing DB stats cinder:SELECT=107,cinder:INSERT=39,cinder:UPDATE=134,cinder:DELETE=9 {{(pid=87116) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 11:52:17 devstack cinder-volume[87116]: DEBUG cinder.volume.flows.manager.create_volume [None req-f77eb49c-f963-44b8-bb2a-6f4a899a7ae6 tempest-VolumesMetadataTest-1475810343 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87116) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 11:52:17 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-f77eb49c-f963-44b8-bb2a-6f4a899a7ae6 tempest-VolumesMetadataTest-1475810343 None] Flow 'volume_create_manager' (c6ef72f1-1828-4854-b0cc-2fbb80800805) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 11:52:17 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-f77eb49c-f963-44b8-bb2a-6f4a899a7ae6 tempest-VolumesMetadataTest-1475810343 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c6f59357-a381-4e7a-b072-046826f7df73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:52:17 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-f77eb49c-f963-44b8-bb2a-6f4a899a7ae6 tempest-VolumesMetadataTest-1475810343 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c6f59357-a381-4e7a-b072-046826f7df73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T10:52:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-823071784',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4029a9ed-3812-4c2e-854f-10e37d7d4db5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f370a3d0e64f4916a469f00b60068db3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T10:52:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T10:52:17Z,use_quota=True,user_id='435d95bfda154dd993c28ea28ea048c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(34d3b144-d9b7-480a-a2e3-01e45f3d54c1),volume_type_id=34d3b144-d9b7-480a-a2e3-01e45f3d54c1)' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:52:17 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-f77eb49c-f963-44b8-bb2a-6f4a899a7ae6 tempest-VolumesMetadataTest-1475810343 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (65d87144-60a9-49f7-a902-820444840e4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:52:17 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-f77eb49c-f963-44b8-bb2a-6f4a899a7ae6 tempest-VolumesMetadataTest-1475810343 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (65d87144-60a9-49f7-a902-820444840e4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:52:17 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-f77eb49c-f963-44b8-bb2a-6f4a899a7ae6 tempest-VolumesMetadataTest-1475810343 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e1d21964-fa52-4f93-9e35-a30be5e5116d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:52:17 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-f77eb49c-f963-44b8-bb2a-6f4a899a7ae6 tempest-VolumesMetadataTest-1475810343 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e1d21964-fa52-4f93-9e35-a30be5e5116d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4029a9ed-3812-4c2e-854f-10e37d7d4db5', 'volume_name': 'volume-4029a9ed-3812-4c2e-854f-10e37d7d4db5', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:52:17 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-f77eb49c-f963-44b8-bb2a-6f4a899a7ae6 tempest-VolumesMetadataTest-1475810343 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (020ecbfd-0b51-40ea-8999-18a95620333e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:52:17 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-f77eb49c-f963-44b8-bb2a-6f4a899a7ae6 tempest-VolumesMetadataTest-1475810343 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (020ecbfd-0b51-40ea-8999-18a95620333e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:52:17 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-f77eb49c-f963-44b8-bb2a-6f4a899a7ae6 tempest-VolumesMetadataTest-1475810343 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c98f33b5-33cb-462e-9b41-38954554e88f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:52:17 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-f77eb49c-f963-44b8-bb2a-6f4a899a7ae6 tempest-VolumesMetadataTest-1475810343 None] Volume 4029a9ed-3812-4c2e-854f-10e37d7d4db5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4029a9ed-3812-4c2e-854f-10e37d7d4db5', 'volume_size': 1} Nov 06 11:52:17 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-f77eb49c-f963-44b8-bb2a-6f4a899a7ae6 tempest-VolumesMetadataTest-1475810343 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 11:52:17 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-f77eb49c-f963-44b8-bb2a-6f4a899a7ae6 tempest-VolumesMetadataTest-1475810343 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 11:52:17 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-f77eb49c-f963-44b8-bb2a-6f4a899a7ae6 tempest-VolumesMetadataTest-1475810343 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T10:52:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-823071784',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4029a9ed-3812-4c2e-854f-10e37d7d4db5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f370a3d0e64f4916a469f00b60068db3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T10:52:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T10:52:17Z,use_quota=True,user_id='435d95bfda154dd993c28ea28ea048c7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(34d3b144-d9b7-480a-a2e3-01e45f3d54c1),volume_type_id=34d3b144-d9b7-480a-a2e3-01e45f3d54c1)}" {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 11:52:17 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-f77eb49c-f963-44b8-bb2a-6f4a899a7ae6 tempest-VolumesMetadataTest-1475810343 None] Creating volume 4029a9ed-3812-4c2e-854f-10e37d7d4db5 {{(pid=87116) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 11:52:17 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-f77eb49c-f963-44b8-bb2a-6f4a899a7ae6 tempest-VolumesMetadataTest-1475810343 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 11:52:17 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-f77eb49c-f963-44b8-bb2a-6f4a899a7ae6 tempest-VolumesMetadataTest-1475810343 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 11:52:17 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-f77eb49c-f963-44b8-bb2a-6f4a899a7ae6 tempest-VolumesMetadataTest-1475810343 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 11:52:17 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-f77eb49c-f963-44b8-bb2a-6f4a899a7ae6 tempest-VolumesMetadataTest-1475810343 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 11:52:17 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-f77eb49c-f963-44b8-bb2a-6f4a899a7ae6 tempest-VolumesMetadataTest-1475810343 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 11:52:17 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-f77eb49c-f963-44b8-bb2a-6f4a899a7ae6 tempest-VolumesMetadataTest-1475810343 None] Selected osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f as target Quobyte volume. {{(pid=87116) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 11:52:17 devstack cinder-volume[87116]: INFO cinder.volume.drivers.remotefs [None req-f77eb49c-f963-44b8-bb2a-6f4a899a7ae6 tempest-VolumesMetadataTest-1475810343 None] casted to osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f Nov 06 11:52:17 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-f77eb49c-f963-44b8-bb2a-6f4a899a7ae6 tempest-VolumesMetadataTest-1475810343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-4029a9ed-3812-4c2e-854f-10e37d7d4db5 1073741824 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:52:17 devstack sudo[98480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-4029a9ed-3812-4c2e-854f-10e37d7d4db5 1073741824 Nov 06 11:52:17 devstack sudo[98480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:52:17 devstack sudo[98480]: pam_unix(sudo:session): session closed for user root Nov 06 11:52:17 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-f77eb49c-f963-44b8-bb2a-6f4a899a7ae6 tempest-VolumesMetadataTest-1475810343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-4029a9ed-3812-4c2e-854f-10e37d7d4db5 1073741824" returned: 0 in 0.557s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:52:18 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-f77eb49c-f963-44b8-bb2a-6f4a899a7ae6 tempest-VolumesMetadataTest-1475810343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-4029a9ed-3812-4c2e-854f-10e37d7d4db5 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:52:18 devstack sudo[98486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-4029a9ed-3812-4c2e-854f-10e37d7d4db5 Nov 06 11:52:18 devstack sudo[98486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:52:18 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-defe0cf3-fadc-43a6-a5fc-6b61b45a470c tempest-VolumesDeleteCascade-915753827 None] Acquiring lock "cinder-8e620ca1-0a83-40b1-aa6f-7a446a8b3b2e-delete_volume" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 11:52:18 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-defe0cf3-fadc-43a6-a5fc-6b61b45a470c tempest-VolumesDeleteCascade-915753827 None] Lock "cinder-8e620ca1-0a83-40b1-aa6f-7a446a8b3b2e-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 11:52:18 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-defe0cf3-fadc-43a6-a5fc-6b61b45a470c tempest-VolumesDeleteCascade-915753827 None] Performing cascade delete. {{(pid=87116) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Nov 06 11:52:18 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-defe0cf3-fadc-43a6-a5fc-6b61b45a470c tempest-VolumesDeleteCascade-915753827 None] Acquiring lock "cinder-067eee10-786e-4c21-831c-faec938ed3cc-delete_snapshot" by "delete_snapshot" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 11:52:18 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-defe0cf3-fadc-43a6-a5fc-6b61b45a470c tempest-VolumesDeleteCascade-915753827 None] Lock "cinder-067eee10-786e-4c21-831c-faec938ed3cc-delete_snapshot" acquired by "delete_snapshot" :: waited 0.045s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 11:52:18 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-defe0cf3-fadc-43a6-a5fc-6b61b45a470c tempest-VolumesDeleteCascade-915753827 None] Acquiring lock "cinder-quobyte-8e620ca1-0a83-40b1-aa6f-7a446a8b3b2e" by "delete_snapshot" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 11:52:18 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-defe0cf3-fadc-43a6-a5fc-6b61b45a470c tempest-VolumesDeleteCascade-915753827 None] Lock "cinder-quobyte-8e620ca1-0a83-40b1-aa6f-7a446a8b3b2e" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 11:52:18 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-defe0cf3-fadc-43a6-a5fc-6b61b45a470c tempest-VolumesDeleteCascade-915753827 None] Acquiring lock "cinder-quobyte-067eee10-786e-4c21-831c-faec938ed3cc" by "_delete_snapshot" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 11:52:18 devstack sudo[98486]: pam_unix(sudo:session): session closed for user root Nov 06 11:52:18 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-defe0cf3-fadc-43a6-a5fc-6b61b45a470c tempest-VolumesDeleteCascade-915753827 None] Lock "cinder-quobyte-067eee10-786e-4c21-831c-faec938ed3cc" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 11:52:18 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-defe0cf3-fadc-43a6-a5fc-6b61b45a470c tempest-VolumesDeleteCascade-915753827 None] Deleting offline snapshot 067eee10-786e-4c21-831c-faec938ed3cc of volume 8e620ca1-0a83-40b1-aa6f-7a446a8b3b2e {{(pid=87116) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 06 11:52:18 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-defe0cf3-fadc-43a6-a5fc-6b61b45a470c tempest-VolumesDeleteCascade-915753827 None] snapshot_file for this snap is: volume-8e620ca1-0a83-40b1-aa6f-7a446a8b3b2e.067eee10-786e-4c21-831c-faec938ed3cc {{(pid=87116) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 06 11:52:18 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-f77eb49c-f963-44b8-bb2a-6f4a899a7ae6 tempest-VolumesMetadataTest-1475810343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-4029a9ed-3812-4c2e-854f-10e37d7d4db5" returned: 0 in 0.363s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:52:18 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-f77eb49c-f963-44b8-bb2a-6f4a899a7ae6 tempest-VolumesMetadataTest-1475810343 None] <== create_volume: return (992ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f'} {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 11:52:18 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-f77eb49c-f963-44b8-bb2a-6f4a899a7ae6 tempest-VolumesMetadataTest-1475810343 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.995s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 11:52:18 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1293ced-581a-4b15-9ac2-837601d4d011]: (4, 'qcow2') {{(pid=88420) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 11:52:18 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-defe0cf3-fadc-43a6-a5fc-6b61b45a470c tempest-VolumesDeleteCascade-915753827 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-8e620ca1-0a83-40b1-aa6f-7a446a8b3b2e.067eee10-786e-4c21-831c-faec938ed3cc {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:52:18 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-f77eb49c-f963-44b8-bb2a-6f4a899a7ae6 tempest-VolumesMetadataTest-1475810343 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c98f33b5-33cb-462e-9b41-38954554e88f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4029a9ed-3812-4c2e-854f-10e37d7d4db5', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:52:18 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-f77eb49c-f963-44b8-bb2a-6f4a899a7ae6 tempest-VolumesMetadataTest-1475810343 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (959b5281-8c80-48bb-9d88-bc3f851c120e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:52:18 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-f77eb49c-f963-44b8-bb2a-6f4a899a7ae6 tempest-VolumesMetadataTest-1475810343 None] Volume volume-4029a9ed-3812-4c2e-854f-10e37d7d4db5 (4029a9ed-3812-4c2e-854f-10e37d7d4db5): created successfully Nov 06 11:52:18 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-f77eb49c-f963-44b8-bb2a-6f4a899a7ae6 tempest-VolumesMetadataTest-1475810343 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (959b5281-8c80-48bb-9d88-bc3f851c120e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:52:18 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-f77eb49c-f963-44b8-bb2a-6f4a899a7ae6 tempest-VolumesMetadataTest-1475810343 None] Flow 'volume_create_manager' (c6ef72f1-1828-4854-b0cc-2fbb80800805) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 11:52:18 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-f77eb49c-f963-44b8-bb2a-6f4a899a7ae6 tempest-VolumesMetadataTest-1475810343 None] Created volume successfully. Nov 06 11:52:18 devstack cinder-volume[87116]: DEBUG cinder.volume.flows.manager.create_volume [None req-6cc37d3d-c055-473e-9b6a-da1dfcdb75f0 tempest-TestInstancesWithCinderVolumes-778023409 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87116) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 11:52:18 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-6cc37d3d-c055-473e-9b6a-da1dfcdb75f0 tempest-TestInstancesWithCinderVolumes-778023409 None] Flow 'volume_create_manager' (8c987b48-d448-46ad-b1ef-dd94c2b7ff85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 11:52:18 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-6cc37d3d-c055-473e-9b6a-da1dfcdb75f0 tempest-TestInstancesWithCinderVolumes-778023409 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b1a3a45f-0c0a-4c05-ab1f-a56d35e60018) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:52:18 devstack sudo[98489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-8e620ca1-0a83-40b1-aa6f-7a446a8b3b2e.067eee10-786e-4c21-831c-faec938ed3cc Nov 06 11:52:18 devstack sudo[98489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:52:18 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-6cc37d3d-c055-473e-9b6a-da1dfcdb75f0 tempest-TestInstancesWithCinderVolumes-778023409 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b1a3a45f-0c0a-4c05-ab1f-a56d35e60018) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T10:52:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1036600471',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b57d0ecb-ebc7-4c22-86d6-22310eeb167d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='03b11da20f3340ca97f572ea35dad2f5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T10:52:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T10:52:18Z,use_quota=True,user_id='7a2ee037e3804e479c3648a3b1bb20b1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc3181ae-8c86-4653-8365-ea7c12e7f9fb),volume_type_id=bc3181ae-8c86-4653-8365-ea7c12e7f9fb)' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:52:18 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-6cc37d3d-c055-473e-9b6a-da1dfcdb75f0 tempest-TestInstancesWithCinderVolumes-778023409 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6234a20f-c6de-4bf2-a553-b93176081402) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:52:18 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-6cc37d3d-c055-473e-9b6a-da1dfcdb75f0 tempest-TestInstancesWithCinderVolumes-778023409 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6234a20f-c6de-4bf2-a553-b93176081402) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:52:18 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-6cc37d3d-c055-473e-9b6a-da1dfcdb75f0 tempest-TestInstancesWithCinderVolumes-778023409 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c46f4ad7-c134-42dd-9594-8dd4171b4069) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:52:18 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-6cc37d3d-c055-473e-9b6a-da1dfcdb75f0 tempest-TestInstancesWithCinderVolumes-778023409 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c46f4ad7-c134-42dd-9594-8dd4171b4069) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b57d0ecb-ebc7-4c22-86d6-22310eeb167d', 'volume_name': 'volume-b57d0ecb-ebc7-4c22-86d6-22310eeb167d', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:52:18 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-6cc37d3d-c055-473e-9b6a-da1dfcdb75f0 tempest-TestInstancesWithCinderVolumes-778023409 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (735274f7-7a74-4416-b4d3-82e11637aee7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:52:18 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-6cc37d3d-c055-473e-9b6a-da1dfcdb75f0 tempest-TestInstancesWithCinderVolumes-778023409 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (735274f7-7a74-4416-b4d3-82e11637aee7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:52:18 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-6cc37d3d-c055-473e-9b6a-da1dfcdb75f0 tempest-TestInstancesWithCinderVolumes-778023409 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c98658f6-9bd4-418c-baa6-2caf702b44db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:52:18 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-6cc37d3d-c055-473e-9b6a-da1dfcdb75f0 tempest-TestInstancesWithCinderVolumes-778023409 None] Volume b57d0ecb-ebc7-4c22-86d6-22310eeb167d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b57d0ecb-ebc7-4c22-86d6-22310eeb167d', 'volume_size': 1} Nov 06 11:52:18 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-6cc37d3d-c055-473e-9b6a-da1dfcdb75f0 tempest-TestInstancesWithCinderVolumes-778023409 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 11:52:18 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-6cc37d3d-c055-473e-9b6a-da1dfcdb75f0 tempest-TestInstancesWithCinderVolumes-778023409 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 11:52:18 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-6cc37d3d-c055-473e-9b6a-da1dfcdb75f0 tempest-TestInstancesWithCinderVolumes-778023409 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T10:52:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1036600471',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b57d0ecb-ebc7-4c22-86d6-22310eeb167d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='03b11da20f3340ca97f572ea35dad2f5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T10:52:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T10:52:18Z,use_quota=True,user_id='7a2ee037e3804e479c3648a3b1bb20b1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bc3181ae-8c86-4653-8365-ea7c12e7f9fb),volume_type_id=bc3181ae-8c86-4653-8365-ea7c12e7f9fb)}" {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 11:52:18 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-6cc37d3d-c055-473e-9b6a-da1dfcdb75f0 tempest-TestInstancesWithCinderVolumes-778023409 None] Creating volume b57d0ecb-ebc7-4c22-86d6-22310eeb167d {{(pid=87116) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 11:52:18 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-6cc37d3d-c055-473e-9b6a-da1dfcdb75f0 tempest-TestInstancesWithCinderVolumes-778023409 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 11:52:18 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-6cc37d3d-c055-473e-9b6a-da1dfcdb75f0 tempest-TestInstancesWithCinderVolumes-778023409 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 11:52:18 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-6cc37d3d-c055-473e-9b6a-da1dfcdb75f0 tempest-TestInstancesWithCinderVolumes-778023409 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 11:52:18 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-6cc37d3d-c055-473e-9b6a-da1dfcdb75f0 tempest-TestInstancesWithCinderVolumes-778023409 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 11:52:18 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-6cc37d3d-c055-473e-9b6a-da1dfcdb75f0 tempest-TestInstancesWithCinderVolumes-778023409 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 11:52:18 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-6cc37d3d-c055-473e-9b6a-da1dfcdb75f0 tempest-TestInstancesWithCinderVolumes-778023409 None] Selected osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f as target Quobyte volume. {{(pid=87116) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 11:52:18 devstack cinder-volume[87116]: INFO cinder.volume.drivers.remotefs [None req-6cc37d3d-c055-473e-9b6a-da1dfcdb75f0 tempest-TestInstancesWithCinderVolumes-778023409 None] casted to osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f Nov 06 11:52:18 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-6cc37d3d-c055-473e-9b6a-da1dfcdb75f0 tempest-TestInstancesWithCinderVolumes-778023409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-b57d0ecb-ebc7-4c22-86d6-22310eeb167d 1073741824 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:52:18 devstack sudo[98491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-b57d0ecb-ebc7-4c22-86d6-22310eeb167d 1073741824 Nov 06 11:52:18 devstack sudo[98491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:52:18 devstack sudo[98489]: pam_unix(sudo:session): session closed for user root Nov 06 11:52:18 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-defe0cf3-fadc-43a6-a5fc-6b61b45a470c tempest-VolumesDeleteCascade-915753827 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-8e620ca1-0a83-40b1-aa6f-7a446a8b3b2e.067eee10-786e-4c21-831c-faec938ed3cc" returned: 0 in 0.545s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:52:18 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-defe0cf3-fadc-43a6-a5fc-6b61b45a470c tempest-VolumesDeleteCascade-915753827 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8e620ca1-0a83-40b1-aa6f-7a446a8b3b2e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87116) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 11:52:19 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[390e5d19-e486-4863-be50-934aa53bda86]: (4, 'qcow2') {{(pid=88420) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 11:52:19 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-defe0cf3-fadc-43a6-a5fc-6b61b45a470c tempest-VolumesDeleteCascade-915753827 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-8e620ca1-0a83-40b1-aa6f-7a446a8b3b2e {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:52:19 devstack cinder-volume[87116]: DEBUG cinder.volume.flows.manager.create_volume [None req-e045b8f6-d289-4e46-941c-fc7c4478088f tempest-TestInstancesWithCinderVolumes-778023409 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87116) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 11:52:19 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-e045b8f6-d289-4e46-941c-fc7c4478088f tempest-TestInstancesWithCinderVolumes-778023409 None] Flow 'volume_create_manager' (9c54415f-43c8-4e06-a2ad-6d58f2a4ab99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 11:52:19 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-e045b8f6-d289-4e46-941c-fc7c4478088f tempest-TestInstancesWithCinderVolumes-778023409 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (55e00681-6076-4f72-9fb4-df38c148019c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:52:19 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-e045b8f6-d289-4e46-941c-fc7c4478088f tempest-TestInstancesWithCinderVolumes-778023409 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (55e00681-6076-4f72-9fb4-df38c148019c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T10:52:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-2030351886',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=82f3f473-5a67-46ee-a572-d16a86aeee72,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='03b11da20f3340ca97f572ea35dad2f5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T10:52:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T10:52:19Z,use_quota=True,user_id='7a2ee037e3804e479c3648a3b1bb20b1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84809cfc-50b6-4206-b0b7-198c0696bda2),volume_type_id=84809cfc-50b6-4206-b0b7-198c0696bda2)' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:52:19 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-e045b8f6-d289-4e46-941c-fc7c4478088f tempest-TestInstancesWithCinderVolumes-778023409 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ba36f10-25ef-4f39-b9bb-04fe6daddc14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:52:19 devstack sudo[98501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-8e620ca1-0a83-40b1-aa6f-7a446a8b3b2e Nov 06 11:52:19 devstack sudo[98501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:52:19 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-e045b8f6-d289-4e46-941c-fc7c4478088f tempest-TestInstancesWithCinderVolumes-778023409 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ba36f10-25ef-4f39-b9bb-04fe6daddc14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:52:19 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-e045b8f6-d289-4e46-941c-fc7c4478088f tempest-TestInstancesWithCinderVolumes-778023409 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a2261953-b22f-4533-8ebc-e0ef4355e94e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:52:19 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-e045b8f6-d289-4e46-941c-fc7c4478088f tempest-TestInstancesWithCinderVolumes-778023409 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a2261953-b22f-4533-8ebc-e0ef4355e94e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '82f3f473-5a67-46ee-a572-d16a86aeee72', 'volume_name': 'volume-82f3f473-5a67-46ee-a572-d16a86aeee72', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:52:19 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-e045b8f6-d289-4e46-941c-fc7c4478088f tempest-TestInstancesWithCinderVolumes-778023409 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5b0d4645-bb67-4a54-8267-45b168ba9a25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:52:19 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-e045b8f6-d289-4e46-941c-fc7c4478088f tempest-TestInstancesWithCinderVolumes-778023409 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5b0d4645-bb67-4a54-8267-45b168ba9a25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:52:19 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-e045b8f6-d289-4e46-941c-fc7c4478088f tempest-TestInstancesWithCinderVolumes-778023409 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ec6a0115-95fe-4016-86e5-c5b9ea14ced1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:52:19 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-e045b8f6-d289-4e46-941c-fc7c4478088f tempest-TestInstancesWithCinderVolumes-778023409 None] Volume 82f3f473-5a67-46ee-a572-d16a86aeee72: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-82f3f473-5a67-46ee-a572-d16a86aeee72', 'volume_size': 1} Nov 06 11:52:19 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-e045b8f6-d289-4e46-941c-fc7c4478088f tempest-TestInstancesWithCinderVolumes-778023409 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 11:52:19 devstack sudo[98491]: pam_unix(sudo:session): session closed for user root Nov 06 11:52:19 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-6cc37d3d-c055-473e-9b6a-da1dfcdb75f0 tempest-TestInstancesWithCinderVolumes-778023409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-b57d0ecb-ebc7-4c22-86d6-22310eeb167d 1073741824" returned: 0 in 0.626s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:52:19 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-6cc37d3d-c055-473e-9b6a-da1dfcdb75f0 tempest-TestInstancesWithCinderVolumes-778023409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-b57d0ecb-ebc7-4c22-86d6-22310eeb167d {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:52:19 devstack sudo[98505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-b57d0ecb-ebc7-4c22-86d6-22310eeb167d Nov 06 11:52:19 devstack sudo[98505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:52:19 devstack sudo[98501]: pam_unix(sudo:session): session closed for user root Nov 06 11:52:19 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-defe0cf3-fadc-43a6-a5fc-6b61b45a470c tempest-VolumesDeleteCascade-915753827 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-8e620ca1-0a83-40b1-aa6f-7a446a8b3b2e" returned: 0 in 0.552s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:52:19 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b985b7f-95e8-48d0-94fe-544dced32f41]: (4, 'qcow2') {{(pid=88420) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 11:52:19 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-defe0cf3-fadc-43a6-a5fc-6b61b45a470c tempest-VolumesDeleteCascade-915753827 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-8e620ca1-0a83-40b1-aa6f-7a446a8b3b2e.562ae9f5-e42a-4fc1-807d-20a870bcfa35 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:52:19 devstack sudo[98505]: pam_unix(sudo:session): session closed for user root Nov 06 11:52:19 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-6cc37d3d-c055-473e-9b6a-da1dfcdb75f0 tempest-TestInstancesWithCinderVolumes-778023409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-b57d0ecb-ebc7-4c22-86d6-22310eeb167d" returned: 0 in 0.421s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:52:19 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-6cc37d3d-c055-473e-9b6a-da1dfcdb75f0 tempest-TestInstancesWithCinderVolumes-778023409 None] <== create_volume: return (1120ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f'} {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 11:52:19 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-6cc37d3d-c055-473e-9b6a-da1dfcdb75f0 tempest-TestInstancesWithCinderVolumes-778023409 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.126s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 11:52:19 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-e045b8f6-d289-4e46-941c-fc7c4478088f tempest-TestInstancesWithCinderVolumes-778023409 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.567s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 11:52:19 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-e045b8f6-d289-4e46-941c-fc7c4478088f tempest-TestInstancesWithCinderVolumes-778023409 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T10:52:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-2030351886',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=82f3f473-5a67-46ee-a572-d16a86aeee72,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='03b11da20f3340ca97f572ea35dad2f5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T10:52:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T10:52:19Z,use_quota=True,user_id='7a2ee037e3804e479c3648a3b1bb20b1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(84809cfc-50b6-4206-b0b7-198c0696bda2),volume_type_id=84809cfc-50b6-4206-b0b7-198c0696bda2)}" {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 11:52:19 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-e045b8f6-d289-4e46-941c-fc7c4478088f tempest-TestInstancesWithCinderVolumes-778023409 None] Creating volume 82f3f473-5a67-46ee-a572-d16a86aeee72 {{(pid=87116) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 11:52:19 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-e045b8f6-d289-4e46-941c-fc7c4478088f tempest-TestInstancesWithCinderVolumes-778023409 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 11:52:19 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-e045b8f6-d289-4e46-941c-fc7c4478088f tempest-TestInstancesWithCinderVolumes-778023409 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 11:52:19 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-e045b8f6-d289-4e46-941c-fc7c4478088f tempest-TestInstancesWithCinderVolumes-778023409 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 11:52:19 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-e045b8f6-d289-4e46-941c-fc7c4478088f tempest-TestInstancesWithCinderVolumes-778023409 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 11:52:19 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-e045b8f6-d289-4e46-941c-fc7c4478088f tempest-TestInstancesWithCinderVolumes-778023409 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 11:52:19 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-e045b8f6-d289-4e46-941c-fc7c4478088f tempest-TestInstancesWithCinderVolumes-778023409 None] Selected osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f as target Quobyte volume. {{(pid=87116) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 11:52:19 devstack cinder-volume[87116]: INFO cinder.volume.drivers.remotefs [None req-e045b8f6-d289-4e46-941c-fc7c4478088f tempest-TestInstancesWithCinderVolumes-778023409 None] casted to osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f Nov 06 11:52:19 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-e045b8f6-d289-4e46-941c-fc7c4478088f tempest-TestInstancesWithCinderVolumes-778023409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-82f3f473-5a67-46ee-a572-d16a86aeee72 1073741824 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:52:19 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-6cc37d3d-c055-473e-9b6a-da1dfcdb75f0 tempest-TestInstancesWithCinderVolumes-778023409 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c98658f6-9bd4-418c-baa6-2caf702b44db) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b57d0ecb-ebc7-4c22-86d6-22310eeb167d', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:52:19 devstack sudo[98511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-8e620ca1-0a83-40b1-aa6f-7a446a8b3b2e.562ae9f5-e42a-4fc1-807d-20a870bcfa35 Nov 06 11:52:19 devstack sudo[98511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:52:19 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-6cc37d3d-c055-473e-9b6a-da1dfcdb75f0 tempest-TestInstancesWithCinderVolumes-778023409 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec12f384-cabf-4c38-8e28-649dc48a3868) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:52:19 devstack sudo[98513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-82f3f473-5a67-46ee-a572-d16a86aeee72 1073741824 Nov 06 11:52:19 devstack sudo[98513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:52:19 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-6cc37d3d-c055-473e-9b6a-da1dfcdb75f0 tempest-TestInstancesWithCinderVolumes-778023409 None] Volume volume-b57d0ecb-ebc7-4c22-86d6-22310eeb167d (b57d0ecb-ebc7-4c22-86d6-22310eeb167d): created successfully Nov 06 11:52:19 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-6cc37d3d-c055-473e-9b6a-da1dfcdb75f0 tempest-TestInstancesWithCinderVolumes-778023409 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec12f384-cabf-4c38-8e28-649dc48a3868) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:52:19 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-6cc37d3d-c055-473e-9b6a-da1dfcdb75f0 tempest-TestInstancesWithCinderVolumes-778023409 None] Flow 'volume_create_manager' (8c987b48-d448-46ad-b1ef-dd94c2b7ff85) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 11:52:19 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-6cc37d3d-c055-473e-9b6a-da1dfcdb75f0 tempest-TestInstancesWithCinderVolumes-778023409 None] Created volume successfully. Nov 06 11:52:20 devstack cinder-volume[87116]: DEBUG cinder.volume.flows.manager.create_volume [None req-c5e25030-e1f0-4d99-be67-fb522000e557 tempest-TestInstancesWithCinderVolumes-778023409 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87116) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 11:52:20 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-c5e25030-e1f0-4d99-be67-fb522000e557 tempest-TestInstancesWithCinderVolumes-778023409 None] Flow 'volume_create_manager' (1801c0d6-a189-4cf4-885d-ee3083e80fb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 11:52:20 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-c5e25030-e1f0-4d99-be67-fb522000e557 tempest-TestInstancesWithCinderVolumes-778023409 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (51085e0b-8a1a-4a56-bf92-a88eb2f9fa4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:52:20 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-c5e25030-e1f0-4d99-be67-fb522000e557 tempest-TestInstancesWithCinderVolumes-778023409 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (51085e0b-8a1a-4a56-bf92-a88eb2f9fa4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T10:52:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1905371921',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8df52254-632f-4669-ba3d-a52aa38c509a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='03b11da20f3340ca97f572ea35dad2f5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T10:52:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T10:52:20Z,use_quota=True,user_id='7a2ee037e3804e479c3648a3b1bb20b1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7246fa2b-17f3-4892-b506-61ed51d3fffd),volume_type_id=7246fa2b-17f3-4892-b506-61ed51d3fffd)' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:52:20 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-c5e25030-e1f0-4d99-be67-fb522000e557 tempest-TestInstancesWithCinderVolumes-778023409 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6d7ea0b5-9045-47b5-b21a-70439317d747) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:52:20 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-c5e25030-e1f0-4d99-be67-fb522000e557 tempest-TestInstancesWithCinderVolumes-778023409 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6d7ea0b5-9045-47b5-b21a-70439317d747) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:52:20 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-c5e25030-e1f0-4d99-be67-fb522000e557 tempest-TestInstancesWithCinderVolumes-778023409 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3a6fcfeb-d0c4-455f-ad5e-374f7ae64649) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:52:20 devstack cinder-volume[87116]: DEBUG cinder.image.glance [None req-c5e25030-e1f0-4d99-be67-fb522000e557 tempest-TestInstancesWithCinderVolumes-778023409 None] Creating Keystone auth plugin from conf {{(pid=87116) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 06 11:52:20 devstack sudo[98511]: pam_unix(sudo:session): session closed for user root Nov 06 11:52:20 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-defe0cf3-fadc-43a6-a5fc-6b61b45a470c tempest-VolumesDeleteCascade-915753827 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-8e620ca1-0a83-40b1-aa6f-7a446a8b3b2e.562ae9f5-e42a-4fc1-807d-20a870bcfa35" returned: 0 in 0.739s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:52:20 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-defe0cf3-fadc-43a6-a5fc-6b61b45a470c tempest-VolumesDeleteCascade-915753827 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8e620ca1-0a83-40b1-aa6f-7a446a8b3b2e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87116) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 11:52:20 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e121b0b-b1a7-4bb5-9cdf-60822014c887]: (4, 'qcow2') {{(pid=88420) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 11:52:20 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-defe0cf3-fadc-43a6-a5fc-6b61b45a470c tempest-VolumesDeleteCascade-915753827 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-8e620ca1-0a83-40b1-aa6f-7a446a8b3b2e.067eee10-786e-4c21-831c-faec938ed3cc {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:52:20 devstack sudo[98523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-8e620ca1-0a83-40b1-aa6f-7a446a8b3b2e.067eee10-786e-4c21-831c-faec938ed3cc Nov 06 11:52:20 devstack sudo[98523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:52:20 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-10c1e6bc-dd6c-4ead-9758-a4c74214609e tempest-VolumesMetadataTest-1475810343 None] Acquiring lock "cinder-4029a9ed-3812-4c2e-854f-10e37d7d4db5-delete_volume" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 11:52:20 devstack sudo[98513]: pam_unix(sudo:session): session closed for user root Nov 06 11:52:20 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-e045b8f6-d289-4e46-941c-fc7c4478088f tempest-TestInstancesWithCinderVolumes-778023409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-82f3f473-5a67-46ee-a572-d16a86aeee72 1073741824" returned: 0 in 0.884s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:52:20 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-10c1e6bc-dd6c-4ead-9758-a4c74214609e tempest-VolumesMetadataTest-1475810343 None] Lock "cinder-4029a9ed-3812-4c2e-854f-10e37d7d4db5-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 11:52:20 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-e045b8f6-d289-4e46-941c-fc7c4478088f tempest-TestInstancesWithCinderVolumes-778023409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-82f3f473-5a67-46ee-a572-d16a86aeee72 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:52:20 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-10c1e6bc-dd6c-4ead-9758-a4c74214609e tempest-VolumesMetadataTest-1475810343 None] Acquiring lock "cinder-quobyte-4029a9ed-3812-4c2e-854f-10e37d7d4db5" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 11:52:20 devstack sudo[98525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-82f3f473-5a67-46ee-a572-d16a86aeee72 Nov 06 11:52:20 devstack sudo[98525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:52:20 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-c5e25030-e1f0-4d99-be67-fb522000e557 tempest-TestInstancesWithCinderVolumes-778023409 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3a6fcfeb-d0c4-455f-ad5e-374f7ae64649) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '8df52254-632f-4669-ba3d-a52aa38c509a', 'volume_name': 'volume-8df52254-632f-4669-ba3d-a52aa38c509a', 'volume_size': 1, 'image_id': '12dc24bd-5004-422c-8e18-19af385719a2', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/12dc24bd-5004-422c-8e18-19af385719a2', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1958393752', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '03b11da20f3340ca97f572ea35dad2f5', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '12dc24bd-5004-422c-8e18-19af385719a2', 'created_at': datetime.datetime(2026, 11, 6, 10, 52, 15, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 6, 10, 52, 17, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/12dc24bd-5004-422c-8e18-19af385719a2/file', 'properties': {}}, 'image_service': }' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:52:20 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-c5e25030-e1f0-4d99-be67-fb522000e557 tempest-TestInstancesWithCinderVolumes-778023409 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fd29cfd9-f840-4f02-a922-e54b89a0013a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:52:20 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-c5e25030-e1f0-4d99-be67-fb522000e557 tempest-TestInstancesWithCinderVolumes-778023409 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fd29cfd9-f840-4f02-a922-e54b89a0013a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:52:20 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-c5e25030-e1f0-4d99-be67-fb522000e557 tempest-TestInstancesWithCinderVolumes-778023409 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f65e7f67-53f7-4b81-95e7-29ebaf72e2d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:52:20 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-c5e25030-e1f0-4d99-be67-fb522000e557 tempest-TestInstancesWithCinderVolumes-778023409 None] Volume 8df52254-632f-4669-ba3d-a52aa38c509a: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-8df52254-632f-4669-ba3d-a52aa38c509a', 'volume_size': 1, 'image_id': '12dc24bd-5004-422c-8e18-19af385719a2', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/12dc24bd-5004-422c-8e18-19af385719a2', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1958393752', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '03b11da20f3340ca97f572ea35dad2f5', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '12dc24bd-5004-422c-8e18-19af385719a2', 'created_at': datetime.datetime(2026, 11, 6, 10, 52, 15, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 6, 10, 52, 17, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/12dc24bd-5004-422c-8e18-19af385719a2/file', 'properties': {}}, 'image_service': } Nov 06 11:52:20 devstack cinder-volume[87116]: DEBUG cinder.volume.flows.manager.create_volume [None req-c5e25030-e1f0-4d99-be67-fb522000e557 tempest-TestInstancesWithCinderVolumes-778023409 None] Trying to clone 8df52254-632f-4669-ba3d-a52aa38c509a from image 12dc24bd-5004-422c-8e18-19af385719a2 at location (None, [{'url': 'file:///opt/stack/data/glance/images/12dc24bd-5004-422c-8e18-19af385719a2', 'metadata': {}}]). {{(pid=87116) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Nov 06 11:52:20 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-10c1e6bc-dd6c-4ead-9758-a4c74214609e tempest-VolumesMetadataTest-1475810343 None] Lock "cinder-quobyte-4029a9ed-3812-4c2e-854f-10e37d7d4db5" acquired by "delete_volume" :: waited 0.054s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 11:52:20 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[00961cf3-4143-4f5f-97c2-fb835ef161ec]: (4, 'qcow2') {{(pid=88420) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 11:52:20 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-10c1e6bc-dd6c-4ead-9758-a4c74214609e tempest-VolumesMetadataTest-1475810343 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-4029a9ed-3812-4c2e-854f-10e37d7d4db5 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:52:21 devstack sudo[98523]: pam_unix(sudo:session): session closed for user root Nov 06 11:52:21 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-defe0cf3-fadc-43a6-a5fc-6b61b45a470c tempest-VolumesDeleteCascade-915753827 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-8e620ca1-0a83-40b1-aa6f-7a446a8b3b2e.067eee10-786e-4c21-831c-faec938ed3cc" returned: 0 in 0.650s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:52:21 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-defe0cf3-fadc-43a6-a5fc-6b61b45a470c tempest-VolumesDeleteCascade-915753827 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8e620ca1-0a83-40b1-aa6f-7a446a8b3b2e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87116) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 11:52:21 devstack sudo[98529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-4029a9ed-3812-4c2e-854f-10e37d7d4db5 Nov 06 11:52:21 devstack sudo[98529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:52:21 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[96997a91-d111-4584-909e-453f695a811f]: (4, 'qcow2') {{(pid=88420) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 11:52:21 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-defe0cf3-fadc-43a6-a5fc-6b61b45a470c tempest-VolumesDeleteCascade-915753827 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-8e620ca1-0a83-40b1-aa6f-7a446a8b3b2e {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:52:21 devstack sudo[98525]: pam_unix(sudo:session): session closed for user root Nov 06 11:52:21 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-e045b8f6-d289-4e46-941c-fc7c4478088f tempest-TestInstancesWithCinderVolumes-778023409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-82f3f473-5a67-46ee-a572-d16a86aeee72" returned: 0 in 0.511s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:52:21 devstack sudo[98532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-8e620ca1-0a83-40b1-aa6f-7a446a8b3b2e Nov 06 11:52:21 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-e045b8f6-d289-4e46-941c-fc7c4478088f tempest-TestInstancesWithCinderVolumes-778023409 None] <== create_volume: return (1496ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f'} {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 11:52:21 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-e045b8f6-d289-4e46-941c-fc7c4478088f tempest-TestInstancesWithCinderVolumes-778023409 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.500s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 11:52:21 devstack sudo[98532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:52:21 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-e045b8f6-d289-4e46-941c-fc7c4478088f tempest-TestInstancesWithCinderVolumes-778023409 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ec6a0115-95fe-4016-86e5-c5b9ea14ced1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-82f3f473-5a67-46ee-a572-d16a86aeee72', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:52:21 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-e045b8f6-d289-4e46-941c-fc7c4478088f tempest-TestInstancesWithCinderVolumes-778023409 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (705c3000-ecbe-409f-8e1a-1e32d8ea33f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:52:21 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-e045b8f6-d289-4e46-941c-fc7c4478088f tempest-TestInstancesWithCinderVolumes-778023409 None] Volume volume-82f3f473-5a67-46ee-a572-d16a86aeee72 (82f3f473-5a67-46ee-a572-d16a86aeee72): created successfully Nov 06 11:52:21 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-e045b8f6-d289-4e46-941c-fc7c4478088f tempest-TestInstancesWithCinderVolumes-778023409 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (705c3000-ecbe-409f-8e1a-1e32d8ea33f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:52:21 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-e045b8f6-d289-4e46-941c-fc7c4478088f tempest-TestInstancesWithCinderVolumes-778023409 None] Flow 'volume_create_manager' (9c54415f-43c8-4e06-a2ad-6d58f2a4ab99) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 11:52:21 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-e045b8f6-d289-4e46-941c-fc7c4478088f tempest-TestInstancesWithCinderVolumes-778023409 None] Created volume successfully. Nov 06 11:52:21 devstack sudo[98529]: pam_unix(sudo:session): session closed for user root Nov 06 11:52:21 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-10c1e6bc-dd6c-4ead-9758-a4c74214609e tempest-VolumesMetadataTest-1475810343 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-4029a9ed-3812-4c2e-854f-10e37d7d4db5" returned: 0 in 0.606s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:52:21 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-10c1e6bc-dd6c-4ead-9758-a4c74214609e tempest-VolumesMetadataTest-1475810343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-4029a9ed-3812-4c2e-854f-10e37d7d4db5 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:52:21 devstack sudo[98538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-4029a9ed-3812-4c2e-854f-10e37d7d4db5 Nov 06 11:52:21 devstack sudo[98538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:52:21 devstack sudo[98532]: pam_unix(sudo:session): session closed for user root Nov 06 11:52:21 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-defe0cf3-fadc-43a6-a5fc-6b61b45a470c tempest-VolumesDeleteCascade-915753827 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-8e620ca1-0a83-40b1-aa6f-7a446a8b3b2e" returned: 0 in 0.524s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:52:21 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-defe0cf3-fadc-43a6-a5fc-6b61b45a470c tempest-VolumesDeleteCascade-915753827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-8e620ca1-0a83-40b1-aa6f-7a446a8b3b2e.067eee10-786e-4c21-831c-faec938ed3cc {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:52:21 devstack sudo[98546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-8e620ca1-0a83-40b1-aa6f-7a446a8b3b2e.067eee10-786e-4c21-831c-faec938ed3cc Nov 06 11:52:21 devstack sudo[98546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:52:21 devstack sudo[98538]: pam_unix(sudo:session): session closed for user root Nov 06 11:52:21 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-10c1e6bc-dd6c-4ead-9758-a4c74214609e tempest-VolumesMetadataTest-1475810343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-4029a9ed-3812-4c2e-854f-10e37d7d4db5" returned: 0 in 0.297s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:52:21 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-10c1e6bc-dd6c-4ead-9758-a4c74214609e tempest-VolumesMetadataTest-1475810343 None] Lock "cinder-quobyte-4029a9ed-3812-4c2e-854f-10e37d7d4db5" released by "delete_volume" :: held 0.974s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 11:52:21 devstack cinder-volume[87116]: DEBUG cinder.quota [None req-10c1e6bc-dd6c-4ead-9758-a4c74214609e tempest-VolumesMetadataTest-1475810343 None] Created reservations ['f4be2f1f-22fa-4bc0-b8f2-476c03c1da6a', '2cab0af3-42a0-49f9-a81b-07e6d8d63581', '56e2642a-858c-43ec-9fa1-5729a0a5623d', '9e46398a-b01a-4180-b9c2-776cd660635b'] {{(pid=87116) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 11:52:22 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-10c1e6bc-dd6c-4ead-9758-a4c74214609e tempest-VolumesMetadataTest-1475810343 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 11:52:22 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-10c1e6bc-dd6c-4ead-9758-a4c74214609e tempest-VolumesMetadataTest-1475810343 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 11:52:22 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-10c1e6bc-dd6c-4ead-9758-a4c74214609e tempest-VolumesMetadataTest-1475810343 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 11:52:22 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-10c1e6bc-dd6c-4ead-9758-a4c74214609e tempest-VolumesMetadataTest-1475810343 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 11:52:22 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-10c1e6bc-dd6c-4ead-9758-a4c74214609e tempest-VolumesMetadataTest-1475810343 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 11:52:22 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-10c1e6bc-dd6c-4ead-9758-a4c74214609e tempest-VolumesMetadataTest-1475810343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:52:22 devstack sudo[98552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756 Nov 06 11:52:22 devstack sudo[98552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:52:22 devstack sudo[98546]: pam_unix(sudo:session): session closed for user root Nov 06 11:52:22 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-defe0cf3-fadc-43a6-a5fc-6b61b45a470c tempest-VolumesDeleteCascade-915753827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-8e620ca1-0a83-40b1-aa6f-7a446a8b3b2e.067eee10-786e-4c21-831c-faec938ed3cc" returned: 0 in 0.442s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:52:22 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-defe0cf3-fadc-43a6-a5fc-6b61b45a470c tempest-VolumesDeleteCascade-915753827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-8e620ca1-0a83-40b1-aa6f-7a446a8b3b2e.067eee10-786e-4c21-831c-faec938ed3cc {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:52:22 devstack sudo[98555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-8e620ca1-0a83-40b1-aa6f-7a446a8b3b2e.067eee10-786e-4c21-831c-faec938ed3cc Nov 06 11:52:22 devstack sudo[98555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:52:22 devstack sudo[98552]: pam_unix(sudo:session): session closed for user root Nov 06 11:52:22 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-10c1e6bc-dd6c-4ead-9758-a4c74214609e tempest-VolumesMetadataTest-1475810343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756" returned: 0 in 0.328s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:52:22 devstack cinder-volume[87116]: DEBUG cinder.manager [None req-10c1e6bc-dd6c-4ead-9758-a4c74214609e tempest-VolumesMetadataTest-1475810343 None] Notifying Schedulers of capabilities ... {{(pid=87116) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 11:52:22 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-10c1e6bc-dd6c-4ead-9758-a4c74214609e tempest-VolumesMetadataTest-1475810343 None] Deleted volume successfully. Nov 06 11:52:22 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-10c1e6bc-dd6c-4ead-9758-a4c74214609e tempest-VolumesMetadataTest-1475810343 None] Lock "cinder-4029a9ed-3812-4c2e-854f-10e37d7d4db5-delete_volume" released by "delete_volume" :: held 1.665s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 11:52:22 devstack sudo[98555]: pam_unix(sudo:session): session closed for user root Nov 06 11:52:22 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-defe0cf3-fadc-43a6-a5fc-6b61b45a470c tempest-VolumesDeleteCascade-915753827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-8e620ca1-0a83-40b1-aa6f-7a446a8b3b2e.067eee10-786e-4c21-831c-faec938ed3cc" returned: 0 in 0.392s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:52:22 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-defe0cf3-fadc-43a6-a5fc-6b61b45a470c tempest-VolumesDeleteCascade-915753827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8e620ca1-0a83-40b1-aa6f-7a446a8b3b2e /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-8e620ca1-0a83-40b1-aa6f-7a446a8b3b2e.562ae9f5-e42a-4fc1-807d-20a870bcfa35 -F qcow2 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:52:22 devstack sudo[98560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8e620ca1-0a83-40b1-aa6f-7a446a8b3b2e /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-8e620ca1-0a83-40b1-aa6f-7a446a8b3b2e.562ae9f5-e42a-4fc1-807d-20a870bcfa35 -F qcow2 Nov 06 11:52:22 devstack sudo[98560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:52:22 devstack sudo[98560]: pam_unix(sudo:session): session closed for user root Nov 06 11:52:22 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-defe0cf3-fadc-43a6-a5fc-6b61b45a470c tempest-VolumesDeleteCascade-915753827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8e620ca1-0a83-40b1-aa6f-7a446a8b3b2e /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-8e620ca1-0a83-40b1-aa6f-7a446a8b3b2e.562ae9f5-e42a-4fc1-807d-20a870bcfa35 -F qcow2" returned: 0 in 0.343s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:52:22 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-defe0cf3-fadc-43a6-a5fc-6b61b45a470c tempest-VolumesDeleteCascade-915753827 None] Lock "cinder-quobyte-067eee10-786e-4c21-831c-faec938ed3cc" released by "_delete_snapshot" :: held 4.538s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 11:52:22 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-defe0cf3-fadc-43a6-a5fc-6b61b45a470c tempest-VolumesDeleteCascade-915753827 None] Lock "cinder-quobyte-8e620ca1-0a83-40b1-aa6f-7a446a8b3b2e" released by "delete_snapshot" :: held 4.571s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 11:52:22 devstack cinder-volume[87116]: DEBUG cinder.quota [None req-defe0cf3-fadc-43a6-a5fc-6b61b45a470c tempest-VolumesDeleteCascade-915753827 None] Created reservations ['c6d50115-a6ff-4811-8612-eddc7005b214', 'd85cbe7e-bff2-464e-aebf-d0e23090ee2b', '161dcbdc-f9cc-4528-8de7-de03fae4ca27', 'd672ea70-9c10-4f6c-9337-3f3b208d7bd5'] {{(pid=87116) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 11:52:23 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-defe0cf3-fadc-43a6-a5fc-6b61b45a470c tempest-VolumesDeleteCascade-915753827 None] Delete snapshot completed successfully. Nov 06 11:52:23 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-defe0cf3-fadc-43a6-a5fc-6b61b45a470c tempest-VolumesDeleteCascade-915753827 None] Lock "cinder-067eee10-786e-4c21-831c-faec938ed3cc-delete_snapshot" released by "delete_snapshot" :: held 4.806s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 11:52:23 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-defe0cf3-fadc-43a6-a5fc-6b61b45a470c tempest-VolumesDeleteCascade-915753827 None] Acquiring lock "cinder-562ae9f5-e42a-4fc1-807d-20a870bcfa35-delete_snapshot" by "delete_snapshot" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 11:52:23 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-defe0cf3-fadc-43a6-a5fc-6b61b45a470c tempest-VolumesDeleteCascade-915753827 None] Lock "cinder-562ae9f5-e42a-4fc1-807d-20a870bcfa35-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 11:52:23 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-defe0cf3-fadc-43a6-a5fc-6b61b45a470c tempest-VolumesDeleteCascade-915753827 None] Acquiring lock "cinder-quobyte-8e620ca1-0a83-40b1-aa6f-7a446a8b3b2e" by "delete_snapshot" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 11:52:23 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-defe0cf3-fadc-43a6-a5fc-6b61b45a470c tempest-VolumesDeleteCascade-915753827 None] Lock "cinder-quobyte-8e620ca1-0a83-40b1-aa6f-7a446a8b3b2e" acquired by "delete_snapshot" :: waited 0.030s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 11:52:23 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-defe0cf3-fadc-43a6-a5fc-6b61b45a470c tempest-VolumesDeleteCascade-915753827 None] Acquiring lock "cinder-quobyte-562ae9f5-e42a-4fc1-807d-20a870bcfa35" by "_delete_snapshot" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 11:52:23 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-defe0cf3-fadc-43a6-a5fc-6b61b45a470c tempest-VolumesDeleteCascade-915753827 None] Lock "cinder-quobyte-562ae9f5-e42a-4fc1-807d-20a870bcfa35" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 11:52:23 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-defe0cf3-fadc-43a6-a5fc-6b61b45a470c tempest-VolumesDeleteCascade-915753827 None] Deleting offline snapshot 562ae9f5-e42a-4fc1-807d-20a870bcfa35 of volume 8e620ca1-0a83-40b1-aa6f-7a446a8b3b2e {{(pid=87116) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 06 11:52:23 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-defe0cf3-fadc-43a6-a5fc-6b61b45a470c tempest-VolumesDeleteCascade-915753827 None] snapshot_file for this snap is: volume-8e620ca1-0a83-40b1-aa6f-7a446a8b3b2e.562ae9f5-e42a-4fc1-807d-20a870bcfa35 {{(pid=87116) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 06 11:52:23 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5d91e26-56e8-4042-aa9a-aaad66760d73]: (4, 'qcow2') {{(pid=88420) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 11:52:23 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-defe0cf3-fadc-43a6-a5fc-6b61b45a470c tempest-VolumesDeleteCascade-915753827 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-8e620ca1-0a83-40b1-aa6f-7a446a8b3b2e.562ae9f5-e42a-4fc1-807d-20a870bcfa35 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:52:23 devstack sudo[98565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-8e620ca1-0a83-40b1-aa6f-7a446a8b3b2e.562ae9f5-e42a-4fc1-807d-20a870bcfa35 Nov 06 11:52:23 devstack sudo[98565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:52:23 devstack sudo[98565]: pam_unix(sudo:session): session closed for user root Nov 06 11:52:23 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-defe0cf3-fadc-43a6-a5fc-6b61b45a470c tempest-VolumesDeleteCascade-915753827 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-8e620ca1-0a83-40b1-aa6f-7a446a8b3b2e.562ae9f5-e42a-4fc1-807d-20a870bcfa35" returned: 0 in 0.666s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:52:23 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-defe0cf3-fadc-43a6-a5fc-6b61b45a470c tempest-VolumesDeleteCascade-915753827 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8e620ca1-0a83-40b1-aa6f-7a446a8b3b2e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87116) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 11:52:23 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[38248f34-ba00-4d17-a3b6-6d7d1fcde230]: (4, 'qcow2') {{(pid=88420) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 11:52:23 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-defe0cf3-fadc-43a6-a5fc-6b61b45a470c tempest-VolumesDeleteCascade-915753827 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-8e620ca1-0a83-40b1-aa6f-7a446a8b3b2e {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:52:24 devstack sudo[98574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-8e620ca1-0a83-40b1-aa6f-7a446a8b3b2e Nov 06 11:52:24 devstack sudo[98574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:52:24 devstack sudo[98574]: pam_unix(sudo:session): session closed for user root Nov 06 11:52:24 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-defe0cf3-fadc-43a6-a5fc-6b61b45a470c tempest-VolumesDeleteCascade-915753827 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-8e620ca1-0a83-40b1-aa6f-7a446a8b3b2e" returned: 0 in 0.428s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:52:24 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-defe0cf3-fadc-43a6-a5fc-6b61b45a470c tempest-VolumesDeleteCascade-915753827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-8e620ca1-0a83-40b1-aa6f-7a446a8b3b2e.562ae9f5-e42a-4fc1-807d-20a870bcfa35 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:52:24 devstack sudo[98579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-8e620ca1-0a83-40b1-aa6f-7a446a8b3b2e.562ae9f5-e42a-4fc1-807d-20a870bcfa35 Nov 06 11:52:24 devstack sudo[98579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:52:24 devstack sudo[98579]: pam_unix(sudo:session): session closed for user root Nov 06 11:52:24 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-defe0cf3-fadc-43a6-a5fc-6b61b45a470c tempest-VolumesDeleteCascade-915753827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-8e620ca1-0a83-40b1-aa6f-7a446a8b3b2e.562ae9f5-e42a-4fc1-807d-20a870bcfa35" returned: 0 in 0.513s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:52:24 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-defe0cf3-fadc-43a6-a5fc-6b61b45a470c tempest-VolumesDeleteCascade-915753827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-8e620ca1-0a83-40b1-aa6f-7a446a8b3b2e.562ae9f5-e42a-4fc1-807d-20a870bcfa35 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:52:24 devstack sudo[98584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-8e620ca1-0a83-40b1-aa6f-7a446a8b3b2e.562ae9f5-e42a-4fc1-807d-20a870bcfa35 Nov 06 11:52:24 devstack sudo[98584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:52:25 devstack sudo[98584]: pam_unix(sudo:session): session closed for user root Nov 06 11:52:25 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-defe0cf3-fadc-43a6-a5fc-6b61b45a470c tempest-VolumesDeleteCascade-915753827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-8e620ca1-0a83-40b1-aa6f-7a446a8b3b2e.562ae9f5-e42a-4fc1-807d-20a870bcfa35" returned: 0 in 0.324s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:52:25 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-defe0cf3-fadc-43a6-a5fc-6b61b45a470c tempest-VolumesDeleteCascade-915753827 None] Lock "cinder-quobyte-562ae9f5-e42a-4fc1-807d-20a870bcfa35" released by "_delete_snapshot" :: held 2.067s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 11:52:25 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-defe0cf3-fadc-43a6-a5fc-6b61b45a470c tempest-VolumesDeleteCascade-915753827 None] Lock "cinder-quobyte-8e620ca1-0a83-40b1-aa6f-7a446a8b3b2e" released by "delete_snapshot" :: held 2.098s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 11:52:25 devstack cinder-volume[87116]: DEBUG cinder.quota [None req-defe0cf3-fadc-43a6-a5fc-6b61b45a470c tempest-VolumesDeleteCascade-915753827 None] Created reservations ['0cde221f-f5e9-4fac-99ed-749909268952', '0ce20c00-991b-4583-8b07-4d3ea91a4cdc', '0b5e25b9-f7b2-43b9-a20e-61a575c631a2', '88f5f14b-b78a-4293-ade8-e1832414b4c0'] {{(pid=87116) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 11:52:25 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-defe0cf3-fadc-43a6-a5fc-6b61b45a470c tempest-VolumesDeleteCascade-915753827 None] Delete snapshot completed successfully. Nov 06 11:52:25 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-defe0cf3-fadc-43a6-a5fc-6b61b45a470c tempest-VolumesDeleteCascade-915753827 None] Lock "cinder-562ae9f5-e42a-4fc1-807d-20a870bcfa35-delete_snapshot" released by "delete_snapshot" :: held 2.311s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 11:52:25 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-defe0cf3-fadc-43a6-a5fc-6b61b45a470c tempest-VolumesDeleteCascade-915753827 None] Snapshots deleted, issuing volume delete {{(pid=87116) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Nov 06 11:52:25 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-defe0cf3-fadc-43a6-a5fc-6b61b45a470c tempest-VolumesDeleteCascade-915753827 None] Acquiring lock "cinder-quobyte-8e620ca1-0a83-40b1-aa6f-7a446a8b3b2e" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 11:52:25 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-defe0cf3-fadc-43a6-a5fc-6b61b45a470c tempest-VolumesDeleteCascade-915753827 None] Lock "cinder-quobyte-8e620ca1-0a83-40b1-aa6f-7a446a8b3b2e" acquired by "delete_volume" :: waited 0.020s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 11:52:25 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[4003bea0-7474-4d31-b57f-36ce18b4c723]: (4, 'qcow2') {{(pid=88420) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 11:52:25 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-defe0cf3-fadc-43a6-a5fc-6b61b45a470c tempest-VolumesDeleteCascade-915753827 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-8e620ca1-0a83-40b1-aa6f-7a446a8b3b2e {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:52:25 devstack sudo[98587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-8e620ca1-0a83-40b1-aa6f-7a446a8b3b2e Nov 06 11:52:25 devstack sudo[98587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:52:25 devstack sudo[98587]: pam_unix(sudo:session): session closed for user root Nov 06 11:52:25 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-defe0cf3-fadc-43a6-a5fc-6b61b45a470c tempest-VolumesDeleteCascade-915753827 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-8e620ca1-0a83-40b1-aa6f-7a446a8b3b2e" returned: 0 in 0.485s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:52:25 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-defe0cf3-fadc-43a6-a5fc-6b61b45a470c tempest-VolumesDeleteCascade-915753827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-8e620ca1-0a83-40b1-aa6f-7a446a8b3b2e {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:52:26 devstack sudo[98593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-8e620ca1-0a83-40b1-aa6f-7a446a8b3b2e Nov 06 11:52:26 devstack sudo[98593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:52:26 devstack cinder-volume[87116]: DEBUG cinder.image.image_utils [None req-c5e25030-e1f0-4d99-be67-fb522000e557 tempest-TestInstancesWithCinderVolumes-778023409 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_12dc24bd-5004-422c-8e18-19af385719a2_x05jwe_1devstack@QuobyteHD, size 20.69 MB, duration 5.20 sec {{(pid=87116) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Nov 06 11:52:26 devstack cinder-volume[87116]: INFO cinder.image.image_utils [None req-c5e25030-e1f0-4d99-be67-fb522000e557 tempest-TestInstancesWithCinderVolumes-778023409 None] Image download 20.69 MB at 3.98 MB/s Nov 06 11:52:26 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[84e79b41-620e-4e55-918d-1cb7404e4738]: (4, 'qcow2') {{(pid=88420) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 11:52:26 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-c5e25030-e1f0-4d99-be67-fb522000e557 tempest-TestInstancesWithCinderVolumes-778023409 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_12dc24bd-5004-422c-8e18-19af385719a2_x05jwe_1devstack@QuobyteHD {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:52:26 devstack sudo[98595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_12dc24bd-5004-422c-8e18-19af385719a2_x05jwe_1devstack@QuobyteHD Nov 06 11:52:26 devstack sudo[98595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:52:26 devstack sudo[98593]: pam_unix(sudo:session): session closed for user root Nov 06 11:52:26 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-defe0cf3-fadc-43a6-a5fc-6b61b45a470c tempest-VolumesDeleteCascade-915753827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-8e620ca1-0a83-40b1-aa6f-7a446a8b3b2e" returned: 0 in 0.400s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:52:26 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-defe0cf3-fadc-43a6-a5fc-6b61b45a470c tempest-VolumesDeleteCascade-915753827 None] Lock "cinder-quobyte-8e620ca1-0a83-40b1-aa6f-7a446a8b3b2e" released by "delete_volume" :: held 0.980s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 11:52:26 devstack cinder-volume[87116]: DEBUG cinder.quota [None req-defe0cf3-fadc-43a6-a5fc-6b61b45a470c tempest-VolumesDeleteCascade-915753827 None] Created reservations ['aff263b1-0645-46af-8b3b-6ce6aea12890', '159d90da-4d05-4c07-933d-8f9bef3dc2cf', '670aba5e-c1f2-4c21-b828-03b6cf9252f0', 'f3a00aaa-0636-4b94-9612-3c4fd78681e1'] {{(pid=87116) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 11:52:26 devstack sudo[98595]: pam_unix(sudo:session): session closed for user root Nov 06 11:52:26 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-c5e25030-e1f0-4d99-be67-fb522000e557 tempest-TestInstancesWithCinderVolumes-778023409 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_12dc24bd-5004-422c-8e18-19af385719a2_x05jwe_1devstack@QuobyteHD" returned: 0 in 0.457s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:52:26 devstack cinder-volume[87116]: DEBUG cinder.image.image_utils [None req-c5e25030-e1f0-4d99-be67-fb522000e557 tempest-TestInstancesWithCinderVolumes-778023409 None] Temporary image 12dc24bd-5004-422c-8e18-19af385719a2 is fetched for user 7a2ee037e3804e479c3648a3b1bb20b1. {{(pid=87116) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Nov 06 11:52:26 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-defe0cf3-fadc-43a6-a5fc-6b61b45a470c tempest-VolumesDeleteCascade-915753827 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 11:52:26 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-defe0cf3-fadc-43a6-a5fc-6b61b45a470c tempest-VolumesDeleteCascade-915753827 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 11:52:26 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-defe0cf3-fadc-43a6-a5fc-6b61b45a470c tempest-VolumesDeleteCascade-915753827 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 11:52:26 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-defe0cf3-fadc-43a6-a5fc-6b61b45a470c tempest-VolumesDeleteCascade-915753827 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 11:52:26 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-defe0cf3-fadc-43a6-a5fc-6b61b45a470c tempest-VolumesDeleteCascade-915753827 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 11:52:26 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-defe0cf3-fadc-43a6-a5fc-6b61b45a470c tempest-VolumesDeleteCascade-915753827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:52:26 devstack sudo[98603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756 Nov 06 11:52:26 devstack sudo[98603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:52:26 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[58d7c711-2666-4135-a5fd-77a67d3e4985]: (4, 'qcow2') {{(pid=88420) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 11:52:26 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-c5e25030-e1f0-4d99-be67-fb522000e557 tempest-TestInstancesWithCinderVolumes-778023409 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_12dc24bd-5004-422c-8e18-19af385719a2_x05jwe_1devstack@QuobyteHD {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:52:26 devstack sudo[98605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_12dc24bd-5004-422c-8e18-19af385719a2_x05jwe_1devstack@QuobyteHD Nov 06 11:52:26 devstack sudo[98605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:52:26 devstack sudo[98603]: pam_unix(sudo:session): session closed for user root Nov 06 11:52:26 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-defe0cf3-fadc-43a6-a5fc-6b61b45a470c tempest-VolumesDeleteCascade-915753827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756" returned: 0 in 0.332s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:52:26 devstack cinder-volume[87116]: DEBUG cinder.manager [None req-defe0cf3-fadc-43a6-a5fc-6b61b45a470c tempest-VolumesDeleteCascade-915753827 None] Notifying Schedulers of capabilities ... {{(pid=87116) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 11:52:26 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-defe0cf3-fadc-43a6-a5fc-6b61b45a470c tempest-VolumesDeleteCascade-915753827 None] Deleted volume successfully. Nov 06 11:52:27 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-defe0cf3-fadc-43a6-a5fc-6b61b45a470c tempest-VolumesDeleteCascade-915753827 None] Lock "cinder-8e620ca1-0a83-40b1-aa6f-7a446a8b3b2e-delete_volume" released by "delete_volume" :: held 8.901s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 11:52:27 devstack sudo[98605]: pam_unix(sudo:session): session closed for user root Nov 06 11:52:27 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-c5e25030-e1f0-4d99-be67-fb522000e557 tempest-TestInstancesWithCinderVolumes-778023409 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_12dc24bd-5004-422c-8e18-19af385719a2_x05jwe_1devstack@QuobyteHD" returned: 0 in 0.422s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:52:27 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-c5e25030-e1f0-4d99-be67-fb522000e557 tempest-TestInstancesWithCinderVolumes-778023409 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 11:52:27 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-c5e25030-e1f0-4d99-be67-fb522000e557 tempest-TestInstancesWithCinderVolumes-778023409 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 11:52:27 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-c5e25030-e1f0-4d99-be67-fb522000e557 tempest-TestInstancesWithCinderVolumes-778023409 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T10:52:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1905371921',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8df52254-632f-4669-ba3d-a52aa38c509a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='03b11da20f3340ca97f572ea35dad2f5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T10:52:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T10:52:20Z,use_quota=True,user_id='7a2ee037e3804e479c3648a3b1bb20b1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7246fa2b-17f3-4892-b506-61ed51d3fffd),volume_type_id=7246fa2b-17f3-4892-b506-61ed51d3fffd)}" {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 11:52:27 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-c5e25030-e1f0-4d99-be67-fb522000e557 tempest-TestInstancesWithCinderVolumes-778023409 None] Creating volume 8df52254-632f-4669-ba3d-a52aa38c509a {{(pid=87116) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 11:52:27 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-c5e25030-e1f0-4d99-be67-fb522000e557 tempest-TestInstancesWithCinderVolumes-778023409 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 11:52:27 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-c5e25030-e1f0-4d99-be67-fb522000e557 tempest-TestInstancesWithCinderVolumes-778023409 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 11:52:27 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-c5e25030-e1f0-4d99-be67-fb522000e557 tempest-TestInstancesWithCinderVolumes-778023409 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 11:52:27 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-c5e25030-e1f0-4d99-be67-fb522000e557 tempest-TestInstancesWithCinderVolumes-778023409 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 11:52:27 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-c5e25030-e1f0-4d99-be67-fb522000e557 tempest-TestInstancesWithCinderVolumes-778023409 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 11:52:27 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-c5e25030-e1f0-4d99-be67-fb522000e557 tempest-TestInstancesWithCinderVolumes-778023409 None] Selected osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f as target Quobyte volume. {{(pid=87116) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 11:52:27 devstack cinder-volume[87116]: INFO cinder.volume.drivers.remotefs [None req-c5e25030-e1f0-4d99-be67-fb522000e557 tempest-TestInstancesWithCinderVolumes-778023409 None] casted to osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f Nov 06 11:52:27 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-c5e25030-e1f0-4d99-be67-fb522000e557 tempest-TestInstancesWithCinderVolumes-778023409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-8df52254-632f-4669-ba3d-a52aa38c509a 1073741824 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:52:27 devstack sudo[98611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-8df52254-632f-4669-ba3d-a52aa38c509a 1073741824 Nov 06 11:52:27 devstack sudo[98611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:52:27 devstack sudo[98611]: pam_unix(sudo:session): session closed for user root Nov 06 11:52:27 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-c5e25030-e1f0-4d99-be67-fb522000e557 tempest-TestInstancesWithCinderVolumes-778023409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-8df52254-632f-4669-ba3d-a52aa38c509a 1073741824" returned: 0 in 0.557s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:52:27 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-c5e25030-e1f0-4d99-be67-fb522000e557 tempest-TestInstancesWithCinderVolumes-778023409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-8df52254-632f-4669-ba3d-a52aa38c509a {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:52:27 devstack sudo[98617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-8df52254-632f-4669-ba3d-a52aa38c509a Nov 06 11:52:27 devstack sudo[98617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:52:28 devstack sudo[98617]: pam_unix(sudo:session): session closed for user root Nov 06 11:52:28 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-c5e25030-e1f0-4d99-be67-fb522000e557 tempest-TestInstancesWithCinderVolumes-778023409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-8df52254-632f-4669-ba3d-a52aa38c509a" returned: 0 in 0.285s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:52:28 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-c5e25030-e1f0-4d99-be67-fb522000e557 tempest-TestInstancesWithCinderVolumes-778023409 None] <== create_volume: return (898ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f'} {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 11:52:28 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-c5e25030-e1f0-4d99-be67-fb522000e557 tempest-TestInstancesWithCinderVolumes-778023409 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.901s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 11:52:28 devstack cinder-volume[87116]: DEBUG cinder.volume.volume_utils [None req-c5e25030-e1f0-4d99-be67-fb522000e557 tempest-TestInstancesWithCinderVolumes-778023409 None] Attempting download of 12dc24bd-5004-422c-8e18-19af385719a2 ((None, [{'url': 'file:///opt/stack/data/glance/images/12dc24bd-5004-422c-8e18-19af385719a2', 'metadata': {}}])) to volume 8df52254-632f-4669-ba3d-a52aa38c509a. {{(pid=87116) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Nov 06 11:52:28 devstack cinder-volume[87116]: DEBUG dbcounter [-] [87116] Writing DB stats cinder:UPDATE=145,cinder:DELETE=16,cinder:SELECT=120,cinder:INSERT=30 {{(pid=87116) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 11:52:28 devstack cinder-volume[87116]: DEBUG cinder.volume.flows.manager.create_volume [None req-7a2395d1-3b3b-48cc-b025-8a005f13c3ad tempest-VolumesDeleteCascade-915753827 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87116) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 11:52:28 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-7a2395d1-3b3b-48cc-b025-8a005f13c3ad tempest-VolumesDeleteCascade-915753827 None] Flow 'volume_create_manager' (e5ec66d3-0e78-4e30-81e6-075f4c8dd60b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 11:52:28 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-7a2395d1-3b3b-48cc-b025-8a005f13c3ad tempest-VolumesDeleteCascade-915753827 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0859de4e-cff3-4df2-9048-a1848bb79c4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:52:28 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[8014ff8c-ff6a-452c-bd1e-5345c0765902]: (4, 'raw') {{(pid=88420) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 11:52:28 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-c5e25030-e1f0-4d99-be67-fb522000e557 tempest-TestInstancesWithCinderVolumes-778023409 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_12dc24bd-5004-422c-8e18-19af385719a2_79u54kqk {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:52:28 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-7a2395d1-3b3b-48cc-b025-8a005f13c3ad tempest-VolumesDeleteCascade-915753827 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0859de4e-cff3-4df2-9048-a1848bb79c4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T10:52:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1976242369',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3a1e2661-d20b-4271-8369-e3a9fb578dcd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='133403ef419b401eb13cf042dad32417',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T10:52:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T10:52:28Z,use_quota=True,user_id='48c070f7f6e344b0a2467bfd96d154fc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(34d3b144-d9b7-480a-a2e3-01e45f3d54c1),volume_type_id=34d3b144-d9b7-480a-a2e3-01e45f3d54c1)' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:52:28 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-7a2395d1-3b3b-48cc-b025-8a005f13c3ad tempest-VolumesDeleteCascade-915753827 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8a899051-53dd-42aa-9185-04b9f35459ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:52:28 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-7a2395d1-3b3b-48cc-b025-8a005f13c3ad tempest-VolumesDeleteCascade-915753827 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8a899051-53dd-42aa-9185-04b9f35459ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:52:28 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-7a2395d1-3b3b-48cc-b025-8a005f13c3ad tempest-VolumesDeleteCascade-915753827 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (244d70f1-ce9c-41eb-81b4-392372f05c6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:52:28 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-7a2395d1-3b3b-48cc-b025-8a005f13c3ad tempest-VolumesDeleteCascade-915753827 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (244d70f1-ce9c-41eb-81b4-392372f05c6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3a1e2661-d20b-4271-8369-e3a9fb578dcd', 'volume_name': 'volume-3a1e2661-d20b-4271-8369-e3a9fb578dcd', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:52:28 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-7a2395d1-3b3b-48cc-b025-8a005f13c3ad tempest-VolumesDeleteCascade-915753827 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0737413f-6c58-4fbd-8663-4105d810f10b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:52:28 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-7a2395d1-3b3b-48cc-b025-8a005f13c3ad tempest-VolumesDeleteCascade-915753827 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0737413f-6c58-4fbd-8663-4105d810f10b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:52:28 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-7a2395d1-3b3b-48cc-b025-8a005f13c3ad tempest-VolumesDeleteCascade-915753827 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f8645bc2-f0d6-4e1a-a827-31d3e43ca573) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:52:28 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-7a2395d1-3b3b-48cc-b025-8a005f13c3ad tempest-VolumesDeleteCascade-915753827 None] Volume 3a1e2661-d20b-4271-8369-e3a9fb578dcd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3a1e2661-d20b-4271-8369-e3a9fb578dcd', 'volume_size': 1} Nov 06 11:52:28 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-7a2395d1-3b3b-48cc-b025-8a005f13c3ad tempest-VolumesDeleteCascade-915753827 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 11:52:28 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-7a2395d1-3b3b-48cc-b025-8a005f13c3ad tempest-VolumesDeleteCascade-915753827 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 11:52:28 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-7a2395d1-3b3b-48cc-b025-8a005f13c3ad tempest-VolumesDeleteCascade-915753827 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T10:52:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1976242369',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3a1e2661-d20b-4271-8369-e3a9fb578dcd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='133403ef419b401eb13cf042dad32417',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T10:52:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T10:52:28Z,use_quota=True,user_id='48c070f7f6e344b0a2467bfd96d154fc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(34d3b144-d9b7-480a-a2e3-01e45f3d54c1),volume_type_id=34d3b144-d9b7-480a-a2e3-01e45f3d54c1)}" {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 11:52:28 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-7a2395d1-3b3b-48cc-b025-8a005f13c3ad tempest-VolumesDeleteCascade-915753827 None] Creating volume 3a1e2661-d20b-4271-8369-e3a9fb578dcd {{(pid=87116) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 11:52:28 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-7a2395d1-3b3b-48cc-b025-8a005f13c3ad tempest-VolumesDeleteCascade-915753827 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 11:52:28 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-7a2395d1-3b3b-48cc-b025-8a005f13c3ad tempest-VolumesDeleteCascade-915753827 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 11:52:28 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-7a2395d1-3b3b-48cc-b025-8a005f13c3ad tempest-VolumesDeleteCascade-915753827 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 11:52:28 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-7a2395d1-3b3b-48cc-b025-8a005f13c3ad tempest-VolumesDeleteCascade-915753827 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 11:52:28 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-7a2395d1-3b3b-48cc-b025-8a005f13c3ad tempest-VolumesDeleteCascade-915753827 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 11:52:28 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-7a2395d1-3b3b-48cc-b025-8a005f13c3ad tempest-VolumesDeleteCascade-915753827 None] Selected osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f as target Quobyte volume. {{(pid=87116) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 11:52:28 devstack cinder-volume[87116]: INFO cinder.volume.drivers.remotefs [None req-7a2395d1-3b3b-48cc-b025-8a005f13c3ad tempest-VolumesDeleteCascade-915753827 None] casted to osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f Nov 06 11:52:28 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-7a2395d1-3b3b-48cc-b025-8a005f13c3ad tempest-VolumesDeleteCascade-915753827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-3a1e2661-d20b-4271-8369-e3a9fb578dcd 1073741824 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:52:28 devstack sudo[98621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-3a1e2661-d20b-4271-8369-e3a9fb578dcd 1073741824 Nov 06 11:52:28 devstack sudo[98621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:52:28 devstack sudo[98620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_12dc24bd-5004-422c-8e18-19af385719a2_79u54kqk Nov 06 11:52:28 devstack sudo[98620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:52:28 devstack sudo[98620]: pam_unix(sudo:session): session closed for user root Nov 06 11:52:28 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-c5e25030-e1f0-4d99-be67-fb522000e557 tempest-TestInstancesWithCinderVolumes-778023409 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_12dc24bd-5004-422c-8e18-19af385719a2_79u54kqk" returned: 0 in 0.417s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:52:28 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-c5e25030-e1f0-4d99-be67-fb522000e557 tempest-TestInstancesWithCinderVolumes-778023409 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_12dc24bd-5004-422c-8e18-19af385719a2_79u54kqk {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:52:28 devstack sudo[98626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_12dc24bd-5004-422c-8e18-19af385719a2_79u54kqk Nov 06 11:52:28 devstack sudo[98626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:52:29 devstack sudo[98621]: pam_unix(sudo:session): session closed for user root Nov 06 11:52:29 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-7a2395d1-3b3b-48cc-b025-8a005f13c3ad tempest-VolumesDeleteCascade-915753827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-3a1e2661-d20b-4271-8369-e3a9fb578dcd 1073741824" returned: 0 in 0.705s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:52:29 devstack sudo[98626]: pam_unix(sudo:session): session closed for user root Nov 06 11:52:29 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-c5e25030-e1f0-4d99-be67-fb522000e557 tempest-TestInstancesWithCinderVolumes-778023409 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_12dc24bd-5004-422c-8e18-19af385719a2_79u54kqk" returned: 1 in 0.397s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:52:29 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-c5e25030-e1f0-4d99-be67-fb522000e557 tempest-TestInstancesWithCinderVolumes-778023409 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_12dc24bd-5004-422c-8e18-19af385719a2_79u54kqk' failed. Not Retrying. {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 06 11:52:29 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[c18ecab2-29c3-4914-8021-31aaa64e2288]: (4, 'qcow2') {{(pid=88420) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 11:52:29 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-c5e25030-e1f0-4d99-be67-fb522000e557 tempest-TestInstancesWithCinderVolumes-778023409 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_12dc24bd-5004-422c-8e18-19af385719a2_x05jwe_1devstack@QuobyteHD {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:52:29 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-7a2395d1-3b3b-48cc-b025-8a005f13c3ad tempest-VolumesDeleteCascade-915753827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-3a1e2661-d20b-4271-8369-e3a9fb578dcd {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:52:29 devstack sudo[98635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-3a1e2661-d20b-4271-8369-e3a9fb578dcd Nov 06 11:52:29 devstack sudo[98635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:52:29 devstack sudo[98634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_12dc24bd-5004-422c-8e18-19af385719a2_x05jwe_1devstack@QuobyteHD Nov 06 11:52:29 devstack sudo[98634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:52:29 devstack sudo[98635]: pam_unix(sudo:session): session closed for user root Nov 06 11:52:29 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-7a2395d1-3b3b-48cc-b025-8a005f13c3ad tempest-VolumesDeleteCascade-915753827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-3a1e2661-d20b-4271-8369-e3a9fb578dcd" returned: 0 in 0.324s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:52:29 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-7a2395d1-3b3b-48cc-b025-8a005f13c3ad tempest-VolumesDeleteCascade-915753827 None] <== create_volume: return (1108ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f'} {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 11:52:29 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-7a2395d1-3b3b-48cc-b025-8a005f13c3ad tempest-VolumesDeleteCascade-915753827 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.112s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 11:52:29 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-7a2395d1-3b3b-48cc-b025-8a005f13c3ad tempest-VolumesDeleteCascade-915753827 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f8645bc2-f0d6-4e1a-a827-31d3e43ca573) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3a1e2661-d20b-4271-8369-e3a9fb578dcd', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:52:29 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-7a2395d1-3b3b-48cc-b025-8a005f13c3ad tempest-VolumesDeleteCascade-915753827 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a3756ba7-9718-4009-a2f9-22492a73611b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:52:29 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-7a2395d1-3b3b-48cc-b025-8a005f13c3ad tempest-VolumesDeleteCascade-915753827 None] Volume volume-3a1e2661-d20b-4271-8369-e3a9fb578dcd (3a1e2661-d20b-4271-8369-e3a9fb578dcd): created successfully Nov 06 11:52:29 devstack sudo[98634]: pam_unix(sudo:session): session closed for user root Nov 06 11:52:29 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-7a2395d1-3b3b-48cc-b025-8a005f13c3ad tempest-VolumesDeleteCascade-915753827 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a3756ba7-9718-4009-a2f9-22492a73611b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:52:29 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-7a2395d1-3b3b-48cc-b025-8a005f13c3ad tempest-VolumesDeleteCascade-915753827 None] Flow 'volume_create_manager' (e5ec66d3-0e78-4e30-81e6-075f4c8dd60b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 11:52:29 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-c5e25030-e1f0-4d99-be67-fb522000e557 tempest-TestInstancesWithCinderVolumes-778023409 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_12dc24bd-5004-422c-8e18-19af385719a2_x05jwe_1devstack@QuobyteHD" returned: 0 in 0.445s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:52:29 devstack cinder-volume[87116]: DEBUG cinder.image.image_utils [None req-c5e25030-e1f0-4d99-be67-fb522000e557 tempest-TestInstancesWithCinderVolumes-778023409 None] 12dc24bd-5004-422c-8e18-19af385719a2 was qcow2, converting to qcow2 {{(pid=87116) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Nov 06 11:52:29 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-c5e25030-e1f0-4d99-be67-fb522000e557 tempest-TestInstancesWithCinderVolumes-778023409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_12dc24bd-5004-422c-8e18-19af385719a2_x05jwe_1devstack@QuobyteHD /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-8df52254-632f-4669-ba3d-a52aa38c509a {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:52:29 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-7a2395d1-3b3b-48cc-b025-8a005f13c3ad tempest-VolumesDeleteCascade-915753827 None] Created volume successfully. Nov 06 11:52:29 devstack sudo[98644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_12dc24bd-5004-422c-8e18-19af385719a2_x05jwe_1devstack@QuobyteHD /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-8df52254-632f-4669-ba3d-a52aa38c509a Nov 06 11:52:29 devstack sudo[98644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:52:30 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-7860798e-4a08-4bce-afa7-62fc169d405c tempest-VolumesDeleteCascade-915753827 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 11:52:30 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-7860798e-4a08-4bce-afa7-62fc169d405c tempest-VolumesDeleteCascade-915753827 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 11:52:30 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-7860798e-4a08-4bce-afa7-62fc169d405c tempest-VolumesDeleteCascade-915753827 None] Creating offline snapshot 525bdfae-17b5-48a0-aee6-e30ac55b42a6 of volume 3a1e2661-d20b-4271-8369-e3a9fb578dcd {{(pid=87116) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 06 11:52:30 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d1ba43d-bbc5-4f29-9fba-d9212df191ad]: (4, 'qcow2') {{(pid=88420) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 11:52:30 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-7860798e-4a08-4bce-afa7-62fc169d405c tempest-VolumesDeleteCascade-915753827 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-3a1e2661-d20b-4271-8369-e3a9fb578dcd {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:52:30 devstack sudo[98685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-3a1e2661-d20b-4271-8369-e3a9fb578dcd Nov 06 11:52:30 devstack sudo[98685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:52:31 devstack sudo[98685]: pam_unix(sudo:session): session closed for user root Nov 06 11:52:31 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-7860798e-4a08-4bce-afa7-62fc169d405c tempest-VolumesDeleteCascade-915753827 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-3a1e2661-d20b-4271-8369-e3a9fb578dcd" returned: 0 in 0.535s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:52:31 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-7860798e-4a08-4bce-afa7-62fc169d405c tempest-VolumesDeleteCascade-915753827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-3a1e2661-d20b-4271-8369-e3a9fb578dcd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-3a1e2661-d20b-4271-8369-e3a9fb578dcd.525bdfae-17b5-48a0-aee6-e30ac55b42a6 1G {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:52:31 devstack sudo[98692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-3a1e2661-d20b-4271-8369-e3a9fb578dcd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-3a1e2661-d20b-4271-8369-e3a9fb578dcd.525bdfae-17b5-48a0-aee6-e30ac55b42a6 1G Nov 06 11:52:31 devstack sudo[98692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:52:31 devstack sudo[98692]: pam_unix(sudo:session): session closed for user root Nov 06 11:52:31 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-7860798e-4a08-4bce-afa7-62fc169d405c tempest-VolumesDeleteCascade-915753827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-3a1e2661-d20b-4271-8369-e3a9fb578dcd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-3a1e2661-d20b-4271-8369-e3a9fb578dcd.525bdfae-17b5-48a0-aee6-e30ac55b42a6 1G" returned: 0 in 0.618s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:52:31 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-7860798e-4a08-4bce-afa7-62fc169d405c tempest-VolumesDeleteCascade-915753827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3a1e2661-d20b-4271-8369-e3a9fb578dcd -F qcow2 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-3a1e2661-d20b-4271-8369-e3a9fb578dcd.525bdfae-17b5-48a0-aee6-e30ac55b42a6 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:52:31 devstack sudo[98698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3a1e2661-d20b-4271-8369-e3a9fb578dcd -F qcow2 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-3a1e2661-d20b-4271-8369-e3a9fb578dcd.525bdfae-17b5-48a0-aee6-e30ac55b42a6 Nov 06 11:52:31 devstack sudo[98698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:52:32 devstack sudo[98644]: pam_unix(sudo:session): session closed for user root Nov 06 11:52:32 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-c5e25030-e1f0-4d99-be67-fb522000e557 tempest-TestInstancesWithCinderVolumes-778023409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_12dc24bd-5004-422c-8e18-19af385719a2_x05jwe_1devstack@QuobyteHD /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-8df52254-632f-4669-ba3d-a52aa38c509a" returned: 0 in 2.603s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:52:32 devstack cinder-volume[87116]: DEBUG cinder.image.image_utils [None req-c5e25030-e1f0-4d99-be67-fb522000e557 tempest-TestInstancesWithCinderVolumes-778023409 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_12dc24bd-5004-422c-8e18-19af385719a2_x05jwe_1devstack@QuobyteHD, size 112.00 MB, duration 2.60 sec, destination /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-8df52254-632f-4669-ba3d-a52aa38c509a {{(pid=87116) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 06 11:52:32 devstack cinder-volume[87116]: INFO cinder.image.image_utils [None req-c5e25030-e1f0-4d99-be67-fb522000e557 tempest-TestInstancesWithCinderVolumes-778023409 None] Converted 112.00 MB image at 43.01 MB/s Nov 06 11:52:32 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-c5e25030-e1f0-4d99-be67-fb522000e557 tempest-TestInstancesWithCinderVolumes-778023409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-8df52254-632f-4669-ba3d-a52aa38c509a 1G {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:52:32 devstack sudo[98703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-8df52254-632f-4669-ba3d-a52aa38c509a 1G Nov 06 11:52:32 devstack sudo[98703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:52:32 devstack sudo[98698]: pam_unix(sudo:session): session closed for user root Nov 06 11:52:32 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-7860798e-4a08-4bce-afa7-62fc169d405c tempest-VolumesDeleteCascade-915753827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3a1e2661-d20b-4271-8369-e3a9fb578dcd -F qcow2 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-3a1e2661-d20b-4271-8369-e3a9fb578dcd.525bdfae-17b5-48a0-aee6-e30ac55b42a6" returned: 0 in 0.456s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:52:32 devstack cinder-volume[87116]: WARNING cinder.volume.drivers.remotefs [None req-7860798e-4a08-4bce-afa7-62fc169d405c tempest-VolumesDeleteCascade-915753827 None] /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-3a1e2661-d20b-4271-8369-e3a9fb578dcd.525bdfae-17b5-48a0-aee6-e30ac55b42a6 is being set with open permissions: ugo+rw Nov 06 11:52:32 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-7860798e-4a08-4bce-afa7-62fc169d405c tempest-VolumesDeleteCascade-915753827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-3a1e2661-d20b-4271-8369-e3a9fb578dcd.525bdfae-17b5-48a0-aee6-e30ac55b42a6 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:52:32 devstack sudo[98706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-3a1e2661-d20b-4271-8369-e3a9fb578dcd.525bdfae-17b5-48a0-aee6-e30ac55b42a6 Nov 06 11:52:32 devstack sudo[98706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:52:32 devstack sudo[98703]: pam_unix(sudo:session): session closed for user root Nov 06 11:52:32 devstack sudo[98706]: pam_unix(sudo:session): session closed for user root Nov 06 11:52:32 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-7860798e-4a08-4bce-afa7-62fc169d405c tempest-VolumesDeleteCascade-915753827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-3a1e2661-d20b-4271-8369-e3a9fb578dcd.525bdfae-17b5-48a0-aee6-e30ac55b42a6" returned: 0 in 0.334s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:52:32 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-c5e25030-e1f0-4d99-be67-fb522000e557 tempest-TestInstancesWithCinderVolumes-778023409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-8df52254-632f-4669-ba3d-a52aa38c509a 1G" returned: 0 in 0.422s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:52:32 devstack cinder-volume[87116]: DEBUG cinder.volume.volume_utils [None req-c5e25030-e1f0-4d99-be67-fb522000e557 tempest-TestInstancesWithCinderVolumes-778023409 None] Downloaded image 12dc24bd-5004-422c-8e18-19af385719a2 ((None, [{'url': 'file:///opt/stack/data/glance/images/12dc24bd-5004-422c-8e18-19af385719a2', 'metadata': {}}])) to volume 8df52254-632f-4669-ba3d-a52aa38c509a successfully. {{(pid=87116) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Nov 06 11:52:32 devstack cinder-volume[87116]: DEBUG cinder.image.image_utils [None req-c5e25030-e1f0-4d99-be67-fb522000e557 tempest-TestInstancesWithCinderVolumes-778023409 None] Temporary image 12dc24bd-5004-422c-8e18-19af385719a2 for user 7a2ee037e3804e479c3648a3b1bb20b1 is deleted. {{(pid=87116) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Nov 06 11:52:32 devstack cinder-volume[87116]: DEBUG cinder.volume.volume_utils [None req-c5e25030-e1f0-4d99-be67-fb522000e557 tempest-TestInstancesWithCinderVolumes-778023409 None] Marking volume 8df52254-632f-4669-ba3d-a52aa38c509a as bootable. {{(pid=87116) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Nov 06 11:52:32 devstack cinder-volume[87116]: DEBUG cinder.volume.flows.manager.create_volume [None req-c5e25030-e1f0-4d99-be67-fb522000e557 tempest-TestInstancesWithCinderVolumes-778023409 None] Copying metadata from image 12dc24bd-5004-422c-8e18-19af385719a2 to 8df52254-632f-4669-ba3d-a52aa38c509a. {{(pid=87116) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Nov 06 11:52:32 devstack cinder-volume[87116]: DEBUG cinder.volume.flows.manager.create_volume [None req-c5e25030-e1f0-4d99-be67-fb522000e557 tempest-TestInstancesWithCinderVolumes-778023409 None] Creating volume glance metadata for volume 8df52254-632f-4669-ba3d-a52aa38c509a backed by image 12dc24bd-5004-422c-8e18-19af385719a2 with: {'image_id': '12dc24bd-5004-422c-8e18-19af385719a2', 'image_name': 'tempest-scenario-img--1958393752', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87116) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Nov 06 11:52:32 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-7860798e-4a08-4bce-afa7-62fc169d405c tempest-VolumesDeleteCascade-915753827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-3a1e2661-d20b-4271-8369-e3a9fb578dcd.info {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:52:32 devstack sudo[98714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-3a1e2661-d20b-4271-8369-e3a9fb578dcd.info Nov 06 11:52:32 devstack sudo[98714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:52:32 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-c5e25030-e1f0-4d99-be67-fb522000e557 tempest-TestInstancesWithCinderVolumes-778023409 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f65e7f67-53f7-4b81-95e7-29ebaf72e2d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8df52254-632f-4669-ba3d-a52aa38c509a', 'volume_size': 1, 'image_id': '12dc24bd-5004-422c-8e18-19af385719a2', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/12dc24bd-5004-422c-8e18-19af385719a2', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1958393752', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '03b11da20f3340ca97f572ea35dad2f5', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '12dc24bd-5004-422c-8e18-19af385719a2', 'created_at': datetime.datetime(2026, 11, 6, 10, 52, 15, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 6, 10, 52, 17, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/12dc24bd-5004-422c-8e18-19af385719a2/file', 'properties': {}}, 'image_service': }' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:52:32 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-c5e25030-e1f0-4d99-be67-fb522000e557 tempest-TestInstancesWithCinderVolumes-778023409 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (80f8ac64-aa4b-40f1-aecf-189e3b7ccb9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:52:32 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-c5e25030-e1f0-4d99-be67-fb522000e557 tempest-TestInstancesWithCinderVolumes-778023409 None] Volume volume-8df52254-632f-4669-ba3d-a52aa38c509a (8df52254-632f-4669-ba3d-a52aa38c509a): created successfully Nov 06 11:52:32 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-c5e25030-e1f0-4d99-be67-fb522000e557 tempest-TestInstancesWithCinderVolumes-778023409 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (80f8ac64-aa4b-40f1-aecf-189e3b7ccb9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:52:32 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-c5e25030-e1f0-4d99-be67-fb522000e557 tempest-TestInstancesWithCinderVolumes-778023409 None] Flow 'volume_create_manager' (1801c0d6-a189-4cf4-885d-ee3083e80fb5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 11:52:32 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-c5e25030-e1f0-4d99-be67-fb522000e557 tempest-TestInstancesWithCinderVolumes-778023409 None] Created volume successfully. Nov 06 11:52:32 devstack sudo[98714]: pam_unix(sudo:session): session closed for user root Nov 06 11:52:32 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-7860798e-4a08-4bce-afa7-62fc169d405c tempest-VolumesDeleteCascade-915753827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-3a1e2661-d20b-4271-8369-e3a9fb578dcd.info" returned: 0 in 0.286s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:52:32 devstack cinder-volume[87116]: WARNING cinder.volume.drivers.remotefs [None req-7860798e-4a08-4bce-afa7-62fc169d405c tempest-VolumesDeleteCascade-915753827 None] /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-3a1e2661-d20b-4271-8369-e3a9fb578dcd.info is being set with open permissions: ugo+rw Nov 06 11:52:32 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-7860798e-4a08-4bce-afa7-62fc169d405c tempest-VolumesDeleteCascade-915753827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-3a1e2661-d20b-4271-8369-e3a9fb578dcd.info {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:52:32 devstack sudo[98717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-3a1e2661-d20b-4271-8369-e3a9fb578dcd.info Nov 06 11:52:32 devstack sudo[98717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:52:33 devstack sudo[98717]: pam_unix(sudo:session): session closed for user root Nov 06 11:52:33 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-7860798e-4a08-4bce-afa7-62fc169d405c tempest-VolumesDeleteCascade-915753827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-3a1e2661-d20b-4271-8369-e3a9fb578dcd.info" returned: 0 in 0.385s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:52:33 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-7860798e-4a08-4bce-afa7-62fc169d405c tempest-VolumesDeleteCascade-915753827 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.789s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 11:52:33 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-7860798e-4a08-4bce-afa7-62fc169d405c tempest-VolumesDeleteCascade-915753827 None] Create snapshot completed successfully Nov 06 11:52:34 devstack cinder-volume[87116]: DEBUG cinder.volume.flows.manager.create_volume [None req-1ca64527-83d5-47c7-a79f-613e2c9e5c9d tempest-VolumesDeleteCascade-915753827 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87116) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 11:52:34 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-1ca64527-83d5-47c7-a79f-613e2c9e5c9d tempest-VolumesDeleteCascade-915753827 None] Flow 'volume_create_manager' (1a1653ea-4e1f-479e-81d6-0743bc627233) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 11:52:34 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-1ca64527-83d5-47c7-a79f-613e2c9e5c9d tempest-VolumesDeleteCascade-915753827 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f9a4fba5-6f35-43fa-aa7a-4e65c4db1416) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:52:34 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-1ca64527-83d5-47c7-a79f-613e2c9e5c9d tempest-VolumesDeleteCascade-915753827 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f9a4fba5-6f35-43fa-aa7a-4e65c4db1416) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T10:52:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-2133823620',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e69c1806-da20-4183-8c2b-7f56008919a0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='133403ef419b401eb13cf042dad32417',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T10:52:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=525bdfae-17b5-48a0-aee6-e30ac55b42a6,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T10:52:34Z,use_quota=True,user_id='48c070f7f6e344b0a2467bfd96d154fc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(34d3b144-d9b7-480a-a2e3-01e45f3d54c1),volume_type_id=34d3b144-d9b7-480a-a2e3-01e45f3d54c1)' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:52:34 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-1ca64527-83d5-47c7-a79f-613e2c9e5c9d tempest-VolumesDeleteCascade-915753827 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6269b37b-a55e-49a2-8ef8-be4e43d3a4e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:52:34 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-1ca64527-83d5-47c7-a79f-613e2c9e5c9d tempest-VolumesDeleteCascade-915753827 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6269b37b-a55e-49a2-8ef8-be4e43d3a4e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:52:34 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-1ca64527-83d5-47c7-a79f-613e2c9e5c9d tempest-VolumesDeleteCascade-915753827 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (99021fd9-a50d-4805-9281-210246fa25c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:52:34 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-1ca64527-83d5-47c7-a79f-613e2c9e5c9d tempest-VolumesDeleteCascade-915753827 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (99021fd9-a50d-4805-9281-210246fa25c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'e69c1806-da20-4183-8c2b-7f56008919a0', 'volume_name': 'volume-e69c1806-da20-4183-8c2b-7f56008919a0', 'volume_size': 1, 'snapshot_id': '525bdfae-17b5-48a0-aee6-e30ac55b42a6'}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:52:34 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-1ca64527-83d5-47c7-a79f-613e2c9e5c9d tempest-VolumesDeleteCascade-915753827 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (707a8c58-559d-4d21-aee1-87546bf2257c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:52:34 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-1ca64527-83d5-47c7-a79f-613e2c9e5c9d tempest-VolumesDeleteCascade-915753827 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (707a8c58-559d-4d21-aee1-87546bf2257c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:52:34 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-1ca64527-83d5-47c7-a79f-613e2c9e5c9d tempest-VolumesDeleteCascade-915753827 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (be26b82e-26eb-471f-a631-42e5b1c62a10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:52:34 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-1ca64527-83d5-47c7-a79f-613e2c9e5c9d tempest-VolumesDeleteCascade-915753827 None] Volume e69c1806-da20-4183-8c2b-7f56008919a0: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-e69c1806-da20-4183-8c2b-7f56008919a0', 'volume_size': 1, 'snapshot_id': '525bdfae-17b5-48a0-aee6-e30ac55b42a6'} Nov 06 11:52:34 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-1ca64527-83d5-47c7-a79f-613e2c9e5c9d tempest-VolumesDeleteCascade-915753827 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 11:52:34 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-1ca64527-83d5-47c7-a79f-613e2c9e5c9d tempest-VolumesDeleteCascade-915753827 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 11:52:34 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-1ca64527-83d5-47c7-a79f-613e2c9e5c9d tempest-VolumesDeleteCascade-915753827 None] Acquiring lock "cinder-quobyte-525bdfae-17b5-48a0-aee6-e30ac55b42a6-e69c1806-da20-4183-8c2b-7f56008919a0" by "_create_volume_from_snapshot" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 11:52:34 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-1ca64527-83d5-47c7-a79f-613e2c9e5c9d tempest-VolumesDeleteCascade-915753827 None] Lock "cinder-quobyte-525bdfae-17b5-48a0-aee6-e30ac55b42a6-e69c1806-da20-4183-8c2b-7f56008919a0" acquired by "_create_volume_from_snapshot" :: waited 0.022s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 11:52:34 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-1ca64527-83d5-47c7-a79f-613e2c9e5c9d tempest-VolumesDeleteCascade-915753827 None] Creating volume e69c1806-da20-4183-8c2b-7f56008919a0 from snapshot 525bdfae-17b5-48a0-aee6-e30ac55b42a6 {{(pid=87116) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Nov 06 11:52:34 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-1ca64527-83d5-47c7-a79f-613e2c9e5c9d tempest-VolumesDeleteCascade-915753827 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 11:52:34 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-1ca64527-83d5-47c7-a79f-613e2c9e5c9d tempest-VolumesDeleteCascade-915753827 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 11:52:34 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-1ca64527-83d5-47c7-a79f-613e2c9e5c9d tempest-VolumesDeleteCascade-915753827 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 11:52:34 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-1ca64527-83d5-47c7-a79f-613e2c9e5c9d tempest-VolumesDeleteCascade-915753827 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 11:52:34 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-1ca64527-83d5-47c7-a79f-613e2c9e5c9d tempest-VolumesDeleteCascade-915753827 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 11:52:34 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-1ca64527-83d5-47c7-a79f-613e2c9e5c9d tempest-VolumesDeleteCascade-915753827 None] Selected osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f as target Quobyte volume. {{(pid=87116) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 11:52:34 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-1ca64527-83d5-47c7-a79f-613e2c9e5c9d tempest-VolumesDeleteCascade-915753827 None] Acquiring lock "cinder-quobyte-e69c1806-da20-4183-8c2b-7f56008919a0" by "_copy_volume_from_snapshot" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 11:52:34 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-1ca64527-83d5-47c7-a79f-613e2c9e5c9d tempest-VolumesDeleteCascade-915753827 None] Lock "cinder-quobyte-e69c1806-da20-4183-8c2b-7f56008919a0" acquired by "_copy_volume_from_snapshot" :: waited 0.028s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 11:52:34 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-1ca64527-83d5-47c7-a79f-613e2c9e5c9d tempest-VolumesDeleteCascade-915753827 None] snapshot: 525bdfae-17b5-48a0-aee6-e30ac55b42a6, volume: e69c1806-da20-4183-8c2b-7f56008919a0, {{(pid=87116) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 06 11:52:34 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-1ca64527-83d5-47c7-a79f-613e2c9e5c9d tempest-VolumesDeleteCascade-915753827 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 11:52:34 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-1ca64527-83d5-47c7-a79f-613e2c9e5c9d tempest-VolumesDeleteCascade-915753827 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 11:52:34 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-1ca64527-83d5-47c7-a79f-613e2c9e5c9d tempest-VolumesDeleteCascade-915753827 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 11:52:34 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-1ca64527-83d5-47c7-a79f-613e2c9e5c9d tempest-VolumesDeleteCascade-915753827 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 11:52:34 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-1ca64527-83d5-47c7-a79f-613e2c9e5c9d tempest-VolumesDeleteCascade-915753827 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 11:52:34 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d761fa3-83bc-45f5-baa2-9d6abb3826a2]: (4, 'qcow2') {{(pid=88420) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 11:52:34 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-1ca64527-83d5-47c7-a79f-613e2c9e5c9d tempest-VolumesDeleteCascade-915753827 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-3a1e2661-d20b-4271-8369-e3a9fb578dcd.525bdfae-17b5-48a0-aee6-e30ac55b42a6 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:52:34 devstack sudo[98720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-3a1e2661-d20b-4271-8369-e3a9fb578dcd.525bdfae-17b5-48a0-aee6-e30ac55b42a6 Nov 06 11:52:34 devstack sudo[98720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:52:35 devstack sudo[98720]: pam_unix(sudo:session): session closed for user root Nov 06 11:52:35 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-1ca64527-83d5-47c7-a79f-613e2c9e5c9d tempest-VolumesDeleteCascade-915753827 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-3a1e2661-d20b-4271-8369-e3a9fb578dcd.525bdfae-17b5-48a0-aee6-e30ac55b42a6" returned: 0 in 0.423s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:52:35 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-1ca64527-83d5-47c7-a79f-613e2c9e5c9d tempest-VolumesDeleteCascade-915753827 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3a1e2661-d20b-4271-8369-e3a9fb578dcd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87116) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 11:52:35 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[27f95368-78dd-45f6-9223-247ffe49f29f]: (4, 'qcow2') {{(pid=88420) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 11:52:35 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-1ca64527-83d5-47c7-a79f-613e2c9e5c9d tempest-VolumesDeleteCascade-915753827 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-3a1e2661-d20b-4271-8369-e3a9fb578dcd {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:52:35 devstack sudo[98725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-3a1e2661-d20b-4271-8369-e3a9fb578dcd Nov 06 11:52:35 devstack sudo[98725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:52:35 devstack sudo[98725]: pam_unix(sudo:session): session closed for user root Nov 06 11:52:35 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-1ca64527-83d5-47c7-a79f-613e2c9e5c9d tempest-VolumesDeleteCascade-915753827 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-3a1e2661-d20b-4271-8369-e3a9fb578dcd" returned: 0 in 0.450s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:52:35 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-1ca64527-83d5-47c7-a79f-613e2c9e5c9d tempest-VolumesDeleteCascade-915753827 None] will copy from snapshot at /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-3a1e2661-d20b-4271-8369-e3a9fb578dcd {{(pid=87116) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 06 11:52:35 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-1ca64527-83d5-47c7-a79f-613e2c9e5c9d tempest-VolumesDeleteCascade-915753827 None] Creating direct copy from snapshot {{(pid=87116) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 06 11:52:35 devstack cinder-volume[87116]: DEBUG cinder.utils [None req-1ca64527-83d5-47c7-a79f-613e2c9e5c9d tempest-VolumesDeleteCascade-915753827 None] Path /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-e69c1806-da20-4183-8c2b-7f56008919a0 not found in is_blk_device check {{(pid=87116) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 06 11:52:35 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-1ca64527-83d5-47c7-a79f-613e2c9e5c9d tempest-VolumesDeleteCascade-915753827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-3a1e2661-d20b-4271-8369-e3a9fb578dcd /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-e69c1806-da20-4183-8c2b-7f56008919a0 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:52:35 devstack sudo[98730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-3a1e2661-d20b-4271-8369-e3a9fb578dcd /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-e69c1806-da20-4183-8c2b-7f56008919a0 Nov 06 11:52:35 devstack sudo[98730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:52:39 devstack cinder-volume[87116]: DEBUG oslo_service.periodic_task [None req-4fab4816-ec2b-4b19-b2ff-8548f2084354 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87116) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 11:52:39 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-4fab4816-ec2b-4b19-b2ff-8548f2084354 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 11:52:39 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-4fab4816-ec2b-4b19-b2ff-8548f2084354 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.010s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 11:52:39 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-4fab4816-ec2b-4b19-b2ff-8548f2084354 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 11:52:39 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-4fab4816-ec2b-4b19-b2ff-8548f2084354 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 11:52:39 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-4fab4816-ec2b-4b19-b2ff-8548f2084354 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 11:52:39 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-4fab4816-ec2b-4b19-b2ff-8548f2084354 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:52:39 devstack sudo[98752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756 Nov 06 11:52:39 devstack sudo[98752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:52:40 devstack sudo[98752]: pam_unix(sudo:session): session closed for user root Nov 06 11:52:40 devstack cinder-volume[87116]: DEBUG cinder.volume.flows.manager.create_volume [None req-dbf72921-98de-4d95-a10c-2e71929475c2 tempest-VolumesActionsTest-1082049010 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87116) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 11:52:40 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-dbf72921-98de-4d95-a10c-2e71929475c2 tempest-VolumesActionsTest-1082049010 None] Flow 'volume_create_manager' (56fa62ee-f745-416d-ad06-18ea486d07b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 11:52:41 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-dbf72921-98de-4d95-a10c-2e71929475c2 tempest-VolumesActionsTest-1082049010 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7842dfbd-c375-4d63-b79d-5ec5e1410bb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:52:41 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-4fab4816-ec2b-4b19-b2ff-8548f2084354 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756" returned: 0 in 1.135s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:52:41 devstack cinder-volume[87116]: DEBUG cinder.manager [None req-4fab4816-ec2b-4b19-b2ff-8548f2084354 None None] Notifying Schedulers of capabilities ... {{(pid=87116) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 11:52:41 devstack cinder-volume[87116]: DEBUG oslo_service.periodic_task [None req-4fab4816-ec2b-4b19-b2ff-8548f2084354 None None] Running periodic task VolumeManager._thread_info {{(pid=87116) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 11:52:41 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-4fab4816-ec2b-4b19-b2ff-8548f2084354 None None] thread count: 28 {{(pid=87116) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 06 11:52:41 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-4fab4816-ec2b-4b19-b2ff-8548f2084354 None None] thread info: [<_MainThread(MainThread, started 131399520669824)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87116) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 06 11:52:41 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-dbf72921-98de-4d95-a10c-2e71929475c2 tempest-VolumesActionsTest-1082049010 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7842dfbd-c375-4d63-b79d-5ec5e1410bb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T10:52:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1624249191',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=07f7eafd-f454-4ca3-9d82-7f4535375548,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2aa361b6871b4801a772ed1d0de908e3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T10:52:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T10:52:41Z,use_quota=True,user_id='517c05ab43b24c93abe86accdd627303',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(34d3b144-d9b7-480a-a2e3-01e45f3d54c1),volume_type_id=34d3b144-d9b7-480a-a2e3-01e45f3d54c1)' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:52:41 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-dbf72921-98de-4d95-a10c-2e71929475c2 tempest-VolumesActionsTest-1082049010 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e7166f75-7843-461b-bb5a-fd3f3066811b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:52:41 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-dbf72921-98de-4d95-a10c-2e71929475c2 tempest-VolumesActionsTest-1082049010 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e7166f75-7843-461b-bb5a-fd3f3066811b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:52:41 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-dbf72921-98de-4d95-a10c-2e71929475c2 tempest-VolumesActionsTest-1082049010 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ac7de220-7f80-4d5d-b522-d333f1ded18a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:52:41 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-dbf72921-98de-4d95-a10c-2e71929475c2 tempest-VolumesActionsTest-1082049010 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ac7de220-7f80-4d5d-b522-d333f1ded18a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '07f7eafd-f454-4ca3-9d82-7f4535375548', 'volume_name': 'volume-07f7eafd-f454-4ca3-9d82-7f4535375548', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:52:41 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-dbf72921-98de-4d95-a10c-2e71929475c2 tempest-VolumesActionsTest-1082049010 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e82ef14b-a342-43a9-ab85-8cdff162ada0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:52:41 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-dbf72921-98de-4d95-a10c-2e71929475c2 tempest-VolumesActionsTest-1082049010 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e82ef14b-a342-43a9-ab85-8cdff162ada0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:52:41 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-dbf72921-98de-4d95-a10c-2e71929475c2 tempest-VolumesActionsTest-1082049010 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (30a51a86-d7aa-4711-bfe3-cd968eb53e5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:52:41 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-dbf72921-98de-4d95-a10c-2e71929475c2 tempest-VolumesActionsTest-1082049010 None] Volume 07f7eafd-f454-4ca3-9d82-7f4535375548: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-07f7eafd-f454-4ca3-9d82-7f4535375548', 'volume_size': 1} Nov 06 11:52:41 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-dbf72921-98de-4d95-a10c-2e71929475c2 tempest-VolumesActionsTest-1082049010 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 11:52:43 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [req-6c5a26c1-0477-423f-8dcb-6e31e63ab5d7 req-6b2aaae7-016a-431c-a436-4ae23e9bbe7d tempest-TestInstancesWithCinderVolumes-778023409 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 11:52:45 devstack sudo[98730]: pam_unix(sudo:session): session closed for user root Nov 06 11:52:45 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-1ca64527-83d5-47c7-a79f-613e2c9e5c9d tempest-VolumesDeleteCascade-915753827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-3a1e2661-d20b-4271-8369-e3a9fb578dcd /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-e69c1806-da20-4183-8c2b-7f56008919a0" returned: 0 in 9.708s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:52:45 devstack cinder-volume[87116]: DEBUG cinder.image.image_utils [None req-1ca64527-83d5-47c7-a79f-613e2c9e5c9d tempest-VolumesDeleteCascade-915753827 None] Image conversion details: src /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-3a1e2661-d20b-4271-8369-e3a9fb578dcd, size 1024.00 MB, duration 9.71 sec, destination /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-e69c1806-da20-4183-8c2b-7f56008919a0 {{(pid=87116) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 06 11:52:45 devstack cinder-volume[87116]: INFO cinder.image.image_utils [None req-1ca64527-83d5-47c7-a79f-613e2c9e5c9d tempest-VolumesDeleteCascade-915753827 None] Converted 1024.00 MB image at 105.47 MB/s Nov 06 11:52:45 devstack cinder-volume[87116]: WARNING cinder.volume.drivers.remotefs [None req-1ca64527-83d5-47c7-a79f-613e2c9e5c9d tempest-VolumesDeleteCascade-915753827 None] /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-e69c1806-da20-4183-8c2b-7f56008919a0 is being set with open permissions: ugo+rw Nov 06 11:52:45 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-1ca64527-83d5-47c7-a79f-613e2c9e5c9d tempest-VolumesDeleteCascade-915753827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-e69c1806-da20-4183-8c2b-7f56008919a0 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:52:45 devstack sudo[98765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-e69c1806-da20-4183-8c2b-7f56008919a0 Nov 06 11:52:45 devstack sudo[98765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:52:45 devstack sudo[98765]: pam_unix(sudo:session): session closed for user root Nov 06 11:52:45 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-1ca64527-83d5-47c7-a79f-613e2c9e5c9d tempest-VolumesDeleteCascade-915753827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-e69c1806-da20-4183-8c2b-7f56008919a0" returned: 0 in 0.268s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:52:45 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-1ca64527-83d5-47c7-a79f-613e2c9e5c9d tempest-VolumesDeleteCascade-915753827 None] Lock "cinder-quobyte-e69c1806-da20-4183-8c2b-7f56008919a0" released by "_copy_volume_from_snapshot" :: held 10.986s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 11:52:45 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-1ca64527-83d5-47c7-a79f-613e2c9e5c9d tempest-VolumesDeleteCascade-915753827 None] Lock "cinder-quobyte-525bdfae-17b5-48a0-aee6-e30ac55b42a6-e69c1806-da20-4183-8c2b-7f56008919a0" released by "_create_volume_from_snapshot" :: held 11.091s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 11:52:45 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-1ca64527-83d5-47c7-a79f-613e2c9e5c9d tempest-VolumesDeleteCascade-915753827 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 11.114s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 11:52:45 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-dbf72921-98de-4d95-a10c-2e71929475c2 tempest-VolumesActionsTest-1082049010 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.439s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 11:52:45 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-dbf72921-98de-4d95-a10c-2e71929475c2 tempest-VolumesActionsTest-1082049010 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T10:52:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1624249191',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=07f7eafd-f454-4ca3-9d82-7f4535375548,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2aa361b6871b4801a772ed1d0de908e3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T10:52:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T10:52:41Z,use_quota=True,user_id='517c05ab43b24c93abe86accdd627303',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(34d3b144-d9b7-480a-a2e3-01e45f3d54c1),volume_type_id=34d3b144-d9b7-480a-a2e3-01e45f3d54c1)}" {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 11:52:45 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-dbf72921-98de-4d95-a10c-2e71929475c2 tempest-VolumesActionsTest-1082049010 None] Creating volume 07f7eafd-f454-4ca3-9d82-7f4535375548 {{(pid=87116) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 11:52:45 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-dbf72921-98de-4d95-a10c-2e71929475c2 tempest-VolumesActionsTest-1082049010 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 11:52:45 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-dbf72921-98de-4d95-a10c-2e71929475c2 tempest-VolumesActionsTest-1082049010 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 11:52:45 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-dbf72921-98de-4d95-a10c-2e71929475c2 tempest-VolumesActionsTest-1082049010 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 11:52:45 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-dbf72921-98de-4d95-a10c-2e71929475c2 tempest-VolumesActionsTest-1082049010 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 11:52:45 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-dbf72921-98de-4d95-a10c-2e71929475c2 tempest-VolumesActionsTest-1082049010 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 11:52:45 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-dbf72921-98de-4d95-a10c-2e71929475c2 tempest-VolumesActionsTest-1082049010 None] Selected osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f as target Quobyte volume. {{(pid=87116) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 11:52:45 devstack cinder-volume[87116]: INFO cinder.volume.drivers.remotefs [None req-dbf72921-98de-4d95-a10c-2e71929475c2 tempest-VolumesActionsTest-1082049010 None] casted to osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f Nov 06 11:52:45 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-dbf72921-98de-4d95-a10c-2e71929475c2 tempest-VolumesActionsTest-1082049010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-07f7eafd-f454-4ca3-9d82-7f4535375548 1073741824 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:52:45 devstack sudo[98768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-07f7eafd-f454-4ca3-9d82-7f4535375548 1073741824 Nov 06 11:52:45 devstack sudo[98768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:52:45 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-1ca64527-83d5-47c7-a79f-613e2c9e5c9d tempest-VolumesDeleteCascade-915753827 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (be26b82e-26eb-471f-a631-42e5b1c62a10) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e69c1806-da20-4183-8c2b-7f56008919a0', 'volume_size': 1, 'snapshot_id': '525bdfae-17b5-48a0-aee6-e30ac55b42a6'}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:52:45 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-1ca64527-83d5-47c7-a79f-613e2c9e5c9d tempest-VolumesDeleteCascade-915753827 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff2b9949-f36d-43da-a87b-31b082b61157) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:52:45 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-1ca64527-83d5-47c7-a79f-613e2c9e5c9d tempest-VolumesDeleteCascade-915753827 None] Volume volume-e69c1806-da20-4183-8c2b-7f56008919a0 (e69c1806-da20-4183-8c2b-7f56008919a0): created successfully Nov 06 11:52:45 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-1ca64527-83d5-47c7-a79f-613e2c9e5c9d tempest-VolumesDeleteCascade-915753827 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff2b9949-f36d-43da-a87b-31b082b61157) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:52:45 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-1ca64527-83d5-47c7-a79f-613e2c9e5c9d tempest-VolumesDeleteCascade-915753827 None] Flow 'volume_create_manager' (1a1653ea-4e1f-479e-81d6-0743bc627233) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 11:52:45 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-1ca64527-83d5-47c7-a79f-613e2c9e5c9d tempest-VolumesDeleteCascade-915753827 None] Created volume successfully. Nov 06 11:52:46 devstack sudo[98768]: pam_unix(sudo:session): session closed for user root Nov 06 11:52:46 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-dbf72921-98de-4d95-a10c-2e71929475c2 tempest-VolumesActionsTest-1082049010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-07f7eafd-f454-4ca3-9d82-7f4535375548 1073741824" returned: 0 in 0.576s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:52:46 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-dbf72921-98de-4d95-a10c-2e71929475c2 tempest-VolumesActionsTest-1082049010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-07f7eafd-f454-4ca3-9d82-7f4535375548 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:52:46 devstack sudo[98775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-07f7eafd-f454-4ca3-9d82-7f4535375548 Nov 06 11:52:46 devstack sudo[98775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:52:46 devstack sudo[98775]: pam_unix(sudo:session): session closed for user root Nov 06 11:52:46 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-dbf72921-98de-4d95-a10c-2e71929475c2 tempest-VolumesActionsTest-1082049010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-07f7eafd-f454-4ca3-9d82-7f4535375548" returned: 0 in 0.307s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:52:46 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-dbf72921-98de-4d95-a10c-2e71929475c2 tempest-VolumesActionsTest-1082049010 None] <== create_volume: return (950ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f'} {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 11:52:46 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-dbf72921-98de-4d95-a10c-2e71929475c2 tempest-VolumesActionsTest-1082049010 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.953s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 11:52:46 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [req-6c5a26c1-0477-423f-8dcb-6e31e63ab5d7 req-6b2aaae7-016a-431c-a436-4ae23e9bbe7d tempest-TestInstancesWithCinderVolumes-778023409 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 3.455s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 11:52:46 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [req-6c5a26c1-0477-423f-8dcb-6e31e63ab5d7 req-6b2aaae7-016a-431c-a436-4ae23e9bbe7d tempest-TestInstancesWithCinderVolumes-778023409 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.021s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 11:52:46 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-dbf72921-98de-4d95-a10c-2e71929475c2 tempest-VolumesActionsTest-1082049010 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (30a51a86-d7aa-4711-bfe3-cd968eb53e5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-07f7eafd-f454-4ca3-9d82-7f4535375548', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:52:46 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-dbf72921-98de-4d95-a10c-2e71929475c2 tempest-VolumesActionsTest-1082049010 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ac639b45-c1da-44bc-8d12-01187c1486f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:52:46 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-dbf72921-98de-4d95-a10c-2e71929475c2 tempest-VolumesActionsTest-1082049010 None] Volume volume-07f7eafd-f454-4ca3-9d82-7f4535375548 (07f7eafd-f454-4ca3-9d82-7f4535375548): created successfully Nov 06 11:52:46 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-dbf72921-98de-4d95-a10c-2e71929475c2 tempest-VolumesActionsTest-1082049010 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ac639b45-c1da-44bc-8d12-01187c1486f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:52:46 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-dbf72921-98de-4d95-a10c-2e71929475c2 tempest-VolumesActionsTest-1082049010 None] Flow 'volume_create_manager' (56fa62ee-f745-416d-ad06-18ea486d07b1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 11:52:46 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-dbf72921-98de-4d95-a10c-2e71929475c2 tempest-VolumesActionsTest-1082049010 None] Created volume successfully. Nov 06 11:52:46 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [req-6c5a26c1-0477-423f-8dcb-6e31e63ab5d7 req-6b2aaae7-016a-431c-a436-4ae23e9bbe7d tempest-TestInstancesWithCinderVolumes-778023409 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f', 'name': 'volume-8df52254-632f-4669-ba3d-a52aa38c509a', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '3ef81fbb-f2b0-407c-a006-29d91451abc2', 'enforce_multipath': True} {{(pid=87116) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 06 11:52:46 devstack cinder-volume[87116]: INFO cinder.volume.manager [req-6c5a26c1-0477-423f-8dcb-6e31e63ab5d7 req-6b2aaae7-016a-431c-a436-4ae23e9bbe7d tempest-TestInstancesWithCinderVolumes-778023409 None] attachment_update completed successfully. Nov 06 11:52:46 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-9b6945e4-871f-4742-a614-d77c4c6c42de tempest-VolumesDeleteCascade-915753827 None] Acquiring lock "cinder-3a1e2661-d20b-4271-8369-e3a9fb578dcd-delete_volume" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 11:52:46 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-9b6945e4-871f-4742-a614-d77c4c6c42de tempest-VolumesDeleteCascade-915753827 None] Lock "cinder-3a1e2661-d20b-4271-8369-e3a9fb578dcd-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 11:52:46 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-9b6945e4-871f-4742-a614-d77c4c6c42de tempest-VolumesDeleteCascade-915753827 None] Performing cascade delete. {{(pid=87116) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Nov 06 11:52:46 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-9b6945e4-871f-4742-a614-d77c4c6c42de tempest-VolumesDeleteCascade-915753827 None] Acquiring lock "cinder-525bdfae-17b5-48a0-aee6-e30ac55b42a6-delete_snapshot" by "delete_snapshot" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 11:52:47 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-9b6945e4-871f-4742-a614-d77c4c6c42de tempest-VolumesDeleteCascade-915753827 None] Lock "cinder-525bdfae-17b5-48a0-aee6-e30ac55b42a6-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 11:52:47 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-9b6945e4-871f-4742-a614-d77c4c6c42de tempest-VolumesDeleteCascade-915753827 None] Acquiring lock "cinder-quobyte-3a1e2661-d20b-4271-8369-e3a9fb578dcd" by "delete_snapshot" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 11:52:47 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-9b6945e4-871f-4742-a614-d77c4c6c42de tempest-VolumesDeleteCascade-915753827 None] Lock "cinder-quobyte-3a1e2661-d20b-4271-8369-e3a9fb578dcd" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 11:52:47 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-9b6945e4-871f-4742-a614-d77c4c6c42de tempest-VolumesDeleteCascade-915753827 None] Acquiring lock "cinder-quobyte-525bdfae-17b5-48a0-aee6-e30ac55b42a6" by "_delete_snapshot" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 11:52:47 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-9b6945e4-871f-4742-a614-d77c4c6c42de tempest-VolumesDeleteCascade-915753827 None] Lock "cinder-quobyte-525bdfae-17b5-48a0-aee6-e30ac55b42a6" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 11:52:47 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-9b6945e4-871f-4742-a614-d77c4c6c42de tempest-VolumesDeleteCascade-915753827 None] Deleting offline snapshot 525bdfae-17b5-48a0-aee6-e30ac55b42a6 of volume 3a1e2661-d20b-4271-8369-e3a9fb578dcd {{(pid=87116) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 06 11:52:47 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-9b6945e4-871f-4742-a614-d77c4c6c42de tempest-VolumesDeleteCascade-915753827 None] snapshot_file for this snap is: volume-3a1e2661-d20b-4271-8369-e3a9fb578dcd.525bdfae-17b5-48a0-aee6-e30ac55b42a6 {{(pid=87116) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 06 11:52:47 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8adbe58-9312-46e9-9b9f-a39a6a25677f]: (4, 'qcow2') {{(pid=88420) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 11:52:47 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-9b6945e4-871f-4742-a614-d77c4c6c42de tempest-VolumesDeleteCascade-915753827 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-3a1e2661-d20b-4271-8369-e3a9fb578dcd.525bdfae-17b5-48a0-aee6-e30ac55b42a6 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:52:47 devstack sudo[98778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-3a1e2661-d20b-4271-8369-e3a9fb578dcd.525bdfae-17b5-48a0-aee6-e30ac55b42a6 Nov 06 11:52:47 devstack sudo[98778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:52:47 devstack sudo[98778]: pam_unix(sudo:session): session closed for user root Nov 06 11:52:47 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-9b6945e4-871f-4742-a614-d77c4c6c42de tempest-VolumesDeleteCascade-915753827 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-3a1e2661-d20b-4271-8369-e3a9fb578dcd.525bdfae-17b5-48a0-aee6-e30ac55b42a6" returned: 0 in 0.777s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:52:47 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-9b6945e4-871f-4742-a614-d77c4c6c42de tempest-VolumesDeleteCascade-915753827 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3a1e2661-d20b-4271-8369-e3a9fb578dcd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87116) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 11:52:47 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e5aabe2-f913-478a-8998-4c98d17ea2de]: (4, 'qcow2') {{(pid=88420) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 11:52:47 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-9b6945e4-871f-4742-a614-d77c4c6c42de tempest-VolumesDeleteCascade-915753827 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-3a1e2661-d20b-4271-8369-e3a9fb578dcd {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:52:48 devstack sudo[98896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-3a1e2661-d20b-4271-8369-e3a9fb578dcd Nov 06 11:52:48 devstack sudo[98896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:52:48 devstack sudo[98896]: pam_unix(sudo:session): session closed for user root Nov 06 11:52:48 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-9b6945e4-871f-4742-a614-d77c4c6c42de tempest-VolumesDeleteCascade-915753827 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-3a1e2661-d20b-4271-8369-e3a9fb578dcd" returned: 0 in 0.905s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:52:48 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-9b6945e4-871f-4742-a614-d77c4c6c42de tempest-VolumesDeleteCascade-915753827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-3a1e2661-d20b-4271-8369-e3a9fb578dcd.525bdfae-17b5-48a0-aee6-e30ac55b42a6 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:52:48 devstack sudo[99264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-3a1e2661-d20b-4271-8369-e3a9fb578dcd.525bdfae-17b5-48a0-aee6-e30ac55b42a6 Nov 06 11:52:48 devstack sudo[99264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:52:49 devstack sudo[99264]: pam_unix(sudo:session): session closed for user root Nov 06 11:52:49 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-9b6945e4-871f-4742-a614-d77c4c6c42de tempest-VolumesDeleteCascade-915753827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-3a1e2661-d20b-4271-8369-e3a9fb578dcd.525bdfae-17b5-48a0-aee6-e30ac55b42a6" returned: 0 in 0.627s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:52:49 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-9b6945e4-871f-4742-a614-d77c4c6c42de tempest-VolumesDeleteCascade-915753827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-3a1e2661-d20b-4271-8369-e3a9fb578dcd.525bdfae-17b5-48a0-aee6-e30ac55b42a6 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:52:49 devstack sudo[99273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-3a1e2661-d20b-4271-8369-e3a9fb578dcd.525bdfae-17b5-48a0-aee6-e30ac55b42a6 Nov 06 11:52:49 devstack sudo[99273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:52:50 devstack sudo[99273]: pam_unix(sudo:session): session closed for user root Nov 06 11:52:50 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-9b6945e4-871f-4742-a614-d77c4c6c42de tempest-VolumesDeleteCascade-915753827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-3a1e2661-d20b-4271-8369-e3a9fb578dcd.525bdfae-17b5-48a0-aee6-e30ac55b42a6" returned: 0 in 0.716s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:52:50 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-9b6945e4-871f-4742-a614-d77c4c6c42de tempest-VolumesDeleteCascade-915753827 None] Lock "cinder-quobyte-525bdfae-17b5-48a0-aee6-e30ac55b42a6" released by "_delete_snapshot" :: held 3.275s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 11:52:50 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-9b6945e4-871f-4742-a614-d77c4c6c42de tempest-VolumesDeleteCascade-915753827 None] Lock "cinder-quobyte-3a1e2661-d20b-4271-8369-e3a9fb578dcd" released by "delete_snapshot" :: held 3.326s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 11:52:50 devstack cinder-volume[87116]: DEBUG cinder.quota [None req-9b6945e4-871f-4742-a614-d77c4c6c42de tempest-VolumesDeleteCascade-915753827 None] Created reservations ['bd5d355d-5207-4c6e-96cc-ebacb07e3e09', '40d812bd-ff43-4280-ac23-4d98b2bdcb10', '972c56e7-76bc-4e2f-a3f3-78185c18e250', '67a0b8f7-5ec6-4365-b9d3-1316d658fe8b'] {{(pid=87116) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 11:52:50 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-9b6945e4-871f-4742-a614-d77c4c6c42de tempest-VolumesDeleteCascade-915753827 None] Delete snapshot completed successfully. Nov 06 11:52:50 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-9b6945e4-871f-4742-a614-d77c4c6c42de tempest-VolumesDeleteCascade-915753827 None] Lock "cinder-525bdfae-17b5-48a0-aee6-e30ac55b42a6-delete_snapshot" released by "delete_snapshot" :: held 3.704s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 11:52:50 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-9b6945e4-871f-4742-a614-d77c4c6c42de tempest-VolumesDeleteCascade-915753827 None] Snapshots deleted, issuing volume delete {{(pid=87116) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Nov 06 11:52:50 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-9b6945e4-871f-4742-a614-d77c4c6c42de tempest-VolumesDeleteCascade-915753827 None] Acquiring lock "cinder-quobyte-3a1e2661-d20b-4271-8369-e3a9fb578dcd" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 11:52:50 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-9b6945e4-871f-4742-a614-d77c4c6c42de tempest-VolumesDeleteCascade-915753827 None] Lock "cinder-quobyte-3a1e2661-d20b-4271-8369-e3a9fb578dcd" acquired by "delete_volume" :: waited 0.050s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 11:52:50 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[6145da24-ed1f-43c0-8009-f6c1d2fb0aef]: (4, 'qcow2') {{(pid=88420) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 11:52:50 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-9b6945e4-871f-4742-a614-d77c4c6c42de tempest-VolumesDeleteCascade-915753827 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-3a1e2661-d20b-4271-8369-e3a9fb578dcd {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:52:51 devstack sudo[99281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-3a1e2661-d20b-4271-8369-e3a9fb578dcd Nov 06 11:52:51 devstack sudo[99281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:52:51 devstack sudo[99281]: pam_unix(sudo:session): session closed for user root Nov 06 11:52:51 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-9b6945e4-871f-4742-a614-d77c4c6c42de tempest-VolumesDeleteCascade-915753827 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-3a1e2661-d20b-4271-8369-e3a9fb578dcd" returned: 0 in 0.814s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:52:51 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-9b6945e4-871f-4742-a614-d77c4c6c42de tempest-VolumesDeleteCascade-915753827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-3a1e2661-d20b-4271-8369-e3a9fb578dcd {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:52:51 devstack sudo[99286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-3a1e2661-d20b-4271-8369-e3a9fb578dcd Nov 06 11:52:51 devstack sudo[99286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:52:52 devstack sudo[99286]: pam_unix(sudo:session): session closed for user root Nov 06 11:52:52 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-9b6945e4-871f-4742-a614-d77c4c6c42de tempest-VolumesDeleteCascade-915753827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-3a1e2661-d20b-4271-8369-e3a9fb578dcd" returned: 0 in 0.502s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:52:52 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-9b6945e4-871f-4742-a614-d77c4c6c42de tempest-VolumesDeleteCascade-915753827 None] Lock "cinder-quobyte-3a1e2661-d20b-4271-8369-e3a9fb578dcd" released by "delete_volume" :: held 1.451s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 11:52:52 devstack cinder-volume[87116]: DEBUG cinder.quota [None req-9b6945e4-871f-4742-a614-d77c4c6c42de tempest-VolumesDeleteCascade-915753827 None] Created reservations ['f9a848e2-95f5-481a-8e43-5f1aa485d89c', 'ea30043f-d85b-4262-a926-34f3ca4d8a13', '30eb5fd5-5414-4691-9deb-a98f5f926683', 'f9b7c93f-2099-44e6-8432-8e569c7bd1c1'] {{(pid=87116) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 11:52:52 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-9b6945e4-871f-4742-a614-d77c4c6c42de tempest-VolumesDeleteCascade-915753827 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 11:52:52 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-9b6945e4-871f-4742-a614-d77c4c6c42de tempest-VolumesDeleteCascade-915753827 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 11:52:52 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-9b6945e4-871f-4742-a614-d77c4c6c42de tempest-VolumesDeleteCascade-915753827 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 11:52:52 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-9b6945e4-871f-4742-a614-d77c4c6c42de tempest-VolumesDeleteCascade-915753827 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 11:52:52 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-9b6945e4-871f-4742-a614-d77c4c6c42de tempest-VolumesDeleteCascade-915753827 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 11:52:52 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-9b6945e4-871f-4742-a614-d77c4c6c42de tempest-VolumesDeleteCascade-915753827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:52:52 devstack sudo[99292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756 Nov 06 11:52:52 devstack sudo[99292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:52:53 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-83811bec-f748-49f0-a4a7-0670f1440c79 tempest-VolumesDeleteCascade-915753827 None] Acquiring lock "cinder-e69c1806-da20-4183-8c2b-7f56008919a0-delete_volume" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 11:52:53 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-83811bec-f748-49f0-a4a7-0670f1440c79 tempest-VolumesDeleteCascade-915753827 None] Lock "cinder-e69c1806-da20-4183-8c2b-7f56008919a0-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 11:52:53 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-83811bec-f748-49f0-a4a7-0670f1440c79 tempest-VolumesDeleteCascade-915753827 None] Acquiring lock "cinder-quobyte-e69c1806-da20-4183-8c2b-7f56008919a0" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 11:52:53 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-83811bec-f748-49f0-a4a7-0670f1440c79 tempest-VolumesDeleteCascade-915753827 None] Lock "cinder-quobyte-e69c1806-da20-4183-8c2b-7f56008919a0" acquired by "delete_volume" :: waited 0.047s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 11:52:53 devstack sudo[99292]: pam_unix(sudo:session): session closed for user root Nov 06 11:52:53 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4cbd810-c8fc-4172-8be8-c0ad9c55a660]: (4, 'qcow2') {{(pid=88420) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 11:52:53 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-83811bec-f748-49f0-a4a7-0670f1440c79 tempest-VolumesDeleteCascade-915753827 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-e69c1806-da20-4183-8c2b-7f56008919a0 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:52:53 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-9b6945e4-871f-4742-a614-d77c4c6c42de tempest-VolumesDeleteCascade-915753827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756" returned: 0 in 0.810s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:52:53 devstack cinder-volume[87116]: DEBUG cinder.manager [None req-9b6945e4-871f-4742-a614-d77c4c6c42de tempest-VolumesDeleteCascade-915753827 None] Notifying Schedulers of capabilities ... {{(pid=87116) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 11:52:53 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-9b6945e4-871f-4742-a614-d77c4c6c42de tempest-VolumesDeleteCascade-915753827 None] Deleted volume successfully. Nov 06 11:52:53 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-9b6945e4-871f-4742-a614-d77c4c6c42de tempest-VolumesDeleteCascade-915753827 None] Lock "cinder-3a1e2661-d20b-4271-8369-e3a9fb578dcd-delete_volume" released by "delete_volume" :: held 6.630s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 11:52:53 devstack sudo[99308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-e69c1806-da20-4183-8c2b-7f56008919a0 Nov 06 11:52:53 devstack sudo[99308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:52:54 devstack sudo[99308]: pam_unix(sudo:session): session closed for user root Nov 06 11:52:54 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-83811bec-f748-49f0-a4a7-0670f1440c79 tempest-VolumesDeleteCascade-915753827 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-e69c1806-da20-4183-8c2b-7f56008919a0" returned: 0 in 0.644s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:52:54 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-83811bec-f748-49f0-a4a7-0670f1440c79 tempest-VolumesDeleteCascade-915753827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-e69c1806-da20-4183-8c2b-7f56008919a0 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:52:54 devstack sudo[99316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-e69c1806-da20-4183-8c2b-7f56008919a0 Nov 06 11:52:54 devstack sudo[99316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:52:54 devstack sudo[99316]: pam_unix(sudo:session): session closed for user root Nov 06 11:52:54 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-83811bec-f748-49f0-a4a7-0670f1440c79 tempest-VolumesDeleteCascade-915753827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-e69c1806-da20-4183-8c2b-7f56008919a0" returned: 0 in 0.463s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:52:54 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-83811bec-f748-49f0-a4a7-0670f1440c79 tempest-VolumesDeleteCascade-915753827 None] Lock "cinder-quobyte-e69c1806-da20-4183-8c2b-7f56008919a0" released by "delete_volume" :: held 1.223s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 11:52:54 devstack cinder-volume[87116]: DEBUG cinder.quota [None req-83811bec-f748-49f0-a4a7-0670f1440c79 tempest-VolumesDeleteCascade-915753827 None] Created reservations ['e6706513-9673-4481-be6a-9740075aa0f4', '1c783d03-2dfd-4969-86e8-3785a902899c', 'ae44c5b7-9dbc-4cc2-9a85-70842104b7f1', 'e0518282-2b67-4ddf-a58f-b789ac395a14'] {{(pid=87116) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 11:52:54 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-83811bec-f748-49f0-a4a7-0670f1440c79 tempest-VolumesDeleteCascade-915753827 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 11:52:54 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-83811bec-f748-49f0-a4a7-0670f1440c79 tempest-VolumesDeleteCascade-915753827 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 11:52:54 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-83811bec-f748-49f0-a4a7-0670f1440c79 tempest-VolumesDeleteCascade-915753827 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 11:52:54 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-83811bec-f748-49f0-a4a7-0670f1440c79 tempest-VolumesDeleteCascade-915753827 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 11:52:54 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-83811bec-f748-49f0-a4a7-0670f1440c79 tempest-VolumesDeleteCascade-915753827 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 11:52:54 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-83811bec-f748-49f0-a4a7-0670f1440c79 tempest-VolumesDeleteCascade-915753827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:52:54 devstack sudo[99319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756 Nov 06 11:52:54 devstack sudo[99319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:52:55 devstack sudo[99319]: pam_unix(sudo:session): session closed for user root Nov 06 11:52:55 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-83811bec-f748-49f0-a4a7-0670f1440c79 tempest-VolumesDeleteCascade-915753827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756" returned: 0 in 0.457s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:52:55 devstack cinder-volume[87116]: DEBUG cinder.manager [None req-83811bec-f748-49f0-a4a7-0670f1440c79 tempest-VolumesDeleteCascade-915753827 None] Notifying Schedulers of capabilities ... {{(pid=87116) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 11:52:55 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-83811bec-f748-49f0-a4a7-0670f1440c79 tempest-VolumesDeleteCascade-915753827 None] Deleted volume successfully. Nov 06 11:52:55 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-83811bec-f748-49f0-a4a7-0670f1440c79 tempest-VolumesDeleteCascade-915753827 None] Lock "cinder-e69c1806-da20-4183-8c2b-7f56008919a0-delete_volume" released by "delete_volume" :: held 2.318s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 11:53:04 devstack cinder-volume[87116]: DEBUG dbcounter [-] [87116] Writing DB stats cinder:SELECT=64,cinder:UPDATE=70,cinder:DELETE=6,cinder:INSERT=24 {{(pid=87116) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 11:53:05 devstack cinder-volume[87116]: DEBUG dbcounter [-] [87116] Writing DB stats cinder:UPDATE=37,cinder:DELETE=3,cinder:SELECT=38,cinder:INSERT=11 {{(pid=87116) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 11:53:08 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-455f032c-c09d-4072-ac0c-dc94a1e9b0ba tempest-VolumesActionsTest-1082049010 None] Acquiring lock "cinder-07f7eafd-f454-4ca3-9d82-7f4535375548" by "attach_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 11:53:08 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-455f032c-c09d-4072-ac0c-dc94a1e9b0ba tempest-VolumesActionsTest-1082049010 None] Lock "cinder-07f7eafd-f454-4ca3-9d82-7f4535375548" acquired by "attach_volume" :: waited 0.047s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 11:53:08 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-455f032c-c09d-4072-ac0c-dc94a1e9b0ba tempest-VolumesActionsTest-1082049010 None] Attaching volume 07f7eafd-f454-4ca3-9d82-7f4535375548 to instance f3f487dc-354b-4d71-9c8b-9e50c752cb9c at mountpoint /dev/vdb on host None. Nov 06 11:53:08 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-455f032c-c09d-4072-ac0c-dc94a1e9b0ba tempest-VolumesActionsTest-1082049010 None] Attach volume completed successfully. Nov 06 11:53:08 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-455f032c-c09d-4072-ac0c-dc94a1e9b0ba tempest-VolumesActionsTest-1082049010 None] Lock "cinder-07f7eafd-f454-4ca3-9d82-7f4535375548" released by "attach_volume" :: held 0.221s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 11:53:09 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-3e771ec7-ab6b-4532-8e57-de004290a3d6 tempest-VolumesActionsTest-1082049010 None] Acquiring lock "cinder-07f7eafd-f454-4ca3-9d82-7f4535375548-detach_volume" by "detach_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 11:53:09 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-3e771ec7-ab6b-4532-8e57-de004290a3d6 tempest-VolumesActionsTest-1082049010 None] Lock "cinder-07f7eafd-f454-4ca3-9d82-7f4535375548-detach_volume" acquired by "detach_volume" :: waited 0.073s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 11:53:09 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-3e771ec7-ab6b-4532-8e57-de004290a3d6 tempest-VolumesActionsTest-1082049010 None] Detaching volume 07f7eafd-f454-4ca3-9d82-7f4535375548 from instance f3f487dc-354b-4d71-9c8b-9e50c752cb9c. Nov 06 11:53:09 devstack cinder-volume[87116]: DEBUG cinder.volume.flows.manager.create_volume [None req-8d747ef0-ecf8-4d18-a2b3-b1b5c5881a02 tempest-VolumesTransfersTest-1739953614 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87116) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 11:53:09 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-8d747ef0-ecf8-4d18-a2b3-b1b5c5881a02 tempest-VolumesTransfersTest-1739953614 None] Flow 'volume_create_manager' (dc085666-11f1-463c-a870-5c612cd3062f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 11:53:09 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-8d747ef0-ecf8-4d18-a2b3-b1b5c5881a02 tempest-VolumesTransfersTest-1739953614 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fdaeb4e1-be6f-4d91-b20e-7e4a6633f3cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:53:09 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-8d747ef0-ecf8-4d18-a2b3-b1b5c5881a02 tempest-VolumesTransfersTest-1739953614 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fdaeb4e1-be6f-4d91-b20e-7e4a6633f3cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T10:53:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1808594324',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=208340b2-9634-49be-a581-a388aed42aee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e5ba2438a7dc4909b369846cac38b6be',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T10:53:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T10:53:09Z,use_quota=True,user_id='3d56ed4c998743698c6ca9a17630bc66',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(34d3b144-d9b7-480a-a2e3-01e45f3d54c1),volume_type_id=34d3b144-d9b7-480a-a2e3-01e45f3d54c1)' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:53:09 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-8d747ef0-ecf8-4d18-a2b3-b1b5c5881a02 tempest-VolumesTransfersTest-1739953614 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4516619b-ce40-4c97-a57d-27f37eb422ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:53:09 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-8d747ef0-ecf8-4d18-a2b3-b1b5c5881a02 tempest-VolumesTransfersTest-1739953614 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4516619b-ce40-4c97-a57d-27f37eb422ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:53:09 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-8d747ef0-ecf8-4d18-a2b3-b1b5c5881a02 tempest-VolumesTransfersTest-1739953614 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a65b59b3-1243-4eb8-aa96-77ae2b851f76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:53:09 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-8d747ef0-ecf8-4d18-a2b3-b1b5c5881a02 tempest-VolumesTransfersTest-1739953614 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a65b59b3-1243-4eb8-aa96-77ae2b851f76) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '208340b2-9634-49be-a581-a388aed42aee', 'volume_name': 'volume-208340b2-9634-49be-a581-a388aed42aee', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:53:09 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-8d747ef0-ecf8-4d18-a2b3-b1b5c5881a02 tempest-VolumesTransfersTest-1739953614 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (875b8628-2068-4edd-885f-0b459e8a408f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:53:09 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-8d747ef0-ecf8-4d18-a2b3-b1b5c5881a02 tempest-VolumesTransfersTest-1739953614 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (875b8628-2068-4edd-885f-0b459e8a408f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:53:09 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-8d747ef0-ecf8-4d18-a2b3-b1b5c5881a02 tempest-VolumesTransfersTest-1739953614 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5440a97e-7b31-4534-bda7-8ba8f42949aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:53:09 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-8d747ef0-ecf8-4d18-a2b3-b1b5c5881a02 tempest-VolumesTransfersTest-1739953614 None] Volume 208340b2-9634-49be-a581-a388aed42aee: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-208340b2-9634-49be-a581-a388aed42aee', 'volume_size': 1} Nov 06 11:53:09 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-8d747ef0-ecf8-4d18-a2b3-b1b5c5881a02 tempest-VolumesTransfersTest-1739953614 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 11:53:09 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-8d747ef0-ecf8-4d18-a2b3-b1b5c5881a02 tempest-VolumesTransfersTest-1739953614 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 11:53:09 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-8d747ef0-ecf8-4d18-a2b3-b1b5c5881a02 tempest-VolumesTransfersTest-1739953614 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T10:53:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1808594324',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=208340b2-9634-49be-a581-a388aed42aee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e5ba2438a7dc4909b369846cac38b6be',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T10:53:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T10:53:09Z,use_quota=True,user_id='3d56ed4c998743698c6ca9a17630bc66',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(34d3b144-d9b7-480a-a2e3-01e45f3d54c1),volume_type_id=34d3b144-d9b7-480a-a2e3-01e45f3d54c1)}" {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 11:53:09 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-8d747ef0-ecf8-4d18-a2b3-b1b5c5881a02 tempest-VolumesTransfersTest-1739953614 None] Creating volume 208340b2-9634-49be-a581-a388aed42aee {{(pid=87116) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 11:53:09 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-8d747ef0-ecf8-4d18-a2b3-b1b5c5881a02 tempest-VolumesTransfersTest-1739953614 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 11:53:09 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-8d747ef0-ecf8-4d18-a2b3-b1b5c5881a02 tempest-VolumesTransfersTest-1739953614 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 11:53:09 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-8d747ef0-ecf8-4d18-a2b3-b1b5c5881a02 tempest-VolumesTransfersTest-1739953614 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 11:53:09 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-8d747ef0-ecf8-4d18-a2b3-b1b5c5881a02 tempest-VolumesTransfersTest-1739953614 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 11:53:09 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-8d747ef0-ecf8-4d18-a2b3-b1b5c5881a02 tempest-VolumesTransfersTest-1739953614 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.066s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 11:53:09 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-8d747ef0-ecf8-4d18-a2b3-b1b5c5881a02 tempest-VolumesTransfersTest-1739953614 None] Selected osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f as target Quobyte volume. {{(pid=87116) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 11:53:09 devstack cinder-volume[87116]: INFO cinder.volume.drivers.remotefs [None req-8d747ef0-ecf8-4d18-a2b3-b1b5c5881a02 tempest-VolumesTransfersTest-1739953614 None] casted to osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f Nov 06 11:53:09 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-8d747ef0-ecf8-4d18-a2b3-b1b5c5881a02 tempest-VolumesTransfersTest-1739953614 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-208340b2-9634-49be-a581-a388aed42aee 1073741824 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:53:09 devstack sudo[99432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-208340b2-9634-49be-a581-a388aed42aee 1073741824 Nov 06 11:53:09 devstack sudo[99432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:53:09 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-3e771ec7-ab6b-4532-8e57-de004290a3d6 tempest-VolumesActionsTest-1082049010 None] Detach volume completed successfully. Nov 06 11:53:09 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-3e771ec7-ab6b-4532-8e57-de004290a3d6 tempest-VolumesActionsTest-1082049010 None] Lock "cinder-07f7eafd-f454-4ca3-9d82-7f4535375548-detach_volume" released by "detach_volume" :: held 0.590s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 11:53:10 devstack sudo[99432]: pam_unix(sudo:session): session closed for user root Nov 06 11:53:10 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-8d747ef0-ecf8-4d18-a2b3-b1b5c5881a02 tempest-VolumesTransfersTest-1739953614 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-208340b2-9634-49be-a581-a388aed42aee 1073741824" returned: 0 in 0.915s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:53:10 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-8d747ef0-ecf8-4d18-a2b3-b1b5c5881a02 tempest-VolumesTransfersTest-1739953614 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-208340b2-9634-49be-a581-a388aed42aee {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:53:10 devstack sudo[99441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-208340b2-9634-49be-a581-a388aed42aee Nov 06 11:53:10 devstack sudo[99441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:53:11 devstack sudo[99441]: pam_unix(sudo:session): session closed for user root Nov 06 11:53:11 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-8d747ef0-ecf8-4d18-a2b3-b1b5c5881a02 tempest-VolumesTransfersTest-1739953614 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-208340b2-9634-49be-a581-a388aed42aee" returned: 0 in 0.459s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:53:11 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-8d747ef0-ecf8-4d18-a2b3-b1b5c5881a02 tempest-VolumesTransfersTest-1739953614 None] <== create_volume: return (1531ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f'} {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 11:53:11 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-8d747ef0-ecf8-4d18-a2b3-b1b5c5881a02 tempest-VolumesTransfersTest-1739953614 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.547s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 11:53:11 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-8d747ef0-ecf8-4d18-a2b3-b1b5c5881a02 tempest-VolumesTransfersTest-1739953614 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5440a97e-7b31-4534-bda7-8ba8f42949aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-208340b2-9634-49be-a581-a388aed42aee', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:53:11 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-8d747ef0-ecf8-4d18-a2b3-b1b5c5881a02 tempest-VolumesTransfersTest-1739953614 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (556ba18e-f202-414c-a2e3-eb42ab85f701) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:53:11 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-8d747ef0-ecf8-4d18-a2b3-b1b5c5881a02 tempest-VolumesTransfersTest-1739953614 None] Volume volume-208340b2-9634-49be-a581-a388aed42aee (208340b2-9634-49be-a581-a388aed42aee): created successfully Nov 06 11:53:11 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-8d747ef0-ecf8-4d18-a2b3-b1b5c5881a02 tempest-VolumesTransfersTest-1739953614 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (556ba18e-f202-414c-a2e3-eb42ab85f701) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:53:11 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-8d747ef0-ecf8-4d18-a2b3-b1b5c5881a02 tempest-VolumesTransfersTest-1739953614 None] Flow 'volume_create_manager' (dc085666-11f1-463c-a870-5c612cd3062f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 11:53:11 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-8d747ef0-ecf8-4d18-a2b3-b1b5c5881a02 tempest-VolumesTransfersTest-1739953614 None] Created volume successfully. Nov 06 11:53:12 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-c65a8f2a-96ec-411f-9c1d-8a3259d7764f tempest-VolumesTransfersTest-1678748798 None] Transfer volume completed successfully. Nov 06 11:53:13 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-e02b8783-ae56-41d2-90bd-81a298b4cde5 tempest-VolumesTransfersTest-678722714 None] Acquiring lock "cinder-208340b2-9634-49be-a581-a388aed42aee-delete_volume" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 11:53:13 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-e02b8783-ae56-41d2-90bd-81a298b4cde5 tempest-VolumesTransfersTest-678722714 None] Lock "cinder-208340b2-9634-49be-a581-a388aed42aee-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 11:53:13 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-e02b8783-ae56-41d2-90bd-81a298b4cde5 tempest-VolumesTransfersTest-678722714 None] Acquiring lock "cinder-quobyte-208340b2-9634-49be-a581-a388aed42aee" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 11:53:13 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-e02b8783-ae56-41d2-90bd-81a298b4cde5 tempest-VolumesTransfersTest-678722714 None] Lock "cinder-quobyte-208340b2-9634-49be-a581-a388aed42aee" acquired by "delete_volume" :: waited 0.016s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 11:53:13 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5cb103c-750e-4a1e-b678-16b5f1f8d223]: (4, 'qcow2') {{(pid=88420) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 11:53:13 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-e02b8783-ae56-41d2-90bd-81a298b4cde5 tempest-VolumesTransfersTest-678722714 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-208340b2-9634-49be-a581-a388aed42aee {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:53:13 devstack sudo[99464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-208340b2-9634-49be-a581-a388aed42aee Nov 06 11:53:13 devstack sudo[99464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:53:13 devstack sudo[99464]: pam_unix(sudo:session): session closed for user root Nov 06 11:53:13 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-e02b8783-ae56-41d2-90bd-81a298b4cde5 tempest-VolumesTransfersTest-678722714 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-208340b2-9634-49be-a581-a388aed42aee" returned: 0 in 0.437s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:53:13 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-e02b8783-ae56-41d2-90bd-81a298b4cde5 tempest-VolumesTransfersTest-678722714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-208340b2-9634-49be-a581-a388aed42aee {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:53:13 devstack sudo[99469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-208340b2-9634-49be-a581-a388aed42aee Nov 06 11:53:13 devstack sudo[99469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:53:13 devstack sudo[99469]: pam_unix(sudo:session): session closed for user root Nov 06 11:53:13 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-e02b8783-ae56-41d2-90bd-81a298b4cde5 tempest-VolumesTransfersTest-678722714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-208340b2-9634-49be-a581-a388aed42aee" returned: 0 in 0.297s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:53:13 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-e02b8783-ae56-41d2-90bd-81a298b4cde5 tempest-VolumesTransfersTest-678722714 None] Lock "cinder-quobyte-208340b2-9634-49be-a581-a388aed42aee" released by "delete_volume" :: held 0.788s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 11:53:13 devstack cinder-volume[87116]: DEBUG cinder.quota [None req-e02b8783-ae56-41d2-90bd-81a298b4cde5 tempest-VolumesTransfersTest-678722714 None] Created reservations ['a0e7b4f0-59db-4b4c-b368-1edf3d2a3cd6', 'eed4b2c2-93be-4c5d-a0fa-f92b055d32e6', '75c79e80-57f0-4a0a-9af3-a9fe0d4ee021', 'ad55ed47-b054-4897-822a-242ac10a95cf'] {{(pid=87116) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 11:53:14 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-e02b8783-ae56-41d2-90bd-81a298b4cde5 tempest-VolumesTransfersTest-678722714 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 11:53:14 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-e02b8783-ae56-41d2-90bd-81a298b4cde5 tempest-VolumesTransfersTest-678722714 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 11:53:14 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-e02b8783-ae56-41d2-90bd-81a298b4cde5 tempest-VolumesTransfersTest-678722714 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 11:53:14 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-e02b8783-ae56-41d2-90bd-81a298b4cde5 tempest-VolumesTransfersTest-678722714 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 11:53:14 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-e02b8783-ae56-41d2-90bd-81a298b4cde5 tempest-VolumesTransfersTest-678722714 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 11:53:14 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-e02b8783-ae56-41d2-90bd-81a298b4cde5 tempest-VolumesTransfersTest-678722714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:53:14 devstack sudo[99472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756 Nov 06 11:53:14 devstack sudo[99472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:53:14 devstack sudo[99472]: pam_unix(sudo:session): session closed for user root Nov 06 11:53:14 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-e02b8783-ae56-41d2-90bd-81a298b4cde5 tempest-VolumesTransfersTest-678722714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756" returned: 0 in 0.341s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:53:14 devstack cinder-volume[87116]: DEBUG cinder.manager [None req-e02b8783-ae56-41d2-90bd-81a298b4cde5 tempest-VolumesTransfersTest-678722714 None] Notifying Schedulers of capabilities ... {{(pid=87116) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 11:53:14 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-e02b8783-ae56-41d2-90bd-81a298b4cde5 tempest-VolumesTransfersTest-678722714 None] Deleted volume successfully. Nov 06 11:53:14 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-e02b8783-ae56-41d2-90bd-81a298b4cde5 tempest-VolumesTransfersTest-678722714 None] Lock "cinder-208340b2-9634-49be-a581-a388aed42aee-delete_volume" released by "delete_volume" :: held 1.372s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 11:53:14 devstack cinder-volume[87116]: DEBUG cinder.volume.flows.manager.create_volume [None req-f3499dfa-1aee-4b58-b8ba-7483045abf29 tempest-VolumesTransfersTest-1739953614 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87116) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 11:53:14 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-f3499dfa-1aee-4b58-b8ba-7483045abf29 tempest-VolumesTransfersTest-1739953614 None] Flow 'volume_create_manager' (bbc7a397-68d8-4287-9854-264ca9410d1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 11:53:14 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-f3499dfa-1aee-4b58-b8ba-7483045abf29 tempest-VolumesTransfersTest-1739953614 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (308960fa-01d5-415e-9650-86c958b79a2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:53:14 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-f3499dfa-1aee-4b58-b8ba-7483045abf29 tempest-VolumesTransfersTest-1739953614 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (308960fa-01d5-415e-9650-86c958b79a2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T10:53:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-2073015337',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d35bdbe5-b156-4bb0-b10e-5e2200dab44e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e5ba2438a7dc4909b369846cac38b6be',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T10:53:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T10:53:15Z,use_quota=True,user_id='3d56ed4c998743698c6ca9a17630bc66',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(34d3b144-d9b7-480a-a2e3-01e45f3d54c1),volume_type_id=34d3b144-d9b7-480a-a2e3-01e45f3d54c1)' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:53:14 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-f3499dfa-1aee-4b58-b8ba-7483045abf29 tempest-VolumesTransfersTest-1739953614 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a1a176ca-bdcc-4079-9ae6-11e5a5c670d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:53:14 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-f3499dfa-1aee-4b58-b8ba-7483045abf29 tempest-VolumesTransfersTest-1739953614 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a1a176ca-bdcc-4079-9ae6-11e5a5c670d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:53:14 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-f3499dfa-1aee-4b58-b8ba-7483045abf29 tempest-VolumesTransfersTest-1739953614 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cade58b1-3186-4ed8-9133-37cc2145bf88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:53:14 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-f3499dfa-1aee-4b58-b8ba-7483045abf29 tempest-VolumesTransfersTest-1739953614 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cade58b1-3186-4ed8-9133-37cc2145bf88) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd35bdbe5-b156-4bb0-b10e-5e2200dab44e', 'volume_name': 'volume-d35bdbe5-b156-4bb0-b10e-5e2200dab44e', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:53:14 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-f3499dfa-1aee-4b58-b8ba-7483045abf29 tempest-VolumesTransfersTest-1739953614 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d3013b86-7870-4399-85a5-ced1b76287d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:53:15 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-f3499dfa-1aee-4b58-b8ba-7483045abf29 tempest-VolumesTransfersTest-1739953614 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d3013b86-7870-4399-85a5-ced1b76287d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:53:15 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-f3499dfa-1aee-4b58-b8ba-7483045abf29 tempest-VolumesTransfersTest-1739953614 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cedc7f07-6c6a-4b49-a111-12f28ef8a589) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:53:15 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-f3499dfa-1aee-4b58-b8ba-7483045abf29 tempest-VolumesTransfersTest-1739953614 None] Volume d35bdbe5-b156-4bb0-b10e-5e2200dab44e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d35bdbe5-b156-4bb0-b10e-5e2200dab44e', 'volume_size': 1} Nov 06 11:53:15 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-f3499dfa-1aee-4b58-b8ba-7483045abf29 tempest-VolumesTransfersTest-1739953614 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 11:53:15 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-f3499dfa-1aee-4b58-b8ba-7483045abf29 tempest-VolumesTransfersTest-1739953614 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 11:53:15 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-f3499dfa-1aee-4b58-b8ba-7483045abf29 tempest-VolumesTransfersTest-1739953614 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T10:53:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-2073015337',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d35bdbe5-b156-4bb0-b10e-5e2200dab44e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e5ba2438a7dc4909b369846cac38b6be',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T10:53:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T10:53:15Z,use_quota=True,user_id='3d56ed4c998743698c6ca9a17630bc66',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(34d3b144-d9b7-480a-a2e3-01e45f3d54c1),volume_type_id=34d3b144-d9b7-480a-a2e3-01e45f3d54c1)}" {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 11:53:15 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-f3499dfa-1aee-4b58-b8ba-7483045abf29 tempest-VolumesTransfersTest-1739953614 None] Creating volume d35bdbe5-b156-4bb0-b10e-5e2200dab44e {{(pid=87116) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 11:53:15 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-f3499dfa-1aee-4b58-b8ba-7483045abf29 tempest-VolumesTransfersTest-1739953614 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 11:53:15 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-f3499dfa-1aee-4b58-b8ba-7483045abf29 tempest-VolumesTransfersTest-1739953614 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 11:53:15 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-f3499dfa-1aee-4b58-b8ba-7483045abf29 tempest-VolumesTransfersTest-1739953614 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 11:53:15 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-f3499dfa-1aee-4b58-b8ba-7483045abf29 tempest-VolumesTransfersTest-1739953614 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 11:53:15 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-f3499dfa-1aee-4b58-b8ba-7483045abf29 tempest-VolumesTransfersTest-1739953614 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 11:53:15 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-f3499dfa-1aee-4b58-b8ba-7483045abf29 tempest-VolumesTransfersTest-1739953614 None] Selected osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f as target Quobyte volume. {{(pid=87116) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 11:53:15 devstack cinder-volume[87116]: INFO cinder.volume.drivers.remotefs [None req-f3499dfa-1aee-4b58-b8ba-7483045abf29 tempest-VolumesTransfersTest-1739953614 None] casted to osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f Nov 06 11:53:15 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-f3499dfa-1aee-4b58-b8ba-7483045abf29 tempest-VolumesTransfersTest-1739953614 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-d35bdbe5-b156-4bb0-b10e-5e2200dab44e 1073741824 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:53:15 devstack sudo[99478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-d35bdbe5-b156-4bb0-b10e-5e2200dab44e 1073741824 Nov 06 11:53:15 devstack sudo[99478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:53:15 devstack sudo[99478]: pam_unix(sudo:session): session closed for user root Nov 06 11:53:15 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-f3499dfa-1aee-4b58-b8ba-7483045abf29 tempest-VolumesTransfersTest-1739953614 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-d35bdbe5-b156-4bb0-b10e-5e2200dab44e 1073741824" returned: 0 in 0.527s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:53:15 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-f3499dfa-1aee-4b58-b8ba-7483045abf29 tempest-VolumesTransfersTest-1739953614 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-d35bdbe5-b156-4bb0-b10e-5e2200dab44e {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:53:15 devstack sudo[99484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-d35bdbe5-b156-4bb0-b10e-5e2200dab44e Nov 06 11:53:15 devstack sudo[99484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:53:15 devstack sudo[99484]: pam_unix(sudo:session): session closed for user root Nov 06 11:53:15 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-f3499dfa-1aee-4b58-b8ba-7483045abf29 tempest-VolumesTransfersTest-1739953614 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-d35bdbe5-b156-4bb0-b10e-5e2200dab44e" returned: 0 in 0.399s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:53:15 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-f3499dfa-1aee-4b58-b8ba-7483045abf29 tempest-VolumesTransfersTest-1739953614 None] <== create_volume: return (981ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f'} {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 11:53:15 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-f3499dfa-1aee-4b58-b8ba-7483045abf29 tempest-VolumesTransfersTest-1739953614 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.984s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 11:53:16 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-f3499dfa-1aee-4b58-b8ba-7483045abf29 tempest-VolumesTransfersTest-1739953614 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cedc7f07-6c6a-4b49-a111-12f28ef8a589) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d35bdbe5-b156-4bb0-b10e-5e2200dab44e', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:53:16 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-f3499dfa-1aee-4b58-b8ba-7483045abf29 tempest-VolumesTransfersTest-1739953614 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f738d38d-2b5e-4275-a6ab-ebda54e3611f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:53:16 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-f3499dfa-1aee-4b58-b8ba-7483045abf29 tempest-VolumesTransfersTest-1739953614 None] Volume volume-d35bdbe5-b156-4bb0-b10e-5e2200dab44e (d35bdbe5-b156-4bb0-b10e-5e2200dab44e): created successfully Nov 06 11:53:16 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-f3499dfa-1aee-4b58-b8ba-7483045abf29 tempest-VolumesTransfersTest-1739953614 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f738d38d-2b5e-4275-a6ab-ebda54e3611f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:53:16 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-f3499dfa-1aee-4b58-b8ba-7483045abf29 tempest-VolumesTransfersTest-1739953614 None] Flow 'volume_create_manager' (bbc7a397-68d8-4287-9854-264ca9410d1c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 11:53:16 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-f3499dfa-1aee-4b58-b8ba-7483045abf29 tempest-VolumesTransfersTest-1739953614 None] Created volume successfully. Nov 06 11:53:17 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-a28ae103-b5e1-4b19-b1a2-1070152aea16 tempest-VolumesTransfersTest-678722714 None] Acquiring lock "cinder-d35bdbe5-b156-4bb0-b10e-5e2200dab44e-delete_volume" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 11:53:17 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-a28ae103-b5e1-4b19-b1a2-1070152aea16 tempest-VolumesTransfersTest-678722714 None] Lock "cinder-d35bdbe5-b156-4bb0-b10e-5e2200dab44e-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 11:53:17 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-a28ae103-b5e1-4b19-b1a2-1070152aea16 tempest-VolumesTransfersTest-678722714 None] Acquiring lock "cinder-quobyte-d35bdbe5-b156-4bb0-b10e-5e2200dab44e" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 11:53:17 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-a28ae103-b5e1-4b19-b1a2-1070152aea16 tempest-VolumesTransfersTest-678722714 None] Lock "cinder-quobyte-d35bdbe5-b156-4bb0-b10e-5e2200dab44e" acquired by "delete_volume" :: waited 0.026s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 11:53:17 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[645e429d-bfd2-4f86-b5ab-8b851feda175]: (4, 'qcow2') {{(pid=88420) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 11:53:17 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-a28ae103-b5e1-4b19-b1a2-1070152aea16 tempest-VolumesTransfersTest-678722714 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-d35bdbe5-b156-4bb0-b10e-5e2200dab44e {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:53:17 devstack sudo[99501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-d35bdbe5-b156-4bb0-b10e-5e2200dab44e Nov 06 11:53:17 devstack sudo[99501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:53:18 devstack sudo[99501]: pam_unix(sudo:session): session closed for user root Nov 06 11:53:18 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-a28ae103-b5e1-4b19-b1a2-1070152aea16 tempest-VolumesTransfersTest-678722714 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-d35bdbe5-b156-4bb0-b10e-5e2200dab44e" returned: 0 in 0.574s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:53:18 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-a28ae103-b5e1-4b19-b1a2-1070152aea16 tempest-VolumesTransfersTest-678722714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-d35bdbe5-b156-4bb0-b10e-5e2200dab44e {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:53:18 devstack sudo[99508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-d35bdbe5-b156-4bb0-b10e-5e2200dab44e Nov 06 11:53:18 devstack sudo[99508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:53:18 devstack sudo[99508]: pam_unix(sudo:session): session closed for user root Nov 06 11:53:18 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-a28ae103-b5e1-4b19-b1a2-1070152aea16 tempest-VolumesTransfersTest-678722714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-d35bdbe5-b156-4bb0-b10e-5e2200dab44e" returned: 0 in 0.294s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:53:18 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-a28ae103-b5e1-4b19-b1a2-1070152aea16 tempest-VolumesTransfersTest-678722714 None] Lock "cinder-quobyte-d35bdbe5-b156-4bb0-b10e-5e2200dab44e" released by "delete_volume" :: held 0.946s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 11:53:18 devstack cinder-volume[87116]: DEBUG cinder.quota [None req-a28ae103-b5e1-4b19-b1a2-1070152aea16 tempest-VolumesTransfersTest-678722714 None] Created reservations ['ffd2f063-26d5-4ec3-8474-e22c1bd60bb3', '9ec163e8-8f95-4c14-affb-120c004948e0', 'ace8adc2-fe5b-4b01-b934-9064b84d3a70', '6d7567ff-8b7b-4da7-adc8-426c44a508ea'] {{(pid=87116) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 11:53:18 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-a28ae103-b5e1-4b19-b1a2-1070152aea16 tempest-VolumesTransfersTest-678722714 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 11:53:18 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-a28ae103-b5e1-4b19-b1a2-1070152aea16 tempest-VolumesTransfersTest-678722714 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 11:53:18 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-a28ae103-b5e1-4b19-b1a2-1070152aea16 tempest-VolumesTransfersTest-678722714 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 11:53:18 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-a28ae103-b5e1-4b19-b1a2-1070152aea16 tempest-VolumesTransfersTest-678722714 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 11:53:18 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-a28ae103-b5e1-4b19-b1a2-1070152aea16 tempest-VolumesTransfersTest-678722714 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 11:53:18 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-a28ae103-b5e1-4b19-b1a2-1070152aea16 tempest-VolumesTransfersTest-678722714 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:53:18 devstack sudo[99521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756 Nov 06 11:53:18 devstack sudo[99521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:53:19 devstack sudo[99521]: pam_unix(sudo:session): session closed for user root Nov 06 11:53:19 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-a28ae103-b5e1-4b19-b1a2-1070152aea16 tempest-VolumesTransfersTest-678722714 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756" returned: 0 in 0.382s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:53:19 devstack cinder-volume[87116]: DEBUG cinder.manager [None req-a28ae103-b5e1-4b19-b1a2-1070152aea16 tempest-VolumesTransfersTest-678722714 None] Notifying Schedulers of capabilities ... {{(pid=87116) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 11:53:19 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-a28ae103-b5e1-4b19-b1a2-1070152aea16 tempest-VolumesTransfersTest-678722714 None] Deleted volume successfully. Nov 06 11:53:19 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-a28ae103-b5e1-4b19-b1a2-1070152aea16 tempest-VolumesTransfersTest-678722714 None] Lock "cinder-d35bdbe5-b156-4bb0-b10e-5e2200dab44e-delete_volume" released by "delete_volume" :: held 1.679s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 11:53:20 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [req-916a2dc3-1940-4519-a2b6-97912f603924 req-e8a05193-97f4-46f2-9016-dca11e18b6b2 tempest-TestInstancesWithCinderVolumes-778023409 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 11:53:20 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [req-916a2dc3-1940-4519-a2b6-97912f603924 req-e8a05193-97f4-46f2-9016-dca11e18b6b2 tempest-TestInstancesWithCinderVolumes-778023409 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 11:53:20 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [req-916a2dc3-1940-4519-a2b6-97912f603924 req-e8a05193-97f4-46f2-9016-dca11e18b6b2 tempest-TestInstancesWithCinderVolumes-778023409 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.042s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 11:53:20 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [req-916a2dc3-1940-4519-a2b6-97912f603924 req-e8a05193-97f4-46f2-9016-dca11e18b6b2 tempest-TestInstancesWithCinderVolumes-778023409 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f', 'name': 'volume-b57d0ecb-ebc7-4c22-86d6-22310eeb167d', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '7289df02-9b9c-44a9-a018-84ac645adc99', 'enforce_multipath': True} {{(pid=87116) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 06 11:53:20 devstack cinder-volume[87116]: INFO cinder.volume.manager [req-916a2dc3-1940-4519-a2b6-97912f603924 req-e8a05193-97f4-46f2-9016-dca11e18b6b2 tempest-TestInstancesWithCinderVolumes-778023409 None] attachment_update completed successfully. Nov 06 11:53:24 devstack cinder-volume[87116]: DEBUG cinder.volume.flows.manager.create_volume [None req-7124b6a6-5c40-4f39-8748-7039eb2d8e2b tempest-TestShelveInstance-1615912961 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87116) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 11:53:24 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-7124b6a6-5c40-4f39-8748-7039eb2d8e2b tempest-TestShelveInstance-1615912961 None] Flow 'volume_create_manager' (349591a3-496f-4044-acd7-9c088db67ad0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 11:53:24 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-7124b6a6-5c40-4f39-8748-7039eb2d8e2b tempest-TestShelveInstance-1615912961 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (832eb49f-1ff2-47b6-b439-df4050e7d6f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:53:24 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-7124b6a6-5c40-4f39-8748-7039eb2d8e2b tempest-TestShelveInstance-1615912961 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (832eb49f-1ff2-47b6-b439-df4050e7d6f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T10:53:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1390694279',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=14e75353-8e88-4e4d-93b1-ac70324e53c9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ac534cd97ea84af595dc0fe0e800ce2a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T10:53:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T10:53:24Z,use_quota=True,user_id='c16530eaae6848618b478779b23f8b91',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(34d3b144-d9b7-480a-a2e3-01e45f3d54c1),volume_type_id=34d3b144-d9b7-480a-a2e3-01e45f3d54c1)' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:53:24 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-7124b6a6-5c40-4f39-8748-7039eb2d8e2b tempest-TestShelveInstance-1615912961 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (573fde2a-ba53-47cf-ba49-16521170309d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:53:24 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-7124b6a6-5c40-4f39-8748-7039eb2d8e2b tempest-TestShelveInstance-1615912961 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (573fde2a-ba53-47cf-ba49-16521170309d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:53:24 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-7124b6a6-5c40-4f39-8748-7039eb2d8e2b tempest-TestShelveInstance-1615912961 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (94e4c236-650b-4142-b15c-f5b235a1cfe2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:53:24 devstack cinder-volume[87116]: DEBUG cinder.image.glance [None req-7124b6a6-5c40-4f39-8748-7039eb2d8e2b tempest-TestShelveInstance-1615912961 None] Creating Keystone auth plugin from conf {{(pid=87116) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 06 11:53:24 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-7124b6a6-5c40-4f39-8748-7039eb2d8e2b tempest-TestShelveInstance-1615912961 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (94e4c236-650b-4142-b15c-f5b235a1cfe2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '14e75353-8e88-4e4d-93b1-ac70324e53c9', 'volume_name': 'volume-14e75353-8e88-4e4d-93b1-ac70324e53c9', 'volume_size': 1, 'image_id': '423469e2-d15b-4cf9-87cd-88e68e947d3b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/423469e2-d15b-4cf9-87cd-88e68e947d3b', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b05f927c30c5407aad52949459346010', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '423469e2-d15b-4cf9-87cd-88e68e947d3b', 'created_at': datetime.datetime(2026, 11, 6, 10, 36, 49, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 6, 10, 36, 50, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/423469e2-d15b-4cf9-87cd-88e68e947d3b/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:53:24 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-7124b6a6-5c40-4f39-8748-7039eb2d8e2b tempest-TestShelveInstance-1615912961 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (df26dd9c-2b89-4001-8752-112ecb5fb8b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:53:24 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-7124b6a6-5c40-4f39-8748-7039eb2d8e2b tempest-TestShelveInstance-1615912961 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (df26dd9c-2b89-4001-8752-112ecb5fb8b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:53:24 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-7124b6a6-5c40-4f39-8748-7039eb2d8e2b tempest-TestShelveInstance-1615912961 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (959e08b6-c24e-467c-99c8-5e1c359fc007) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:53:24 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-7124b6a6-5c40-4f39-8748-7039eb2d8e2b tempest-TestShelveInstance-1615912961 None] Volume 14e75353-8e88-4e4d-93b1-ac70324e53c9: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-14e75353-8e88-4e4d-93b1-ac70324e53c9', 'volume_size': 1, 'image_id': '423469e2-d15b-4cf9-87cd-88e68e947d3b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/423469e2-d15b-4cf9-87cd-88e68e947d3b', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b05f927c30c5407aad52949459346010', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '423469e2-d15b-4cf9-87cd-88e68e947d3b', 'created_at': datetime.datetime(2026, 11, 6, 10, 36, 49, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 6, 10, 36, 50, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/423469e2-d15b-4cf9-87cd-88e68e947d3b/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Nov 06 11:53:24 devstack cinder-volume[87116]: DEBUG cinder.volume.flows.manager.create_volume [None req-7124b6a6-5c40-4f39-8748-7039eb2d8e2b tempest-TestShelveInstance-1615912961 None] Trying to clone 14e75353-8e88-4e4d-93b1-ac70324e53c9 from image 423469e2-d15b-4cf9-87cd-88e68e947d3b at location (None, [{'url': 'file:///opt/stack/data/glance/images/423469e2-d15b-4cf9-87cd-88e68e947d3b', 'metadata': {}}]). {{(pid=87116) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Nov 06 11:53:24 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [req-a1aecc77-d00e-44ad-a076-63e2bacdba50 req-00b1e7da-24b1-4eb1-a3d7-fb1ac3e9d95c tempest-TestInstancesWithCinderVolumes-778023409 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 11:53:24 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [req-a1aecc77-d00e-44ad-a076-63e2bacdba50 req-00b1e7da-24b1-4eb1-a3d7-fb1ac3e9d95c tempest-TestInstancesWithCinderVolumes-778023409 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 11:53:24 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [req-a1aecc77-d00e-44ad-a076-63e2bacdba50 req-00b1e7da-24b1-4eb1-a3d7-fb1ac3e9d95c tempest-TestInstancesWithCinderVolumes-778023409 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.086s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 11:53:25 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [req-a1aecc77-d00e-44ad-a076-63e2bacdba50 req-00b1e7da-24b1-4eb1-a3d7-fb1ac3e9d95c tempest-TestInstancesWithCinderVolumes-778023409 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f', 'name': 'volume-82f3f473-5a67-46ee-a572-d16a86aeee72', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'bc4519cf-70d4-4487-a215-b633868153d6', 'enforce_multipath': True} {{(pid=87116) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 06 11:53:25 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-022a2c62-10f8-4d95-afa9-416ca38a9c14 tempest-VolumesActionsTest-1082049010 None] Acquiring lock "cinder-07f7eafd-f454-4ca3-9d82-7f4535375548" by "attach_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 11:53:25 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-022a2c62-10f8-4d95-afa9-416ca38a9c14 tempest-VolumesActionsTest-1082049010 None] Lock "cinder-07f7eafd-f454-4ca3-9d82-7f4535375548" acquired by "attach_volume" :: waited 0.036s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 11:53:25 devstack cinder-volume[87116]: DEBUG cinder.image.image_utils [None req-7124b6a6-5c40-4f39-8748-7039eb2d8e2b tempest-TestShelveInstance-1615912961 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_423469e2-d15b-4cf9-87cd-88e68e947d3b_crmqc6b8devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87116) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Nov 06 11:53:25 devstack cinder-volume[87116]: INFO cinder.image.image_utils [None req-7124b6a6-5c40-4f39-8748-7039eb2d8e2b tempest-TestShelveInstance-1615912961 None] Image download 20.69 MB at 20.69 MB/s Nov 06 11:53:25 devstack cinder-volume[87116]: INFO cinder.volume.manager [req-a1aecc77-d00e-44ad-a076-63e2bacdba50 req-00b1e7da-24b1-4eb1-a3d7-fb1ac3e9d95c tempest-TestInstancesWithCinderVolumes-778023409 None] attachment_update completed successfully. Nov 06 11:53:25 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-022a2c62-10f8-4d95-afa9-416ca38a9c14 tempest-VolumesActionsTest-1082049010 None] Attaching volume 07f7eafd-f454-4ca3-9d82-7f4535375548 to instance ad18be1c-2275-4a84-8b97-be3de2f27394 at mountpoint /dev/vdb on host None. Nov 06 11:53:25 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cdd312b-e3af-4b5c-a8e2-4f7b8ca91a43]: (4, 'qcow2') {{(pid=88420) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 11:53:25 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-7124b6a6-5c40-4f39-8748-7039eb2d8e2b tempest-TestShelveInstance-1615912961 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_423469e2-d15b-4cf9-87cd-88e68e947d3b_crmqc6b8devstack@QuobyteHD {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:53:25 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-022a2c62-10f8-4d95-afa9-416ca38a9c14 tempest-VolumesActionsTest-1082049010 None] Attach volume completed successfully. Nov 06 11:53:25 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-022a2c62-10f8-4d95-afa9-416ca38a9c14 tempest-VolumesActionsTest-1082049010 None] Lock "cinder-07f7eafd-f454-4ca3-9d82-7f4535375548" released by "attach_volume" :: held 0.227s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 11:53:25 devstack sudo[99633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_423469e2-d15b-4cf9-87cd-88e68e947d3b_crmqc6b8devstack@QuobyteHD Nov 06 11:53:25 devstack sudo[99633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:53:26 devstack sudo[99633]: pam_unix(sudo:session): session closed for user root Nov 06 11:53:26 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-055ad7d0-55d2-4c1a-82d0-77f990655839 tempest-VolumesActionsTest-1082049010 None] Acquiring lock "cinder-07f7eafd-f454-4ca3-9d82-7f4535375548-detach_volume" by "detach_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 11:53:26 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-7124b6a6-5c40-4f39-8748-7039eb2d8e2b tempest-TestShelveInstance-1615912961 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_423469e2-d15b-4cf9-87cd-88e68e947d3b_crmqc6b8devstack@QuobyteHD" returned: 0 in 0.774s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:53:26 devstack cinder-volume[87116]: DEBUG cinder.image.image_utils [None req-7124b6a6-5c40-4f39-8748-7039eb2d8e2b tempest-TestShelveInstance-1615912961 None] Temporary image 423469e2-d15b-4cf9-87cd-88e68e947d3b is fetched for user c16530eaae6848618b478779b23f8b91. {{(pid=87116) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Nov 06 11:53:26 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-055ad7d0-55d2-4c1a-82d0-77f990655839 tempest-VolumesActionsTest-1082049010 None] Lock "cinder-07f7eafd-f454-4ca3-9d82-7f4535375548-detach_volume" acquired by "detach_volume" :: waited 0.061s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 11:53:26 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-055ad7d0-55d2-4c1a-82d0-77f990655839 tempest-VolumesActionsTest-1082049010 None] Detaching volume 07f7eafd-f454-4ca3-9d82-7f4535375548 from instance ad18be1c-2275-4a84-8b97-be3de2f27394. Nov 06 11:53:26 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bbae19f-5c4d-4d18-95c8-011a240c8f6e]: (4, 'qcow2') {{(pid=88420) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 11:53:26 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-7124b6a6-5c40-4f39-8748-7039eb2d8e2b tempest-TestShelveInstance-1615912961 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_423469e2-d15b-4cf9-87cd-88e68e947d3b_crmqc6b8devstack@QuobyteHD {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:53:26 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-055ad7d0-55d2-4c1a-82d0-77f990655839 tempest-VolumesActionsTest-1082049010 None] Detach volume completed successfully. Nov 06 11:53:26 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-055ad7d0-55d2-4c1a-82d0-77f990655839 tempest-VolumesActionsTest-1082049010 None] Lock "cinder-07f7eafd-f454-4ca3-9d82-7f4535375548-detach_volume" released by "detach_volume" :: held 0.170s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 11:53:26 devstack sudo[99641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_423469e2-d15b-4cf9-87cd-88e68e947d3b_crmqc6b8devstack@QuobyteHD Nov 06 11:53:26 devstack sudo[99641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:53:26 devstack sudo[99641]: pam_unix(sudo:session): session closed for user root Nov 06 11:53:26 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-7124b6a6-5c40-4f39-8748-7039eb2d8e2b tempest-TestShelveInstance-1615912961 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_423469e2-d15b-4cf9-87cd-88e68e947d3b_crmqc6b8devstack@QuobyteHD" returned: 0 in 0.525s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:53:26 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-7124b6a6-5c40-4f39-8748-7039eb2d8e2b tempest-TestShelveInstance-1615912961 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 11:53:26 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-7124b6a6-5c40-4f39-8748-7039eb2d8e2b tempest-TestShelveInstance-1615912961 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 11:53:26 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-7124b6a6-5c40-4f39-8748-7039eb2d8e2b tempest-TestShelveInstance-1615912961 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T10:53:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1390694279',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=14e75353-8e88-4e4d-93b1-ac70324e53c9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ac534cd97ea84af595dc0fe0e800ce2a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T10:53:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T10:53:24Z,use_quota=True,user_id='c16530eaae6848618b478779b23f8b91',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(34d3b144-d9b7-480a-a2e3-01e45f3d54c1),volume_type_id=34d3b144-d9b7-480a-a2e3-01e45f3d54c1)}" {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 11:53:26 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-7124b6a6-5c40-4f39-8748-7039eb2d8e2b tempest-TestShelveInstance-1615912961 None] Creating volume 14e75353-8e88-4e4d-93b1-ac70324e53c9 {{(pid=87116) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 11:53:26 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-7124b6a6-5c40-4f39-8748-7039eb2d8e2b tempest-TestShelveInstance-1615912961 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 11:53:26 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-7124b6a6-5c40-4f39-8748-7039eb2d8e2b tempest-TestShelveInstance-1615912961 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 11:53:26 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-7124b6a6-5c40-4f39-8748-7039eb2d8e2b tempest-TestShelveInstance-1615912961 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 11:53:26 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-7124b6a6-5c40-4f39-8748-7039eb2d8e2b tempest-TestShelveInstance-1615912961 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 11:53:26 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-7124b6a6-5c40-4f39-8748-7039eb2d8e2b tempest-TestShelveInstance-1615912961 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 11:53:26 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-7124b6a6-5c40-4f39-8748-7039eb2d8e2b tempest-TestShelveInstance-1615912961 None] Selected osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f as target Quobyte volume. {{(pid=87116) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 11:53:26 devstack cinder-volume[87116]: INFO cinder.volume.drivers.remotefs [None req-7124b6a6-5c40-4f39-8748-7039eb2d8e2b tempest-TestShelveInstance-1615912961 None] casted to osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f Nov 06 11:53:26 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-7124b6a6-5c40-4f39-8748-7039eb2d8e2b tempest-TestShelveInstance-1615912961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-14e75353-8e88-4e4d-93b1-ac70324e53c9 1073741824 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:53:26 devstack sudo[99650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-14e75353-8e88-4e4d-93b1-ac70324e53c9 1073741824 Nov 06 11:53:26 devstack sudo[99650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:53:27 devstack sudo[99650]: pam_unix(sudo:session): session closed for user root Nov 06 11:53:27 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-7124b6a6-5c40-4f39-8748-7039eb2d8e2b tempest-TestShelveInstance-1615912961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-14e75353-8e88-4e4d-93b1-ac70324e53c9 1073741824" returned: 0 in 0.695s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:53:27 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-7124b6a6-5c40-4f39-8748-7039eb2d8e2b tempest-TestShelveInstance-1615912961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-14e75353-8e88-4e4d-93b1-ac70324e53c9 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:53:27 devstack sudo[99682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-14e75353-8e88-4e4d-93b1-ac70324e53c9 Nov 06 11:53:27 devstack sudo[99682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:53:27 devstack sudo[99682]: pam_unix(sudo:session): session closed for user root Nov 06 11:53:27 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-7124b6a6-5c40-4f39-8748-7039eb2d8e2b tempest-TestShelveInstance-1615912961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-14e75353-8e88-4e4d-93b1-ac70324e53c9" returned: 0 in 0.337s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:53:27 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-7124b6a6-5c40-4f39-8748-7039eb2d8e2b tempest-TestShelveInstance-1615912961 None] <== create_volume: return (1099ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f'} {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 11:53:27 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-7124b6a6-5c40-4f39-8748-7039eb2d8e2b tempest-TestShelveInstance-1615912961 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.102s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 11:53:28 devstack cinder-volume[87116]: DEBUG cinder.volume.volume_utils [None req-7124b6a6-5c40-4f39-8748-7039eb2d8e2b tempest-TestShelveInstance-1615912961 None] Attempting download of 423469e2-d15b-4cf9-87cd-88e68e947d3b ((None, [{'url': 'file:///opt/stack/data/glance/images/423469e2-d15b-4cf9-87cd-88e68e947d3b', 'metadata': {}}])) to volume 14e75353-8e88-4e4d-93b1-ac70324e53c9. {{(pid=87116) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Nov 06 11:53:28 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e316983-4e2f-4a20-ab4a-d35db386b6b7]: (4, 'raw') {{(pid=88420) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 11:53:28 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-7124b6a6-5c40-4f39-8748-7039eb2d8e2b tempest-TestShelveInstance-1615912961 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_423469e2-d15b-4cf9-87cd-88e68e947d3b_51fkhe64 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:53:28 devstack sudo[99685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_423469e2-d15b-4cf9-87cd-88e68e947d3b_51fkhe64 Nov 06 11:53:28 devstack sudo[99685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:53:28 devstack sudo[99685]: pam_unix(sudo:session): session closed for user root Nov 06 11:53:28 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-7124b6a6-5c40-4f39-8748-7039eb2d8e2b tempest-TestShelveInstance-1615912961 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_423469e2-d15b-4cf9-87cd-88e68e947d3b_51fkhe64" returned: 0 in 0.582s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:53:28 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-7124b6a6-5c40-4f39-8748-7039eb2d8e2b tempest-TestShelveInstance-1615912961 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_423469e2-d15b-4cf9-87cd-88e68e947d3b_51fkhe64 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:53:28 devstack sudo[99692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_423469e2-d15b-4cf9-87cd-88e68e947d3b_51fkhe64 Nov 06 11:53:28 devstack sudo[99692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:53:29 devstack sudo[99692]: pam_unix(sudo:session): session closed for user root Nov 06 11:53:29 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-7124b6a6-5c40-4f39-8748-7039eb2d8e2b tempest-TestShelveInstance-1615912961 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_423469e2-d15b-4cf9-87cd-88e68e947d3b_51fkhe64" returned: 1 in 0.528s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:53:29 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-7124b6a6-5c40-4f39-8748-7039eb2d8e2b tempest-TestShelveInstance-1615912961 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_423469e2-d15b-4cf9-87cd-88e68e947d3b_51fkhe64' failed. Not Retrying. {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 06 11:53:29 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cdc2264-d4f9-4a18-a133-fb65b8ef33a4]: (4, 'qcow2') {{(pid=88420) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 11:53:29 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-7124b6a6-5c40-4f39-8748-7039eb2d8e2b tempest-TestShelveInstance-1615912961 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_423469e2-d15b-4cf9-87cd-88e68e947d3b_crmqc6b8devstack@QuobyteHD {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:53:29 devstack sudo[99697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_423469e2-d15b-4cf9-87cd-88e68e947d3b_crmqc6b8devstack@QuobyteHD Nov 06 11:53:29 devstack sudo[99697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:53:29 devstack sudo[99697]: pam_unix(sudo:session): session closed for user root Nov 06 11:53:29 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-7124b6a6-5c40-4f39-8748-7039eb2d8e2b tempest-TestShelveInstance-1615912961 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_423469e2-d15b-4cf9-87cd-88e68e947d3b_crmqc6b8devstack@QuobyteHD" returned: 0 in 0.467s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:53:29 devstack cinder-volume[87116]: DEBUG cinder.image.image_utils [None req-7124b6a6-5c40-4f39-8748-7039eb2d8e2b tempest-TestShelveInstance-1615912961 None] 423469e2-d15b-4cf9-87cd-88e68e947d3b was qcow2, converting to qcow2 {{(pid=87116) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Nov 06 11:53:29 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-7124b6a6-5c40-4f39-8748-7039eb2d8e2b tempest-TestShelveInstance-1615912961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_423469e2-d15b-4cf9-87cd-88e68e947d3b_crmqc6b8devstack@QuobyteHD /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-14e75353-8e88-4e4d-93b1-ac70324e53c9 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:53:29 devstack sudo[99702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_423469e2-d15b-4cf9-87cd-88e68e947d3b_crmqc6b8devstack@QuobyteHD /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-14e75353-8e88-4e4d-93b1-ac70324e53c9 Nov 06 11:53:29 devstack sudo[99702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:53:31 devstack cinder-volume[87116]: DEBUG cinder.volume.flows.manager.create_volume [None req-9a8c87a7-26e3-4e23-948a-df987ee6e149 tempest-VolumesCloneTest-605058744 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87116) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 11:53:31 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-9a8c87a7-26e3-4e23-948a-df987ee6e149 tempest-VolumesCloneTest-605058744 None] Flow 'volume_create_manager' (249c7f07-1ef8-4798-a3c5-4ac7800ddf09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 11:53:31 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-9a8c87a7-26e3-4e23-948a-df987ee6e149 tempest-VolumesCloneTest-605058744 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fa3c95ee-8ed4-49f4-b85d-bb5e6c7f48c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:53:31 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-9a8c87a7-26e3-4e23-948a-df987ee6e149 tempest-VolumesCloneTest-605058744 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fa3c95ee-8ed4-49f4-b85d-bb5e6c7f48c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T10:53:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-23708943',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=18cd5b0e-6501-442e-b686-f3c2aed8a4d8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fc14fde3ba414f9ba626ac3c7f8fdce7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T10:53:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T10:53:32Z,use_quota=True,user_id='0e7a30818ad04bd9b43e1491d1ff7187',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(34d3b144-d9b7-480a-a2e3-01e45f3d54c1),volume_type_id=34d3b144-d9b7-480a-a2e3-01e45f3d54c1)' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:53:31 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-9a8c87a7-26e3-4e23-948a-df987ee6e149 tempest-VolumesCloneTest-605058744 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df77fd8d-cfb5-48d5-bf30-4b2ce1b559de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:53:31 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-9a8c87a7-26e3-4e23-948a-df987ee6e149 tempest-VolumesCloneTest-605058744 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df77fd8d-cfb5-48d5-bf30-4b2ce1b559de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:53:31 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-9a8c87a7-26e3-4e23-948a-df987ee6e149 tempest-VolumesCloneTest-605058744 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (63c0cf42-d591-494b-b46e-6781f1527dd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:53:31 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-9a8c87a7-26e3-4e23-948a-df987ee6e149 tempest-VolumesCloneTest-605058744 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (63c0cf42-d591-494b-b46e-6781f1527dd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '18cd5b0e-6501-442e-b686-f3c2aed8a4d8', 'volume_name': 'volume-18cd5b0e-6501-442e-b686-f3c2aed8a4d8', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:53:31 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-9a8c87a7-26e3-4e23-948a-df987ee6e149 tempest-VolumesCloneTest-605058744 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1871305b-4c50-4f9b-90e6-89774cb9753b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:53:31 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-9a8c87a7-26e3-4e23-948a-df987ee6e149 tempest-VolumesCloneTest-605058744 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1871305b-4c50-4f9b-90e6-89774cb9753b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:53:31 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-9a8c87a7-26e3-4e23-948a-df987ee6e149 tempest-VolumesCloneTest-605058744 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9746e8f9-5af8-4380-87c4-19a36496babe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:53:31 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-9a8c87a7-26e3-4e23-948a-df987ee6e149 tempest-VolumesCloneTest-605058744 None] Volume 18cd5b0e-6501-442e-b686-f3c2aed8a4d8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-18cd5b0e-6501-442e-b686-f3c2aed8a4d8', 'volume_size': 1} Nov 06 11:53:31 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-9a8c87a7-26e3-4e23-948a-df987ee6e149 tempest-VolumesCloneTest-605058744 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 11:53:31 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-9a8c87a7-26e3-4e23-948a-df987ee6e149 tempest-VolumesCloneTest-605058744 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 11:53:31 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-9a8c87a7-26e3-4e23-948a-df987ee6e149 tempest-VolumesCloneTest-605058744 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T10:53:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-23708943',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=18cd5b0e-6501-442e-b686-f3c2aed8a4d8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fc14fde3ba414f9ba626ac3c7f8fdce7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T10:53:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T10:53:32Z,use_quota=True,user_id='0e7a30818ad04bd9b43e1491d1ff7187',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(34d3b144-d9b7-480a-a2e3-01e45f3d54c1),volume_type_id=34d3b144-d9b7-480a-a2e3-01e45f3d54c1)}" {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 11:53:31 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-9a8c87a7-26e3-4e23-948a-df987ee6e149 tempest-VolumesCloneTest-605058744 None] Creating volume 18cd5b0e-6501-442e-b686-f3c2aed8a4d8 {{(pid=87116) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 11:53:31 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-9a8c87a7-26e3-4e23-948a-df987ee6e149 tempest-VolumesCloneTest-605058744 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 11:53:31 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-9a8c87a7-26e3-4e23-948a-df987ee6e149 tempest-VolumesCloneTest-605058744 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 11:53:31 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-9a8c87a7-26e3-4e23-948a-df987ee6e149 tempest-VolumesCloneTest-605058744 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 11:53:31 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-9a8c87a7-26e3-4e23-948a-df987ee6e149 tempest-VolumesCloneTest-605058744 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 11:53:31 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-9a8c87a7-26e3-4e23-948a-df987ee6e149 tempest-VolumesCloneTest-605058744 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 11:53:31 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-9a8c87a7-26e3-4e23-948a-df987ee6e149 tempest-VolumesCloneTest-605058744 None] Selected osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f as target Quobyte volume. {{(pid=87116) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 11:53:31 devstack cinder-volume[87116]: INFO cinder.volume.drivers.remotefs [None req-9a8c87a7-26e3-4e23-948a-df987ee6e149 tempest-VolumesCloneTest-605058744 None] casted to osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f Nov 06 11:53:31 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-9a8c87a7-26e3-4e23-948a-df987ee6e149 tempest-VolumesCloneTest-605058744 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-18cd5b0e-6501-442e-b686-f3c2aed8a4d8 1073741824 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:53:31 devstack sudo[99766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-18cd5b0e-6501-442e-b686-f3c2aed8a4d8 1073741824 Nov 06 11:53:31 devstack sudo[99766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:53:32 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-dbeb16a2-d83a-4fae-a306-652d9704617e tempest-VolumesActionsTest-1082049010 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 11:53:32 devstack sudo[99702]: pam_unix(sudo:session): session closed for user root Nov 06 11:53:32 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-7124b6a6-5c40-4f39-8748-7039eb2d8e2b tempest-TestShelveInstance-1615912961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_423469e2-d15b-4cf9-87cd-88e68e947d3b_crmqc6b8devstack@QuobyteHD /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-14e75353-8e88-4e4d-93b1-ac70324e53c9" returned: 0 in 2.469s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:53:32 devstack cinder-volume[87116]: DEBUG cinder.image.image_utils [None req-7124b6a6-5c40-4f39-8748-7039eb2d8e2b tempest-TestShelveInstance-1615912961 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_423469e2-d15b-4cf9-87cd-88e68e947d3b_crmqc6b8devstack@QuobyteHD, size 112.00 MB, duration 2.47 sec, destination /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-14e75353-8e88-4e4d-93b1-ac70324e53c9 {{(pid=87116) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 06 11:53:32 devstack cinder-volume[87116]: INFO cinder.image.image_utils [None req-7124b6a6-5c40-4f39-8748-7039eb2d8e2b tempest-TestShelveInstance-1615912961 None] Converted 112.00 MB image at 45.36 MB/s Nov 06 11:53:32 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-7124b6a6-5c40-4f39-8748-7039eb2d8e2b tempest-TestShelveInstance-1615912961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-14e75353-8e88-4e4d-93b1-ac70324e53c9 1G {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:53:32 devstack sudo[99769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-14e75353-8e88-4e4d-93b1-ac70324e53c9 1G Nov 06 11:53:32 devstack sudo[99769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:53:32 devstack cinder-volume[87116]: INFO cinder.volume.manager [req-61e4235f-10a5-4761-b49a-1ec3101ed0d6 req-f7176154-4ba2-4c36-89ff-5c2b8b1a2374 tempest-TestInstancesWithCinderVolumes-778023409 None] Terminate volume connection completed successfully. Nov 06 11:53:32 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [req-61e4235f-10a5-4761-b49a-1ec3101ed0d6 req-f7176154-4ba2-4c36-89ff-5c2b8b1a2374 tempest-TestInstancesWithCinderVolumes-778023409 None] Deleting attachment 7289df02-9b9c-44a9-a018-84ac645adc99. {{(pid=87116) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 06 11:53:32 devstack sudo[99766]: pam_unix(sudo:session): session closed for user root Nov 06 11:53:32 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-9a8c87a7-26e3-4e23-948a-df987ee6e149 tempest-VolumesCloneTest-605058744 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-18cd5b0e-6501-442e-b686-f3c2aed8a4d8 1073741824" returned: 0 in 0.504s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:53:32 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-9a8c87a7-26e3-4e23-948a-df987ee6e149 tempest-VolumesCloneTest-605058744 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-18cd5b0e-6501-442e-b686-f3c2aed8a4d8 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:53:32 devstack sudo[99780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-18cd5b0e-6501-442e-b686-f3c2aed8a4d8 Nov 06 11:53:32 devstack sudo[99780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:53:32 devstack sudo[99769]: pam_unix(sudo:session): session closed for user root Nov 06 11:53:32 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-7124b6a6-5c40-4f39-8748-7039eb2d8e2b tempest-TestShelveInstance-1615912961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-14e75353-8e88-4e4d-93b1-ac70324e53c9 1G" returned: 0 in 0.361s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:53:32 devstack cinder-volume[87116]: DEBUG cinder.volume.volume_utils [None req-7124b6a6-5c40-4f39-8748-7039eb2d8e2b tempest-TestShelveInstance-1615912961 None] Downloaded image 423469e2-d15b-4cf9-87cd-88e68e947d3b ((None, [{'url': 'file:///opt/stack/data/glance/images/423469e2-d15b-4cf9-87cd-88e68e947d3b', 'metadata': {}}])) to volume 14e75353-8e88-4e4d-93b1-ac70324e53c9 successfully. {{(pid=87116) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Nov 06 11:53:32 devstack cinder-volume[87116]: DEBUG cinder.image.image_utils [None req-7124b6a6-5c40-4f39-8748-7039eb2d8e2b tempest-TestShelveInstance-1615912961 None] Temporary image 423469e2-d15b-4cf9-87cd-88e68e947d3b for user c16530eaae6848618b478779b23f8b91 is deleted. {{(pid=87116) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Nov 06 11:53:32 devstack cinder-volume[87116]: DEBUG cinder.volume.volume_utils [None req-7124b6a6-5c40-4f39-8748-7039eb2d8e2b tempest-TestShelveInstance-1615912961 None] Marking volume 14e75353-8e88-4e4d-93b1-ac70324e53c9 as bootable. {{(pid=87116) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Nov 06 11:53:32 devstack cinder-volume[87116]: DEBUG cinder.volume.flows.manager.create_volume [None req-7124b6a6-5c40-4f39-8748-7039eb2d8e2b tempest-TestShelveInstance-1615912961 None] Copying metadata from image 423469e2-d15b-4cf9-87cd-88e68e947d3b to 14e75353-8e88-4e4d-93b1-ac70324e53c9. {{(pid=87116) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Nov 06 11:53:32 devstack cinder-volume[87116]: DEBUG cinder.volume.flows.manager.create_volume [None req-7124b6a6-5c40-4f39-8748-7039eb2d8e2b tempest-TestShelveInstance-1615912961 None] Creating volume glance metadata for volume 14e75353-8e88-4e4d-93b1-ac70324e53c9 backed by image 423469e2-d15b-4cf9-87cd-88e68e947d3b with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '423469e2-d15b-4cf9-87cd-88e68e947d3b', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87116) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Nov 06 11:53:32 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-7124b6a6-5c40-4f39-8748-7039eb2d8e2b tempest-TestShelveInstance-1615912961 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (959e08b6-c24e-467c-99c8-5e1c359fc007) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-14e75353-8e88-4e4d-93b1-ac70324e53c9', 'volume_size': 1, 'image_id': '423469e2-d15b-4cf9-87cd-88e68e947d3b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/423469e2-d15b-4cf9-87cd-88e68e947d3b', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b05f927c30c5407aad52949459346010', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '423469e2-d15b-4cf9-87cd-88e68e947d3b', 'created_at': datetime.datetime(2026, 11, 6, 10, 36, 49, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 6, 10, 36, 50, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/423469e2-d15b-4cf9-87cd-88e68e947d3b/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:53:32 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-7124b6a6-5c40-4f39-8748-7039eb2d8e2b tempest-TestShelveInstance-1615912961 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b2882301-687e-4587-9eb3-ed0a36efdd8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:53:32 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-7124b6a6-5c40-4f39-8748-7039eb2d8e2b tempest-TestShelveInstance-1615912961 None] Volume volume-14e75353-8e88-4e4d-93b1-ac70324e53c9 (14e75353-8e88-4e4d-93b1-ac70324e53c9): created successfully Nov 06 11:53:32 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-7124b6a6-5c40-4f39-8748-7039eb2d8e2b tempest-TestShelveInstance-1615912961 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b2882301-687e-4587-9eb3-ed0a36efdd8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:53:32 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-7124b6a6-5c40-4f39-8748-7039eb2d8e2b tempest-TestShelveInstance-1615912961 None] Flow 'volume_create_manager' (349591a3-496f-4044-acd7-9c088db67ad0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 11:53:32 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-7124b6a6-5c40-4f39-8748-7039eb2d8e2b tempest-TestShelveInstance-1615912961 None] Created volume successfully. Nov 06 11:53:32 devstack sudo[99780]: pam_unix(sudo:session): session closed for user root Nov 06 11:53:32 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-9a8c87a7-26e3-4e23-948a-df987ee6e149 tempest-VolumesCloneTest-605058744 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-18cd5b0e-6501-442e-b686-f3c2aed8a4d8" returned: 0 in 0.257s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:53:32 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-9a8c87a7-26e3-4e23-948a-df987ee6e149 tempest-VolumesCloneTest-605058744 None] <== create_volume: return (802ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f'} {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 11:53:32 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-9a8c87a7-26e3-4e23-948a-df987ee6e149 tempest-VolumesCloneTest-605058744 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.805s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 11:53:32 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-dbeb16a2-d83a-4fae-a306-652d9704617e tempest-VolumesActionsTest-1082049010 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.680s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 11:53:32 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-9a8c87a7-26e3-4e23-948a-df987ee6e149 tempest-VolumesCloneTest-605058744 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9746e8f9-5af8-4380-87c4-19a36496babe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-18cd5b0e-6501-442e-b686-f3c2aed8a4d8', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:53:32 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-9a8c87a7-26e3-4e23-948a-df987ee6e149 tempest-VolumesCloneTest-605058744 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9aebc4ee-a29f-46cf-8c8b-a38c318eac79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:53:32 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[6519bbdd-0d4f-42e0-8a7e-df2393ed9b61]: (4, 'qcow2') {{(pid=88420) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 11:53:32 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-dbeb16a2-d83a-4fae-a306-652d9704617e tempest-VolumesActionsTest-1082049010 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-07f7eafd-f454-4ca3-9d82-7f4535375548 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:53:32 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-9a8c87a7-26e3-4e23-948a-df987ee6e149 tempest-VolumesCloneTest-605058744 None] Volume volume-18cd5b0e-6501-442e-b686-f3c2aed8a4d8 (18cd5b0e-6501-442e-b686-f3c2aed8a4d8): created successfully Nov 06 11:53:32 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-9a8c87a7-26e3-4e23-948a-df987ee6e149 tempest-VolumesCloneTest-605058744 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9aebc4ee-a29f-46cf-8c8b-a38c318eac79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:53:32 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-9a8c87a7-26e3-4e23-948a-df987ee6e149 tempest-VolumesCloneTest-605058744 None] Flow 'volume_create_manager' (249c7f07-1ef8-4798-a3c5-4ac7800ddf09) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 11:53:32 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-9a8c87a7-26e3-4e23-948a-df987ee6e149 tempest-VolumesCloneTest-605058744 None] Created volume successfully. Nov 06 11:53:32 devstack sudo[99783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-07f7eafd-f454-4ca3-9d82-7f4535375548 Nov 06 11:53:32 devstack sudo[99783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:53:33 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-589da725-f967-495d-b165-5ec075baec96 tempest-TestInstancesWithCinderVolumes-778023409 None] Acquiring lock "cinder-b57d0ecb-ebc7-4c22-86d6-22310eeb167d-delete_volume" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 11:53:33 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-589da725-f967-495d-b165-5ec075baec96 tempest-TestInstancesWithCinderVolumes-778023409 None] Lock "cinder-b57d0ecb-ebc7-4c22-86d6-22310eeb167d-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 11:53:33 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-589da725-f967-495d-b165-5ec075baec96 tempest-TestInstancesWithCinderVolumes-778023409 None] Acquiring lock "cinder-quobyte-b57d0ecb-ebc7-4c22-86d6-22310eeb167d" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 11:53:33 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-589da725-f967-495d-b165-5ec075baec96 tempest-TestInstancesWithCinderVolumes-778023409 None] Lock "cinder-quobyte-b57d0ecb-ebc7-4c22-86d6-22310eeb167d" acquired by "delete_volume" :: waited 0.020s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 11:53:33 devstack sudo[99783]: pam_unix(sudo:session): session closed for user root Nov 06 11:53:33 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-dbeb16a2-d83a-4fae-a306-652d9704617e tempest-VolumesActionsTest-1082049010 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-07f7eafd-f454-4ca3-9d82-7f4535375548" returned: 0 in 0.406s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:53:33 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa3f751b-751a-4dbe-9cbd-21f505c56b57]: (4, 'qcow2') {{(pid=88420) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 11:53:33 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-589da725-f967-495d-b165-5ec075baec96 tempest-TestInstancesWithCinderVolumes-778023409 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-b57d0ecb-ebc7-4c22-86d6-22310eeb167d {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:53:33 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac9a8e7e-628b-4e6d-aa5b-ed2c3bc3805b]: (4, 'qcow2') {{(pid=88420) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 11:53:33 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-dbeb16a2-d83a-4fae-a306-652d9704617e tempest-VolumesActionsTest-1082049010 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-07f7eafd-f454-4ca3-9d82-7f4535375548 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:53:33 devstack sudo[99793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-b57d0ecb-ebc7-4c22-86d6-22310eeb167d Nov 06 11:53:33 devstack sudo[99793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:53:33 devstack sudo[99794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-07f7eafd-f454-4ca3-9d82-7f4535375548 Nov 06 11:53:33 devstack sudo[99794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:53:33 devstack sudo[99793]: pam_unix(sudo:session): session closed for user root Nov 06 11:53:33 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-589da725-f967-495d-b165-5ec075baec96 tempest-TestInstancesWithCinderVolumes-778023409 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-b57d0ecb-ebc7-4c22-86d6-22310eeb167d" returned: 0 in 0.429s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:53:33 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-589da725-f967-495d-b165-5ec075baec96 tempest-TestInstancesWithCinderVolumes-778023409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-b57d0ecb-ebc7-4c22-86d6-22310eeb167d {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:53:33 devstack sudo[99794]: pam_unix(sudo:session): session closed for user root Nov 06 11:53:33 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-dbeb16a2-d83a-4fae-a306-652d9704617e tempest-VolumesActionsTest-1082049010 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-07f7eafd-f454-4ca3-9d82-7f4535375548" returned: 0 in 0.437s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:53:33 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-dbeb16a2-d83a-4fae-a306-652d9704617e tempest-VolumesActionsTest-1082049010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-07f7eafd-f454-4ca3-9d82-7f4535375548 /opt/stack/data/cinder/conversion/07f7eafd-f454-4ca3-9d82-7f4535375548.temp_image.e76bcd95-096e-4de4-9855-0e19e64c8503twaytfuf.img {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:53:33 devstack sudo[99803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-b57d0ecb-ebc7-4c22-86d6-22310eeb167d Nov 06 11:53:33 devstack sudo[99803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:53:33 devstack sudo[99804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-07f7eafd-f454-4ca3-9d82-7f4535375548 /opt/stack/data/cinder/conversion/07f7eafd-f454-4ca3-9d82-7f4535375548.temp_image.e76bcd95-096e-4de4-9855-0e19e64c8503twaytfuf.img Nov 06 11:53:33 devstack sudo[99804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:53:33 devstack sudo[99803]: pam_unix(sudo:session): session closed for user root Nov 06 11:53:33 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-589da725-f967-495d-b165-5ec075baec96 tempest-TestInstancesWithCinderVolumes-778023409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-b57d0ecb-ebc7-4c22-86d6-22310eeb167d" returned: 0 in 0.397s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:53:34 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-589da725-f967-495d-b165-5ec075baec96 tempest-TestInstancesWithCinderVolumes-778023409 None] Lock "cinder-quobyte-b57d0ecb-ebc7-4c22-86d6-22310eeb167d" released by "delete_volume" :: held 0.901s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 11:53:34 devstack cinder-volume[87116]: WARNING cinder.quota [None req-589da725-f967-495d-b165-5ec075baec96 tempest-TestInstancesWithCinderVolumes-778023409 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-659166075-1536765440 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-659166075-1536765440, it is now deprecated. Please use the default quota class for default quota. Nov 06 11:53:34 devstack cinder-volume[87116]: WARNING cinder.quota [None req-589da725-f967-495d-b165-5ec075baec96 tempest-TestInstancesWithCinderVolumes-778023409 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-659166075-1536765440 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-659166075-1536765440, it is now deprecated. Please use the default quota class for default quota. Nov 06 11:53:34 devstack cinder-volume[87116]: DEBUG cinder.quota [None req-589da725-f967-495d-b165-5ec075baec96 tempest-TestInstancesWithCinderVolumes-778023409 None] Created reservations ['021099d6-2a20-4153-9c30-11e7cb73388c', '63d7a167-7b4c-4978-aba7-e98deb139858', 'e05e5900-56b5-462a-9d87-4cff36fa7362', 'cfd54d99-daa8-47bb-9e7f-c764c1f1e2c3'] {{(pid=87116) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 11:53:34 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-589da725-f967-495d-b165-5ec075baec96 tempest-TestInstancesWithCinderVolumes-778023409 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 11:53:34 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-589da725-f967-495d-b165-5ec075baec96 tempest-TestInstancesWithCinderVolumes-778023409 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 11:53:34 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-589da725-f967-495d-b165-5ec075baec96 tempest-TestInstancesWithCinderVolumes-778023409 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 11:53:34 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-589da725-f967-495d-b165-5ec075baec96 tempest-TestInstancesWithCinderVolumes-778023409 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 11:53:34 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-589da725-f967-495d-b165-5ec075baec96 tempest-TestInstancesWithCinderVolumes-778023409 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 11:53:34 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-589da725-f967-495d-b165-5ec075baec96 tempest-TestInstancesWithCinderVolumes-778023409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:53:34 devstack sudo[99819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756 Nov 06 11:53:34 devstack sudo[99819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:53:34 devstack sudo[99819]: pam_unix(sudo:session): session closed for user root Nov 06 11:53:34 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-589da725-f967-495d-b165-5ec075baec96 tempest-TestInstancesWithCinderVolumes-778023409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756" returned: 0 in 0.421s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:53:34 devstack cinder-volume[87116]: DEBUG cinder.manager [None req-589da725-f967-495d-b165-5ec075baec96 tempest-TestInstancesWithCinderVolumes-778023409 None] Notifying Schedulers of capabilities ... {{(pid=87116) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 11:53:34 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-589da725-f967-495d-b165-5ec075baec96 tempest-TestInstancesWithCinderVolumes-778023409 None] Deleted volume successfully. Nov 06 11:53:34 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-589da725-f967-495d-b165-5ec075baec96 tempest-TestInstancesWithCinderVolumes-778023409 None] Lock "cinder-b57d0ecb-ebc7-4c22-86d6-22310eeb167d-delete_volume" released by "delete_volume" :: held 1.787s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 11:53:35 devstack cinder-volume[87116]: DEBUG cinder.volume.flows.manager.create_volume [None req-40040203-8461-4574-b21f-ded615f03011 tempest-VolumesCloneTest-605058744 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87116) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 11:53:35 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-40040203-8461-4574-b21f-ded615f03011 tempest-VolumesCloneTest-605058744 None] Flow 'volume_create_manager' (a7bb4a4d-958f-4e73-b904-d132dfa14292) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 11:53:35 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-40040203-8461-4574-b21f-ded615f03011 tempest-VolumesCloneTest-605058744 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c5ef1249-6097-488b-af6f-8b1bf0391783) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:53:35 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-40040203-8461-4574-b21f-ded615f03011 tempest-VolumesCloneTest-605058744 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c5ef1249-6097-488b-af6f-8b1bf0391783) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T10:53:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1561395303',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=573e08b7-b507-4b36-9d5d-8953fe665bee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fc14fde3ba414f9ba626ac3c7f8fdce7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T10:53:35Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=18cd5b0e-6501-442e-b686-f3c2aed8a4d8,status='creating',terminated_at=None,updated_at=2026-11-06T10:53:35Z,use_quota=True,user_id='0e7a30818ad04bd9b43e1491d1ff7187',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(34d3b144-d9b7-480a-a2e3-01e45f3d54c1),volume_type_id=34d3b144-d9b7-480a-a2e3-01e45f3d54c1)' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:53:35 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-40040203-8461-4574-b21f-ded615f03011 tempest-VolumesCloneTest-605058744 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3c3ab5ff-3dba-4e7c-b497-4bea566a7e26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:53:35 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-40040203-8461-4574-b21f-ded615f03011 tempest-VolumesCloneTest-605058744 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3c3ab5ff-3dba-4e7c-b497-4bea566a7e26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:53:35 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-40040203-8461-4574-b21f-ded615f03011 tempest-VolumesCloneTest-605058744 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9bddea3f-673c-4b4e-b7e8-0ae12c5c21d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:53:35 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-40040203-8461-4574-b21f-ded615f03011 tempest-VolumesCloneTest-605058744 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9bddea3f-673c-4b4e-b7e8-0ae12c5c21d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '573e08b7-b507-4b36-9d5d-8953fe665bee', 'volume_name': 'volume-573e08b7-b507-4b36-9d5d-8953fe665bee', 'volume_size': 2, 'source_volid': '18cd5b0e-6501-442e-b686-f3c2aed8a4d8', 'source_volstatus': 'available'}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:53:35 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-40040203-8461-4574-b21f-ded615f03011 tempest-VolumesCloneTest-605058744 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4be6f924-a11e-44da-819b-22689cc70e6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:53:35 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-40040203-8461-4574-b21f-ded615f03011 tempest-VolumesCloneTest-605058744 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4be6f924-a11e-44da-819b-22689cc70e6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:53:35 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-40040203-8461-4574-b21f-ded615f03011 tempest-VolumesCloneTest-605058744 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (83766994-16f6-44d0-8745-fcae7b56c945) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:53:35 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-40040203-8461-4574-b21f-ded615f03011 tempest-VolumesCloneTest-605058744 None] Volume 573e08b7-b507-4b36-9d5d-8953fe665bee: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-573e08b7-b507-4b36-9d5d-8953fe665bee', 'volume_size': 2, 'source_volid': '18cd5b0e-6501-442e-b686-f3c2aed8a4d8', 'source_volstatus': 'available'} Nov 06 11:53:35 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-40040203-8461-4574-b21f-ded615f03011 tempest-VolumesCloneTest-605058744 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 11:53:37 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [req-03b8465c-4ce3-47af-b60c-46ecd90fa233 req-a98aad7a-cdbe-467a-88ad-98a0871ddb9c tempest-TestShelveInstance-1615912961 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 11:53:38 devstack cinder-volume[87116]: INFO cinder.volume.manager [req-0c2c8b0b-6401-4d23-82e9-eba5d7564f20 req-3aeb107b-b493-4e03-8df9-5d4694af1ece tempest-TestInstancesWithCinderVolumes-778023409 None] Terminate volume connection completed successfully. Nov 06 11:53:38 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [req-0c2c8b0b-6401-4d23-82e9-eba5d7564f20 req-3aeb107b-b493-4e03-8df9-5d4694af1ece tempest-TestInstancesWithCinderVolumes-778023409 None] Deleting attachment bc4519cf-70d4-4487-a215-b633868153d6. {{(pid=87116) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 06 11:53:39 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-23c88d5d-8ac4-4a90-9088-a324e90c024c tempest-TestInstancesWithCinderVolumes-778023409 None] Acquiring lock "cinder-82f3f473-5a67-46ee-a572-d16a86aeee72-delete_volume" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 11:53:39 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-23c88d5d-8ac4-4a90-9088-a324e90c024c tempest-TestInstancesWithCinderVolumes-778023409 None] Lock "cinder-82f3f473-5a67-46ee-a572-d16a86aeee72-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 11:53:39 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-23c88d5d-8ac4-4a90-9088-a324e90c024c tempest-TestInstancesWithCinderVolumes-778023409 None] Acquiring lock "cinder-quobyte-82f3f473-5a67-46ee-a572-d16a86aeee72" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 11:53:39 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-23c88d5d-8ac4-4a90-9088-a324e90c024c tempest-TestInstancesWithCinderVolumes-778023409 None] Lock "cinder-quobyte-82f3f473-5a67-46ee-a572-d16a86aeee72" acquired by "delete_volume" :: waited 0.035s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 11:53:39 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[32d83dc6-6ef1-47ec-984d-6ea25112e105]: (4, 'qcow2') {{(pid=88420) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 11:53:39 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-23c88d5d-8ac4-4a90-9088-a324e90c024c tempest-TestInstancesWithCinderVolumes-778023409 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-82f3f473-5a67-46ee-a572-d16a86aeee72 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:53:39 devstack cinder-volume[87116]: DEBUG oslo_service.periodic_task [None req-4fab4816-ec2b-4b19-b2ff-8548f2084354 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87116) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 11:53:39 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-4fab4816-ec2b-4b19-b2ff-8548f2084354 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 11:53:39 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-4fab4816-ec2b-4b19-b2ff-8548f2084354 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 11:53:39 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-4fab4816-ec2b-4b19-b2ff-8548f2084354 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 11:53:39 devstack sudo[99864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-82f3f473-5a67-46ee-a572-d16a86aeee72 Nov 06 11:53:39 devstack sudo[99864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:53:39 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-4fab4816-ec2b-4b19-b2ff-8548f2084354 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 11:53:39 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-4fab4816-ec2b-4b19-b2ff-8548f2084354 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 11:53:39 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-4fab4816-ec2b-4b19-b2ff-8548f2084354 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:53:39 devstack sudo[99866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756 Nov 06 11:53:39 devstack sudo[99866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:53:40 devstack sudo[99866]: pam_unix(sudo:session): session closed for user root Nov 06 11:53:40 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-4fab4816-ec2b-4b19-b2ff-8548f2084354 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756" returned: 0 in 0.398s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:53:40 devstack cinder-volume[87116]: DEBUG cinder.manager [None req-4fab4816-ec2b-4b19-b2ff-8548f2084354 None None] Notifying Schedulers of capabilities ... {{(pid=87116) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 11:53:40 devstack cinder-volume[87116]: DEBUG oslo_service.periodic_task [None req-4fab4816-ec2b-4b19-b2ff-8548f2084354 None None] Running periodic task VolumeManager._thread_info {{(pid=87116) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 11:53:40 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-4fab4816-ec2b-4b19-b2ff-8548f2084354 None None] thread count: 28 {{(pid=87116) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 06 11:53:40 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-4fab4816-ec2b-4b19-b2ff-8548f2084354 None None] thread info: [<_MainThread(MainThread, started 131399520669824)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87116) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 06 11:53:40 devstack sudo[99864]: pam_unix(sudo:session): session closed for user root Nov 06 11:53:40 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-23c88d5d-8ac4-4a90-9088-a324e90c024c tempest-TestInstancesWithCinderVolumes-778023409 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-82f3f473-5a67-46ee-a572-d16a86aeee72" returned: 0 in 0.912s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:53:40 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-23c88d5d-8ac4-4a90-9088-a324e90c024c tempest-TestInstancesWithCinderVolumes-778023409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-82f3f473-5a67-46ee-a572-d16a86aeee72 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:53:40 devstack sudo[99873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-82f3f473-5a67-46ee-a572-d16a86aeee72 Nov 06 11:53:40 devstack sudo[99873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:53:41 devstack sudo[99873]: pam_unix(sudo:session): session closed for user root Nov 06 11:53:41 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-23c88d5d-8ac4-4a90-9088-a324e90c024c tempest-TestInstancesWithCinderVolumes-778023409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-82f3f473-5a67-46ee-a572-d16a86aeee72" returned: 0 in 0.558s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:53:41 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-23c88d5d-8ac4-4a90-9088-a324e90c024c tempest-TestInstancesWithCinderVolumes-778023409 None] Lock "cinder-quobyte-82f3f473-5a67-46ee-a572-d16a86aeee72" released by "delete_volume" :: held 1.600s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 11:53:41 devstack cinder-volume[87116]: WARNING cinder.quota [None req-23c88d5d-8ac4-4a90-9088-a324e90c024c tempest-TestInstancesWithCinderVolumes-778023409 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1453915626-1798287542 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1453915626-1798287542, it is now deprecated. Please use the default quota class for default quota. Nov 06 11:53:41 devstack cinder-volume[87116]: WARNING cinder.quota [None req-23c88d5d-8ac4-4a90-9088-a324e90c024c tempest-TestInstancesWithCinderVolumes-778023409 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1453915626-1798287542 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1453915626-1798287542, it is now deprecated. Please use the default quota class for default quota. Nov 06 11:53:41 devstack cinder-volume[87116]: DEBUG cinder.quota [None req-23c88d5d-8ac4-4a90-9088-a324e90c024c tempest-TestInstancesWithCinderVolumes-778023409 None] Created reservations ['b53e7d18-03f5-4426-8e0a-483e423ba6aa', 'f4d95aaa-764c-4dd0-b1f1-4e25a6c4accf', '93686925-4ad5-4bce-bfc3-17d28708c641', 'c1b43d92-a0db-414d-a324-a239337eb0ac'] {{(pid=87116) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 11:53:41 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-23c88d5d-8ac4-4a90-9088-a324e90c024c tempest-TestInstancesWithCinderVolumes-778023409 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 11:53:41 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-23c88d5d-8ac4-4a90-9088-a324e90c024c tempest-TestInstancesWithCinderVolumes-778023409 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 11:53:41 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-23c88d5d-8ac4-4a90-9088-a324e90c024c tempest-TestInstancesWithCinderVolumes-778023409 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 11:53:41 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-23c88d5d-8ac4-4a90-9088-a324e90c024c tempest-TestInstancesWithCinderVolumes-778023409 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 11:53:41 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-23c88d5d-8ac4-4a90-9088-a324e90c024c tempest-TestInstancesWithCinderVolumes-778023409 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 11:53:41 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-23c88d5d-8ac4-4a90-9088-a324e90c024c tempest-TestInstancesWithCinderVolumes-778023409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:53:41 devstack sudo[99877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756 Nov 06 11:53:41 devstack sudo[99877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:53:41 devstack sudo[99877]: pam_unix(sudo:session): session closed for user root Nov 06 11:53:41 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-23c88d5d-8ac4-4a90-9088-a324e90c024c tempest-TestInstancesWithCinderVolumes-778023409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756" returned: 0 in 0.470s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:53:41 devstack cinder-volume[87116]: DEBUG cinder.manager [None req-23c88d5d-8ac4-4a90-9088-a324e90c024c tempest-TestInstancesWithCinderVolumes-778023409 None] Notifying Schedulers of capabilities ... {{(pid=87116) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 11:53:41 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-23c88d5d-8ac4-4a90-9088-a324e90c024c tempest-TestInstancesWithCinderVolumes-778023409 None] Deleted volume successfully. Nov 06 11:53:42 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-23c88d5d-8ac4-4a90-9088-a324e90c024c tempest-TestInstancesWithCinderVolumes-778023409 None] Lock "cinder-82f3f473-5a67-46ee-a572-d16a86aeee72-delete_volume" released by "delete_volume" :: held 2.648s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 11:53:42 devstack sudo[99804]: pam_unix(sudo:session): session closed for user root Nov 06 11:53:42 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-dbeb16a2-d83a-4fae-a306-652d9704617e tempest-VolumesActionsTest-1082049010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-07f7eafd-f454-4ca3-9d82-7f4535375548 /opt/stack/data/cinder/conversion/07f7eafd-f454-4ca3-9d82-7f4535375548.temp_image.e76bcd95-096e-4de4-9855-0e19e64c8503twaytfuf.img" returned: 0 in 9.301s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:53:42 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a572d4c-7585-4fe7-be58-e9b6909893b6]: (4, 'qcow2') {{(pid=88420) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 11:53:42 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-dbeb16a2-d83a-4fae-a306-652d9704617e tempest-VolumesActionsTest-1082049010 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-07f7eafd-f454-4ca3-9d82-7f4535375548 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:53:43 devstack sudo[99882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-07f7eafd-f454-4ca3-9d82-7f4535375548 Nov 06 11:53:43 devstack sudo[99882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:53:43 devstack sudo[99882]: pam_unix(sudo:session): session closed for user root Nov 06 11:53:43 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-dbeb16a2-d83a-4fae-a306-652d9704617e tempest-VolumesActionsTest-1082049010 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-07f7eafd-f454-4ca3-9d82-7f4535375548" returned: 0 in 0.579s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:53:43 devstack cinder-volume[87116]: DEBUG cinder.image.image_utils [None req-dbeb16a2-d83a-4fae-a306-652d9704617e tempest-VolumesActionsTest-1082049010 None] Image conversion details: src /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-07f7eafd-f454-4ca3-9d82-7f4535375548, size 1024.00 MB, duration 9.30 sec, destination /opt/stack/data/cinder/conversion/07f7eafd-f454-4ca3-9d82-7f4535375548.temp_image.e76bcd95-096e-4de4-9855-0e19e64c8503twaytfuf.img {{(pid=87116) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 06 11:53:43 devstack cinder-volume[87116]: INFO cinder.image.image_utils [None req-dbeb16a2-d83a-4fae-a306-652d9704617e tempest-VolumesActionsTest-1082049010 None] Converted 1024.00 MB image at 110.08 MB/s Nov 06 11:53:43 devstack cinder-volume[87116]: DEBUG cinder.image.image_utils [None req-dbeb16a2-d83a-4fae-a306-652d9704617e tempest-VolumesActionsTest-1082049010 None] e76bcd95-096e-4de4-9855-0e19e64c8503 was raw, no need to convert to raw {{(pid=87116) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1186}} Nov 06 11:53:45 devstack cinder-volume[87116]: INFO cinder.volume.manager [req-397c0ee6-0cd0-495a-8ef9-0aa43febe8b5 req-b266e511-5687-403f-9ea7-203d082657ea tempest-TestInstancesWithCinderVolumes-778023409 None] Terminate volume connection completed successfully. Nov 06 11:53:45 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [req-397c0ee6-0cd0-495a-8ef9-0aa43febe8b5 req-b266e511-5687-403f-9ea7-203d082657ea tempest-TestInstancesWithCinderVolumes-778023409 None] Deleting attachment 3ef81fbb-f2b0-407c-a006-29d91451abc2. {{(pid=87116) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 06 11:53:46 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-e54cb032-468e-4599-b203-a6775d387ad7 tempest-TestInstancesWithCinderVolumes-778023409 None] Acquiring lock "cinder-8df52254-632f-4669-ba3d-a52aa38c509a-delete_volume" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 11:53:46 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-e54cb032-468e-4599-b203-a6775d387ad7 tempest-TestInstancesWithCinderVolumes-778023409 None] Lock "cinder-8df52254-632f-4669-ba3d-a52aa38c509a-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 11:53:46 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-e54cb032-468e-4599-b203-a6775d387ad7 tempest-TestInstancesWithCinderVolumes-778023409 None] Acquiring lock "cinder-quobyte-8df52254-632f-4669-ba3d-a52aa38c509a" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 11:53:46 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-e54cb032-468e-4599-b203-a6775d387ad7 tempest-TestInstancesWithCinderVolumes-778023409 None] Lock "cinder-quobyte-8df52254-632f-4669-ba3d-a52aa38c509a" acquired by "delete_volume" :: waited 0.020s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 11:53:46 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fe0147e-85d2-4df0-9202-b0d44076cfbd]: (4, 'qcow2') {{(pid=88420) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 11:53:46 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-e54cb032-468e-4599-b203-a6775d387ad7 tempest-TestInstancesWithCinderVolumes-778023409 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-8df52254-632f-4669-ba3d-a52aa38c509a {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:53:46 devstack sudo[99912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-8df52254-632f-4669-ba3d-a52aa38c509a Nov 06 11:53:46 devstack sudo[99912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:53:46 devstack sudo[99912]: pam_unix(sudo:session): session closed for user root Nov 06 11:53:46 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-e54cb032-468e-4599-b203-a6775d387ad7 tempest-TestInstancesWithCinderVolumes-778023409 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-8df52254-632f-4669-ba3d-a52aa38c509a" returned: 0 in 0.377s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:53:46 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-e54cb032-468e-4599-b203-a6775d387ad7 tempest-TestInstancesWithCinderVolumes-778023409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-8df52254-632f-4669-ba3d-a52aa38c509a {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:53:46 devstack sudo[99917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-8df52254-632f-4669-ba3d-a52aa38c509a Nov 06 11:53:46 devstack sudo[99917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:53:47 devstack sudo[99917]: pam_unix(sudo:session): session closed for user root Nov 06 11:53:47 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-e54cb032-468e-4599-b203-a6775d387ad7 tempest-TestInstancesWithCinderVolumes-778023409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-8df52254-632f-4669-ba3d-a52aa38c509a" returned: 0 in 0.242s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:53:47 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-e54cb032-468e-4599-b203-a6775d387ad7 tempest-TestInstancesWithCinderVolumes-778023409 None] Lock "cinder-quobyte-8df52254-632f-4669-ba3d-a52aa38c509a" released by "delete_volume" :: held 0.677s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 11:53:47 devstack cinder-volume[87116]: WARNING cinder.quota [None req-e54cb032-468e-4599-b203-a6775d387ad7 tempest-TestInstancesWithCinderVolumes-778023409 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-331188545-1474578177 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-331188545-1474578177, it is now deprecated. Please use the default quota class for default quota. Nov 06 11:53:47 devstack cinder-volume[87116]: WARNING cinder.quota [None req-e54cb032-468e-4599-b203-a6775d387ad7 tempest-TestInstancesWithCinderVolumes-778023409 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-331188545-1474578177 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-331188545-1474578177, it is now deprecated. Please use the default quota class for default quota. Nov 06 11:53:47 devstack cinder-volume[87116]: DEBUG cinder.quota [None req-e54cb032-468e-4599-b203-a6775d387ad7 tempest-TestInstancesWithCinderVolumes-778023409 None] Created reservations ['a93e7660-f0a5-4b69-9cef-30156ac7675c', '9ab96487-30b9-48f3-a7a2-4a24c4402941', 'b35e3277-aaed-42cf-bf1e-68531a22871c', '1dd0b7e8-1a18-469b-8f7e-14660a088b3d'] {{(pid=87116) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 11:53:47 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-e54cb032-468e-4599-b203-a6775d387ad7 tempest-TestInstancesWithCinderVolumes-778023409 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 11:53:47 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-e54cb032-468e-4599-b203-a6775d387ad7 tempest-TestInstancesWithCinderVolumes-778023409 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 11:53:47 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-e54cb032-468e-4599-b203-a6775d387ad7 tempest-TestInstancesWithCinderVolumes-778023409 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 11:53:47 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-e54cb032-468e-4599-b203-a6775d387ad7 tempest-TestInstancesWithCinderVolumes-778023409 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 11:53:47 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-e54cb032-468e-4599-b203-a6775d387ad7 tempest-TestInstancesWithCinderVolumes-778023409 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 11:53:47 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-e54cb032-468e-4599-b203-a6775d387ad7 tempest-TestInstancesWithCinderVolumes-778023409 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:53:47 devstack sudo[99920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756 Nov 06 11:53:47 devstack sudo[99920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:53:47 devstack sudo[99920]: pam_unix(sudo:session): session closed for user root Nov 06 11:53:47 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-e54cb032-468e-4599-b203-a6775d387ad7 tempest-TestInstancesWithCinderVolumes-778023409 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756" returned: 0 in 0.324s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:53:47 devstack cinder-volume[87116]: DEBUG cinder.manager [None req-e54cb032-468e-4599-b203-a6775d387ad7 tempest-TestInstancesWithCinderVolumes-778023409 None] Notifying Schedulers of capabilities ... {{(pid=87116) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 11:53:47 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-e54cb032-468e-4599-b203-a6775d387ad7 tempest-TestInstancesWithCinderVolumes-778023409 None] Deleted volume successfully. Nov 06 11:53:47 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-e54cb032-468e-4599-b203-a6775d387ad7 tempest-TestInstancesWithCinderVolumes-778023409 None] Lock "cinder-8df52254-632f-4669-ba3d-a52aa38c509a-delete_volume" released by "delete_volume" :: held 1.287s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 11:53:57 devstack cinder-volume[87116]: DEBUG dbcounter [-] [87116] Writing DB stats cinder:SELECT=74,cinder:INSERT=24,cinder:UPDATE=68,cinder:DELETE=3 {{(pid=87116) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 11:53:57 devstack cinder-volume[87116]: DEBUG dbcounter [-] [87116] Writing DB stats cinder:INSERT=17,cinder:UPDATE=59,cinder:SELECT=76,cinder:DELETE=6 {{(pid=87116) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 11:54:05 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-dbeb16a2-d83a-4fae-a306-652d9704617e tempest-VolumesActionsTest-1082049010 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 32.534s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 11:54:05 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-dbeb16a2-d83a-4fae-a306-652d9704617e tempest-VolumesActionsTest-1082049010 None] Uploaded volume to glance image-id: e76bcd95-096e-4de4-9855-0e19e64c8503. {{(pid=87116) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Nov 06 11:54:05 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-40040203-8461-4574-b21f-ded615f03011 tempest-VolumesCloneTest-605058744 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 29.793s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 11:54:05 devstack cinder-volume[87116]: INFO cinder.volume.drivers.remotefs [None req-40040203-8461-4574-b21f-ded615f03011 tempest-VolumesCloneTest-605058744 None] Cloning volume 18cd5b0e-6501-442e-b686-f3c2aed8a4d8 to volume 573e08b7-b507-4b36-9d5d-8953fe665bee Nov 06 11:54:05 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-dbeb16a2-d83a-4fae-a306-652d9704617e tempest-VolumesActionsTest-1082049010 None] Copy volume to image completed successfully. Nov 06 11:54:05 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-40040203-8461-4574-b21f-ded615f03011 tempest-VolumesCloneTest-605058744 None] Creating offline snapshot 0fde0a8a-a16b-4de0-ab7e-d69d6dc482ac of volume 18cd5b0e-6501-442e-b686-f3c2aed8a4d8 {{(pid=87116) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 06 11:54:05 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b9a6589-28c6-4fc0-8698-829f4e685651]: (4, 'qcow2') {{(pid=88420) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 11:54:05 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-40040203-8461-4574-b21f-ded615f03011 tempest-VolumesCloneTest-605058744 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-18cd5b0e-6501-442e-b686-f3c2aed8a4d8 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:54:05 devstack sudo[99931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-18cd5b0e-6501-442e-b686-f3c2aed8a4d8 Nov 06 11:54:05 devstack sudo[99931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:54:05 devstack sudo[99931]: pam_unix(sudo:session): session closed for user root Nov 06 11:54:05 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-40040203-8461-4574-b21f-ded615f03011 tempest-VolumesCloneTest-605058744 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-18cd5b0e-6501-442e-b686-f3c2aed8a4d8" returned: 0 in 0.448s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:54:05 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-40040203-8461-4574-b21f-ded615f03011 tempest-VolumesCloneTest-605058744 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-18cd5b0e-6501-442e-b686-f3c2aed8a4d8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-18cd5b0e-6501-442e-b686-f3c2aed8a4d8.0fde0a8a-a16b-4de0-ab7e-d69d6dc482ac 1G {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:54:05 devstack sudo[99936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-18cd5b0e-6501-442e-b686-f3c2aed8a4d8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-18cd5b0e-6501-442e-b686-f3c2aed8a4d8.0fde0a8a-a16b-4de0-ab7e-d69d6dc482ac 1G Nov 06 11:54:05 devstack sudo[99936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:54:06 devstack sudo[99936]: pam_unix(sudo:session): session closed for user root Nov 06 11:54:06 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-40040203-8461-4574-b21f-ded615f03011 tempest-VolumesCloneTest-605058744 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-18cd5b0e-6501-442e-b686-f3c2aed8a4d8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-18cd5b0e-6501-442e-b686-f3c2aed8a4d8.0fde0a8a-a16b-4de0-ab7e-d69d6dc482ac 1G" returned: 0 in 0.546s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:54:06 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-40040203-8461-4574-b21f-ded615f03011 tempest-VolumesCloneTest-605058744 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-18cd5b0e-6501-442e-b686-f3c2aed8a4d8 -F qcow2 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-18cd5b0e-6501-442e-b686-f3c2aed8a4d8.0fde0a8a-a16b-4de0-ab7e-d69d6dc482ac {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:54:06 devstack sudo[99942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-18cd5b0e-6501-442e-b686-f3c2aed8a4d8 -F qcow2 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-18cd5b0e-6501-442e-b686-f3c2aed8a4d8.0fde0a8a-a16b-4de0-ab7e-d69d6dc482ac Nov 06 11:54:06 devstack sudo[99942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:54:06 devstack sudo[99942]: pam_unix(sudo:session): session closed for user root Nov 06 11:54:06 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-40040203-8461-4574-b21f-ded615f03011 tempest-VolumesCloneTest-605058744 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-18cd5b0e-6501-442e-b686-f3c2aed8a4d8 -F qcow2 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-18cd5b0e-6501-442e-b686-f3c2aed8a4d8.0fde0a8a-a16b-4de0-ab7e-d69d6dc482ac" returned: 0 in 0.322s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:54:06 devstack cinder-volume[87116]: WARNING cinder.volume.drivers.remotefs [None req-40040203-8461-4574-b21f-ded615f03011 tempest-VolumesCloneTest-605058744 None] /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-18cd5b0e-6501-442e-b686-f3c2aed8a4d8.0fde0a8a-a16b-4de0-ab7e-d69d6dc482ac is being set with open permissions: ugo+rw Nov 06 11:54:06 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-40040203-8461-4574-b21f-ded615f03011 tempest-VolumesCloneTest-605058744 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-18cd5b0e-6501-442e-b686-f3c2aed8a4d8.0fde0a8a-a16b-4de0-ab7e-d69d6dc482ac {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:54:06 devstack sudo[99948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-18cd5b0e-6501-442e-b686-f3c2aed8a4d8.0fde0a8a-a16b-4de0-ab7e-d69d6dc482ac Nov 06 11:54:06 devstack sudo[99948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:54:06 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-2fc3bb2c-6e34-4589-b601-ad480cb5f294 tempest-VolumesActionsTest-1082049010 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 11:54:06 devstack sudo[99948]: pam_unix(sudo:session): session closed for user root Nov 06 11:54:06 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-40040203-8461-4574-b21f-ded615f03011 tempest-VolumesCloneTest-605058744 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-18cd5b0e-6501-442e-b686-f3c2aed8a4d8.0fde0a8a-a16b-4de0-ab7e-d69d6dc482ac" returned: 0 in 0.279s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:54:06 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-40040203-8461-4574-b21f-ded615f03011 tempest-VolumesCloneTest-605058744 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-18cd5b0e-6501-442e-b686-f3c2aed8a4d8.info {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:54:06 devstack sudo[99951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-18cd5b0e-6501-442e-b686-f3c2aed8a4d8.info Nov 06 11:54:06 devstack sudo[99951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:54:07 devstack sudo[99951]: pam_unix(sudo:session): session closed for user root Nov 06 11:54:07 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-40040203-8461-4574-b21f-ded615f03011 tempest-VolumesCloneTest-605058744 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-18cd5b0e-6501-442e-b686-f3c2aed8a4d8.info" returned: 0 in 0.276s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:54:07 devstack cinder-volume[87116]: WARNING cinder.volume.drivers.remotefs [None req-40040203-8461-4574-b21f-ded615f03011 tempest-VolumesCloneTest-605058744 None] /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-18cd5b0e-6501-442e-b686-f3c2aed8a4d8.info is being set with open permissions: ugo+rw Nov 06 11:54:07 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-40040203-8461-4574-b21f-ded615f03011 tempest-VolumesCloneTest-605058744 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-18cd5b0e-6501-442e-b686-f3c2aed8a4d8.info {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:54:07 devstack sudo[99954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-18cd5b0e-6501-442e-b686-f3c2aed8a4d8.info Nov 06 11:54:07 devstack sudo[99954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:54:07 devstack sudo[99954]: pam_unix(sudo:session): session closed for user root Nov 06 11:54:07 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-40040203-8461-4574-b21f-ded615f03011 tempest-VolumesCloneTest-605058744 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-18cd5b0e-6501-442e-b686-f3c2aed8a4d8.info" returned: 0 in 0.364s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:54:07 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-40040203-8461-4574-b21f-ded615f03011 tempest-VolumesCloneTest-605058744 None] Acquiring lock "cinder-quobyte-573e08b7-b507-4b36-9d5d-8953fe665bee" by "_copy_volume_from_snapshot" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 11:54:07 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-40040203-8461-4574-b21f-ded615f03011 tempest-VolumesCloneTest-605058744 None] Lock "cinder-quobyte-573e08b7-b507-4b36-9d5d-8953fe665bee" acquired by "_copy_volume_from_snapshot" :: waited 0.015s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 11:54:07 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-40040203-8461-4574-b21f-ded615f03011 tempest-VolumesCloneTest-605058744 None] snapshot: 0fde0a8a-a16b-4de0-ab7e-d69d6dc482ac, volume: 573e08b7-b507-4b36-9d5d-8953fe665bee, {{(pid=87116) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 06 11:54:07 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-40040203-8461-4574-b21f-ded615f03011 tempest-VolumesCloneTest-605058744 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 11:54:07 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-40040203-8461-4574-b21f-ded615f03011 tempest-VolumesCloneTest-605058744 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 11:54:07 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-40040203-8461-4574-b21f-ded615f03011 tempest-VolumesCloneTest-605058744 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 11:54:07 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-40040203-8461-4574-b21f-ded615f03011 tempest-VolumesCloneTest-605058744 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 11:54:07 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-40040203-8461-4574-b21f-ded615f03011 tempest-VolumesCloneTest-605058744 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 11:54:07 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[113d076b-689e-41ce-a0da-1157cf004575]: (4, 'qcow2') {{(pid=88420) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 11:54:07 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-40040203-8461-4574-b21f-ded615f03011 tempest-VolumesCloneTest-605058744 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-18cd5b0e-6501-442e-b686-f3c2aed8a4d8.0fde0a8a-a16b-4de0-ab7e-d69d6dc482ac {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:54:07 devstack sudo[99957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-18cd5b0e-6501-442e-b686-f3c2aed8a4d8.0fde0a8a-a16b-4de0-ab7e-d69d6dc482ac Nov 06 11:54:07 devstack sudo[99957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:54:08 devstack sudo[99957]: pam_unix(sudo:session): session closed for user root Nov 06 11:54:08 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-40040203-8461-4574-b21f-ded615f03011 tempest-VolumesCloneTest-605058744 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-18cd5b0e-6501-442e-b686-f3c2aed8a4d8.0fde0a8a-a16b-4de0-ab7e-d69d6dc482ac" returned: 0 in 0.475s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:54:08 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-40040203-8461-4574-b21f-ded615f03011 tempest-VolumesCloneTest-605058744 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-18cd5b0e-6501-442e-b686-f3c2aed8a4d8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87116) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 11:54:08 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1de4645-04b5-4a0c-a8f4-cf19f418d5dc]: (4, 'qcow2') {{(pid=88420) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 11:54:08 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-40040203-8461-4574-b21f-ded615f03011 tempest-VolumesCloneTest-605058744 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-18cd5b0e-6501-442e-b686-f3c2aed8a4d8 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:54:08 devstack sudo[99962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-18cd5b0e-6501-442e-b686-f3c2aed8a4d8 Nov 06 11:54:08 devstack sudo[99962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:54:08 devstack sudo[99962]: pam_unix(sudo:session): session closed for user root Nov 06 11:54:08 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-40040203-8461-4574-b21f-ded615f03011 tempest-VolumesCloneTest-605058744 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-18cd5b0e-6501-442e-b686-f3c2aed8a4d8" returned: 0 in 0.485s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:54:08 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-40040203-8461-4574-b21f-ded615f03011 tempest-VolumesCloneTest-605058744 None] will copy from snapshot at /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-18cd5b0e-6501-442e-b686-f3c2aed8a4d8 {{(pid=87116) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 06 11:54:08 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-40040203-8461-4574-b21f-ded615f03011 tempest-VolumesCloneTest-605058744 None] Creating direct copy from snapshot {{(pid=87116) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 06 11:54:08 devstack cinder-volume[87116]: DEBUG cinder.utils [None req-40040203-8461-4574-b21f-ded615f03011 tempest-VolumesCloneTest-605058744 None] Path /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-573e08b7-b507-4b36-9d5d-8953fe665bee not found in is_blk_device check {{(pid=87116) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 06 11:54:08 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-40040203-8461-4574-b21f-ded615f03011 tempest-VolumesCloneTest-605058744 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-18cd5b0e-6501-442e-b686-f3c2aed8a4d8 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-573e08b7-b507-4b36-9d5d-8953fe665bee {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:54:08 devstack sudo[99968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-18cd5b0e-6501-442e-b686-f3c2aed8a4d8 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-573e08b7-b507-4b36-9d5d-8953fe665bee Nov 06 11:54:08 devstack sudo[99968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:54:16 devstack sudo[99968]: pam_unix(sudo:session): session closed for user root Nov 06 11:54:16 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-40040203-8461-4574-b21f-ded615f03011 tempest-VolumesCloneTest-605058744 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-18cd5b0e-6501-442e-b686-f3c2aed8a4d8 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-573e08b7-b507-4b36-9d5d-8953fe665bee" returned: 0 in 7.831s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:54:16 devstack cinder-volume[87116]: DEBUG cinder.image.image_utils [None req-40040203-8461-4574-b21f-ded615f03011 tempest-VolumesCloneTest-605058744 None] Image conversion details: src /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-18cd5b0e-6501-442e-b686-f3c2aed8a4d8, size 1024.00 MB, duration 7.83 sec, destination /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-573e08b7-b507-4b36-9d5d-8953fe665bee {{(pid=87116) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 06 11:54:16 devstack cinder-volume[87116]: INFO cinder.image.image_utils [None req-40040203-8461-4574-b21f-ded615f03011 tempest-VolumesCloneTest-605058744 None] Converted 1024.00 MB image at 130.74 MB/s Nov 06 11:54:16 devstack cinder-volume[87116]: WARNING cinder.volume.drivers.remotefs [None req-40040203-8461-4574-b21f-ded615f03011 tempest-VolumesCloneTest-605058744 None] /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-573e08b7-b507-4b36-9d5d-8953fe665bee is being set with open permissions: ugo+rw Nov 06 11:54:16 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-40040203-8461-4574-b21f-ded615f03011 tempest-VolumesCloneTest-605058744 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-573e08b7-b507-4b36-9d5d-8953fe665bee {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:54:16 devstack sudo[99982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-573e08b7-b507-4b36-9d5d-8953fe665bee Nov 06 11:54:16 devstack sudo[99982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:54:16 devstack sudo[99982]: pam_unix(sudo:session): session closed for user root Nov 06 11:54:16 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-40040203-8461-4574-b21f-ded615f03011 tempest-VolumesCloneTest-605058744 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-573e08b7-b507-4b36-9d5d-8953fe665bee" returned: 0 in 0.272s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:54:16 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-40040203-8461-4574-b21f-ded615f03011 tempest-VolumesCloneTest-605058744 None] Lock "cinder-quobyte-573e08b7-b507-4b36-9d5d-8953fe665bee" released by "_copy_volume_from_snapshot" :: held 9.157s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 11:54:16 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-40040203-8461-4574-b21f-ded615f03011 tempest-VolumesCloneTest-605058744 None] Acquiring lock "cinder-quobyte-0fde0a8a-a16b-4de0-ab7e-d69d6dc482ac" by "_delete_snapshot" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 11:54:16 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-40040203-8461-4574-b21f-ded615f03011 tempest-VolumesCloneTest-605058744 None] Lock "cinder-quobyte-0fde0a8a-a16b-4de0-ab7e-d69d6dc482ac" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 11:54:16 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-40040203-8461-4574-b21f-ded615f03011 tempest-VolumesCloneTest-605058744 None] Deleting offline snapshot 0fde0a8a-a16b-4de0-ab7e-d69d6dc482ac of volume 18cd5b0e-6501-442e-b686-f3c2aed8a4d8 {{(pid=87116) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 06 11:54:16 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-40040203-8461-4574-b21f-ded615f03011 tempest-VolumesCloneTest-605058744 None] snapshot_file for this snap is: volume-18cd5b0e-6501-442e-b686-f3c2aed8a4d8.0fde0a8a-a16b-4de0-ab7e-d69d6dc482ac {{(pid=87116) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 06 11:54:16 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[d05879ac-0c65-4c76-b543-ec2cad225a51]: (4, 'qcow2') {{(pid=88420) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 11:54:16 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-40040203-8461-4574-b21f-ded615f03011 tempest-VolumesCloneTest-605058744 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-18cd5b0e-6501-442e-b686-f3c2aed8a4d8.0fde0a8a-a16b-4de0-ab7e-d69d6dc482ac {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:54:16 devstack cinder-volume[87116]: DEBUG dbcounter [-] [87116] Writing DB stats cinder:UPDATE=2,cinder:SELECT=3,cinder:INSERT=1 {{(pid=87116) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 11:54:16 devstack sudo[99985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-18cd5b0e-6501-442e-b686-f3c2aed8a4d8.0fde0a8a-a16b-4de0-ab7e-d69d6dc482ac Nov 06 11:54:16 devstack sudo[99985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:54:17 devstack sudo[99985]: pam_unix(sudo:session): session closed for user root Nov 06 11:54:17 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-40040203-8461-4574-b21f-ded615f03011 tempest-VolumesCloneTest-605058744 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-18cd5b0e-6501-442e-b686-f3c2aed8a4d8.0fde0a8a-a16b-4de0-ab7e-d69d6dc482ac" returned: 0 in 0.371s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:54:17 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-40040203-8461-4574-b21f-ded615f03011 tempest-VolumesCloneTest-605058744 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-18cd5b0e-6501-442e-b686-f3c2aed8a4d8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87116) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 11:54:17 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[77599219-4645-41b5-b7e9-6f1cab3856f7]: (4, 'qcow2') {{(pid=88420) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 11:54:17 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-40040203-8461-4574-b21f-ded615f03011 tempest-VolumesCloneTest-605058744 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-18cd5b0e-6501-442e-b686-f3c2aed8a4d8 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:54:17 devstack sudo[99991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-18cd5b0e-6501-442e-b686-f3c2aed8a4d8 Nov 06 11:54:17 devstack sudo[99991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:54:17 devstack sudo[99991]: pam_unix(sudo:session): session closed for user root Nov 06 11:54:17 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-40040203-8461-4574-b21f-ded615f03011 tempest-VolumesCloneTest-605058744 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-18cd5b0e-6501-442e-b686-f3c2aed8a4d8" returned: 0 in 0.558s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:54:17 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-40040203-8461-4574-b21f-ded615f03011 tempest-VolumesCloneTest-605058744 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-18cd5b0e-6501-442e-b686-f3c2aed8a4d8.0fde0a8a-a16b-4de0-ab7e-d69d6dc482ac {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:54:17 devstack sudo[99996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-18cd5b0e-6501-442e-b686-f3c2aed8a4d8.0fde0a8a-a16b-4de0-ab7e-d69d6dc482ac Nov 06 11:54:17 devstack sudo[99996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:54:18 devstack sudo[99996]: pam_unix(sudo:session): session closed for user root Nov 06 11:54:18 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-40040203-8461-4574-b21f-ded615f03011 tempest-VolumesCloneTest-605058744 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-18cd5b0e-6501-442e-b686-f3c2aed8a4d8.0fde0a8a-a16b-4de0-ab7e-d69d6dc482ac" returned: 0 in 0.355s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:54:18 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-40040203-8461-4574-b21f-ded615f03011 tempest-VolumesCloneTest-605058744 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-18cd5b0e-6501-442e-b686-f3c2aed8a4d8.0fde0a8a-a16b-4de0-ab7e-d69d6dc482ac {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:54:18 devstack sudo[100003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-18cd5b0e-6501-442e-b686-f3c2aed8a4d8.0fde0a8a-a16b-4de0-ab7e-d69d6dc482ac Nov 06 11:54:18 devstack sudo[100003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:54:18 devstack sudo[100003]: pam_unix(sudo:session): session closed for user root Nov 06 11:54:18 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-40040203-8461-4574-b21f-ded615f03011 tempest-VolumesCloneTest-605058744 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-18cd5b0e-6501-442e-b686-f3c2aed8a4d8.0fde0a8a-a16b-4de0-ab7e-d69d6dc482ac" returned: 0 in 0.265s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:54:18 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-40040203-8461-4574-b21f-ded615f03011 tempest-VolumesCloneTest-605058744 None] Lock "cinder-quobyte-0fde0a8a-a16b-4de0-ab7e-d69d6dc482ac" released by "_delete_snapshot" :: held 1.659s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 11:54:18 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-40040203-8461-4574-b21f-ded615f03011 tempest-VolumesCloneTest-605058744 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 13.253s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 11:54:18 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [req-03b8465c-4ce3-47af-b60c-46ecd90fa233 req-a98aad7a-cdbe-467a-88ad-98a0871ddb9c tempest-TestShelveInstance-1615912961 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 40.918s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 11:54:18 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [req-03b8465c-4ce3-47af-b60c-46ecd90fa233 req-a98aad7a-cdbe-467a-88ad-98a0871ddb9c tempest-TestShelveInstance-1615912961 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.015s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 11:54:18 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-2fc3bb2c-6e34-4589-b601-ad480cb5f294 tempest-VolumesActionsTest-1082049010 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 11.770s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 11:54:18 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-40040203-8461-4574-b21f-ded615f03011 tempest-VolumesCloneTest-605058744 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (83766994-16f6-44d0-8745-fcae7b56c945) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-573e08b7-b507-4b36-9d5d-8953fe665bee', 'volume_size': 2, 'source_volid': '18cd5b0e-6501-442e-b686-f3c2aed8a4d8', 'source_volstatus': 'available'}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:54:18 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-40040203-8461-4574-b21f-ded615f03011 tempest-VolumesCloneTest-605058744 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a379fee8-b593-4361-8298-fca6cd932691) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:54:18 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[671034d4-ec63-4bfc-8274-32eb6d0e59b1]: (4, 'qcow2') {{(pid=88420) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 11:54:18 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-2fc3bb2c-6e34-4589-b601-ad480cb5f294 tempest-VolumesActionsTest-1082049010 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-07f7eafd-f454-4ca3-9d82-7f4535375548 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:54:18 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-40040203-8461-4574-b21f-ded615f03011 tempest-VolumesCloneTest-605058744 None] Volume volume-573e08b7-b507-4b36-9d5d-8953fe665bee (573e08b7-b507-4b36-9d5d-8953fe665bee): created successfully Nov 06 11:54:18 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-40040203-8461-4574-b21f-ded615f03011 tempest-VolumesCloneTest-605058744 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a379fee8-b593-4361-8298-fca6cd932691) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:54:18 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-40040203-8461-4574-b21f-ded615f03011 tempest-VolumesCloneTest-605058744 None] Flow 'volume_create_manager' (a7bb4a4d-958f-4e73-b904-d132dfa14292) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 11:54:18 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-40040203-8461-4574-b21f-ded615f03011 tempest-VolumesCloneTest-605058744 None] Created volume successfully. Nov 06 11:54:18 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [req-03b8465c-4ce3-47af-b60c-46ecd90fa233 req-a98aad7a-cdbe-467a-88ad-98a0871ddb9c tempest-TestShelveInstance-1615912961 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f', 'name': 'volume-14e75353-8e88-4e4d-93b1-ac70324e53c9', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '752894f2-5ab8-45d4-830c-92a8fe6a2511', 'enforce_multipath': True} {{(pid=87116) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 06 11:54:18 devstack sudo[100006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-07f7eafd-f454-4ca3-9d82-7f4535375548 Nov 06 11:54:18 devstack sudo[100006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:54:18 devstack cinder-volume[87116]: INFO cinder.volume.manager [req-03b8465c-4ce3-47af-b60c-46ecd90fa233 req-a98aad7a-cdbe-467a-88ad-98a0871ddb9c tempest-TestShelveInstance-1615912961 None] attachment_update completed successfully. Nov 06 11:54:19 devstack sudo[100006]: pam_unix(sudo:session): session closed for user root Nov 06 11:54:19 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-2fc3bb2c-6e34-4589-b601-ad480cb5f294 tempest-VolumesActionsTest-1082049010 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-07f7eafd-f454-4ca3-9d82-7f4535375548" returned: 0 in 0.503s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:54:19 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4347b76-e92f-4d83-9d30-a4200a4420e7]: (4, 'qcow2') {{(pid=88420) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 11:54:19 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-2fc3bb2c-6e34-4589-b601-ad480cb5f294 tempest-VolumesActionsTest-1082049010 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-07f7eafd-f454-4ca3-9d82-7f4535375548 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:54:19 devstack sudo[100012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-07f7eafd-f454-4ca3-9d82-7f4535375548 Nov 06 11:54:19 devstack sudo[100012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:54:19 devstack sudo[100012]: pam_unix(sudo:session): session closed for user root Nov 06 11:54:19 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-2fc3bb2c-6e34-4589-b601-ad480cb5f294 tempest-VolumesActionsTest-1082049010 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-07f7eafd-f454-4ca3-9d82-7f4535375548" returned: 0 in 0.496s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:54:19 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-2fc3bb2c-6e34-4589-b601-ad480cb5f294 tempest-VolumesActionsTest-1082049010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-07f7eafd-f454-4ca3-9d82-7f4535375548 /opt/stack/data/cinder/conversion/07f7eafd-f454-4ca3-9d82-7f4535375548.temp_image.d73eab6e-fc80-497a-a005-a2f58465e9ec9do8k4hl.img {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:54:19 devstack sudo[100122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-07f7eafd-f454-4ca3-9d82-7f4535375548 /opt/stack/data/cinder/conversion/07f7eafd-f454-4ca3-9d82-7f4535375548.temp_image.d73eab6e-fc80-497a-a005-a2f58465e9ec9do8k4hl.img Nov 06 11:54:19 devstack sudo[100122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:54:19 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-76f6dfc5-9cf0-4b07-81f6-1705d28a3411 tempest-VolumesCloneTest-605058744 None] Acquiring lock "cinder-573e08b7-b507-4b36-9d5d-8953fe665bee-delete_volume" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 11:54:19 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-76f6dfc5-9cf0-4b07-81f6-1705d28a3411 tempest-VolumesCloneTest-605058744 None] Lock "cinder-573e08b7-b507-4b36-9d5d-8953fe665bee-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 11:54:19 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-76f6dfc5-9cf0-4b07-81f6-1705d28a3411 tempest-VolumesCloneTest-605058744 None] Acquiring lock "cinder-quobyte-573e08b7-b507-4b36-9d5d-8953fe665bee" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 11:54:20 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-76f6dfc5-9cf0-4b07-81f6-1705d28a3411 tempest-VolumesCloneTest-605058744 None] Lock "cinder-quobyte-573e08b7-b507-4b36-9d5d-8953fe665bee" acquired by "delete_volume" :: waited 0.028s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 11:54:20 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[859dee2e-0e1a-41c7-ac0f-df2f22237904]: (4, 'qcow2') {{(pid=88420) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 11:54:20 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-76f6dfc5-9cf0-4b07-81f6-1705d28a3411 tempest-VolumesCloneTest-605058744 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-573e08b7-b507-4b36-9d5d-8953fe665bee {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:54:20 devstack sudo[100468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-573e08b7-b507-4b36-9d5d-8953fe665bee Nov 06 11:54:20 devstack sudo[100468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:54:21 devstack sudo[100468]: pam_unix(sudo:session): session closed for user root Nov 06 11:54:21 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-76f6dfc5-9cf0-4b07-81f6-1705d28a3411 tempest-VolumesCloneTest-605058744 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-573e08b7-b507-4b36-9d5d-8953fe665bee" returned: 0 in 1.213s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:54:21 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-76f6dfc5-9cf0-4b07-81f6-1705d28a3411 tempest-VolumesCloneTest-605058744 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-573e08b7-b507-4b36-9d5d-8953fe665bee {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:54:21 devstack sudo[100514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-573e08b7-b507-4b36-9d5d-8953fe665bee Nov 06 11:54:21 devstack sudo[100514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:54:21 devstack sudo[100514]: pam_unix(sudo:session): session closed for user root Nov 06 11:54:21 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-76f6dfc5-9cf0-4b07-81f6-1705d28a3411 tempest-VolumesCloneTest-605058744 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-573e08b7-b507-4b36-9d5d-8953fe665bee" returned: 0 in 0.654s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:54:22 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-76f6dfc5-9cf0-4b07-81f6-1705d28a3411 tempest-VolumesCloneTest-605058744 None] Lock "cinder-quobyte-573e08b7-b507-4b36-9d5d-8953fe665bee" released by "delete_volume" :: held 2.023s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 11:54:22 devstack cinder-volume[87116]: DEBUG cinder.quota [None req-76f6dfc5-9cf0-4b07-81f6-1705d28a3411 tempest-VolumesCloneTest-605058744 None] Created reservations ['b6eb4141-259b-46c7-88b2-b6b9924d46b7', 'ff5dd72d-7da2-440b-8e38-a0b45e314afb', '04a03a41-0649-4a0a-972c-34e9c3419f23', '5163f61e-ff7f-45b6-b545-4b4adbcd5680'] {{(pid=87116) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 11:54:22 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-76f6dfc5-9cf0-4b07-81f6-1705d28a3411 tempest-VolumesCloneTest-605058744 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 11:54:22 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-76f6dfc5-9cf0-4b07-81f6-1705d28a3411 tempest-VolumesCloneTest-605058744 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 11:54:22 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-76f6dfc5-9cf0-4b07-81f6-1705d28a3411 tempest-VolumesCloneTest-605058744 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 11:54:22 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-76f6dfc5-9cf0-4b07-81f6-1705d28a3411 tempest-VolumesCloneTest-605058744 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 11:54:22 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-76f6dfc5-9cf0-4b07-81f6-1705d28a3411 tempest-VolumesCloneTest-605058744 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.034s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 11:54:22 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-76f6dfc5-9cf0-4b07-81f6-1705d28a3411 tempest-VolumesCloneTest-605058744 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:54:22 devstack sudo[100523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756 Nov 06 11:54:22 devstack sudo[100523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:54:23 devstack sudo[100523]: pam_unix(sudo:session): session closed for user root Nov 06 11:54:23 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-76f6dfc5-9cf0-4b07-81f6-1705d28a3411 tempest-VolumesCloneTest-605058744 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756" returned: 0 in 0.983s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:54:23 devstack cinder-volume[87116]: DEBUG cinder.manager [None req-76f6dfc5-9cf0-4b07-81f6-1705d28a3411 tempest-VolumesCloneTest-605058744 None] Notifying Schedulers of capabilities ... {{(pid=87116) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 11:54:23 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-76f6dfc5-9cf0-4b07-81f6-1705d28a3411 tempest-VolumesCloneTest-605058744 None] Deleted volume successfully. Nov 06 11:54:23 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-76f6dfc5-9cf0-4b07-81f6-1705d28a3411 tempest-VolumesCloneTest-605058744 None] Lock "cinder-573e08b7-b507-4b36-9d5d-8953fe665bee-delete_volume" released by "delete_volume" :: held 3.839s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 11:54:23 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-4a46006a-849c-49d5-ae15-99cf8a32adaa tempest-VolumesCloneTest-605058744 None] Acquiring lock "cinder-18cd5b0e-6501-442e-b686-f3c2aed8a4d8-delete_volume" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 11:54:24 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-4a46006a-849c-49d5-ae15-99cf8a32adaa tempest-VolumesCloneTest-605058744 None] Lock "cinder-18cd5b0e-6501-442e-b686-f3c2aed8a4d8-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 11:54:24 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-4a46006a-849c-49d5-ae15-99cf8a32adaa tempest-VolumesCloneTest-605058744 None] Acquiring lock "cinder-quobyte-18cd5b0e-6501-442e-b686-f3c2aed8a4d8" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 11:54:24 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-4a46006a-849c-49d5-ae15-99cf8a32adaa tempest-VolumesCloneTest-605058744 None] Lock "cinder-quobyte-18cd5b0e-6501-442e-b686-f3c2aed8a4d8" acquired by "delete_volume" :: waited 0.053s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 11:54:24 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[99d01912-1a16-4d53-8cd2-1ff0e7e6ab0c]: (4, 'qcow2') {{(pid=88420) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 11:54:24 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-4a46006a-849c-49d5-ae15-99cf8a32adaa tempest-VolumesCloneTest-605058744 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-18cd5b0e-6501-442e-b686-f3c2aed8a4d8 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:54:24 devstack sudo[100526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-18cd5b0e-6501-442e-b686-f3c2aed8a4d8 Nov 06 11:54:24 devstack sudo[100526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:54:25 devstack sudo[100526]: pam_unix(sudo:session): session closed for user root Nov 06 11:54:25 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-4a46006a-849c-49d5-ae15-99cf8a32adaa tempest-VolumesCloneTest-605058744 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-18cd5b0e-6501-442e-b686-f3c2aed8a4d8" returned: 0 in 1.377s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:54:25 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-4a46006a-849c-49d5-ae15-99cf8a32adaa tempest-VolumesCloneTest-605058744 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-18cd5b0e-6501-442e-b686-f3c2aed8a4d8 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:54:25 devstack sudo[100531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-18cd5b0e-6501-442e-b686-f3c2aed8a4d8 Nov 06 11:54:25 devstack sudo[100531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:54:26 devstack sudo[100531]: pam_unix(sudo:session): session closed for user root Nov 06 11:54:26 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-4a46006a-849c-49d5-ae15-99cf8a32adaa tempest-VolumesCloneTest-605058744 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-18cd5b0e-6501-442e-b686-f3c2aed8a4d8" returned: 0 in 0.477s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:54:26 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-4a46006a-849c-49d5-ae15-99cf8a32adaa tempest-VolumesCloneTest-605058744 None] Lock "cinder-quobyte-18cd5b0e-6501-442e-b686-f3c2aed8a4d8" released by "delete_volume" :: held 2.099s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 11:54:26 devstack cinder-volume[87116]: DEBUG cinder.quota [None req-4a46006a-849c-49d5-ae15-99cf8a32adaa tempest-VolumesCloneTest-605058744 None] Created reservations ['87a9118b-ca56-4cab-917b-8146a8e88771', 'e926dc6e-295e-49e0-ad27-535371310b9d', '4dd339a0-8d5d-4412-9e1c-9e9f63a169d9', '8b587e4d-cdcf-46a1-844a-0ead6f9a09f0'] {{(pid=87116) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 11:54:26 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-4a46006a-849c-49d5-ae15-99cf8a32adaa tempest-VolumesCloneTest-605058744 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 11:54:26 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-4a46006a-849c-49d5-ae15-99cf8a32adaa tempest-VolumesCloneTest-605058744 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 11:54:26 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-4a46006a-849c-49d5-ae15-99cf8a32adaa tempest-VolumesCloneTest-605058744 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 11:54:26 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-4a46006a-849c-49d5-ae15-99cf8a32adaa tempest-VolumesCloneTest-605058744 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 11:54:26 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-4a46006a-849c-49d5-ae15-99cf8a32adaa tempest-VolumesCloneTest-605058744 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 11:54:26 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-4a46006a-849c-49d5-ae15-99cf8a32adaa tempest-VolumesCloneTest-605058744 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:54:26 devstack sudo[100534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756 Nov 06 11:54:26 devstack sudo[100534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:54:27 devstack sudo[100534]: pam_unix(sudo:session): session closed for user root Nov 06 11:54:27 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-4a46006a-849c-49d5-ae15-99cf8a32adaa tempest-VolumesCloneTest-605058744 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756" returned: 0 in 1.095s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:54:27 devstack cinder-volume[87116]: DEBUG cinder.manager [None req-4a46006a-849c-49d5-ae15-99cf8a32adaa tempest-VolumesCloneTest-605058744 None] Notifying Schedulers of capabilities ... {{(pid=87116) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 11:54:27 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-4a46006a-849c-49d5-ae15-99cf8a32adaa tempest-VolumesCloneTest-605058744 None] Deleted volume successfully. Nov 06 11:54:27 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-4a46006a-849c-49d5-ae15-99cf8a32adaa tempest-VolumesCloneTest-605058744 None] Lock "cinder-18cd5b0e-6501-442e-b686-f3c2aed8a4d8-delete_volume" released by "delete_volume" :: held 3.934s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 11:54:32 devstack sudo[100122]: pam_unix(sudo:session): session closed for user root Nov 06 11:54:32 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-2fc3bb2c-6e34-4589-b601-ad480cb5f294 tempest-VolumesActionsTest-1082049010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-07f7eafd-f454-4ca3-9d82-7f4535375548 /opt/stack/data/cinder/conversion/07f7eafd-f454-4ca3-9d82-7f4535375548.temp_image.d73eab6e-fc80-497a-a005-a2f58465e9ec9do8k4hl.img" returned: 0 in 12.520s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:54:32 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[9941c2b5-f611-4d9b-a093-0b5f57b63db4]: (4, 'qcow2') {{(pid=88420) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 11:54:32 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-2fc3bb2c-6e34-4589-b601-ad480cb5f294 tempest-VolumesActionsTest-1082049010 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-07f7eafd-f454-4ca3-9d82-7f4535375548 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:54:32 devstack sudo[100573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-07f7eafd-f454-4ca3-9d82-7f4535375548 Nov 06 11:54:32 devstack sudo[100573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:54:33 devstack sudo[100573]: pam_unix(sudo:session): session closed for user root Nov 06 11:54:33 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-2fc3bb2c-6e34-4589-b601-ad480cb5f294 tempest-VolumesActionsTest-1082049010 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-07f7eafd-f454-4ca3-9d82-7f4535375548" returned: 0 in 1.113s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:54:33 devstack cinder-volume[87116]: DEBUG cinder.image.image_utils [None req-2fc3bb2c-6e34-4589-b601-ad480cb5f294 tempest-VolumesActionsTest-1082049010 None] Image conversion details: src /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-07f7eafd-f454-4ca3-9d82-7f4535375548, size 1024.00 MB, duration 12.52 sec, destination /opt/stack/data/cinder/conversion/07f7eafd-f454-4ca3-9d82-7f4535375548.temp_image.d73eab6e-fc80-497a-a005-a2f58465e9ec9do8k4hl.img {{(pid=87116) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 06 11:54:33 devstack cinder-volume[87116]: INFO cinder.image.image_utils [None req-2fc3bb2c-6e34-4589-b601-ad480cb5f294 tempest-VolumesActionsTest-1082049010 None] Converted 1024.00 MB image at 81.78 MB/s Nov 06 11:54:33 devstack cinder-volume[87116]: DEBUG cinder.image.image_utils [None req-2fc3bb2c-6e34-4589-b601-ad480cb5f294 tempest-VolumesActionsTest-1082049010 None] d73eab6e-fc80-497a-a005-a2f58465e9ec was raw, converting to qcow2 {{(pid=87116) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1203}} Nov 06 11:54:33 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[741e4154-0bd2-4ca5-97b9-d696edc0c766]: (4, 'raw') {{(pid=88420) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 11:54:33 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-2fc3bb2c-6e34-4589-b601-ad480cb5f294 tempest-VolumesActionsTest-1082049010 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/07f7eafd-f454-4ca3-9d82-7f4535375548.temp_image.d73eab6e-fc80-497a-a005-a2f58465e9ec9do8k4hl.img {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:54:33 devstack sudo[100583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/07f7eafd-f454-4ca3-9d82-7f4535375548.temp_image.d73eab6e-fc80-497a-a005-a2f58465e9ec9do8k4hl.img Nov 06 11:54:33 devstack sudo[100583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:54:33 devstack sudo[100583]: pam_unix(sudo:session): session closed for user root Nov 06 11:54:33 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-2fc3bb2c-6e34-4589-b601-ad480cb5f294 tempest-VolumesActionsTest-1082049010 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/07f7eafd-f454-4ca3-9d82-7f4535375548.temp_image.d73eab6e-fc80-497a-a005-a2f58465e9ec9do8k4hl.img" returned: 0 in 0.441s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:54:33 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-2fc3bb2c-6e34-4589-b601-ad480cb5f294 tempest-VolumesActionsTest-1082049010 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/07f7eafd-f454-4ca3-9d82-7f4535375548.temp_image.d73eab6e-fc80-497a-a005-a2f58465e9ec9do8k4hl.img {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:54:33 devstack sudo[100587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/07f7eafd-f454-4ca3-9d82-7f4535375548.temp_image.d73eab6e-fc80-497a-a005-a2f58465e9ec9do8k4hl.img Nov 06 11:54:33 devstack sudo[100587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:54:34 devstack sudo[100587]: pam_unix(sudo:session): session closed for user root Nov 06 11:54:34 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-2fc3bb2c-6e34-4589-b601-ad480cb5f294 tempest-VolumesActionsTest-1082049010 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/07f7eafd-f454-4ca3-9d82-7f4535375548.temp_image.d73eab6e-fc80-497a-a005-a2f58465e9ec9do8k4hl.img" returned: 1 in 0.494s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:54:34 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-2fc3bb2c-6e34-4589-b601-ad480cb5f294 tempest-VolumesActionsTest-1082049010 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/07f7eafd-f454-4ca3-9d82-7f4535375548.temp_image.d73eab6e-fc80-497a-a005-a2f58465e9ec9do8k4hl.img' failed. Not Retrying. {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 06 11:54:34 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-2fc3bb2c-6e34-4589-b601-ad480cb5f294 tempest-VolumesActionsTest-1082049010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/07f7eafd-f454-4ca3-9d82-7f4535375548.temp_image.d73eab6e-fc80-497a-a005-a2f58465e9ec9do8k4hl.img /opt/stack/data/cinder/conversion/vol_upload_2xqg3i4c {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:54:34 devstack sudo[100593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/07f7eafd-f454-4ca3-9d82-7f4535375548.temp_image.d73eab6e-fc80-497a-a005-a2f58465e9ec9do8k4hl.img /opt/stack/data/cinder/conversion/vol_upload_2xqg3i4c Nov 06 11:54:34 devstack sudo[100593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:54:34 devstack sudo[100593]: pam_unix(sudo:session): session closed for user root Nov 06 11:54:34 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-2fc3bb2c-6e34-4589-b601-ad480cb5f294 tempest-VolumesActionsTest-1082049010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/07f7eafd-f454-4ca3-9d82-7f4535375548.temp_image.d73eab6e-fc80-497a-a005-a2f58465e9ec9do8k4hl.img /opt/stack/data/cinder/conversion/vol_upload_2xqg3i4c" returned: 0 in 0.266s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:54:34 devstack cinder-volume[87116]: DEBUG cinder.image.image_utils [None req-2fc3bb2c-6e34-4589-b601-ad480cb5f294 tempest-VolumesActionsTest-1082049010 None] Image conversion details: src /opt/stack/data/cinder/conversion/07f7eafd-f454-4ca3-9d82-7f4535375548.temp_image.d73eab6e-fc80-497a-a005-a2f58465e9ec9do8k4hl.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_2xqg3i4c {{(pid=87116) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 06 11:54:34 devstack cinder-volume[87116]: INFO cinder.image.image_utils [None req-2fc3bb2c-6e34-4589-b601-ad480cb5f294 tempest-VolumesActionsTest-1082049010 None] Converted 1024.00 MB image at 1024.00 MB/s Nov 06 11:54:34 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[0021c40f-976d-4351-a6d7-baa493f8f343]: (4, 'qcow2') {{(pid=88420) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 11:54:34 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-2fc3bb2c-6e34-4589-b601-ad480cb5f294 tempest-VolumesActionsTest-1082049010 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_2xqg3i4c {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:54:34 devstack sudo[100599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_2xqg3i4c Nov 06 11:54:34 devstack sudo[100599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:54:34 devstack sudo[100599]: pam_unix(sudo:session): session closed for user root Nov 06 11:54:34 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-2fc3bb2c-6e34-4589-b601-ad480cb5f294 tempest-VolumesActionsTest-1082049010 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_2xqg3i4c" returned: 0 in 0.344s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:54:37 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-2fc3bb2c-6e34-4589-b601-ad480cb5f294 tempest-VolumesActionsTest-1082049010 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 18.877s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 11:54:37 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-2fc3bb2c-6e34-4589-b601-ad480cb5f294 tempest-VolumesActionsTest-1082049010 None] Uploaded volume to glance image-id: d73eab6e-fc80-497a-a005-a2f58465e9ec. {{(pid=87116) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Nov 06 11:54:37 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-2fc3bb2c-6e34-4589-b601-ad480cb5f294 tempest-VolumesActionsTest-1082049010 None] Copy volume to image completed successfully. Nov 06 11:54:38 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-1047c6eb-ef3f-4eae-92f3-9aadd2a16e59 tempest-VolumesActionsTest-1082049010 None] Acquiring lock "cinder-07f7eafd-f454-4ca3-9d82-7f4535375548-delete_volume" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 11:54:38 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-1047c6eb-ef3f-4eae-92f3-9aadd2a16e59 tempest-VolumesActionsTest-1082049010 None] Lock "cinder-07f7eafd-f454-4ca3-9d82-7f4535375548-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 11:54:38 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-1047c6eb-ef3f-4eae-92f3-9aadd2a16e59 tempest-VolumesActionsTest-1082049010 None] Acquiring lock "cinder-quobyte-07f7eafd-f454-4ca3-9d82-7f4535375548" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 11:54:38 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-1047c6eb-ef3f-4eae-92f3-9aadd2a16e59 tempest-VolumesActionsTest-1082049010 None] Lock "cinder-quobyte-07f7eafd-f454-4ca3-9d82-7f4535375548" acquired by "delete_volume" :: waited 0.020s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 11:54:38 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[29c7be13-c13a-4939-89c7-3efe3de1c606]: (4, 'qcow2') {{(pid=88420) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 11:54:38 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-1047c6eb-ef3f-4eae-92f3-9aadd2a16e59 tempest-VolumesActionsTest-1082049010 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-07f7eafd-f454-4ca3-9d82-7f4535375548 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:54:39 devstack sudo[100611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-07f7eafd-f454-4ca3-9d82-7f4535375548 Nov 06 11:54:39 devstack sudo[100611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:54:39 devstack cinder-volume[87116]: DEBUG cinder.volume.flows.manager.create_volume [None req-3cbae39d-8ef1-423a-8563-c0b5b4df479e tempest-VolumesCloneNegativeTest-798083277 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87116) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 11:54:39 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-3cbae39d-8ef1-423a-8563-c0b5b4df479e tempest-VolumesCloneNegativeTest-798083277 None] Flow 'volume_create_manager' (d8c59f11-cc4e-4e79-b069-25acf083d9b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 11:54:39 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-3cbae39d-8ef1-423a-8563-c0b5b4df479e tempest-VolumesCloneNegativeTest-798083277 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (de271341-fe51-4fe1-b69b-3e6cd906c298) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:54:39 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-3cbae39d-8ef1-423a-8563-c0b5b4df479e tempest-VolumesCloneNegativeTest-798083277 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (de271341-fe51-4fe1-b69b-3e6cd906c298) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T10:54:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1381048675',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=99521e02-bb49-4253-8fdd-3c010e5baccd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2c6b95124323479ba357545cdecc2ece',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T10:54:39Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T10:54:39Z,use_quota=True,user_id='4726b9b89c1548eb9f81321fd2ad4606',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(34d3b144-d9b7-480a-a2e3-01e45f3d54c1),volume_type_id=34d3b144-d9b7-480a-a2e3-01e45f3d54c1)' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:54:39 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-3cbae39d-8ef1-423a-8563-c0b5b4df479e tempest-VolumesCloneNegativeTest-798083277 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5a04a07f-a957-4292-90b2-462dfad240c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:54:39 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-3cbae39d-8ef1-423a-8563-c0b5b4df479e tempest-VolumesCloneNegativeTest-798083277 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5a04a07f-a957-4292-90b2-462dfad240c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:54:39 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-3cbae39d-8ef1-423a-8563-c0b5b4df479e tempest-VolumesCloneNegativeTest-798083277 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1a64d28e-7dbb-4682-8ea0-5bd8109517c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:54:39 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-3cbae39d-8ef1-423a-8563-c0b5b4df479e tempest-VolumesCloneNegativeTest-798083277 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1a64d28e-7dbb-4682-8ea0-5bd8109517c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '99521e02-bb49-4253-8fdd-3c010e5baccd', 'volume_name': 'volume-99521e02-bb49-4253-8fdd-3c010e5baccd', 'volume_size': 2}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:54:39 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-3cbae39d-8ef1-423a-8563-c0b5b4df479e tempest-VolumesCloneNegativeTest-798083277 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (093f2100-9483-464d-ac1c-2e387fa9ddd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:54:39 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-3cbae39d-8ef1-423a-8563-c0b5b4df479e tempest-VolumesCloneNegativeTest-798083277 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (093f2100-9483-464d-ac1c-2e387fa9ddd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:54:39 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-3cbae39d-8ef1-423a-8563-c0b5b4df479e tempest-VolumesCloneNegativeTest-798083277 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (250bb597-fbd1-4064-bd33-d7e5a0a20b47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:54:39 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-3cbae39d-8ef1-423a-8563-c0b5b4df479e tempest-VolumesCloneNegativeTest-798083277 None] Volume 99521e02-bb49-4253-8fdd-3c010e5baccd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-99521e02-bb49-4253-8fdd-3c010e5baccd', 'volume_size': 2} Nov 06 11:54:39 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-3cbae39d-8ef1-423a-8563-c0b5b4df479e tempest-VolumesCloneNegativeTest-798083277 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 11:54:39 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-3cbae39d-8ef1-423a-8563-c0b5b4df479e tempest-VolumesCloneNegativeTest-798083277 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 11:54:39 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-3cbae39d-8ef1-423a-8563-c0b5b4df479e tempest-VolumesCloneNegativeTest-798083277 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T10:54:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1381048675',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=99521e02-bb49-4253-8fdd-3c010e5baccd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2c6b95124323479ba357545cdecc2ece',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T10:54:39Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T10:54:39Z,use_quota=True,user_id='4726b9b89c1548eb9f81321fd2ad4606',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(34d3b144-d9b7-480a-a2e3-01e45f3d54c1),volume_type_id=34d3b144-d9b7-480a-a2e3-01e45f3d54c1)}" {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 11:54:39 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-3cbae39d-8ef1-423a-8563-c0b5b4df479e tempest-VolumesCloneNegativeTest-798083277 None] Creating volume 99521e02-bb49-4253-8fdd-3c010e5baccd {{(pid=87116) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 11:54:39 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-3cbae39d-8ef1-423a-8563-c0b5b4df479e tempest-VolumesCloneNegativeTest-798083277 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 11:54:39 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-3cbae39d-8ef1-423a-8563-c0b5b4df479e tempest-VolumesCloneNegativeTest-798083277 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 11:54:39 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-3cbae39d-8ef1-423a-8563-c0b5b4df479e tempest-VolumesCloneNegativeTest-798083277 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 11:54:39 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-3cbae39d-8ef1-423a-8563-c0b5b4df479e tempest-VolumesCloneNegativeTest-798083277 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 11:54:39 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-3cbae39d-8ef1-423a-8563-c0b5b4df479e tempest-VolumesCloneNegativeTest-798083277 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 11:54:39 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-3cbae39d-8ef1-423a-8563-c0b5b4df479e tempest-VolumesCloneNegativeTest-798083277 None] Selected osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f as target Quobyte volume. {{(pid=87116) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 11:54:39 devstack cinder-volume[87116]: INFO cinder.volume.drivers.remotefs [None req-3cbae39d-8ef1-423a-8563-c0b5b4df479e tempest-VolumesCloneNegativeTest-798083277 None] casted to osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f Nov 06 11:54:39 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-3cbae39d-8ef1-423a-8563-c0b5b4df479e tempest-VolumesCloneNegativeTest-798083277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-99521e02-bb49-4253-8fdd-3c010e5baccd 2147483648 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:54:39 devstack sudo[100638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-99521e02-bb49-4253-8fdd-3c010e5baccd 2147483648 Nov 06 11:54:39 devstack sudo[100638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:54:39 devstack sudo[100611]: pam_unix(sudo:session): session closed for user root Nov 06 11:54:39 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-1047c6eb-ef3f-4eae-92f3-9aadd2a16e59 tempest-VolumesActionsTest-1082049010 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-07f7eafd-f454-4ca3-9d82-7f4535375548" returned: 0 in 0.476s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:54:39 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-1047c6eb-ef3f-4eae-92f3-9aadd2a16e59 tempest-VolumesActionsTest-1082049010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-07f7eafd-f454-4ca3-9d82-7f4535375548 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:54:39 devstack sudo[100643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-07f7eafd-f454-4ca3-9d82-7f4535375548 Nov 06 11:54:39 devstack sudo[100643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:54:39 devstack sudo[100643]: pam_unix(sudo:session): session closed for user root Nov 06 11:54:39 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-1047c6eb-ef3f-4eae-92f3-9aadd2a16e59 tempest-VolumesActionsTest-1082049010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-07f7eafd-f454-4ca3-9d82-7f4535375548" returned: 0 in 0.294s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:54:39 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-1047c6eb-ef3f-4eae-92f3-9aadd2a16e59 tempest-VolumesActionsTest-1082049010 None] Lock "cinder-quobyte-07f7eafd-f454-4ca3-9d82-7f4535375548" released by "delete_volume" :: held 0.838s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 11:54:39 devstack cinder-volume[87116]: DEBUG cinder.quota [None req-1047c6eb-ef3f-4eae-92f3-9aadd2a16e59 tempest-VolumesActionsTest-1082049010 None] Created reservations ['ebcef48e-3ad8-4583-9530-b25f28eb8a4e', '3a6c5f20-ebb8-4349-b142-feffc999edc5', '934a53ee-230a-44f9-9cf7-b9bc22427380', 'a5ece3c7-5e6e-4c5e-b128-47b2e51fef62'] {{(pid=87116) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 11:54:39 devstack cinder-volume[87116]: DEBUG oslo_service.periodic_task [None req-4fab4816-ec2b-4b19-b2ff-8548f2084354 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87116) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 11:54:39 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-4fab4816-ec2b-4b19-b2ff-8548f2084354 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 11:54:39 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-4fab4816-ec2b-4b19-b2ff-8548f2084354 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 11:54:39 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-4fab4816-ec2b-4b19-b2ff-8548f2084354 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 11:54:39 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-4fab4816-ec2b-4b19-b2ff-8548f2084354 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 11:54:39 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-4fab4816-ec2b-4b19-b2ff-8548f2084354 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 11:54:39 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-4fab4816-ec2b-4b19-b2ff-8548f2084354 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:54:39 devstack sudo[100650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756 Nov 06 11:54:39 devstack sudo[100650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:54:39 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-1047c6eb-ef3f-4eae-92f3-9aadd2a16e59 tempest-VolumesActionsTest-1082049010 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 11:54:39 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-1047c6eb-ef3f-4eae-92f3-9aadd2a16e59 tempest-VolumesActionsTest-1082049010 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 11:54:39 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-1047c6eb-ef3f-4eae-92f3-9aadd2a16e59 tempest-VolumesActionsTest-1082049010 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 11:54:39 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-1047c6eb-ef3f-4eae-92f3-9aadd2a16e59 tempest-VolumesActionsTest-1082049010 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 11:54:39 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-1047c6eb-ef3f-4eae-92f3-9aadd2a16e59 tempest-VolumesActionsTest-1082049010 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 11:54:39 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-1047c6eb-ef3f-4eae-92f3-9aadd2a16e59 tempest-VolumesActionsTest-1082049010 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:54:39 devstack sudo[100638]: pam_unix(sudo:session): session closed for user root Nov 06 11:54:39 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-3cbae39d-8ef1-423a-8563-c0b5b4df479e tempest-VolumesCloneNegativeTest-798083277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-99521e02-bb49-4253-8fdd-3c010e5baccd 2147483648" returned: 0 in 0.657s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:54:39 devstack sudo[100652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756 Nov 06 11:54:40 devstack sudo[100652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:54:40 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-3cbae39d-8ef1-423a-8563-c0b5b4df479e tempest-VolumesCloneNegativeTest-798083277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-99521e02-bb49-4253-8fdd-3c010e5baccd {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:54:40 devstack sudo[100654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-99521e02-bb49-4253-8fdd-3c010e5baccd Nov 06 11:54:40 devstack sudo[100654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:54:40 devstack sudo[100650]: pam_unix(sudo:session): session closed for user root Nov 06 11:54:40 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-4fab4816-ec2b-4b19-b2ff-8548f2084354 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756" returned: 0 in 0.578s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:54:40 devstack cinder-volume[87116]: DEBUG cinder.manager [None req-4fab4816-ec2b-4b19-b2ff-8548f2084354 None None] Notifying Schedulers of capabilities ... {{(pid=87116) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 11:54:40 devstack sudo[100652]: pam_unix(sudo:session): session closed for user root Nov 06 11:54:40 devstack cinder-volume[87116]: DEBUG oslo_service.periodic_task [None req-4fab4816-ec2b-4b19-b2ff-8548f2084354 None None] Running periodic task VolumeManager._thread_info {{(pid=87116) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 11:54:40 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-4fab4816-ec2b-4b19-b2ff-8548f2084354 None None] thread count: 28 {{(pid=87116) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 06 11:54:40 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-4fab4816-ec2b-4b19-b2ff-8548f2084354 None None] thread info: [<_MainThread(MainThread, started 131399520669824)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87116) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 06 11:54:40 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-1047c6eb-ef3f-4eae-92f3-9aadd2a16e59 tempest-VolumesActionsTest-1082049010 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756" returned: 0 in 0.537s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:54:40 devstack cinder-volume[87116]: DEBUG cinder.manager [None req-1047c6eb-ef3f-4eae-92f3-9aadd2a16e59 tempest-VolumesActionsTest-1082049010 None] Notifying Schedulers of capabilities ... {{(pid=87116) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 11:54:40 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-1047c6eb-ef3f-4eae-92f3-9aadd2a16e59 tempest-VolumesActionsTest-1082049010 None] Deleted volume successfully. Nov 06 11:54:40 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-1047c6eb-ef3f-4eae-92f3-9aadd2a16e59 tempest-VolumesActionsTest-1082049010 None] Lock "cinder-07f7eafd-f454-4ca3-9d82-7f4535375548-delete_volume" released by "delete_volume" :: held 1.725s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 11:54:40 devstack sudo[100654]: pam_unix(sudo:session): session closed for user root Nov 06 11:54:40 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-3cbae39d-8ef1-423a-8563-c0b5b4df479e tempest-VolumesCloneNegativeTest-798083277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-99521e02-bb49-4253-8fdd-3c010e5baccd" returned: 0 in 0.527s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:54:40 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-3cbae39d-8ef1-423a-8563-c0b5b4df479e tempest-VolumesCloneNegativeTest-798083277 None] <== create_volume: return (1266ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f'} {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 11:54:40 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-3cbae39d-8ef1-423a-8563-c0b5b4df479e tempest-VolumesCloneNegativeTest-798083277 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.271s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 11:54:40 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-3cbae39d-8ef1-423a-8563-c0b5b4df479e tempest-VolumesCloneNegativeTest-798083277 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (250bb597-fbd1-4064-bd33-d7e5a0a20b47) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-99521e02-bb49-4253-8fdd-3c010e5baccd', 'volume_size': 2}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:54:40 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-3cbae39d-8ef1-423a-8563-c0b5b4df479e tempest-VolumesCloneNegativeTest-798083277 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7796d73b-952c-4e18-84b3-f9f98af1235b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:54:40 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-3cbae39d-8ef1-423a-8563-c0b5b4df479e tempest-VolumesCloneNegativeTest-798083277 None] Volume volume-99521e02-bb49-4253-8fdd-3c010e5baccd (99521e02-bb49-4253-8fdd-3c010e5baccd): created successfully Nov 06 11:54:40 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-3cbae39d-8ef1-423a-8563-c0b5b4df479e tempest-VolumesCloneNegativeTest-798083277 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7796d73b-952c-4e18-84b3-f9f98af1235b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:54:40 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-3cbae39d-8ef1-423a-8563-c0b5b4df479e tempest-VolumesCloneNegativeTest-798083277 None] Flow 'volume_create_manager' (d8c59f11-cc4e-4e79-b069-25acf083d9b2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 11:54:40 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-3cbae39d-8ef1-423a-8563-c0b5b4df479e tempest-VolumesCloneNegativeTest-798083277 None] Created volume successfully. Nov 06 11:54:41 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-3e99e0c6-a5ee-4e09-b839-bb1ec636b3e1 tempest-VolumesCloneNegativeTest-798083277 None] Acquiring lock "cinder-99521e02-bb49-4253-8fdd-3c010e5baccd-delete_volume" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 11:54:41 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-3e99e0c6-a5ee-4e09-b839-bb1ec636b3e1 tempest-VolumesCloneNegativeTest-798083277 None] Lock "cinder-99521e02-bb49-4253-8fdd-3c010e5baccd-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 11:54:41 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-3e99e0c6-a5ee-4e09-b839-bb1ec636b3e1 tempest-VolumesCloneNegativeTest-798083277 None] Acquiring lock "cinder-quobyte-99521e02-bb49-4253-8fdd-3c010e5baccd" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 11:54:41 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-3e99e0c6-a5ee-4e09-b839-bb1ec636b3e1 tempest-VolumesCloneNegativeTest-798083277 None] Lock "cinder-quobyte-99521e02-bb49-4253-8fdd-3c010e5baccd" acquired by "delete_volume" :: waited 0.014s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 11:54:41 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[21706813-7f61-4f47-b6fc-80530c484701]: (4, 'qcow2') {{(pid=88420) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 11:54:41 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-3e99e0c6-a5ee-4e09-b839-bb1ec636b3e1 tempest-VolumesCloneNegativeTest-798083277 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-99521e02-bb49-4253-8fdd-3c010e5baccd {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:54:41 devstack sudo[100664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-99521e02-bb49-4253-8fdd-3c010e5baccd Nov 06 11:54:41 devstack sudo[100664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:54:42 devstack sudo[100664]: pam_unix(sudo:session): session closed for user root Nov 06 11:54:42 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-3e99e0c6-a5ee-4e09-b839-bb1ec636b3e1 tempest-VolumesCloneNegativeTest-798083277 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-99521e02-bb49-4253-8fdd-3c010e5baccd" returned: 0 in 0.587s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:54:42 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-3e99e0c6-a5ee-4e09-b839-bb1ec636b3e1 tempest-VolumesCloneNegativeTest-798083277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-99521e02-bb49-4253-8fdd-3c010e5baccd {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:54:42 devstack sudo[100673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-99521e02-bb49-4253-8fdd-3c010e5baccd Nov 06 11:54:42 devstack sudo[100673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:54:42 devstack sudo[100673]: pam_unix(sudo:session): session closed for user root Nov 06 11:54:42 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-3e99e0c6-a5ee-4e09-b839-bb1ec636b3e1 tempest-VolumesCloneNegativeTest-798083277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-99521e02-bb49-4253-8fdd-3c010e5baccd" returned: 0 in 0.290s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:54:42 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-3e99e0c6-a5ee-4e09-b839-bb1ec636b3e1 tempest-VolumesCloneNegativeTest-798083277 None] Lock "cinder-quobyte-99521e02-bb49-4253-8fdd-3c010e5baccd" released by "delete_volume" :: held 0.968s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 11:54:42 devstack cinder-volume[87116]: DEBUG cinder.quota [None req-3e99e0c6-a5ee-4e09-b839-bb1ec636b3e1 tempest-VolumesCloneNegativeTest-798083277 None] Created reservations ['337a4d55-fa3d-4326-aafb-bb308296ac63', 'ea355ec1-7795-4502-a26c-c51cb0e27e1a', 'f271d084-ea71-4740-b28d-f49310da6d79', 'fdc31e3a-8f8a-4709-925d-80328e11c97d'] {{(pid=87116) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 11:54:42 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-3e99e0c6-a5ee-4e09-b839-bb1ec636b3e1 tempest-VolumesCloneNegativeTest-798083277 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 11:54:42 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-3e99e0c6-a5ee-4e09-b839-bb1ec636b3e1 tempest-VolumesCloneNegativeTest-798083277 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 11:54:42 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-3e99e0c6-a5ee-4e09-b839-bb1ec636b3e1 tempest-VolumesCloneNegativeTest-798083277 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 11:54:42 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-3e99e0c6-a5ee-4e09-b839-bb1ec636b3e1 tempest-VolumesCloneNegativeTest-798083277 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 11:54:42 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-3e99e0c6-a5ee-4e09-b839-bb1ec636b3e1 tempest-VolumesCloneNegativeTest-798083277 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 11:54:42 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-3e99e0c6-a5ee-4e09-b839-bb1ec636b3e1 tempest-VolumesCloneNegativeTest-798083277 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:54:42 devstack sudo[100686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756 Nov 06 11:54:42 devstack sudo[100686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:54:43 devstack sudo[100686]: pam_unix(sudo:session): session closed for user root Nov 06 11:54:43 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-3e99e0c6-a5ee-4e09-b839-bb1ec636b3e1 tempest-VolumesCloneNegativeTest-798083277 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756" returned: 0 in 0.331s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:54:43 devstack cinder-volume[87116]: DEBUG cinder.manager [None req-3e99e0c6-a5ee-4e09-b839-bb1ec636b3e1 tempest-VolumesCloneNegativeTest-798083277 None] Notifying Schedulers of capabilities ... {{(pid=87116) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 11:54:43 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-3e99e0c6-a5ee-4e09-b839-bb1ec636b3e1 tempest-VolumesCloneNegativeTest-798083277 None] Deleted volume successfully. Nov 06 11:54:43 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-3e99e0c6-a5ee-4e09-b839-bb1ec636b3e1 tempest-VolumesCloneNegativeTest-798083277 None] Lock "cinder-99521e02-bb49-4253-8fdd-3c010e5baccd-delete_volume" released by "delete_volume" :: held 1.645s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 11:54:49 devstack cinder-volume[87116]: DEBUG cinder.volume.flows.manager.create_volume [None req-ba4a2bee-9406-4e16-b8aa-640d9604344b tempest-VolumesGetTest-482783544 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87116) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 11:54:49 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-ba4a2bee-9406-4e16-b8aa-640d9604344b tempest-VolumesGetTest-482783544 None] Flow 'volume_create_manager' (32cbdac0-cdca-4104-beb0-99925aa464db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 11:54:49 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-ba4a2bee-9406-4e16-b8aa-640d9604344b tempest-VolumesGetTest-482783544 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d68c1694-c040-4dac-9bc3-f18737cce8fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:54:49 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-ba4a2bee-9406-4e16-b8aa-640d9604344b tempest-VolumesGetTest-482783544 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d68c1694-c040-4dac-9bc3-f18737cce8fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T10:54:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1173873599',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fb07b8e0-072c-425a-9be6-f0ce55c537d8,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='d7de355fe6574fb3803d0652cc58996c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T10:54:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T10:54:49Z,use_quota=True,user_id='0e7aa2fc2ce242719cef88bdfb0422e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(34d3b144-d9b7-480a-a2e3-01e45f3d54c1),volume_type_id=34d3b144-d9b7-480a-a2e3-01e45f3d54c1)' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:54:49 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-ba4a2bee-9406-4e16-b8aa-640d9604344b tempest-VolumesGetTest-482783544 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2d6e7840-583d-4796-9086-f35dc9d93dce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:54:49 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-ba4a2bee-9406-4e16-b8aa-640d9604344b tempest-VolumesGetTest-482783544 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2d6e7840-583d-4796-9086-f35dc9d93dce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:54:49 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-ba4a2bee-9406-4e16-b8aa-640d9604344b tempest-VolumesGetTest-482783544 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fee9c3cc-ff27-46e6-8e0d-6798c9950ebc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:54:49 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-ba4a2bee-9406-4e16-b8aa-640d9604344b tempest-VolumesGetTest-482783544 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fee9c3cc-ff27-46e6-8e0d-6798c9950ebc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fb07b8e0-072c-425a-9be6-f0ce55c537d8', 'volume_name': 'volume-fb07b8e0-072c-425a-9be6-f0ce55c537d8', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:54:49 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-ba4a2bee-9406-4e16-b8aa-640d9604344b tempest-VolumesGetTest-482783544 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (73a45722-599e-40c6-9e64-f54e552cee60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:54:49 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-ba4a2bee-9406-4e16-b8aa-640d9604344b tempest-VolumesGetTest-482783544 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (73a45722-599e-40c6-9e64-f54e552cee60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:54:49 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-ba4a2bee-9406-4e16-b8aa-640d9604344b tempest-VolumesGetTest-482783544 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6d25c366-6c8d-42eb-b15a-7202485e4a9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:54:49 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-ba4a2bee-9406-4e16-b8aa-640d9604344b tempest-VolumesGetTest-482783544 None] Volume fb07b8e0-072c-425a-9be6-f0ce55c537d8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fb07b8e0-072c-425a-9be6-f0ce55c537d8', 'volume_size': 1} Nov 06 11:54:49 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-ba4a2bee-9406-4e16-b8aa-640d9604344b tempest-VolumesGetTest-482783544 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 11:54:49 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-ba4a2bee-9406-4e16-b8aa-640d9604344b tempest-VolumesGetTest-482783544 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 11:54:49 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-ba4a2bee-9406-4e16-b8aa-640d9604344b tempest-VolumesGetTest-482783544 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T10:54:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1173873599',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fb07b8e0-072c-425a-9be6-f0ce55c537d8,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='d7de355fe6574fb3803d0652cc58996c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T10:54:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T10:54:49Z,use_quota=True,user_id='0e7aa2fc2ce242719cef88bdfb0422e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(34d3b144-d9b7-480a-a2e3-01e45f3d54c1),volume_type_id=34d3b144-d9b7-480a-a2e3-01e45f3d54c1)}" {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 11:54:49 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-ba4a2bee-9406-4e16-b8aa-640d9604344b tempest-VolumesGetTest-482783544 None] Creating volume fb07b8e0-072c-425a-9be6-f0ce55c537d8 {{(pid=87116) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 11:54:49 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-ba4a2bee-9406-4e16-b8aa-640d9604344b tempest-VolumesGetTest-482783544 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 11:54:49 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-ba4a2bee-9406-4e16-b8aa-640d9604344b tempest-VolumesGetTest-482783544 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 11:54:49 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-ba4a2bee-9406-4e16-b8aa-640d9604344b tempest-VolumesGetTest-482783544 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 11:54:49 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-ba4a2bee-9406-4e16-b8aa-640d9604344b tempest-VolumesGetTest-482783544 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 11:54:49 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-ba4a2bee-9406-4e16-b8aa-640d9604344b tempest-VolumesGetTest-482783544 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 11:54:49 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-ba4a2bee-9406-4e16-b8aa-640d9604344b tempest-VolumesGetTest-482783544 None] Selected osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f as target Quobyte volume. {{(pid=87116) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 11:54:49 devstack cinder-volume[87116]: INFO cinder.volume.drivers.remotefs [None req-ba4a2bee-9406-4e16-b8aa-640d9604344b tempest-VolumesGetTest-482783544 None] casted to osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f Nov 06 11:54:49 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-ba4a2bee-9406-4e16-b8aa-640d9604344b tempest-VolumesGetTest-482783544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-fb07b8e0-072c-425a-9be6-f0ce55c537d8 1073741824 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:54:49 devstack sudo[100798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-fb07b8e0-072c-425a-9be6-f0ce55c537d8 1073741824 Nov 06 11:54:49 devstack sudo[100798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:54:49 devstack sudo[100798]: pam_unix(sudo:session): session closed for user root Nov 06 11:54:49 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-ba4a2bee-9406-4e16-b8aa-640d9604344b tempest-VolumesGetTest-482783544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-fb07b8e0-072c-425a-9be6-f0ce55c537d8 1073741824" returned: 0 in 0.666s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:54:49 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-ba4a2bee-9406-4e16-b8aa-640d9604344b tempest-VolumesGetTest-482783544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-fb07b8e0-072c-425a-9be6-f0ce55c537d8 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:54:49 devstack sudo[100804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-fb07b8e0-072c-425a-9be6-f0ce55c537d8 Nov 06 11:54:49 devstack sudo[100804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:54:50 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-ba4a2bee-9406-4e16-b8aa-640d9604344b tempest-VolumesGetTest-482783544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-fb07b8e0-072c-425a-9be6-f0ce55c537d8" returned: 0 in 0.362s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:54:50 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-ba4a2bee-9406-4e16-b8aa-640d9604344b tempest-VolumesGetTest-482783544 None] <== create_volume: return (1098ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f'} {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 11:54:50 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-ba4a2bee-9406-4e16-b8aa-640d9604344b tempest-VolumesGetTest-482783544 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.100s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 11:54:50 devstack sudo[100804]: pam_unix(sudo:session): session closed for user root Nov 06 11:54:50 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-ba4a2bee-9406-4e16-b8aa-640d9604344b tempest-VolumesGetTest-482783544 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6d25c366-6c8d-42eb-b15a-7202485e4a9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fb07b8e0-072c-425a-9be6-f0ce55c537d8', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:54:50 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-ba4a2bee-9406-4e16-b8aa-640d9604344b tempest-VolumesGetTest-482783544 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa6f5064-790f-4c57-bf3b-df5f69fb4736) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:54:50 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-ba4a2bee-9406-4e16-b8aa-640d9604344b tempest-VolumesGetTest-482783544 None] Volume volume-fb07b8e0-072c-425a-9be6-f0ce55c537d8 (fb07b8e0-072c-425a-9be6-f0ce55c537d8): created successfully Nov 06 11:54:50 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-ba4a2bee-9406-4e16-b8aa-640d9604344b tempest-VolumesGetTest-482783544 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa6f5064-790f-4c57-bf3b-df5f69fb4736) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:54:50 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-ba4a2bee-9406-4e16-b8aa-640d9604344b tempest-VolumesGetTest-482783544 None] Flow 'volume_create_manager' (32cbdac0-cdca-4104-beb0-99925aa464db) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 11:54:50 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-ba4a2bee-9406-4e16-b8aa-640d9604344b tempest-VolumesGetTest-482783544 None] Created volume successfully. Nov 06 11:54:51 devstack cinder-volume[87116]: DEBUG cinder.volume.flows.manager.create_volume [None req-3141d978-ccfb-4007-afaf-5e3f6226a298 tempest-TestMinimumBasicScenario-1835675095 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87116) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 11:54:51 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-3141d978-ccfb-4007-afaf-5e3f6226a298 tempest-TestMinimumBasicScenario-1835675095 None] Flow 'volume_create_manager' (322d0785-a426-48ca-91ea-8b3ad8d20ccb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 11:54:51 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-3141d978-ccfb-4007-afaf-5e3f6226a298 tempest-TestMinimumBasicScenario-1835675095 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c6d0bdd-494d-4752-b849-afbb55bc98bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:54:51 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-3141d978-ccfb-4007-afaf-5e3f6226a298 tempest-TestMinimumBasicScenario-1835675095 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c6d0bdd-494d-4752-b849-afbb55bc98bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T10:54:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-526740535',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=152f72a7-ed4e-4940-9668-1074ef10555b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ea64b10aceae48008dd88531b526888e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T10:54:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T10:54:52Z,use_quota=True,user_id='5b979b0fdc8b4d19a20e1b53db83929c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(34d3b144-d9b7-480a-a2e3-01e45f3d54c1),volume_type_id=34d3b144-d9b7-480a-a2e3-01e45f3d54c1)' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:54:51 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-3141d978-ccfb-4007-afaf-5e3f6226a298 tempest-TestMinimumBasicScenario-1835675095 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (721b80a6-a92a-4ade-a0a4-7ece96726524) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:54:51 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-3141d978-ccfb-4007-afaf-5e3f6226a298 tempest-TestMinimumBasicScenario-1835675095 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (721b80a6-a92a-4ade-a0a4-7ece96726524) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:54:51 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-3141d978-ccfb-4007-afaf-5e3f6226a298 tempest-TestMinimumBasicScenario-1835675095 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (904f125a-c570-40d8-9233-c8bfcbf35955) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:54:51 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-3141d978-ccfb-4007-afaf-5e3f6226a298 tempest-TestMinimumBasicScenario-1835675095 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (904f125a-c570-40d8-9233-c8bfcbf35955) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '152f72a7-ed4e-4940-9668-1074ef10555b', 'volume_name': 'volume-152f72a7-ed4e-4940-9668-1074ef10555b', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:54:52 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-3141d978-ccfb-4007-afaf-5e3f6226a298 tempest-TestMinimumBasicScenario-1835675095 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b3c1f180-8b73-474f-b761-72a4405e3fcc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:54:52 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-3141d978-ccfb-4007-afaf-5e3f6226a298 tempest-TestMinimumBasicScenario-1835675095 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b3c1f180-8b73-474f-b761-72a4405e3fcc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:54:52 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-3141d978-ccfb-4007-afaf-5e3f6226a298 tempest-TestMinimumBasicScenario-1835675095 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7b1aabb3-fbc1-4288-9009-05062c1a7307) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:54:52 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-3141d978-ccfb-4007-afaf-5e3f6226a298 tempest-TestMinimumBasicScenario-1835675095 None] Volume 152f72a7-ed4e-4940-9668-1074ef10555b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-152f72a7-ed4e-4940-9668-1074ef10555b', 'volume_size': 1} Nov 06 11:54:52 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-3141d978-ccfb-4007-afaf-5e3f6226a298 tempest-TestMinimumBasicScenario-1835675095 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 11:54:52 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-3141d978-ccfb-4007-afaf-5e3f6226a298 tempest-TestMinimumBasicScenario-1835675095 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 11:54:52 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-3141d978-ccfb-4007-afaf-5e3f6226a298 tempest-TestMinimumBasicScenario-1835675095 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T10:54:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-526740535',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=152f72a7-ed4e-4940-9668-1074ef10555b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ea64b10aceae48008dd88531b526888e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T10:54:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T10:54:52Z,use_quota=True,user_id='5b979b0fdc8b4d19a20e1b53db83929c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(34d3b144-d9b7-480a-a2e3-01e45f3d54c1),volume_type_id=34d3b144-d9b7-480a-a2e3-01e45f3d54c1)}" {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 11:54:52 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-3141d978-ccfb-4007-afaf-5e3f6226a298 tempest-TestMinimumBasicScenario-1835675095 None] Creating volume 152f72a7-ed4e-4940-9668-1074ef10555b {{(pid=87116) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 11:54:52 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-3141d978-ccfb-4007-afaf-5e3f6226a298 tempest-TestMinimumBasicScenario-1835675095 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 11:54:52 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-3141d978-ccfb-4007-afaf-5e3f6226a298 tempest-TestMinimumBasicScenario-1835675095 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 11:54:52 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-3141d978-ccfb-4007-afaf-5e3f6226a298 tempest-TestMinimumBasicScenario-1835675095 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 11:54:52 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-3141d978-ccfb-4007-afaf-5e3f6226a298 tempest-TestMinimumBasicScenario-1835675095 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 11:54:52 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-3141d978-ccfb-4007-afaf-5e3f6226a298 tempest-TestMinimumBasicScenario-1835675095 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 11:54:52 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-3141d978-ccfb-4007-afaf-5e3f6226a298 tempest-TestMinimumBasicScenario-1835675095 None] Selected osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f as target Quobyte volume. {{(pid=87116) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 11:54:52 devstack cinder-volume[87116]: INFO cinder.volume.drivers.remotefs [None req-3141d978-ccfb-4007-afaf-5e3f6226a298 tempest-TestMinimumBasicScenario-1835675095 None] casted to osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f Nov 06 11:54:52 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-3141d978-ccfb-4007-afaf-5e3f6226a298 tempest-TestMinimumBasicScenario-1835675095 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-152f72a7-ed4e-4940-9668-1074ef10555b 1073741824 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:54:52 devstack sudo[100807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-152f72a7-ed4e-4940-9668-1074ef10555b 1073741824 Nov 06 11:54:52 devstack sudo[100807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:54:52 devstack sudo[100807]: pam_unix(sudo:session): session closed for user root Nov 06 11:54:52 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-3141d978-ccfb-4007-afaf-5e3f6226a298 tempest-TestMinimumBasicScenario-1835675095 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-152f72a7-ed4e-4940-9668-1074ef10555b 1073741824" returned: 0 in 0.800s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:54:52 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-3141d978-ccfb-4007-afaf-5e3f6226a298 tempest-TestMinimumBasicScenario-1835675095 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-152f72a7-ed4e-4940-9668-1074ef10555b {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:54:52 devstack sudo[100814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-152f72a7-ed4e-4940-9668-1074ef10555b Nov 06 11:54:52 devstack sudo[100814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:54:53 devstack cinder-volume[87116]: DEBUG cinder.volume.flows.manager.create_volume [None req-8cc63a42-b5ac-44fa-bcd3-576f999b80a4 tempest-VolumesExtendTest-367270268 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87116) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 11:54:53 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-8cc63a42-b5ac-44fa-bcd3-576f999b80a4 tempest-VolumesExtendTest-367270268 None] Flow 'volume_create_manager' (526e8da6-01a1-4d53-80ff-f188e170f13f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 11:54:53 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-8cc63a42-b5ac-44fa-bcd3-576f999b80a4 tempest-VolumesExtendTest-367270268 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ef42784a-7289-4c09-8bc2-36166cd213ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:54:53 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-8cc63a42-b5ac-44fa-bcd3-576f999b80a4 tempest-VolumesExtendTest-367270268 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ef42784a-7289-4c09-8bc2-36166cd213ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T10:54:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-696686747',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b05eb85b-ef71-4e69-a126-415db8eab179,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3e4f892e15c74f5db446925a987ad272',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T10:54:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T10:54:53Z,use_quota=True,user_id='4ecae06626ae4bb399e25c7aff78f4da',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(34d3b144-d9b7-480a-a2e3-01e45f3d54c1),volume_type_id=34d3b144-d9b7-480a-a2e3-01e45f3d54c1)' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:54:53 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-8cc63a42-b5ac-44fa-bcd3-576f999b80a4 tempest-VolumesExtendTest-367270268 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (56d04814-f217-4c3d-94e3-e6f155a31842) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:54:53 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-8cc63a42-b5ac-44fa-bcd3-576f999b80a4 tempest-VolumesExtendTest-367270268 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (56d04814-f217-4c3d-94e3-e6f155a31842) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:54:53 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-8cc63a42-b5ac-44fa-bcd3-576f999b80a4 tempest-VolumesExtendTest-367270268 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7f5cc383-5053-4508-9bf8-c7ad52c0b87f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:54:53 devstack cinder-volume[87116]: DEBUG cinder.image.glance [None req-8cc63a42-b5ac-44fa-bcd3-576f999b80a4 tempest-VolumesExtendTest-367270268 None] Creating Keystone auth plugin from conf {{(pid=87116) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 06 11:54:53 devstack sudo[100814]: pam_unix(sudo:session): session closed for user root Nov 06 11:54:53 devstack cinder-volume[87116]: DEBUG cinder.volume.flows.manager.create_volume [None req-bbab8ca3-da83-426e-b9dd-269e8169c1a4 tempest-VolumesGetTest-482783544 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87116) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 11:54:53 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-bbab8ca3-da83-426e-b9dd-269e8169c1a4 tempest-VolumesGetTest-482783544 None] Flow 'volume_create_manager' (b2f32b45-119d-4eed-a291-bc090ac3bfa6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 11:54:53 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-bbab8ca3-da83-426e-b9dd-269e8169c1a4 tempest-VolumesGetTest-482783544 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9188670c-c221-4f88-859c-4256e6425ef2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:54:53 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-3141d978-ccfb-4007-afaf-5e3f6226a298 tempest-TestMinimumBasicScenario-1835675095 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-152f72a7-ed4e-4940-9668-1074ef10555b" returned: 0 in 0.427s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:54:53 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-3141d978-ccfb-4007-afaf-5e3f6226a298 tempest-TestMinimumBasicScenario-1835675095 None] <== create_volume: return (1305ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f'} {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 11:54:53 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-3141d978-ccfb-4007-afaf-5e3f6226a298 tempest-TestMinimumBasicScenario-1835675095 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.308s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 11:54:53 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-bbab8ca3-da83-426e-b9dd-269e8169c1a4 tempest-VolumesGetTest-482783544 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9188670c-c221-4f88-859c-4256e6425ef2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T10:54:53Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-858582547',display_name='tempest-VolumesGetTest-Volume-585418190',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4bad362d-3b71-4817-9cf1-12b20df39389,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d7de355fe6574fb3803d0652cc58996c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T10:54:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T10:54:53Z,use_quota=True,user_id='0e7aa2fc2ce242719cef88bdfb0422e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(34d3b144-d9b7-480a-a2e3-01e45f3d54c1),volume_type_id=34d3b144-d9b7-480a-a2e3-01e45f3d54c1)' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:54:53 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-bbab8ca3-da83-426e-b9dd-269e8169c1a4 tempest-VolumesGetTest-482783544 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (550c1c2d-5e6b-4a77-a1e7-55dbcfb89188) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:54:53 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-bbab8ca3-da83-426e-b9dd-269e8169c1a4 tempest-VolumesGetTest-482783544 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (550c1c2d-5e6b-4a77-a1e7-55dbcfb89188) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:54:53 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-bbab8ca3-da83-426e-b9dd-269e8169c1a4 tempest-VolumesGetTest-482783544 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8500afa4-ed11-4843-860a-34cd3ad09524) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:54:53 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-bbab8ca3-da83-426e-b9dd-269e8169c1a4 tempest-VolumesGetTest-482783544 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8500afa4-ed11-4843-860a-34cd3ad09524) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4bad362d-3b71-4817-9cf1-12b20df39389', 'volume_name': 'volume-4bad362d-3b71-4817-9cf1-12b20df39389', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:54:53 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-bbab8ca3-da83-426e-b9dd-269e8169c1a4 tempest-VolumesGetTest-482783544 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c45ad50e-0d21-4591-add1-1203accd0d2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:54:53 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-bbab8ca3-da83-426e-b9dd-269e8169c1a4 tempest-VolumesGetTest-482783544 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c45ad50e-0d21-4591-add1-1203accd0d2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:54:53 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-bbab8ca3-da83-426e-b9dd-269e8169c1a4 tempest-VolumesGetTest-482783544 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f35f85e7-5c06-4d20-bbcb-b354d55e10d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:54:53 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-bbab8ca3-da83-426e-b9dd-269e8169c1a4 tempest-VolumesGetTest-482783544 None] Volume 4bad362d-3b71-4817-9cf1-12b20df39389: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4bad362d-3b71-4817-9cf1-12b20df39389', 'volume_size': 1} Nov 06 11:54:53 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-bbab8ca3-da83-426e-b9dd-269e8169c1a4 tempest-VolumesGetTest-482783544 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 11:54:53 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-bbab8ca3-da83-426e-b9dd-269e8169c1a4 tempest-VolumesGetTest-482783544 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 11:54:53 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-bbab8ca3-da83-426e-b9dd-269e8169c1a4 tempest-VolumesGetTest-482783544 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T10:54:53Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-858582547',display_name='tempest-VolumesGetTest-Volume-585418190',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4bad362d-3b71-4817-9cf1-12b20df39389,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d7de355fe6574fb3803d0652cc58996c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T10:54:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T10:54:53Z,use_quota=True,user_id='0e7aa2fc2ce242719cef88bdfb0422e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(34d3b144-d9b7-480a-a2e3-01e45f3d54c1),volume_type_id=34d3b144-d9b7-480a-a2e3-01e45f3d54c1)}" {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 11:54:53 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-bbab8ca3-da83-426e-b9dd-269e8169c1a4 tempest-VolumesGetTest-482783544 None] Creating volume 4bad362d-3b71-4817-9cf1-12b20df39389 {{(pid=87116) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 11:54:53 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-bbab8ca3-da83-426e-b9dd-269e8169c1a4 tempest-VolumesGetTest-482783544 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 11:54:53 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-bbab8ca3-da83-426e-b9dd-269e8169c1a4 tempest-VolumesGetTest-482783544 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 11:54:53 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-bbab8ca3-da83-426e-b9dd-269e8169c1a4 tempest-VolumesGetTest-482783544 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 11:54:53 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-bbab8ca3-da83-426e-b9dd-269e8169c1a4 tempest-VolumesGetTest-482783544 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 11:54:53 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-bbab8ca3-da83-426e-b9dd-269e8169c1a4 tempest-VolumesGetTest-482783544 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 11:54:53 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-bbab8ca3-da83-426e-b9dd-269e8169c1a4 tempest-VolumesGetTest-482783544 None] Selected osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f as target Quobyte volume. {{(pid=87116) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 11:54:53 devstack cinder-volume[87116]: INFO cinder.volume.drivers.remotefs [None req-bbab8ca3-da83-426e-b9dd-269e8169c1a4 tempest-VolumesGetTest-482783544 None] casted to osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f Nov 06 11:54:53 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-bbab8ca3-da83-426e-b9dd-269e8169c1a4 tempest-VolumesGetTest-482783544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-4bad362d-3b71-4817-9cf1-12b20df39389 1073741824 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:54:53 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-3141d978-ccfb-4007-afaf-5e3f6226a298 tempest-TestMinimumBasicScenario-1835675095 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7b1aabb3-fbc1-4288-9009-05062c1a7307) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-152f72a7-ed4e-4940-9668-1074ef10555b', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:54:53 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-3141d978-ccfb-4007-afaf-5e3f6226a298 tempest-TestMinimumBasicScenario-1835675095 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b79f3d6e-8cec-438a-8383-608e16abe787) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:54:53 devstack sudo[100818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-4bad362d-3b71-4817-9cf1-12b20df39389 1073741824 Nov 06 11:54:53 devstack sudo[100818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:54:53 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-3141d978-ccfb-4007-afaf-5e3f6226a298 tempest-TestMinimumBasicScenario-1835675095 None] Volume volume-152f72a7-ed4e-4940-9668-1074ef10555b (152f72a7-ed4e-4940-9668-1074ef10555b): created successfully Nov 06 11:54:53 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-3141d978-ccfb-4007-afaf-5e3f6226a298 tempest-TestMinimumBasicScenario-1835675095 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b79f3d6e-8cec-438a-8383-608e16abe787) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:54:53 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-3141d978-ccfb-4007-afaf-5e3f6226a298 tempest-TestMinimumBasicScenario-1835675095 None] Flow 'volume_create_manager' (322d0785-a426-48ca-91ea-8b3ad8d20ccb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 11:54:53 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-3141d978-ccfb-4007-afaf-5e3f6226a298 tempest-TestMinimumBasicScenario-1835675095 None] Created volume successfully. Nov 06 11:54:53 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-8cc63a42-b5ac-44fa-bcd3-576f999b80a4 tempest-VolumesExtendTest-367270268 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7f5cc383-5053-4508-9bf8-c7ad52c0b87f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'b05eb85b-ef71-4e69-a126-415db8eab179', 'volume_name': 'volume-b05eb85b-ef71-4e69-a126-415db8eab179', 'volume_size': 1, 'image_id': '423469e2-d15b-4cf9-87cd-88e68e947d3b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/423469e2-d15b-4cf9-87cd-88e68e947d3b', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b05f927c30c5407aad52949459346010', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '423469e2-d15b-4cf9-87cd-88e68e947d3b', 'created_at': datetime.datetime(2026, 11, 6, 10, 36, 49, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 6, 10, 36, 50, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/423469e2-d15b-4cf9-87cd-88e68e947d3b/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:54:53 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-8cc63a42-b5ac-44fa-bcd3-576f999b80a4 tempest-VolumesExtendTest-367270268 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a4c87de3-71c1-4a9e-9c9d-30bddb278bc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:54:53 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-8cc63a42-b5ac-44fa-bcd3-576f999b80a4 tempest-VolumesExtendTest-367270268 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a4c87de3-71c1-4a9e-9c9d-30bddb278bc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:54:53 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-8cc63a42-b5ac-44fa-bcd3-576f999b80a4 tempest-VolumesExtendTest-367270268 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (22e35f55-2055-4191-8d53-968885323dc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:54:53 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-8cc63a42-b5ac-44fa-bcd3-576f999b80a4 tempest-VolumesExtendTest-367270268 None] Volume b05eb85b-ef71-4e69-a126-415db8eab179: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-b05eb85b-ef71-4e69-a126-415db8eab179', 'volume_size': 1, 'image_id': '423469e2-d15b-4cf9-87cd-88e68e947d3b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/423469e2-d15b-4cf9-87cd-88e68e947d3b', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b05f927c30c5407aad52949459346010', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '423469e2-d15b-4cf9-87cd-88e68e947d3b', 'created_at': datetime.datetime(2026, 11, 6, 10, 36, 49, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 6, 10, 36, 50, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/423469e2-d15b-4cf9-87cd-88e68e947d3b/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Nov 06 11:54:53 devstack cinder-volume[87116]: DEBUG cinder.volume.flows.manager.create_volume [None req-8cc63a42-b5ac-44fa-bcd3-576f999b80a4 tempest-VolumesExtendTest-367270268 None] Trying to clone b05eb85b-ef71-4e69-a126-415db8eab179 from image 423469e2-d15b-4cf9-87cd-88e68e947d3b at location (None, [{'url': 'file:///opt/stack/data/glance/images/423469e2-d15b-4cf9-87cd-88e68e947d3b', 'metadata': {}}]). {{(pid=87116) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Nov 06 11:54:54 devstack cinder-volume[87116]: DEBUG cinder.image.image_utils [None req-8cc63a42-b5ac-44fa-bcd3-576f999b80a4 tempest-VolumesExtendTest-367270268 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_423469e2-d15b-4cf9-87cd-88e68e947d3b_0zt0hls7devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87116) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Nov 06 11:54:54 devstack cinder-volume[87116]: INFO cinder.image.image_utils [None req-8cc63a42-b5ac-44fa-bcd3-576f999b80a4 tempest-VolumesExtendTest-367270268 None] Image download 20.69 MB at 20.69 MB/s Nov 06 11:54:54 devstack sudo[100818]: pam_unix(sudo:session): session closed for user root Nov 06 11:54:54 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-bbab8ca3-da83-426e-b9dd-269e8169c1a4 tempest-VolumesGetTest-482783544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-4bad362d-3b71-4817-9cf1-12b20df39389 1073741824" returned: 0 in 0.849s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:54:54 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-bbab8ca3-da83-426e-b9dd-269e8169c1a4 tempest-VolumesGetTest-482783544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-4bad362d-3b71-4817-9cf1-12b20df39389 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:54:54 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[6271952d-9d6a-4e66-b8c5-dd847ab54cbe]: (4, 'qcow2') {{(pid=88420) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 11:54:54 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-8cc63a42-b5ac-44fa-bcd3-576f999b80a4 tempest-VolumesExtendTest-367270268 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_423469e2-d15b-4cf9-87cd-88e68e947d3b_0zt0hls7devstack@QuobyteHD {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:54:54 devstack sudo[100834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-4bad362d-3b71-4817-9cf1-12b20df39389 Nov 06 11:54:54 devstack sudo[100834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:54:54 devstack sudo[100837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_423469e2-d15b-4cf9-87cd-88e68e947d3b_0zt0hls7devstack@QuobyteHD Nov 06 11:54:54 devstack sudo[100837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:54:54 devstack sudo[100834]: pam_unix(sudo:session): session closed for user root Nov 06 11:54:54 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-bbab8ca3-da83-426e-b9dd-269e8169c1a4 tempest-VolumesGetTest-482783544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-4bad362d-3b71-4817-9cf1-12b20df39389" returned: 0 in 0.510s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:54:54 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-bbab8ca3-da83-426e-b9dd-269e8169c1a4 tempest-VolumesGetTest-482783544 None] <== create_volume: return (1428ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f'} {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 11:54:54 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-bbab8ca3-da83-426e-b9dd-269e8169c1a4 tempest-VolumesGetTest-482783544 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.430s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 11:54:54 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-bbab8ca3-da83-426e-b9dd-269e8169c1a4 tempest-VolumesGetTest-482783544 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f35f85e7-5c06-4d20-bbcb-b354d55e10d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4bad362d-3b71-4817-9cf1-12b20df39389', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:54:54 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-bbab8ca3-da83-426e-b9dd-269e8169c1a4 tempest-VolumesGetTest-482783544 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa4fd287-7734-4c74-974c-438038190fd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:54:54 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-bbab8ca3-da83-426e-b9dd-269e8169c1a4 tempest-VolumesGetTest-482783544 None] Volume volume-4bad362d-3b71-4817-9cf1-12b20df39389 (4bad362d-3b71-4817-9cf1-12b20df39389): created successfully Nov 06 11:54:54 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-bbab8ca3-da83-426e-b9dd-269e8169c1a4 tempest-VolumesGetTest-482783544 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa4fd287-7734-4c74-974c-438038190fd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:54:54 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-bbab8ca3-da83-426e-b9dd-269e8169c1a4 tempest-VolumesGetTest-482783544 None] Flow 'volume_create_manager' (b2f32b45-119d-4eed-a291-bc090ac3bfa6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 11:54:54 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-bbab8ca3-da83-426e-b9dd-269e8169c1a4 tempest-VolumesGetTest-482783544 None] Created volume successfully. Nov 06 11:54:55 devstack sudo[100837]: pam_unix(sudo:session): session closed for user root Nov 06 11:54:55 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-8cc63a42-b5ac-44fa-bcd3-576f999b80a4 tempest-VolumesExtendTest-367270268 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_423469e2-d15b-4cf9-87cd-88e68e947d3b_0zt0hls7devstack@QuobyteHD" returned: 0 in 0.804s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:54:55 devstack cinder-volume[87116]: DEBUG cinder.image.image_utils [None req-8cc63a42-b5ac-44fa-bcd3-576f999b80a4 tempest-VolumesExtendTest-367270268 None] Temporary image 423469e2-d15b-4cf9-87cd-88e68e947d3b is fetched for user 4ecae06626ae4bb399e25c7aff78f4da. {{(pid=87116) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Nov 06 11:54:55 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e63f688-b11f-42b1-8e02-80f972340679]: (4, 'qcow2') {{(pid=88420) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 11:54:55 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-8cc63a42-b5ac-44fa-bcd3-576f999b80a4 tempest-VolumesExtendTest-367270268 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_423469e2-d15b-4cf9-87cd-88e68e947d3b_0zt0hls7devstack@QuobyteHD {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:54:55 devstack sudo[100850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_423469e2-d15b-4cf9-87cd-88e68e947d3b_0zt0hls7devstack@QuobyteHD Nov 06 11:54:55 devstack sudo[100850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:54:55 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-cd3403b0-5b5e-4a04-b3d9-1828ecb275cd tempest-VolumesGetTest-482783544 None] Acquiring lock "cinder-4bad362d-3b71-4817-9cf1-12b20df39389-delete_volume" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 11:54:55 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-cd3403b0-5b5e-4a04-b3d9-1828ecb275cd tempest-VolumesGetTest-482783544 None] Lock "cinder-4bad362d-3b71-4817-9cf1-12b20df39389-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 11:54:55 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-cd3403b0-5b5e-4a04-b3d9-1828ecb275cd tempest-VolumesGetTest-482783544 None] Acquiring lock "cinder-quobyte-4bad362d-3b71-4817-9cf1-12b20df39389" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 11:54:55 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-cd3403b0-5b5e-4a04-b3d9-1828ecb275cd tempest-VolumesGetTest-482783544 None] Lock "cinder-quobyte-4bad362d-3b71-4817-9cf1-12b20df39389" acquired by "delete_volume" :: waited 0.021s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 11:54:55 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[125c7897-addd-4e02-aa7e-1519b7cae3dc]: (4, 'qcow2') {{(pid=88420) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 11:54:55 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-cd3403b0-5b5e-4a04-b3d9-1828ecb275cd tempest-VolumesGetTest-482783544 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-4bad362d-3b71-4817-9cf1-12b20df39389 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:54:56 devstack sudo[100850]: pam_unix(sudo:session): session closed for user root Nov 06 11:54:56 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-8cc63a42-b5ac-44fa-bcd3-576f999b80a4 tempest-VolumesExtendTest-367270268 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_423469e2-d15b-4cf9-87cd-88e68e947d3b_0zt0hls7devstack@QuobyteHD" returned: 0 in 0.969s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:54:56 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-8cc63a42-b5ac-44fa-bcd3-576f999b80a4 tempest-VolumesExtendTest-367270268 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 11:54:56 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-8cc63a42-b5ac-44fa-bcd3-576f999b80a4 tempest-VolumesExtendTest-367270268 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 11:54:56 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-8cc63a42-b5ac-44fa-bcd3-576f999b80a4 tempest-VolumesExtendTest-367270268 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T10:54:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-696686747',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b05eb85b-ef71-4e69-a126-415db8eab179,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3e4f892e15c74f5db446925a987ad272',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T10:54:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T10:54:53Z,use_quota=True,user_id='4ecae06626ae4bb399e25c7aff78f4da',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(34d3b144-d9b7-480a-a2e3-01e45f3d54c1),volume_type_id=34d3b144-d9b7-480a-a2e3-01e45f3d54c1)}" {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 11:54:56 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-8cc63a42-b5ac-44fa-bcd3-576f999b80a4 tempest-VolumesExtendTest-367270268 None] Creating volume b05eb85b-ef71-4e69-a126-415db8eab179 {{(pid=87116) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 11:54:56 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-8cc63a42-b5ac-44fa-bcd3-576f999b80a4 tempest-VolumesExtendTest-367270268 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 11:54:56 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-8cc63a42-b5ac-44fa-bcd3-576f999b80a4 tempest-VolumesExtendTest-367270268 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 11:54:56 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-8cc63a42-b5ac-44fa-bcd3-576f999b80a4 tempest-VolumesExtendTest-367270268 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 11:54:56 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-8cc63a42-b5ac-44fa-bcd3-576f999b80a4 tempest-VolumesExtendTest-367270268 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 11:54:56 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-8cc63a42-b5ac-44fa-bcd3-576f999b80a4 tempest-VolumesExtendTest-367270268 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 11:54:56 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-8cc63a42-b5ac-44fa-bcd3-576f999b80a4 tempest-VolumesExtendTest-367270268 None] Selected osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f as target Quobyte volume. {{(pid=87116) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 11:54:56 devstack cinder-volume[87116]: INFO cinder.volume.drivers.remotefs [None req-8cc63a42-b5ac-44fa-bcd3-576f999b80a4 tempest-VolumesExtendTest-367270268 None] casted to osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f Nov 06 11:54:56 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-8cc63a42-b5ac-44fa-bcd3-576f999b80a4 tempest-VolumesExtendTest-367270268 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-b05eb85b-ef71-4e69-a126-415db8eab179 1073741824 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:54:56 devstack sudo[100860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-4bad362d-3b71-4817-9cf1-12b20df39389 Nov 06 11:54:56 devstack sudo[100860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:54:56 devstack sudo[100865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-b05eb85b-ef71-4e69-a126-415db8eab179 1073741824 Nov 06 11:54:56 devstack sudo[100865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:54:56 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [req-14e34d73-4d4b-4243-a2a6-2fb05a0dba0c req-60f8af6e-b676-4730-9508-1326039f70c9 tempest-TestMinimumBasicScenario-1835675095 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 11:54:56 devstack sudo[100860]: pam_unix(sudo:session): session closed for user root Nov 06 11:54:56 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-cd3403b0-5b5e-4a04-b3d9-1828ecb275cd tempest-VolumesGetTest-482783544 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-4bad362d-3b71-4817-9cf1-12b20df39389" returned: 0 in 0.794s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:54:56 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-cd3403b0-5b5e-4a04-b3d9-1828ecb275cd tempest-VolumesGetTest-482783544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-4bad362d-3b71-4817-9cf1-12b20df39389 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:54:56 devstack sudo[100874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-4bad362d-3b71-4817-9cf1-12b20df39389 Nov 06 11:54:56 devstack sudo[100874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:54:56 devstack sudo[100865]: pam_unix(sudo:session): session closed for user root Nov 06 11:54:57 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-8cc63a42-b5ac-44fa-bcd3-576f999b80a4 tempest-VolumesExtendTest-367270268 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-b05eb85b-ef71-4e69-a126-415db8eab179 1073741824" returned: 0 in 0.771s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:54:57 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-8cc63a42-b5ac-44fa-bcd3-576f999b80a4 tempest-VolumesExtendTest-367270268 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-b05eb85b-ef71-4e69-a126-415db8eab179 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:54:57 devstack sudo[100877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-b05eb85b-ef71-4e69-a126-415db8eab179 Nov 06 11:54:57 devstack sudo[100877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:54:57 devstack sudo[100874]: pam_unix(sudo:session): session closed for user root Nov 06 11:54:57 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-cd3403b0-5b5e-4a04-b3d9-1828ecb275cd tempest-VolumesGetTest-482783544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-4bad362d-3b71-4817-9cf1-12b20df39389" returned: 0 in 0.637s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:54:57 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-cd3403b0-5b5e-4a04-b3d9-1828ecb275cd tempest-VolumesGetTest-482783544 None] Lock "cinder-quobyte-4bad362d-3b71-4817-9cf1-12b20df39389" released by "delete_volume" :: held 1.542s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 11:54:57 devstack cinder-volume[87116]: DEBUG dbcounter [-] [87116] Writing DB stats cinder:SELECT=40,cinder:INSERT=10,cinder:UPDATE=56,cinder:DELETE=5 {{(pid=87116) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 11:54:57 devstack cinder-volume[87116]: DEBUG cinder.quota [None req-cd3403b0-5b5e-4a04-b3d9-1828ecb275cd tempest-VolumesGetTest-482783544 None] Created reservations ['301a7509-f24e-4564-89f5-c1e98600eef7', '57712b30-fca8-4771-acd4-9ede81e39ea2', '9c4e9dc8-4fbc-4c24-929d-c4c63f2e7560', 'f0666944-b033-44b4-a363-c60cc2f79891'] {{(pid=87116) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 11:54:57 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-cd3403b0-5b5e-4a04-b3d9-1828ecb275cd tempest-VolumesGetTest-482783544 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 11:54:57 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-cd3403b0-5b5e-4a04-b3d9-1828ecb275cd tempest-VolumesGetTest-482783544 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 11:54:57 devstack sudo[100877]: pam_unix(sudo:session): session closed for user root Nov 06 11:54:57 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-cd3403b0-5b5e-4a04-b3d9-1828ecb275cd tempest-VolumesGetTest-482783544 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 11:54:57 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-cd3403b0-5b5e-4a04-b3d9-1828ecb275cd tempest-VolumesGetTest-482783544 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 11:54:57 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-cd3403b0-5b5e-4a04-b3d9-1828ecb275cd tempest-VolumesGetTest-482783544 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.049s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 11:54:57 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-cd3403b0-5b5e-4a04-b3d9-1828ecb275cd tempest-VolumesGetTest-482783544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:54:57 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-8cc63a42-b5ac-44fa-bcd3-576f999b80a4 tempest-VolumesExtendTest-367270268 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-b05eb85b-ef71-4e69-a126-415db8eab179" returned: 0 in 0.863s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:54:57 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-8cc63a42-b5ac-44fa-bcd3-576f999b80a4 tempest-VolumesExtendTest-367270268 None] <== create_volume: return (1721ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f'} {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 11:54:57 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-8cc63a42-b5ac-44fa-bcd3-576f999b80a4 tempest-VolumesExtendTest-367270268 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.729s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 11:54:57 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [req-14e34d73-4d4b-4243-a2a6-2fb05a0dba0c req-60f8af6e-b676-4730-9508-1326039f70c9 tempest-TestMinimumBasicScenario-1835675095 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.693s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 11:54:57 devstack sudo[100896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756 Nov 06 11:54:57 devstack sudo[100896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:54:58 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [req-14e34d73-4d4b-4243-a2a6-2fb05a0dba0c req-60f8af6e-b676-4730-9508-1326039f70c9 tempest-TestMinimumBasicScenario-1835675095 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.080s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 11:54:58 devstack cinder-volume[87116]: DEBUG cinder.volume.volume_utils [None req-8cc63a42-b5ac-44fa-bcd3-576f999b80a4 tempest-VolumesExtendTest-367270268 None] Attempting download of 423469e2-d15b-4cf9-87cd-88e68e947d3b ((None, [{'url': 'file:///opt/stack/data/glance/images/423469e2-d15b-4cf9-87cd-88e68e947d3b', 'metadata': {}}])) to volume b05eb85b-ef71-4e69-a126-415db8eab179. {{(pid=87116) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Nov 06 11:54:58 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [req-14e34d73-4d4b-4243-a2a6-2fb05a0dba0c req-60f8af6e-b676-4730-9508-1326039f70c9 tempest-TestMinimumBasicScenario-1835675095 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f', 'name': 'volume-152f72a7-ed4e-4940-9668-1074ef10555b', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '9b8ca8ca-7b65-444a-bc43-fcc791ae483d', 'enforce_multipath': True} {{(pid=87116) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 06 11:54:58 devstack sudo[100896]: pam_unix(sudo:session): session closed for user root Nov 06 11:54:58 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ea415e2-97eb-4c60-9541-8aa59f686835]: (4, 'raw') {{(pid=88420) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 11:54:58 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-8cc63a42-b5ac-44fa-bcd3-576f999b80a4 tempest-VolumesExtendTest-367270268 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_423469e2-d15b-4cf9-87cd-88e68e947d3b_3pm28i_e {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:54:58 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-cd3403b0-5b5e-4a04-b3d9-1828ecb275cd tempest-VolumesGetTest-482783544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756" returned: 0 in 0.540s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:54:58 devstack cinder-volume[87116]: DEBUG cinder.manager [None req-cd3403b0-5b5e-4a04-b3d9-1828ecb275cd tempest-VolumesGetTest-482783544 None] Notifying Schedulers of capabilities ... {{(pid=87116) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 11:54:58 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-cd3403b0-5b5e-4a04-b3d9-1828ecb275cd tempest-VolumesGetTest-482783544 None] Deleted volume successfully. Nov 06 11:54:58 devstack cinder-volume[87116]: INFO cinder.volume.manager [req-14e34d73-4d4b-4243-a2a6-2fb05a0dba0c req-60f8af6e-b676-4730-9508-1326039f70c9 tempest-TestMinimumBasicScenario-1835675095 None] attachment_update completed successfully. Nov 06 11:54:58 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-cd3403b0-5b5e-4a04-b3d9-1828ecb275cd tempest-VolumesGetTest-482783544 None] Lock "cinder-4bad362d-3b71-4817-9cf1-12b20df39389-delete_volume" released by "delete_volume" :: held 2.730s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 11:54:58 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-0856260f-b7f7-4f12-9779-39de92ffd386 tempest-VolumesGetTest-482783544 None] Acquiring lock "cinder-fb07b8e0-072c-425a-9be6-f0ce55c537d8-delete_volume" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 11:54:58 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-0856260f-b7f7-4f12-9779-39de92ffd386 tempest-VolumesGetTest-482783544 None] Lock "cinder-fb07b8e0-072c-425a-9be6-f0ce55c537d8-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 11:54:58 devstack sudo[100904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_423469e2-d15b-4cf9-87cd-88e68e947d3b_3pm28i_e Nov 06 11:54:58 devstack sudo[100904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:54:58 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-0856260f-b7f7-4f12-9779-39de92ffd386 tempest-VolumesGetTest-482783544 None] Acquiring lock "cinder-quobyte-fb07b8e0-072c-425a-9be6-f0ce55c537d8" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 11:54:58 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-0856260f-b7f7-4f12-9779-39de92ffd386 tempest-VolumesGetTest-482783544 None] Lock "cinder-quobyte-fb07b8e0-072c-425a-9be6-f0ce55c537d8" acquired by "delete_volume" :: waited 0.038s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 11:54:58 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e596ed9-431c-4def-8b81-d06e2db058bd]: (4, 'qcow2') {{(pid=88420) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 11:54:58 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-0856260f-b7f7-4f12-9779-39de92ffd386 tempest-VolumesGetTest-482783544 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-fb07b8e0-072c-425a-9be6-f0ce55c537d8 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:54:59 devstack cinder-volume[87116]: INFO cinder.volume.manager [req-f5914536-2fcd-456b-86ec-ba44d35cffc0 req-baa5609d-b9c7-4863-b5bc-b7f4e76ce258 tempest-TestShelveInstance-1615912961 None] Terminate volume connection completed successfully. Nov 06 11:54:59 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [req-f5914536-2fcd-456b-86ec-ba44d35cffc0 req-baa5609d-b9c7-4863-b5bc-b7f4e76ce258 tempest-TestShelveInstance-1615912961 None] Deleting attachment 752894f2-5ab8-45d4-830c-92a8fe6a2511. {{(pid=87116) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 06 11:54:59 devstack sudo[100965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-fb07b8e0-072c-425a-9be6-f0ce55c537d8 Nov 06 11:54:59 devstack sudo[100965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:54:59 devstack sudo[100904]: pam_unix(sudo:session): session closed for user root Nov 06 11:54:59 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-8cc63a42-b5ac-44fa-bcd3-576f999b80a4 tempest-VolumesExtendTest-367270268 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_423469e2-d15b-4cf9-87cd-88e68e947d3b_3pm28i_e" returned: 0 in 0.878s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:54:59 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-8cc63a42-b5ac-44fa-bcd3-576f999b80a4 tempest-VolumesExtendTest-367270268 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_423469e2-d15b-4cf9-87cd-88e68e947d3b_3pm28i_e {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:54:59 devstack sudo[101188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_423469e2-d15b-4cf9-87cd-88e68e947d3b_3pm28i_e Nov 06 11:54:59 devstack sudo[101188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:54:59 devstack sudo[100965]: pam_unix(sudo:session): session closed for user root Nov 06 11:54:59 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-0856260f-b7f7-4f12-9779-39de92ffd386 tempest-VolumesGetTest-482783544 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-fb07b8e0-072c-425a-9be6-f0ce55c537d8" returned: 0 in 0.607s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:54:59 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-0856260f-b7f7-4f12-9779-39de92ffd386 tempest-VolumesGetTest-482783544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-fb07b8e0-072c-425a-9be6-f0ce55c537d8 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:54:59 devstack sudo[101330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-fb07b8e0-072c-425a-9be6-f0ce55c537d8 Nov 06 11:54:59 devstack sudo[101330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:55:00 devstack sudo[101330]: pam_unix(sudo:session): session closed for user root Nov 06 11:55:00 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-0856260f-b7f7-4f12-9779-39de92ffd386 tempest-VolumesGetTest-482783544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-fb07b8e0-072c-425a-9be6-f0ce55c537d8" returned: 0 in 0.542s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:55:00 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-0856260f-b7f7-4f12-9779-39de92ffd386 tempest-VolumesGetTest-482783544 None] Lock "cinder-quobyte-fb07b8e0-072c-425a-9be6-f0ce55c537d8" released by "delete_volume" :: held 1.245s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 11:55:00 devstack sudo[101188]: pam_unix(sudo:session): session closed for user root Nov 06 11:55:00 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-8cc63a42-b5ac-44fa-bcd3-576f999b80a4 tempest-VolumesExtendTest-367270268 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_423469e2-d15b-4cf9-87cd-88e68e947d3b_3pm28i_e" returned: 1 in 0.955s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:55:00 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-8cc63a42-b5ac-44fa-bcd3-576f999b80a4 tempest-VolumesExtendTest-367270268 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_423469e2-d15b-4cf9-87cd-88e68e947d3b_3pm28i_e' failed. Not Retrying. {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 06 11:55:00 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbd139a9-5977-45b8-92db-eda264b9268e]: (4, 'qcow2') {{(pid=88420) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 11:55:00 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-8cc63a42-b5ac-44fa-bcd3-576f999b80a4 tempest-VolumesExtendTest-367270268 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_423469e2-d15b-4cf9-87cd-88e68e947d3b_0zt0hls7devstack@QuobyteHD {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:55:00 devstack cinder-volume[87116]: DEBUG cinder.quota [None req-0856260f-b7f7-4f12-9779-39de92ffd386 tempest-VolumesGetTest-482783544 None] Created reservations ['c7cadd09-8dd6-43ff-880a-60fbd0160d13', '8fa6d6dd-3d64-4735-ad75-7e211ad14c70', '2ea99c76-e663-4b49-8614-fa4b994ac493', '72985b72-71e4-4693-8069-7b2ecfadfd98'] {{(pid=87116) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 11:55:00 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-0856260f-b7f7-4f12-9779-39de92ffd386 tempest-VolumesGetTest-482783544 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 11:55:00 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-0856260f-b7f7-4f12-9779-39de92ffd386 tempest-VolumesGetTest-482783544 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 11:55:00 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-0856260f-b7f7-4f12-9779-39de92ffd386 tempest-VolumesGetTest-482783544 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 11:55:00 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-0856260f-b7f7-4f12-9779-39de92ffd386 tempest-VolumesGetTest-482783544 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 11:55:00 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-0856260f-b7f7-4f12-9779-39de92ffd386 tempest-VolumesGetTest-482783544 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.031s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 11:55:00 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-0856260f-b7f7-4f12-9779-39de92ffd386 tempest-VolumesGetTest-482783544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:55:00 devstack sudo[101335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_423469e2-d15b-4cf9-87cd-88e68e947d3b_0zt0hls7devstack@QuobyteHD Nov 06 11:55:00 devstack sudo[101335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:55:00 devstack sudo[101338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756 Nov 06 11:55:00 devstack sudo[101338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:55:01 devstack sudo[101338]: pam_unix(sudo:session): session closed for user root Nov 06 11:55:01 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-0856260f-b7f7-4f12-9779-39de92ffd386 tempest-VolumesGetTest-482783544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756" returned: 0 in 0.580s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:55:01 devstack cinder-volume[87116]: DEBUG cinder.manager [None req-0856260f-b7f7-4f12-9779-39de92ffd386 tempest-VolumesGetTest-482783544 None] Notifying Schedulers of capabilities ... {{(pid=87116) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 11:55:01 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-0856260f-b7f7-4f12-9779-39de92ffd386 tempest-VolumesGetTest-482783544 None] Deleted volume successfully. Nov 06 11:55:01 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-0856260f-b7f7-4f12-9779-39de92ffd386 tempest-VolumesGetTest-482783544 None] Lock "cinder-fb07b8e0-072c-425a-9be6-f0ce55c537d8-delete_volume" released by "delete_volume" :: held 2.570s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 11:55:01 devstack sudo[101335]: pam_unix(sudo:session): session closed for user root Nov 06 11:55:01 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-8cc63a42-b5ac-44fa-bcd3-576f999b80a4 tempest-VolumesExtendTest-367270268 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_423469e2-d15b-4cf9-87cd-88e68e947d3b_0zt0hls7devstack@QuobyteHD" returned: 0 in 1.111s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:55:01 devstack cinder-volume[87116]: DEBUG cinder.image.image_utils [None req-8cc63a42-b5ac-44fa-bcd3-576f999b80a4 tempest-VolumesExtendTest-367270268 None] 423469e2-d15b-4cf9-87cd-88e68e947d3b was qcow2, converting to qcow2 {{(pid=87116) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Nov 06 11:55:01 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-8cc63a42-b5ac-44fa-bcd3-576f999b80a4 tempest-VolumesExtendTest-367270268 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_423469e2-d15b-4cf9-87cd-88e68e947d3b_0zt0hls7devstack@QuobyteHD /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-b05eb85b-ef71-4e69-a126-415db8eab179 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:55:01 devstack sudo[101346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_423469e2-d15b-4cf9-87cd-88e68e947d3b_0zt0hls7devstack@QuobyteHD /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-b05eb85b-ef71-4e69-a126-415db8eab179 Nov 06 11:55:01 devstack sudo[101346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:55:01 devstack cinder-volume[87116]: DEBUG cinder.volume.flows.manager.create_volume [None req-ce2d67e0-06d5-4cbf-9b06-d2229ee947a5 tempest-VolumesGetTest-482783544 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87116) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 11:55:01 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-ce2d67e0-06d5-4cbf-9b06-d2229ee947a5 tempest-VolumesGetTest-482783544 None] Flow 'volume_create_manager' (6c366acd-ac7c-4b2a-85cb-54bf565be135) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 11:55:02 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-ce2d67e0-06d5-4cbf-9b06-d2229ee947a5 tempest-VolumesGetTest-482783544 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (711fbaee-2e60-46ad-a1ed-3b926bd71ac4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:55:02 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-ce2d67e0-06d5-4cbf-9b06-d2229ee947a5 tempest-VolumesGetTest-482783544 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (711fbaee-2e60-46ad-a1ed-3b926bd71ac4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T10:55:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1026958279',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0cc4181c-7a27-4877-be92-80385ed838b2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d7de355fe6574fb3803d0652cc58996c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T10:55:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T10:55:02Z,use_quota=True,user_id='0e7aa2fc2ce242719cef88bdfb0422e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(34d3b144-d9b7-480a-a2e3-01e45f3d54c1),volume_type_id=34d3b144-d9b7-480a-a2e3-01e45f3d54c1)' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:55:02 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-ce2d67e0-06d5-4cbf-9b06-d2229ee947a5 tempest-VolumesGetTest-482783544 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f73890bd-0e41-480a-8348-de3f8c401dfd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:55:02 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-ce2d67e0-06d5-4cbf-9b06-d2229ee947a5 tempest-VolumesGetTest-482783544 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f73890bd-0e41-480a-8348-de3f8c401dfd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:55:02 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-ce2d67e0-06d5-4cbf-9b06-d2229ee947a5 tempest-VolumesGetTest-482783544 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b2882aaa-9828-4b27-a13c-c0c82085b59b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:55:02 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-ce2d67e0-06d5-4cbf-9b06-d2229ee947a5 tempest-VolumesGetTest-482783544 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b2882aaa-9828-4b27-a13c-c0c82085b59b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0cc4181c-7a27-4877-be92-80385ed838b2', 'volume_name': 'volume-0cc4181c-7a27-4877-be92-80385ed838b2', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:55:02 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-ce2d67e0-06d5-4cbf-9b06-d2229ee947a5 tempest-VolumesGetTest-482783544 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b7fd16a8-5ea5-4e4e-83db-3530a292b5dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:55:02 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-ce2d67e0-06d5-4cbf-9b06-d2229ee947a5 tempest-VolumesGetTest-482783544 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b7fd16a8-5ea5-4e4e-83db-3530a292b5dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:55:02 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-ce2d67e0-06d5-4cbf-9b06-d2229ee947a5 tempest-VolumesGetTest-482783544 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6a7f8f5e-b8e9-4823-b694-75a6b225287f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:55:02 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-ce2d67e0-06d5-4cbf-9b06-d2229ee947a5 tempest-VolumesGetTest-482783544 None] Volume 0cc4181c-7a27-4877-be92-80385ed838b2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0cc4181c-7a27-4877-be92-80385ed838b2', 'volume_size': 1} Nov 06 11:55:02 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-ce2d67e0-06d5-4cbf-9b06-d2229ee947a5 tempest-VolumesGetTest-482783544 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 11:55:02 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-ce2d67e0-06d5-4cbf-9b06-d2229ee947a5 tempest-VolumesGetTest-482783544 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 11:55:02 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-ce2d67e0-06d5-4cbf-9b06-d2229ee947a5 tempest-VolumesGetTest-482783544 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T10:55:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1026958279',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0cc4181c-7a27-4877-be92-80385ed838b2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d7de355fe6574fb3803d0652cc58996c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T10:55:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T10:55:02Z,use_quota=True,user_id='0e7aa2fc2ce242719cef88bdfb0422e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(34d3b144-d9b7-480a-a2e3-01e45f3d54c1),volume_type_id=34d3b144-d9b7-480a-a2e3-01e45f3d54c1)}" {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 11:55:02 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-ce2d67e0-06d5-4cbf-9b06-d2229ee947a5 tempest-VolumesGetTest-482783544 None] Creating volume 0cc4181c-7a27-4877-be92-80385ed838b2 {{(pid=87116) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 11:55:02 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-ce2d67e0-06d5-4cbf-9b06-d2229ee947a5 tempest-VolumesGetTest-482783544 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 11:55:02 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-ce2d67e0-06d5-4cbf-9b06-d2229ee947a5 tempest-VolumesGetTest-482783544 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 11:55:02 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-ce2d67e0-06d5-4cbf-9b06-d2229ee947a5 tempest-VolumesGetTest-482783544 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 11:55:02 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-ce2d67e0-06d5-4cbf-9b06-d2229ee947a5 tempest-VolumesGetTest-482783544 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 11:55:02 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-ce2d67e0-06d5-4cbf-9b06-d2229ee947a5 tempest-VolumesGetTest-482783544 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 11:55:02 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-ce2d67e0-06d5-4cbf-9b06-d2229ee947a5 tempest-VolumesGetTest-482783544 None] Selected osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f as target Quobyte volume. {{(pid=87116) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 11:55:02 devstack cinder-volume[87116]: INFO cinder.volume.drivers.remotefs [None req-ce2d67e0-06d5-4cbf-9b06-d2229ee947a5 tempest-VolumesGetTest-482783544 None] casted to osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f Nov 06 11:55:02 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-ce2d67e0-06d5-4cbf-9b06-d2229ee947a5 tempest-VolumesGetTest-482783544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-0cc4181c-7a27-4877-be92-80385ed838b2 1073741824 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:55:02 devstack sudo[101357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-0cc4181c-7a27-4877-be92-80385ed838b2 1073741824 Nov 06 11:55:02 devstack sudo[101357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:55:03 devstack sudo[101357]: pam_unix(sudo:session): session closed for user root Nov 06 11:55:03 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-ce2d67e0-06d5-4cbf-9b06-d2229ee947a5 tempest-VolumesGetTest-482783544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-0cc4181c-7a27-4877-be92-80385ed838b2 1073741824" returned: 0 in 0.884s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:55:03 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-ce2d67e0-06d5-4cbf-9b06-d2229ee947a5 tempest-VolumesGetTest-482783544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-0cc4181c-7a27-4877-be92-80385ed838b2 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:55:03 devstack sudo[101382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-0cc4181c-7a27-4877-be92-80385ed838b2 Nov 06 11:55:03 devstack sudo[101382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:55:03 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [req-7ab9bd40-3a22-43e3-b3e1-37325487277f req-5034f8f7-2e7e-47a3-aac3-265b32618716 tempest-TestShelveInstance-1615912961 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 11:55:03 devstack sudo[101382]: pam_unix(sudo:session): session closed for user root Nov 06 11:55:03 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-ce2d67e0-06d5-4cbf-9b06-d2229ee947a5 tempest-VolumesGetTest-482783544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-0cc4181c-7a27-4877-be92-80385ed838b2" returned: 0 in 0.460s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:55:03 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-ce2d67e0-06d5-4cbf-9b06-d2229ee947a5 tempest-VolumesGetTest-482783544 None] <== create_volume: return (1411ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f'} {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 11:55:03 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-ce2d67e0-06d5-4cbf-9b06-d2229ee947a5 tempest-VolumesGetTest-482783544 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.419s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 11:55:03 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [req-7ab9bd40-3a22-43e3-b3e1-37325487277f req-5034f8f7-2e7e-47a3-aac3-265b32618716 tempest-TestShelveInstance-1615912961 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.026s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 11:55:03 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-ce2d67e0-06d5-4cbf-9b06-d2229ee947a5 tempest-VolumesGetTest-482783544 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6a7f8f5e-b8e9-4823-b694-75a6b225287f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0cc4181c-7a27-4877-be92-80385ed838b2', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:55:03 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-ce2d67e0-06d5-4cbf-9b06-d2229ee947a5 tempest-VolumesGetTest-482783544 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f57e8e20-cc28-4bef-8ea6-125b8969be34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:55:03 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [req-7ab9bd40-3a22-43e3-b3e1-37325487277f req-5034f8f7-2e7e-47a3-aac3-265b32618716 tempest-TestShelveInstance-1615912961 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.050s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 11:55:03 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-ce2d67e0-06d5-4cbf-9b06-d2229ee947a5 tempest-VolumesGetTest-482783544 None] Volume volume-0cc4181c-7a27-4877-be92-80385ed838b2 (0cc4181c-7a27-4877-be92-80385ed838b2): created successfully Nov 06 11:55:03 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-ce2d67e0-06d5-4cbf-9b06-d2229ee947a5 tempest-VolumesGetTest-482783544 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f57e8e20-cc28-4bef-8ea6-125b8969be34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:55:03 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-ce2d67e0-06d5-4cbf-9b06-d2229ee947a5 tempest-VolumesGetTest-482783544 None] Flow 'volume_create_manager' (6c366acd-ac7c-4b2a-85cb-54bf565be135) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 11:55:03 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-ce2d67e0-06d5-4cbf-9b06-d2229ee947a5 tempest-VolumesGetTest-482783544 None] Created volume successfully. Nov 06 11:55:03 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [req-7ab9bd40-3a22-43e3-b3e1-37325487277f req-5034f8f7-2e7e-47a3-aac3-265b32618716 tempest-TestShelveInstance-1615912961 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f', 'name': 'volume-14e75353-8e88-4e4d-93b1-ac70324e53c9', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '6bc7b301-215e-4ef7-bcad-2291aa219c75', 'enforce_multipath': True} {{(pid=87116) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 06 11:55:03 devstack cinder-volume[87116]: INFO cinder.volume.manager [req-7ab9bd40-3a22-43e3-b3e1-37325487277f req-5034f8f7-2e7e-47a3-aac3-265b32618716 tempest-TestShelveInstance-1615912961 None] attachment_update completed successfully. Nov 06 11:55:04 devstack sudo[101346]: pam_unix(sudo:session): session closed for user root Nov 06 11:55:04 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-8cc63a42-b5ac-44fa-bcd3-576f999b80a4 tempest-VolumesExtendTest-367270268 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_423469e2-d15b-4cf9-87cd-88e68e947d3b_0zt0hls7devstack@QuobyteHD /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-b05eb85b-ef71-4e69-a126-415db8eab179" returned: 0 in 3.084s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:55:04 devstack cinder-volume[87116]: DEBUG cinder.image.image_utils [None req-8cc63a42-b5ac-44fa-bcd3-576f999b80a4 tempest-VolumesExtendTest-367270268 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_423469e2-d15b-4cf9-87cd-88e68e947d3b_0zt0hls7devstack@QuobyteHD, size 112.00 MB, duration 3.09 sec, destination /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-b05eb85b-ef71-4e69-a126-415db8eab179 {{(pid=87116) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 06 11:55:04 devstack cinder-volume[87116]: INFO cinder.image.image_utils [None req-8cc63a42-b5ac-44fa-bcd3-576f999b80a4 tempest-VolumesExtendTest-367270268 None] Converted 112.00 MB image at 36.30 MB/s Nov 06 11:55:04 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-8cc63a42-b5ac-44fa-bcd3-576f999b80a4 tempest-VolumesExtendTest-367270268 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-b05eb85b-ef71-4e69-a126-415db8eab179 1G {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:55:04 devstack sudo[101401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-b05eb85b-ef71-4e69-a126-415db8eab179 1G Nov 06 11:55:04 devstack sudo[101401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:55:04 devstack cinder-volume[87116]: DEBUG cinder.volume.flows.manager.create_volume [None req-78fe947f-5588-4ce1-835d-c3fb042c32a3 tempest-VolumesGetTest-482783544 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87116) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 11:55:04 devstack sudo[101401]: pam_unix(sudo:session): session closed for user root Nov 06 11:55:04 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-78fe947f-5588-4ce1-835d-c3fb042c32a3 tempest-VolumesGetTest-482783544 None] Flow 'volume_create_manager' (8efc7577-d5e0-4d81-9aef-f437c4508530) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 11:55:04 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-78fe947f-5588-4ce1-835d-c3fb042c32a3 tempest-VolumesGetTest-482783544 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (25be2d5d-c71b-45b0-a179-600dd84e4ac5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:55:04 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-8cc63a42-b5ac-44fa-bcd3-576f999b80a4 tempest-VolumesExtendTest-367270268 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-b05eb85b-ef71-4e69-a126-415db8eab179 1G" returned: 0 in 0.466s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:55:04 devstack cinder-volume[87116]: DEBUG cinder.volume.volume_utils [None req-8cc63a42-b5ac-44fa-bcd3-576f999b80a4 tempest-VolumesExtendTest-367270268 None] Downloaded image 423469e2-d15b-4cf9-87cd-88e68e947d3b ((None, [{'url': 'file:///opt/stack/data/glance/images/423469e2-d15b-4cf9-87cd-88e68e947d3b', 'metadata': {}}])) to volume b05eb85b-ef71-4e69-a126-415db8eab179 successfully. {{(pid=87116) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Nov 06 11:55:04 devstack cinder-volume[87116]: DEBUG cinder.image.image_utils [None req-8cc63a42-b5ac-44fa-bcd3-576f999b80a4 tempest-VolumesExtendTest-367270268 None] Temporary image 423469e2-d15b-4cf9-87cd-88e68e947d3b for user 4ecae06626ae4bb399e25c7aff78f4da is deleted. {{(pid=87116) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Nov 06 11:55:04 devstack cinder-volume[87116]: DEBUG cinder.volume.volume_utils [None req-8cc63a42-b5ac-44fa-bcd3-576f999b80a4 tempest-VolumesExtendTest-367270268 None] Marking volume b05eb85b-ef71-4e69-a126-415db8eab179 as bootable. {{(pid=87116) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Nov 06 11:55:04 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-78fe947f-5588-4ce1-835d-c3fb042c32a3 tempest-VolumesGetTest-482783544 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (25be2d5d-c71b-45b0-a179-600dd84e4ac5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T10:55:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1152542403',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=78bc8400-bf07-43bb-911a-cba91926a8fe,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='d7de355fe6574fb3803d0652cc58996c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T10:55:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=0cc4181c-7a27-4877-be92-80385ed838b2,status='creating',terminated_at=None,updated_at=2026-11-06T10:55:05Z,use_quota=True,user_id='0e7aa2fc2ce242719cef88bdfb0422e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(34d3b144-d9b7-480a-a2e3-01e45f3d54c1),volume_type_id=34d3b144-d9b7-480a-a2e3-01e45f3d54c1)' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:55:04 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-78fe947f-5588-4ce1-835d-c3fb042c32a3 tempest-VolumesGetTest-482783544 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f199dbf5-e0e0-4776-8a9e-37dd54eebc8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:55:04 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-78fe947f-5588-4ce1-835d-c3fb042c32a3 tempest-VolumesGetTest-482783544 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f199dbf5-e0e0-4776-8a9e-37dd54eebc8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:55:04 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-78fe947f-5588-4ce1-835d-c3fb042c32a3 tempest-VolumesGetTest-482783544 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4072e321-48fd-4da5-90ef-55350e5bc9ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:55:04 devstack cinder-volume[87116]: DEBUG cinder.volume.flows.manager.create_volume [None req-8cc63a42-b5ac-44fa-bcd3-576f999b80a4 tempest-VolumesExtendTest-367270268 None] Copying metadata from image 423469e2-d15b-4cf9-87cd-88e68e947d3b to b05eb85b-ef71-4e69-a126-415db8eab179. {{(pid=87116) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Nov 06 11:55:04 devstack cinder-volume[87116]: DEBUG cinder.volume.flows.manager.create_volume [None req-8cc63a42-b5ac-44fa-bcd3-576f999b80a4 tempest-VolumesExtendTest-367270268 None] Creating volume glance metadata for volume b05eb85b-ef71-4e69-a126-415db8eab179 backed by image 423469e2-d15b-4cf9-87cd-88e68e947d3b with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '423469e2-d15b-4cf9-87cd-88e68e947d3b', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87116) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Nov 06 11:55:04 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-78fe947f-5588-4ce1-835d-c3fb042c32a3 tempest-VolumesGetTest-482783544 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4072e321-48fd-4da5-90ef-55350e5bc9ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '78bc8400-bf07-43bb-911a-cba91926a8fe', 'volume_name': 'volume-78bc8400-bf07-43bb-911a-cba91926a8fe', 'volume_size': 1, 'source_volid': '0cc4181c-7a27-4877-be92-80385ed838b2', 'source_volstatus': 'available'}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:55:04 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-78fe947f-5588-4ce1-835d-c3fb042c32a3 tempest-VolumesGetTest-482783544 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (15f0c55f-e0e1-4ee3-bd17-8c5827d45c2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:55:04 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-78fe947f-5588-4ce1-835d-c3fb042c32a3 tempest-VolumesGetTest-482783544 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (15f0c55f-e0e1-4ee3-bd17-8c5827d45c2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:55:04 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-78fe947f-5588-4ce1-835d-c3fb042c32a3 tempest-VolumesGetTest-482783544 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7a898323-e400-4191-a9a5-6bc5f5075de5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:55:04 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-78fe947f-5588-4ce1-835d-c3fb042c32a3 tempest-VolumesGetTest-482783544 None] Volume 78bc8400-bf07-43bb-911a-cba91926a8fe: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-78bc8400-bf07-43bb-911a-cba91926a8fe', 'volume_size': 1, 'source_volid': '0cc4181c-7a27-4877-be92-80385ed838b2', 'source_volstatus': 'available'} Nov 06 11:55:04 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-78fe947f-5588-4ce1-835d-c3fb042c32a3 tempest-VolumesGetTest-482783544 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 11:55:04 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-78fe947f-5588-4ce1-835d-c3fb042c32a3 tempest-VolumesGetTest-482783544 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 11:55:04 devstack cinder-volume[87116]: INFO cinder.volume.drivers.remotefs [None req-78fe947f-5588-4ce1-835d-c3fb042c32a3 tempest-VolumesGetTest-482783544 None] Cloning volume 0cc4181c-7a27-4877-be92-80385ed838b2 to volume 78bc8400-bf07-43bb-911a-cba91926a8fe Nov 06 11:55:05 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-78fe947f-5588-4ce1-835d-c3fb042c32a3 tempest-VolumesGetTest-482783544 None] Creating offline snapshot 32385d6c-b840-4dcf-bb46-25096e6eb383 of volume 0cc4181c-7a27-4877-be92-80385ed838b2 {{(pid=87116) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 06 11:55:05 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[598d2c7f-65a3-44c3-8d6b-e55f9a7ca414]: (4, 'qcow2') {{(pid=88420) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 11:55:05 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-78fe947f-5588-4ce1-835d-c3fb042c32a3 tempest-VolumesGetTest-482783544 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-0cc4181c-7a27-4877-be92-80385ed838b2 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:55:05 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-8cc63a42-b5ac-44fa-bcd3-576f999b80a4 tempest-VolumesExtendTest-367270268 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (22e35f55-2055-4191-8d53-968885323dc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b05eb85b-ef71-4e69-a126-415db8eab179', 'volume_size': 1, 'image_id': '423469e2-d15b-4cf9-87cd-88e68e947d3b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/423469e2-d15b-4cf9-87cd-88e68e947d3b', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b05f927c30c5407aad52949459346010', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '423469e2-d15b-4cf9-87cd-88e68e947d3b', 'created_at': datetime.datetime(2026, 11, 6, 10, 36, 49, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 6, 10, 36, 50, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/423469e2-d15b-4cf9-87cd-88e68e947d3b/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:55:05 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-8cc63a42-b5ac-44fa-bcd3-576f999b80a4 tempest-VolumesExtendTest-367270268 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5068aa29-b7fd-4d69-a313-3444b6cb91c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:55:05 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-8cc63a42-b5ac-44fa-bcd3-576f999b80a4 tempest-VolumesExtendTest-367270268 None] Volume volume-b05eb85b-ef71-4e69-a126-415db8eab179 (b05eb85b-ef71-4e69-a126-415db8eab179): created successfully Nov 06 11:55:05 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-8cc63a42-b5ac-44fa-bcd3-576f999b80a4 tempest-VolumesExtendTest-367270268 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5068aa29-b7fd-4d69-a313-3444b6cb91c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:55:05 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-8cc63a42-b5ac-44fa-bcd3-576f999b80a4 tempest-VolumesExtendTest-367270268 None] Flow 'volume_create_manager' (526e8da6-01a1-4d53-80ff-f188e170f13f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 11:55:05 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-8cc63a42-b5ac-44fa-bcd3-576f999b80a4 tempest-VolumesExtendTest-367270268 None] Created volume successfully. Nov 06 11:55:05 devstack sudo[101407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-0cc4181c-7a27-4877-be92-80385ed838b2 Nov 06 11:55:05 devstack sudo[101407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:55:05 devstack sudo[101407]: pam_unix(sudo:session): session closed for user root Nov 06 11:55:05 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-78fe947f-5588-4ce1-835d-c3fb042c32a3 tempest-VolumesGetTest-482783544 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-0cc4181c-7a27-4877-be92-80385ed838b2" returned: 0 in 0.469s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:55:05 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-78fe947f-5588-4ce1-835d-c3fb042c32a3 tempest-VolumesGetTest-482783544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-0cc4181c-7a27-4877-be92-80385ed838b2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-0cc4181c-7a27-4877-be92-80385ed838b2.32385d6c-b840-4dcf-bb46-25096e6eb383 1G {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:55:05 devstack sudo[101413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-0cc4181c-7a27-4877-be92-80385ed838b2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-0cc4181c-7a27-4877-be92-80385ed838b2.32385d6c-b840-4dcf-bb46-25096e6eb383 1G Nov 06 11:55:05 devstack sudo[101413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:55:05 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-9d18d87d-db89-4ea3-b574-8c12dedb8f97 tempest-VolumesExtendTest-367270268 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 11:55:06 devstack sudo[101413]: pam_unix(sudo:session): session closed for user root Nov 06 11:55:06 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-78fe947f-5588-4ce1-835d-c3fb042c32a3 tempest-VolumesGetTest-482783544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-0cc4181c-7a27-4877-be92-80385ed838b2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-0cc4181c-7a27-4877-be92-80385ed838b2.32385d6c-b840-4dcf-bb46-25096e6eb383 1G" returned: 0 in 0.583s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:55:06 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-78fe947f-5588-4ce1-835d-c3fb042c32a3 tempest-VolumesGetTest-482783544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0cc4181c-7a27-4877-be92-80385ed838b2 -F qcow2 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-0cc4181c-7a27-4877-be92-80385ed838b2.32385d6c-b840-4dcf-bb46-25096e6eb383 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:55:06 devstack sudo[101421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0cc4181c-7a27-4877-be92-80385ed838b2 -F qcow2 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-0cc4181c-7a27-4877-be92-80385ed838b2.32385d6c-b840-4dcf-bb46-25096e6eb383 Nov 06 11:55:06 devstack sudo[101421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:55:06 devstack sudo[101421]: pam_unix(sudo:session): session closed for user root Nov 06 11:55:06 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-78fe947f-5588-4ce1-835d-c3fb042c32a3 tempest-VolumesGetTest-482783544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0cc4181c-7a27-4877-be92-80385ed838b2 -F qcow2 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-0cc4181c-7a27-4877-be92-80385ed838b2.32385d6c-b840-4dcf-bb46-25096e6eb383" returned: 0 in 0.353s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:55:06 devstack cinder-volume[87116]: WARNING cinder.volume.drivers.remotefs [None req-78fe947f-5588-4ce1-835d-c3fb042c32a3 tempest-VolumesGetTest-482783544 None] /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-0cc4181c-7a27-4877-be92-80385ed838b2.32385d6c-b840-4dcf-bb46-25096e6eb383 is being set with open permissions: ugo+rw Nov 06 11:55:06 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-78fe947f-5588-4ce1-835d-c3fb042c32a3 tempest-VolumesGetTest-482783544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-0cc4181c-7a27-4877-be92-80385ed838b2.32385d6c-b840-4dcf-bb46-25096e6eb383 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:55:06 devstack sudo[101426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-0cc4181c-7a27-4877-be92-80385ed838b2.32385d6c-b840-4dcf-bb46-25096e6eb383 Nov 06 11:55:06 devstack sudo[101426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:55:06 devstack sudo[101426]: pam_unix(sudo:session): session closed for user root Nov 06 11:55:06 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-78fe947f-5588-4ce1-835d-c3fb042c32a3 tempest-VolumesGetTest-482783544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-0cc4181c-7a27-4877-be92-80385ed838b2.32385d6c-b840-4dcf-bb46-25096e6eb383" returned: 0 in 0.376s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:55:06 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-78fe947f-5588-4ce1-835d-c3fb042c32a3 tempest-VolumesGetTest-482783544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-0cc4181c-7a27-4877-be92-80385ed838b2.info {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:55:06 devstack sudo[101522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-0cc4181c-7a27-4877-be92-80385ed838b2.info Nov 06 11:55:06 devstack sudo[101522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:55:07 devstack sudo[101522]: pam_unix(sudo:session): session closed for user root Nov 06 11:55:07 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-78fe947f-5588-4ce1-835d-c3fb042c32a3 tempest-VolumesGetTest-482783544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-0cc4181c-7a27-4877-be92-80385ed838b2.info" returned: 0 in 0.310s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:55:07 devstack cinder-volume[87116]: WARNING cinder.volume.drivers.remotefs [None req-78fe947f-5588-4ce1-835d-c3fb042c32a3 tempest-VolumesGetTest-482783544 None] /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-0cc4181c-7a27-4877-be92-80385ed838b2.info is being set with open permissions: ugo+rw Nov 06 11:55:07 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-78fe947f-5588-4ce1-835d-c3fb042c32a3 tempest-VolumesGetTest-482783544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-0cc4181c-7a27-4877-be92-80385ed838b2.info {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:55:07 devstack sudo[101651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-0cc4181c-7a27-4877-be92-80385ed838b2.info Nov 06 11:55:07 devstack sudo[101651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:55:07 devstack sudo[101651]: pam_unix(sudo:session): session closed for user root Nov 06 11:55:07 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-78fe947f-5588-4ce1-835d-c3fb042c32a3 tempest-VolumesGetTest-482783544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-0cc4181c-7a27-4877-be92-80385ed838b2.info" returned: 0 in 0.451s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:55:07 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-78fe947f-5588-4ce1-835d-c3fb042c32a3 tempest-VolumesGetTest-482783544 None] Acquiring lock "cinder-quobyte-78bc8400-bf07-43bb-911a-cba91926a8fe" by "_copy_volume_from_snapshot" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 11:55:07 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-78fe947f-5588-4ce1-835d-c3fb042c32a3 tempest-VolumesGetTest-482783544 None] Lock "cinder-quobyte-78bc8400-bf07-43bb-911a-cba91926a8fe" acquired by "_copy_volume_from_snapshot" :: waited 0.031s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 11:55:07 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-78fe947f-5588-4ce1-835d-c3fb042c32a3 tempest-VolumesGetTest-482783544 None] snapshot: 32385d6c-b840-4dcf-bb46-25096e6eb383, volume: 78bc8400-bf07-43bb-911a-cba91926a8fe, {{(pid=87116) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 06 11:55:07 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-78fe947f-5588-4ce1-835d-c3fb042c32a3 tempest-VolumesGetTest-482783544 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 11:55:07 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-78fe947f-5588-4ce1-835d-c3fb042c32a3 tempest-VolumesGetTest-482783544 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 11:55:07 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-78fe947f-5588-4ce1-835d-c3fb042c32a3 tempest-VolumesGetTest-482783544 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 11:55:07 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-78fe947f-5588-4ce1-835d-c3fb042c32a3 tempest-VolumesGetTest-482783544 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 11:55:07 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-78fe947f-5588-4ce1-835d-c3fb042c32a3 tempest-VolumesGetTest-482783544 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 11:55:07 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[4330efb4-80c3-4133-8a95-c523ce294889]: (4, 'qcow2') {{(pid=88420) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 11:55:07 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-78fe947f-5588-4ce1-835d-c3fb042c32a3 tempest-VolumesGetTest-482783544 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-0cc4181c-7a27-4877-be92-80385ed838b2.32385d6c-b840-4dcf-bb46-25096e6eb383 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:55:08 devstack sudo[101797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-0cc4181c-7a27-4877-be92-80385ed838b2.32385d6c-b840-4dcf-bb46-25096e6eb383 Nov 06 11:55:08 devstack sudo[101797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:55:08 devstack sudo[101797]: pam_unix(sudo:session): session closed for user root Nov 06 11:55:08 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-78fe947f-5588-4ce1-835d-c3fb042c32a3 tempest-VolumesGetTest-482783544 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-0cc4181c-7a27-4877-be92-80385ed838b2.32385d6c-b840-4dcf-bb46-25096e6eb383" returned: 0 in 0.663s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:55:08 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-78fe947f-5588-4ce1-835d-c3fb042c32a3 tempest-VolumesGetTest-482783544 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0cc4181c-7a27-4877-be92-80385ed838b2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87116) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 11:55:08 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ecc4993-51f1-4302-8837-e7e5c288449f]: (4, 'qcow2') {{(pid=88420) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 11:55:08 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-78fe947f-5588-4ce1-835d-c3fb042c32a3 tempest-VolumesGetTest-482783544 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-0cc4181c-7a27-4877-be92-80385ed838b2 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:55:08 devstack sudo[101833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-0cc4181c-7a27-4877-be92-80385ed838b2 Nov 06 11:55:08 devstack sudo[101833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:55:09 devstack sudo[101833]: pam_unix(sudo:session): session closed for user root Nov 06 11:55:09 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-78fe947f-5588-4ce1-835d-c3fb042c32a3 tempest-VolumesGetTest-482783544 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-0cc4181c-7a27-4877-be92-80385ed838b2" returned: 0 in 0.480s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:55:09 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-78fe947f-5588-4ce1-835d-c3fb042c32a3 tempest-VolumesGetTest-482783544 None] will copy from snapshot at /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-0cc4181c-7a27-4877-be92-80385ed838b2 {{(pid=87116) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 06 11:55:09 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-78fe947f-5588-4ce1-835d-c3fb042c32a3 tempest-VolumesGetTest-482783544 None] Creating direct copy from snapshot {{(pid=87116) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 06 11:55:09 devstack cinder-volume[87116]: DEBUG cinder.utils [None req-78fe947f-5588-4ce1-835d-c3fb042c32a3 tempest-VolumesGetTest-482783544 None] Path /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-78bc8400-bf07-43bb-911a-cba91926a8fe not found in is_blk_device check {{(pid=87116) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 06 11:55:09 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-78fe947f-5588-4ce1-835d-c3fb042c32a3 tempest-VolumesGetTest-482783544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-0cc4181c-7a27-4877-be92-80385ed838b2 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-78bc8400-bf07-43bb-911a-cba91926a8fe {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:55:09 devstack sudo[101841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-0cc4181c-7a27-4877-be92-80385ed838b2 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-78bc8400-bf07-43bb-911a-cba91926a8fe Nov 06 11:55:09 devstack sudo[101841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:55:16 devstack cinder-volume[87116]: DEBUG dbcounter [-] [87116] Writing DB stats cinder:UPDATE=70,cinder:SELECT=84,cinder:INSERT=23,cinder:DELETE=5 {{(pid=87116) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 11:55:16 devstack cinder-volume[87116]: DEBUG dbcounter [-] [87116] Writing DB stats cinder:INSERT=14,cinder:UPDATE=28,cinder:SELECT=30,cinder:DELETE=3 {{(pid=87116) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 11:55:19 devstack sudo[101841]: pam_unix(sudo:session): session closed for user root Nov 06 11:55:19 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-78fe947f-5588-4ce1-835d-c3fb042c32a3 tempest-VolumesGetTest-482783544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-0cc4181c-7a27-4877-be92-80385ed838b2 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-78bc8400-bf07-43bb-911a-cba91926a8fe" returned: 0 in 10.342s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:55:19 devstack cinder-volume[87116]: DEBUG cinder.image.image_utils [None req-78fe947f-5588-4ce1-835d-c3fb042c32a3 tempest-VolumesGetTest-482783544 None] Image conversion details: src /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-0cc4181c-7a27-4877-be92-80385ed838b2, size 1024.00 MB, duration 10.34 sec, destination /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-78bc8400-bf07-43bb-911a-cba91926a8fe {{(pid=87116) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 06 11:55:19 devstack cinder-volume[87116]: INFO cinder.image.image_utils [None req-78fe947f-5588-4ce1-835d-c3fb042c32a3 tempest-VolumesGetTest-482783544 None] Converted 1024.00 MB image at 99.01 MB/s Nov 06 11:55:19 devstack cinder-volume[87116]: WARNING cinder.volume.drivers.remotefs [None req-78fe947f-5588-4ce1-835d-c3fb042c32a3 tempest-VolumesGetTest-482783544 None] /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-78bc8400-bf07-43bb-911a-cba91926a8fe is being set with open permissions: ugo+rw Nov 06 11:55:19 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-78fe947f-5588-4ce1-835d-c3fb042c32a3 tempest-VolumesGetTest-482783544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-78bc8400-bf07-43bb-911a-cba91926a8fe {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:55:19 devstack sudo[101977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-78bc8400-bf07-43bb-911a-cba91926a8fe Nov 06 11:55:19 devstack sudo[101977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:55:19 devstack sudo[101977]: pam_unix(sudo:session): session closed for user root Nov 06 11:55:19 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-78fe947f-5588-4ce1-835d-c3fb042c32a3 tempest-VolumesGetTest-482783544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-78bc8400-bf07-43bb-911a-cba91926a8fe" returned: 0 in 0.244s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:55:19 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-78fe947f-5588-4ce1-835d-c3fb042c32a3 tempest-VolumesGetTest-482783544 None] Lock "cinder-quobyte-78bc8400-bf07-43bb-911a-cba91926a8fe" released by "_copy_volume_from_snapshot" :: held 11.968s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 11:55:19 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-78fe947f-5588-4ce1-835d-c3fb042c32a3 tempest-VolumesGetTest-482783544 None] Acquiring lock "cinder-quobyte-32385d6c-b840-4dcf-bb46-25096e6eb383" by "_delete_snapshot" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 11:55:19 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-78fe947f-5588-4ce1-835d-c3fb042c32a3 tempest-VolumesGetTest-482783544 None] Lock "cinder-quobyte-32385d6c-b840-4dcf-bb46-25096e6eb383" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 11:55:19 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-78fe947f-5588-4ce1-835d-c3fb042c32a3 tempest-VolumesGetTest-482783544 None] Deleting offline snapshot 32385d6c-b840-4dcf-bb46-25096e6eb383 of volume 0cc4181c-7a27-4877-be92-80385ed838b2 {{(pid=87116) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 06 11:55:19 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-78fe947f-5588-4ce1-835d-c3fb042c32a3 tempest-VolumesGetTest-482783544 None] snapshot_file for this snap is: volume-0cc4181c-7a27-4877-be92-80385ed838b2.32385d6c-b840-4dcf-bb46-25096e6eb383 {{(pid=87116) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 06 11:55:19 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[2268f4ac-a84c-4502-9372-7e9079ed8714]: (4, 'qcow2') {{(pid=88420) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 11:55:19 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-78fe947f-5588-4ce1-835d-c3fb042c32a3 tempest-VolumesGetTest-482783544 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-0cc4181c-7a27-4877-be92-80385ed838b2.32385d6c-b840-4dcf-bb46-25096e6eb383 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:55:19 devstack sudo[101980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-0cc4181c-7a27-4877-be92-80385ed838b2.32385d6c-b840-4dcf-bb46-25096e6eb383 Nov 06 11:55:19 devstack sudo[101980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:55:20 devstack sudo[101980]: pam_unix(sudo:session): session closed for user root Nov 06 11:55:20 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-78fe947f-5588-4ce1-835d-c3fb042c32a3 tempest-VolumesGetTest-482783544 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-0cc4181c-7a27-4877-be92-80385ed838b2.32385d6c-b840-4dcf-bb46-25096e6eb383" returned: 0 in 0.441s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:55:20 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-78fe947f-5588-4ce1-835d-c3fb042c32a3 tempest-VolumesGetTest-482783544 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0cc4181c-7a27-4877-be92-80385ed838b2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87116) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 11:55:20 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea345a5f-1111-43e5-be3c-37ed1742e30d]: (4, 'qcow2') {{(pid=88420) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 11:55:20 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-78fe947f-5588-4ce1-835d-c3fb042c32a3 tempest-VolumesGetTest-482783544 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-0cc4181c-7a27-4877-be92-80385ed838b2 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:55:20 devstack sudo[102007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-0cc4181c-7a27-4877-be92-80385ed838b2 Nov 06 11:55:20 devstack sudo[102007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:55:20 devstack sudo[102007]: pam_unix(sudo:session): session closed for user root Nov 06 11:55:20 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-78fe947f-5588-4ce1-835d-c3fb042c32a3 tempest-VolumesGetTest-482783544 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-0cc4181c-7a27-4877-be92-80385ed838b2" returned: 0 in 0.537s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:55:20 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-78fe947f-5588-4ce1-835d-c3fb042c32a3 tempest-VolumesGetTest-482783544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-0cc4181c-7a27-4877-be92-80385ed838b2.32385d6c-b840-4dcf-bb46-25096e6eb383 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:55:20 devstack sudo[102012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-0cc4181c-7a27-4877-be92-80385ed838b2.32385d6c-b840-4dcf-bb46-25096e6eb383 Nov 06 11:55:20 devstack sudo[102012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:55:21 devstack sudo[102012]: pam_unix(sudo:session): session closed for user root Nov 06 11:55:21 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-78fe947f-5588-4ce1-835d-c3fb042c32a3 tempest-VolumesGetTest-482783544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-0cc4181c-7a27-4877-be92-80385ed838b2.32385d6c-b840-4dcf-bb46-25096e6eb383" returned: 0 in 0.670s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:55:21 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-78fe947f-5588-4ce1-835d-c3fb042c32a3 tempest-VolumesGetTest-482783544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-0cc4181c-7a27-4877-be92-80385ed838b2.32385d6c-b840-4dcf-bb46-25096e6eb383 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:55:21 devstack sudo[102019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-0cc4181c-7a27-4877-be92-80385ed838b2.32385d6c-b840-4dcf-bb46-25096e6eb383 Nov 06 11:55:21 devstack sudo[102019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:55:21 devstack sudo[102019]: pam_unix(sudo:session): session closed for user root Nov 06 11:55:21 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-78fe947f-5588-4ce1-835d-c3fb042c32a3 tempest-VolumesGetTest-482783544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-0cc4181c-7a27-4877-be92-80385ed838b2.32385d6c-b840-4dcf-bb46-25096e6eb383" returned: 0 in 0.327s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:55:21 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-78fe947f-5588-4ce1-835d-c3fb042c32a3 tempest-VolumesGetTest-482783544 None] Lock "cinder-quobyte-32385d6c-b840-4dcf-bb46-25096e6eb383" released by "_delete_snapshot" :: held 2.084s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 11:55:21 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-78fe947f-5588-4ce1-835d-c3fb042c32a3 tempest-VolumesGetTest-482783544 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 16.888s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 11:55:21 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-9d18d87d-db89-4ea3-b574-8c12dedb8f97 tempest-VolumesExtendTest-367270268 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 16.058s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 11:55:21 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-78fe947f-5588-4ce1-835d-c3fb042c32a3 tempest-VolumesGetTest-482783544 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7a898323-e400-4191-a9a5-6bc5f5075de5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-78bc8400-bf07-43bb-911a-cba91926a8fe', 'volume_size': 1, 'source_volid': '0cc4181c-7a27-4877-be92-80385ed838b2', 'source_volstatus': 'available'}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:55:21 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-78fe947f-5588-4ce1-835d-c3fb042c32a3 tempest-VolumesGetTest-482783544 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c6a1fbdd-3588-4140-8a5f-540f940b1f9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:55:21 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d40119b-061b-4e8d-b171-354b29135c83]: (4, 'qcow2') {{(pid=88420) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 11:55:21 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-9d18d87d-db89-4ea3-b574-8c12dedb8f97 tempest-VolumesExtendTest-367270268 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-b05eb85b-ef71-4e69-a126-415db8eab179 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:55:21 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-78fe947f-5588-4ce1-835d-c3fb042c32a3 tempest-VolumesGetTest-482783544 None] Volume volume-78bc8400-bf07-43bb-911a-cba91926a8fe (78bc8400-bf07-43bb-911a-cba91926a8fe): created successfully Nov 06 11:55:21 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-78fe947f-5588-4ce1-835d-c3fb042c32a3 tempest-VolumesGetTest-482783544 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c6a1fbdd-3588-4140-8a5f-540f940b1f9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:55:21 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-78fe947f-5588-4ce1-835d-c3fb042c32a3 tempest-VolumesGetTest-482783544 None] Flow 'volume_create_manager' (8efc7577-d5e0-4d81-9aef-f437c4508530) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 11:55:21 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-78fe947f-5588-4ce1-835d-c3fb042c32a3 tempest-VolumesGetTest-482783544 None] Created volume successfully. Nov 06 11:55:22 devstack sudo[102024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-b05eb85b-ef71-4e69-a126-415db8eab179 Nov 06 11:55:22 devstack sudo[102024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:55:22 devstack sudo[102024]: pam_unix(sudo:session): session closed for user root Nov 06 11:55:22 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-9d18d87d-db89-4ea3-b574-8c12dedb8f97 tempest-VolumesExtendTest-367270268 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-b05eb85b-ef71-4e69-a126-415db8eab179" returned: 0 in 0.438s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:55:22 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-9d18d87d-db89-4ea3-b574-8c12dedb8f97 tempest-VolumesExtendTest-367270268 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-b05eb85b-ef71-4e69-a126-415db8eab179 2G {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:55:22 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-9d18d87d-db89-4ea3-b574-8c12dedb8f97 tempest-VolumesExtendTest-367270268 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-b05eb85b-ef71-4e69-a126-415db8eab179 2G" returned: 0 in 0.112s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:55:22 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-9d18d87d-db89-4ea3-b574-8c12dedb8f97 tempest-VolumesExtendTest-367270268 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.592s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 11:55:22 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-9d18d87d-db89-4ea3-b574-8c12dedb8f97 tempest-VolumesExtendTest-367270268 None] Extend volume completed successfully. Nov 06 11:55:23 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-db2d80da-508e-4485-a308-d03e6f5156fb tempest-VolumesExtendTest-367270268 None] Acquiring lock "cinder-b05eb85b-ef71-4e69-a126-415db8eab179-delete_volume" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 11:55:23 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-db2d80da-508e-4485-a308-d03e6f5156fb tempest-VolumesExtendTest-367270268 None] Lock "cinder-b05eb85b-ef71-4e69-a126-415db8eab179-delete_volume" acquired by "delete_volume" :: waited 0.075s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 11:55:23 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-db2d80da-508e-4485-a308-d03e6f5156fb tempest-VolumesExtendTest-367270268 None] Acquiring lock "cinder-quobyte-b05eb85b-ef71-4e69-a126-415db8eab179" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 11:55:23 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-db2d80da-508e-4485-a308-d03e6f5156fb tempest-VolumesExtendTest-367270268 None] Lock "cinder-quobyte-b05eb85b-ef71-4e69-a126-415db8eab179" acquired by "delete_volume" :: waited 0.023s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 11:55:23 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[d14fb886-e3ed-4d17-b52f-142d8df58f11]: (4, 'qcow2') {{(pid=88420) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 11:55:23 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-db2d80da-508e-4485-a308-d03e6f5156fb tempest-VolumesExtendTest-367270268 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-b05eb85b-ef71-4e69-a126-415db8eab179 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:55:23 devstack sudo[102033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-b05eb85b-ef71-4e69-a126-415db8eab179 Nov 06 11:55:23 devstack sudo[102033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:55:23 devstack cinder-volume[87116]: DEBUG cinder.volume.flows.manager.create_volume [None req-57ff51da-5a43-48cf-ab24-b919cefd217b tempest-VolumesGetTest-482783544 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87116) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 11:55:23 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-57ff51da-5a43-48cf-ab24-b919cefd217b tempest-VolumesGetTest-482783544 None] Flow 'volume_create_manager' (cd6f8dcc-183e-40aa-a75d-60ca3a7e2013) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 11:55:23 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-57ff51da-5a43-48cf-ab24-b919cefd217b tempest-VolumesGetTest-482783544 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (143cbee8-aa77-41e9-8731-4f24368bc309) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:55:23 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-57ff51da-5a43-48cf-ab24-b919cefd217b tempest-VolumesGetTest-482783544 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (143cbee8-aa77-41e9-8731-4f24368bc309) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T10:55:23Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-553523363',display_name='tempest-VolumesGetTest-Volume-1482559230',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ea04fb32-1097-4924-a41e-679346808870,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d7de355fe6574fb3803d0652cc58996c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T10:55:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T10:55:24Z,use_quota=True,user_id='0e7aa2fc2ce242719cef88bdfb0422e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(34d3b144-d9b7-480a-a2e3-01e45f3d54c1),volume_type_id=34d3b144-d9b7-480a-a2e3-01e45f3d54c1)' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:55:23 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-57ff51da-5a43-48cf-ab24-b919cefd217b tempest-VolumesGetTest-482783544 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7bd472f7-0b04-43d8-9530-8cdab8ead66b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:55:23 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-57ff51da-5a43-48cf-ab24-b919cefd217b tempest-VolumesGetTest-482783544 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7bd472f7-0b04-43d8-9530-8cdab8ead66b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:55:23 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-57ff51da-5a43-48cf-ab24-b919cefd217b tempest-VolumesGetTest-482783544 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5392d70c-60d4-4c6f-a6d4-eb72510d2e23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:55:23 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-57ff51da-5a43-48cf-ab24-b919cefd217b tempest-VolumesGetTest-482783544 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5392d70c-60d4-4c6f-a6d4-eb72510d2e23) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ea04fb32-1097-4924-a41e-679346808870', 'volume_name': 'volume-ea04fb32-1097-4924-a41e-679346808870', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:55:23 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-57ff51da-5a43-48cf-ab24-b919cefd217b tempest-VolumesGetTest-482783544 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (06c8b817-4553-4855-bf0b-7cbe75dc3080) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:55:24 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-57ff51da-5a43-48cf-ab24-b919cefd217b tempest-VolumesGetTest-482783544 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (06c8b817-4553-4855-bf0b-7cbe75dc3080) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:55:24 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-57ff51da-5a43-48cf-ab24-b919cefd217b tempest-VolumesGetTest-482783544 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (89c7108f-c4f1-47e8-8747-0f756cd2b9eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:55:24 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-57ff51da-5a43-48cf-ab24-b919cefd217b tempest-VolumesGetTest-482783544 None] Volume ea04fb32-1097-4924-a41e-679346808870: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ea04fb32-1097-4924-a41e-679346808870', 'volume_size': 1} Nov 06 11:55:24 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-57ff51da-5a43-48cf-ab24-b919cefd217b tempest-VolumesGetTest-482783544 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 11:55:24 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-57ff51da-5a43-48cf-ab24-b919cefd217b tempest-VolumesGetTest-482783544 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 11:55:24 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-57ff51da-5a43-48cf-ab24-b919cefd217b tempest-VolumesGetTest-482783544 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T10:55:23Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-553523363',display_name='tempest-VolumesGetTest-Volume-1482559230',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ea04fb32-1097-4924-a41e-679346808870,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d7de355fe6574fb3803d0652cc58996c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T10:55:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T10:55:24Z,use_quota=True,user_id='0e7aa2fc2ce242719cef88bdfb0422e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(34d3b144-d9b7-480a-a2e3-01e45f3d54c1),volume_type_id=34d3b144-d9b7-480a-a2e3-01e45f3d54c1)}" {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 11:55:24 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-57ff51da-5a43-48cf-ab24-b919cefd217b tempest-VolumesGetTest-482783544 None] Creating volume ea04fb32-1097-4924-a41e-679346808870 {{(pid=87116) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 11:55:24 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-57ff51da-5a43-48cf-ab24-b919cefd217b tempest-VolumesGetTest-482783544 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 11:55:24 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-57ff51da-5a43-48cf-ab24-b919cefd217b tempest-VolumesGetTest-482783544 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 11:55:24 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-57ff51da-5a43-48cf-ab24-b919cefd217b tempest-VolumesGetTest-482783544 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 11:55:24 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-57ff51da-5a43-48cf-ab24-b919cefd217b tempest-VolumesGetTest-482783544 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 11:55:24 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-57ff51da-5a43-48cf-ab24-b919cefd217b tempest-VolumesGetTest-482783544 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 11:55:24 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-57ff51da-5a43-48cf-ab24-b919cefd217b tempest-VolumesGetTest-482783544 None] Selected osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f as target Quobyte volume. {{(pid=87116) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 11:55:24 devstack cinder-volume[87116]: INFO cinder.volume.drivers.remotefs [None req-57ff51da-5a43-48cf-ab24-b919cefd217b tempest-VolumesGetTest-482783544 None] casted to osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f Nov 06 11:55:24 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-57ff51da-5a43-48cf-ab24-b919cefd217b tempest-VolumesGetTest-482783544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-ea04fb32-1097-4924-a41e-679346808870 1073741824 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:55:24 devstack sudo[102037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-ea04fb32-1097-4924-a41e-679346808870 1073741824 Nov 06 11:55:24 devstack sudo[102037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:55:24 devstack sudo[102033]: pam_unix(sudo:session): session closed for user root Nov 06 11:55:24 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-db2d80da-508e-4485-a308-d03e6f5156fb tempest-VolumesExtendTest-367270268 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-b05eb85b-ef71-4e69-a126-415db8eab179" returned: 0 in 0.458s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:55:24 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-db2d80da-508e-4485-a308-d03e6f5156fb tempest-VolumesExtendTest-367270268 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-b05eb85b-ef71-4e69-a126-415db8eab179 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:55:24 devstack sudo[102040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-b05eb85b-ef71-4e69-a126-415db8eab179 Nov 06 11:55:24 devstack sudo[102040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:55:24 devstack sudo[102040]: pam_unix(sudo:session): session closed for user root Nov 06 11:55:24 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-db2d80da-508e-4485-a308-d03e6f5156fb tempest-VolumesExtendTest-367270268 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-b05eb85b-ef71-4e69-a126-415db8eab179" returned: 0 in 0.329s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:55:24 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-db2d80da-508e-4485-a308-d03e6f5156fb tempest-VolumesExtendTest-367270268 None] Lock "cinder-quobyte-b05eb85b-ef71-4e69-a126-415db8eab179" released by "delete_volume" :: held 0.846s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 11:55:24 devstack cinder-volume[87116]: DEBUG cinder.quota [None req-db2d80da-508e-4485-a308-d03e6f5156fb tempest-VolumesExtendTest-367270268 None] Created reservations ['6efcf82e-0a97-4402-8d97-72c441ca1f2d', '0fdfe48d-e695-4ebc-bc14-9243835c5867', '727365a9-b9c2-4b0d-aa63-f20bedc6eb3f', 'c68cec3e-634c-4133-ab24-ef5399488159'] {{(pid=87116) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 11:55:24 devstack sudo[102037]: pam_unix(sudo:session): session closed for user root Nov 06 11:55:24 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-57ff51da-5a43-48cf-ab24-b919cefd217b tempest-VolumesGetTest-482783544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-ea04fb32-1097-4924-a41e-679346808870 1073741824" returned: 0 in 0.573s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:55:24 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-db2d80da-508e-4485-a308-d03e6f5156fb tempest-VolumesExtendTest-367270268 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 11:55:24 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-db2d80da-508e-4485-a308-d03e6f5156fb tempest-VolumesExtendTest-367270268 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 11:55:24 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-db2d80da-508e-4485-a308-d03e6f5156fb tempest-VolumesExtendTest-367270268 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 11:55:24 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-db2d80da-508e-4485-a308-d03e6f5156fb tempest-VolumesExtendTest-367270268 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 11:55:24 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-db2d80da-508e-4485-a308-d03e6f5156fb tempest-VolumesExtendTest-367270268 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 11:55:24 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-db2d80da-508e-4485-a308-d03e6f5156fb tempest-VolumesExtendTest-367270268 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:55:24 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-57ff51da-5a43-48cf-ab24-b919cefd217b tempest-VolumesGetTest-482783544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-ea04fb32-1097-4924-a41e-679346808870 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:55:24 devstack sudo[102047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756 Nov 06 11:55:24 devstack sudo[102047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:55:24 devstack sudo[102048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-ea04fb32-1097-4924-a41e-679346808870 Nov 06 11:55:24 devstack sudo[102048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:55:25 devstack sudo[102048]: pam_unix(sudo:session): session closed for user root Nov 06 11:55:25 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-57ff51da-5a43-48cf-ab24-b919cefd217b tempest-VolumesGetTest-482783544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-ea04fb32-1097-4924-a41e-679346808870" returned: 0 in 0.284s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:55:25 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-57ff51da-5a43-48cf-ab24-b919cefd217b tempest-VolumesGetTest-482783544 None] <== create_volume: return (989ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f'} {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 11:55:25 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-57ff51da-5a43-48cf-ab24-b919cefd217b tempest-VolumesGetTest-482783544 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.993s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 11:55:25 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-57ff51da-5a43-48cf-ab24-b919cefd217b tempest-VolumesGetTest-482783544 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (89c7108f-c4f1-47e8-8747-0f756cd2b9eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ea04fb32-1097-4924-a41e-679346808870', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:55:25 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-57ff51da-5a43-48cf-ab24-b919cefd217b tempest-VolumesGetTest-482783544 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8c32de60-e70e-4ab4-9297-7f0830837e00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:55:25 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-57ff51da-5a43-48cf-ab24-b919cefd217b tempest-VolumesGetTest-482783544 None] Volume volume-ea04fb32-1097-4924-a41e-679346808870 (ea04fb32-1097-4924-a41e-679346808870): created successfully Nov 06 11:55:25 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-57ff51da-5a43-48cf-ab24-b919cefd217b tempest-VolumesGetTest-482783544 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8c32de60-e70e-4ab4-9297-7f0830837e00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:55:25 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-57ff51da-5a43-48cf-ab24-b919cefd217b tempest-VolumesGetTest-482783544 None] Flow 'volume_create_manager' (cd6f8dcc-183e-40aa-a75d-60ca3a7e2013) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 11:55:25 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-57ff51da-5a43-48cf-ab24-b919cefd217b tempest-VolumesGetTest-482783544 None] Created volume successfully. Nov 06 11:55:25 devstack sudo[102047]: pam_unix(sudo:session): session closed for user root Nov 06 11:55:25 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-db2d80da-508e-4485-a308-d03e6f5156fb tempest-VolumesExtendTest-367270268 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756" returned: 0 in 0.523s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:55:25 devstack cinder-volume[87116]: DEBUG cinder.manager [None req-db2d80da-508e-4485-a308-d03e6f5156fb tempest-VolumesExtendTest-367270268 None] Notifying Schedulers of capabilities ... {{(pid=87116) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 11:55:25 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-db2d80da-508e-4485-a308-d03e6f5156fb tempest-VolumesExtendTest-367270268 None] Deleted volume successfully. Nov 06 11:55:25 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-db2d80da-508e-4485-a308-d03e6f5156fb tempest-VolumesExtendTest-367270268 None] Lock "cinder-b05eb85b-ef71-4e69-a126-415db8eab179-delete_volume" released by "delete_volume" :: held 1.712s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 11:55:25 devstack cinder-volume[87116]: DEBUG cinder.volume.flows.manager.create_volume [None req-e60f30e6-669b-47bb-ae03-24ce0c347734 tempest-VolumesExtendTest-367270268 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87116) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 11:55:25 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-e60f30e6-669b-47bb-ae03-24ce0c347734 tempest-VolumesExtendTest-367270268 None] Flow 'volume_create_manager' (237c188d-4762-45ce-ba9e-2288ea4eb4c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 11:55:25 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-e60f30e6-669b-47bb-ae03-24ce0c347734 tempest-VolumesExtendTest-367270268 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e7d49ece-2da3-4e55-b4d4-95fa5d6f0de5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:55:25 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-e60f30e6-669b-47bb-ae03-24ce0c347734 tempest-VolumesExtendTest-367270268 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e7d49ece-2da3-4e55-b4d4-95fa5d6f0de5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T10:55:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-909685985',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=99c7fd34-9aca-4da4-9c63-151f8d6af1a2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3e4f892e15c74f5db446925a987ad272',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T10:55:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T10:55:25Z,use_quota=True,user_id='4ecae06626ae4bb399e25c7aff78f4da',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(34d3b144-d9b7-480a-a2e3-01e45f3d54c1),volume_type_id=34d3b144-d9b7-480a-a2e3-01e45f3d54c1)' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:55:25 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-e60f30e6-669b-47bb-ae03-24ce0c347734 tempest-VolumesExtendTest-367270268 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (71d9b45d-3a58-4f28-83e6-6a26d4c51fdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:55:25 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-e60f30e6-669b-47bb-ae03-24ce0c347734 tempest-VolumesExtendTest-367270268 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (71d9b45d-3a58-4f28-83e6-6a26d4c51fdb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:55:25 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-e60f30e6-669b-47bb-ae03-24ce0c347734 tempest-VolumesExtendTest-367270268 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b0bf4eac-83d5-4e03-9d55-e446bb1410af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:55:25 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-e60f30e6-669b-47bb-ae03-24ce0c347734 tempest-VolumesExtendTest-367270268 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b0bf4eac-83d5-4e03-9d55-e446bb1410af) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '99c7fd34-9aca-4da4-9c63-151f8d6af1a2', 'volume_name': 'volume-99c7fd34-9aca-4da4-9c63-151f8d6af1a2', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:55:25 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-e60f30e6-669b-47bb-ae03-24ce0c347734 tempest-VolumesExtendTest-367270268 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (603ed39f-dd30-41df-b8ad-d41f38add4f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:55:25 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-e60f30e6-669b-47bb-ae03-24ce0c347734 tempest-VolumesExtendTest-367270268 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (603ed39f-dd30-41df-b8ad-d41f38add4f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:55:25 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-e60f30e6-669b-47bb-ae03-24ce0c347734 tempest-VolumesExtendTest-367270268 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f7b052c9-76ea-40a7-910c-f9f24a2848cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:55:25 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-e60f30e6-669b-47bb-ae03-24ce0c347734 tempest-VolumesExtendTest-367270268 None] Volume 99c7fd34-9aca-4da4-9c63-151f8d6af1a2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-99c7fd34-9aca-4da4-9c63-151f8d6af1a2', 'volume_size': 1} Nov 06 11:55:25 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-e60f30e6-669b-47bb-ae03-24ce0c347734 tempest-VolumesExtendTest-367270268 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 11:55:25 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-e60f30e6-669b-47bb-ae03-24ce0c347734 tempest-VolumesExtendTest-367270268 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 11:55:25 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-e60f30e6-669b-47bb-ae03-24ce0c347734 tempest-VolumesExtendTest-367270268 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T10:55:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-909685985',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=99c7fd34-9aca-4da4-9c63-151f8d6af1a2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3e4f892e15c74f5db446925a987ad272',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T10:55:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T10:55:25Z,use_quota=True,user_id='4ecae06626ae4bb399e25c7aff78f4da',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(34d3b144-d9b7-480a-a2e3-01e45f3d54c1),volume_type_id=34d3b144-d9b7-480a-a2e3-01e45f3d54c1)}" {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 11:55:25 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-e60f30e6-669b-47bb-ae03-24ce0c347734 tempest-VolumesExtendTest-367270268 None] Creating volume 99c7fd34-9aca-4da4-9c63-151f8d6af1a2 {{(pid=87116) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 11:55:25 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-e60f30e6-669b-47bb-ae03-24ce0c347734 tempest-VolumesExtendTest-367270268 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 11:55:25 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-e60f30e6-669b-47bb-ae03-24ce0c347734 tempest-VolumesExtendTest-367270268 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 11:55:25 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-e60f30e6-669b-47bb-ae03-24ce0c347734 tempest-VolumesExtendTest-367270268 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 11:55:25 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-e60f30e6-669b-47bb-ae03-24ce0c347734 tempest-VolumesExtendTest-367270268 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 11:55:25 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-e60f30e6-669b-47bb-ae03-24ce0c347734 tempest-VolumesExtendTest-367270268 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 11:55:25 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-e60f30e6-669b-47bb-ae03-24ce0c347734 tempest-VolumesExtendTest-367270268 None] Selected osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f as target Quobyte volume. {{(pid=87116) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 11:55:25 devstack cinder-volume[87116]: INFO cinder.volume.drivers.remotefs [None req-e60f30e6-669b-47bb-ae03-24ce0c347734 tempest-VolumesExtendTest-367270268 None] casted to osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f Nov 06 11:55:25 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-e60f30e6-669b-47bb-ae03-24ce0c347734 tempest-VolumesExtendTest-367270268 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-99c7fd34-9aca-4da4-9c63-151f8d6af1a2 1073741824 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:55:25 devstack sudo[102053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-99c7fd34-9aca-4da4-9c63-151f8d6af1a2 1073741824 Nov 06 11:55:25 devstack sudo[102053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:55:25 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-3b7e6222-0f4d-414b-b693-bef7662c695f tempest-VolumesGetTest-482783544 None] Acquiring lock "cinder-ea04fb32-1097-4924-a41e-679346808870-delete_volume" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 11:55:25 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-3b7e6222-0f4d-414b-b693-bef7662c695f tempest-VolumesGetTest-482783544 None] Lock "cinder-ea04fb32-1097-4924-a41e-679346808870-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 11:55:26 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-3b7e6222-0f4d-414b-b693-bef7662c695f tempest-VolumesGetTest-482783544 None] Acquiring lock "cinder-quobyte-ea04fb32-1097-4924-a41e-679346808870" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 11:55:26 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-3b7e6222-0f4d-414b-b693-bef7662c695f tempest-VolumesGetTest-482783544 None] Lock "cinder-quobyte-ea04fb32-1097-4924-a41e-679346808870" acquired by "delete_volume" :: waited 0.026s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 11:55:26 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[86083924-a21a-4a2a-9107-ee9723468ce9]: (4, 'qcow2') {{(pid=88420) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 11:55:26 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-3b7e6222-0f4d-414b-b693-bef7662c695f tempest-VolumesGetTest-482783544 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-ea04fb32-1097-4924-a41e-679346808870 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:55:26 devstack sudo[102053]: pam_unix(sudo:session): session closed for user root Nov 06 11:55:26 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-e60f30e6-669b-47bb-ae03-24ce0c347734 tempest-VolumesExtendTest-367270268 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-99c7fd34-9aca-4da4-9c63-151f8d6af1a2 1073741824" returned: 0 in 0.551s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:55:26 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-e60f30e6-669b-47bb-ae03-24ce0c347734 tempest-VolumesExtendTest-367270268 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-99c7fd34-9aca-4da4-9c63-151f8d6af1a2 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:55:26 devstack sudo[102059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-ea04fb32-1097-4924-a41e-679346808870 Nov 06 11:55:26 devstack sudo[102060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-99c7fd34-9aca-4da4-9c63-151f8d6af1a2 Nov 06 11:55:26 devstack sudo[102060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:55:26 devstack sudo[102059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:55:26 devstack sudo[102060]: pam_unix(sudo:session): session closed for user root Nov 06 11:55:26 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-e60f30e6-669b-47bb-ae03-24ce0c347734 tempest-VolumesExtendTest-367270268 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-99c7fd34-9aca-4da4-9c63-151f8d6af1a2" returned: 0 in 0.318s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:55:26 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-e60f30e6-669b-47bb-ae03-24ce0c347734 tempest-VolumesExtendTest-367270268 None] <== create_volume: return (919ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f'} {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 11:55:26 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-e60f30e6-669b-47bb-ae03-24ce0c347734 tempest-VolumesExtendTest-367270268 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.922s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 11:55:26 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-e60f30e6-669b-47bb-ae03-24ce0c347734 tempest-VolumesExtendTest-367270268 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f7b052c9-76ea-40a7-910c-f9f24a2848cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-99c7fd34-9aca-4da4-9c63-151f8d6af1a2', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:55:26 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-e60f30e6-669b-47bb-ae03-24ce0c347734 tempest-VolumesExtendTest-367270268 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a710fba6-ca05-4cdf-9139-c0f7b2d59f66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:55:26 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-e60f30e6-669b-47bb-ae03-24ce0c347734 tempest-VolumesExtendTest-367270268 None] Volume volume-99c7fd34-9aca-4da4-9c63-151f8d6af1a2 (99c7fd34-9aca-4da4-9c63-151f8d6af1a2): created successfully Nov 06 11:55:26 devstack sudo[102059]: pam_unix(sudo:session): session closed for user root Nov 06 11:55:26 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-e60f30e6-669b-47bb-ae03-24ce0c347734 tempest-VolumesExtendTest-367270268 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a710fba6-ca05-4cdf-9139-c0f7b2d59f66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:55:26 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-e60f30e6-669b-47bb-ae03-24ce0c347734 tempest-VolumesExtendTest-367270268 None] Flow 'volume_create_manager' (237c188d-4762-45ce-ba9e-2288ea4eb4c4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 11:55:26 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-3b7e6222-0f4d-414b-b693-bef7662c695f tempest-VolumesGetTest-482783544 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-ea04fb32-1097-4924-a41e-679346808870" returned: 0 in 0.460s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:55:26 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-3b7e6222-0f4d-414b-b693-bef7662c695f tempest-VolumesGetTest-482783544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-ea04fb32-1097-4924-a41e-679346808870 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:55:26 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-e60f30e6-669b-47bb-ae03-24ce0c347734 tempest-VolumesExtendTest-367270268 None] Created volume successfully. Nov 06 11:55:26 devstack sudo[102067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-ea04fb32-1097-4924-a41e-679346808870 Nov 06 11:55:26 devstack sudo[102067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:55:26 devstack sudo[102067]: pam_unix(sudo:session): session closed for user root Nov 06 11:55:26 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-3b7e6222-0f4d-414b-b693-bef7662c695f tempest-VolumesGetTest-482783544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-ea04fb32-1097-4924-a41e-679346808870" returned: 0 in 0.270s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:55:26 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-3b7e6222-0f4d-414b-b693-bef7662c695f tempest-VolumesGetTest-482783544 None] Lock "cinder-quobyte-ea04fb32-1097-4924-a41e-679346808870" released by "delete_volume" :: held 0.793s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 11:55:26 devstack cinder-volume[87116]: DEBUG cinder.quota [None req-3b7e6222-0f4d-414b-b693-bef7662c695f tempest-VolumesGetTest-482783544 None] Created reservations ['7dd6578c-6c1e-4033-bc40-23a790b08066', 'a83794c3-2ee3-404d-9407-197f1b0b563a', '78b5d3b4-8c76-4d20-86b1-be9c078482a1', '4d0040d6-419b-458f-8e00-dff859efbb67'] {{(pid=87116) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 11:55:26 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-3b7e6222-0f4d-414b-b693-bef7662c695f tempest-VolumesGetTest-482783544 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 11:55:26 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-3b7e6222-0f4d-414b-b693-bef7662c695f tempest-VolumesGetTest-482783544 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 11:55:26 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-3b7e6222-0f4d-414b-b693-bef7662c695f tempest-VolumesGetTest-482783544 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 11:55:26 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-3b7e6222-0f4d-414b-b693-bef7662c695f tempest-VolumesGetTest-482783544 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 11:55:26 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-3b7e6222-0f4d-414b-b693-bef7662c695f tempest-VolumesGetTest-482783544 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 11:55:26 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-3b7e6222-0f4d-414b-b693-bef7662c695f tempest-VolumesGetTest-482783544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:55:26 devstack sudo[102070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756 Nov 06 11:55:26 devstack sudo[102070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:55:27 devstack sudo[102070]: pam_unix(sudo:session): session closed for user root Nov 06 11:55:27 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-3b7e6222-0f4d-414b-b693-bef7662c695f tempest-VolumesGetTest-482783544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756" returned: 0 in 0.263s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:55:27 devstack cinder-volume[87116]: DEBUG cinder.manager [None req-3b7e6222-0f4d-414b-b693-bef7662c695f tempest-VolumesGetTest-482783544 None] Notifying Schedulers of capabilities ... {{(pid=87116) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 11:55:27 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-3b7e6222-0f4d-414b-b693-bef7662c695f tempest-VolumesGetTest-482783544 None] Deleted volume successfully. Nov 06 11:55:27 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-0879168a-0cff-4164-bf74-9669fb9fa8b8 tempest-VolumesGetTest-482783544 None] Acquiring lock "cinder-78bc8400-bf07-43bb-911a-cba91926a8fe-delete_volume" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 11:55:27 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-3b7e6222-0f4d-414b-b693-bef7662c695f tempest-VolumesGetTest-482783544 None] Lock "cinder-ea04fb32-1097-4924-a41e-679346808870-delete_volume" released by "delete_volume" :: held 1.342s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 11:55:27 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-0879168a-0cff-4164-bf74-9669fb9fa8b8 tempest-VolumesGetTest-482783544 None] Lock "cinder-78bc8400-bf07-43bb-911a-cba91926a8fe-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 11:55:27 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-0879168a-0cff-4164-bf74-9669fb9fa8b8 tempest-VolumesGetTest-482783544 None] Acquiring lock "cinder-quobyte-78bc8400-bf07-43bb-911a-cba91926a8fe" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 11:55:27 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-0879168a-0cff-4164-bf74-9669fb9fa8b8 tempest-VolumesGetTest-482783544 None] Lock "cinder-quobyte-78bc8400-bf07-43bb-911a-cba91926a8fe" acquired by "delete_volume" :: waited 0.016s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 11:55:27 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[0aa31e44-735b-4766-885e-b0f8a4d1ca9e]: (4, 'qcow2') {{(pid=88420) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 11:55:27 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-0879168a-0cff-4164-bf74-9669fb9fa8b8 tempest-VolumesGetTest-482783544 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-78bc8400-bf07-43bb-911a-cba91926a8fe {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:55:27 devstack sudo[102073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-78bc8400-bf07-43bb-911a-cba91926a8fe Nov 06 11:55:27 devstack sudo[102073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:55:27 devstack sudo[102073]: pam_unix(sudo:session): session closed for user root Nov 06 11:55:27 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-0879168a-0cff-4164-bf74-9669fb9fa8b8 tempest-VolumesGetTest-482783544 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-78bc8400-bf07-43bb-911a-cba91926a8fe" returned: 0 in 0.500s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:55:27 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-0879168a-0cff-4164-bf74-9669fb9fa8b8 tempest-VolumesGetTest-482783544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-78bc8400-bf07-43bb-911a-cba91926a8fe {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:55:27 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-21ebc8e2-8a0c-4310-b337-ca5f630f0c70 tempest-VolumesExtendTest-367270268 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 11:55:27 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-21ebc8e2-8a0c-4310-b337-ca5f630f0c70 tempest-VolumesExtendTest-367270268 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 11:55:27 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-21ebc8e2-8a0c-4310-b337-ca5f630f0c70 tempest-VolumesExtendTest-367270268 None] Creating offline snapshot 800593e5-2ef8-477b-8d6e-662948bec85b of volume 99c7fd34-9aca-4da4-9c63-151f8d6af1a2 {{(pid=87116) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 06 11:55:27 devstack sudo[102078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-78bc8400-bf07-43bb-911a-cba91926a8fe Nov 06 11:55:27 devstack sudo[102078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:55:27 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[c401d382-516b-4b9b-87a7-bf0ea69b3275]: (4, 'qcow2') {{(pid=88420) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 11:55:27 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-21ebc8e2-8a0c-4310-b337-ca5f630f0c70 tempest-VolumesExtendTest-367270268 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-99c7fd34-9aca-4da4-9c63-151f8d6af1a2 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:55:28 devstack sudo[102080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-99c7fd34-9aca-4da4-9c63-151f8d6af1a2 Nov 06 11:55:28 devstack sudo[102080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:55:28 devstack sudo[102078]: pam_unix(sudo:session): session closed for user root Nov 06 11:55:28 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-0879168a-0cff-4164-bf74-9669fb9fa8b8 tempest-VolumesGetTest-482783544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-78bc8400-bf07-43bb-911a-cba91926a8fe" returned: 0 in 0.355s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:55:28 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-0879168a-0cff-4164-bf74-9669fb9fa8b8 tempest-VolumesGetTest-482783544 None] Lock "cinder-quobyte-78bc8400-bf07-43bb-911a-cba91926a8fe" released by "delete_volume" :: held 0.902s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 11:55:28 devstack cinder-volume[87116]: DEBUG cinder.quota [None req-0879168a-0cff-4164-bf74-9669fb9fa8b8 tempest-VolumesGetTest-482783544 None] Created reservations ['6c7d8bc9-da95-4197-bc1d-bd363e25d382', 'cabd995b-4854-48ce-92db-2f1e03551803', '91adc4f1-6f2f-449f-8a10-33cdba2fa518', 'dc822b9c-e5dd-4290-adeb-ff3f2531210e'] {{(pid=87116) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 11:55:28 devstack sudo[102080]: pam_unix(sudo:session): session closed for user root Nov 06 11:55:28 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-21ebc8e2-8a0c-4310-b337-ca5f630f0c70 tempest-VolumesExtendTest-367270268 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-99c7fd34-9aca-4da4-9c63-151f8d6af1a2" returned: 0 in 0.471s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:55:28 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-21ebc8e2-8a0c-4310-b337-ca5f630f0c70 tempest-VolumesExtendTest-367270268 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-99c7fd34-9aca-4da4-9c63-151f8d6af1a2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-99c7fd34-9aca-4da4-9c63-151f8d6af1a2.800593e5-2ef8-477b-8d6e-662948bec85b 1G {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:55:28 devstack sudo[102087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-99c7fd34-9aca-4da4-9c63-151f8d6af1a2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-99c7fd34-9aca-4da4-9c63-151f8d6af1a2.800593e5-2ef8-477b-8d6e-662948bec85b 1G Nov 06 11:55:28 devstack sudo[102087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:55:28 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-0879168a-0cff-4164-bf74-9669fb9fa8b8 tempest-VolumesGetTest-482783544 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 11:55:28 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-0879168a-0cff-4164-bf74-9669fb9fa8b8 tempest-VolumesGetTest-482783544 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 11:55:28 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-0879168a-0cff-4164-bf74-9669fb9fa8b8 tempest-VolumesGetTest-482783544 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 11:55:28 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-0879168a-0cff-4164-bf74-9669fb9fa8b8 tempest-VolumesGetTest-482783544 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 11:55:28 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-0879168a-0cff-4164-bf74-9669fb9fa8b8 tempest-VolumesGetTest-482783544 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 11:55:28 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-0879168a-0cff-4164-bf74-9669fb9fa8b8 tempest-VolumesGetTest-482783544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:55:28 devstack sudo[102089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756 Nov 06 11:55:28 devstack sudo[102089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:55:28 devstack sudo[102089]: pam_unix(sudo:session): session closed for user root Nov 06 11:55:28 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-0879168a-0cff-4164-bf74-9669fb9fa8b8 tempest-VolumesGetTest-482783544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756" returned: 0 in 0.312s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:55:28 devstack cinder-volume[87116]: DEBUG cinder.manager [None req-0879168a-0cff-4164-bf74-9669fb9fa8b8 tempest-VolumesGetTest-482783544 None] Notifying Schedulers of capabilities ... {{(pid=87116) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 11:55:28 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-0879168a-0cff-4164-bf74-9669fb9fa8b8 tempest-VolumesGetTest-482783544 None] Deleted volume successfully. Nov 06 11:55:28 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-0879168a-0cff-4164-bf74-9669fb9fa8b8 tempest-VolumesGetTest-482783544 None] Lock "cinder-78bc8400-bf07-43bb-911a-cba91926a8fe-delete_volume" released by "delete_volume" :: held 1.559s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 11:55:28 devstack sudo[102087]: pam_unix(sudo:session): session closed for user root Nov 06 11:55:28 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-21ebc8e2-8a0c-4310-b337-ca5f630f0c70 tempest-VolumesExtendTest-367270268 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-99c7fd34-9aca-4da4-9c63-151f8d6af1a2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-99c7fd34-9aca-4da4-9c63-151f8d6af1a2.800593e5-2ef8-477b-8d6e-662948bec85b 1G" returned: 0 in 0.497s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:55:28 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-21ebc8e2-8a0c-4310-b337-ca5f630f0c70 tempest-VolumesExtendTest-367270268 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-99c7fd34-9aca-4da4-9c63-151f8d6af1a2 -F qcow2 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-99c7fd34-9aca-4da4-9c63-151f8d6af1a2.800593e5-2ef8-477b-8d6e-662948bec85b {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:55:28 devstack sudo[102096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-99c7fd34-9aca-4da4-9c63-151f8d6af1a2 -F qcow2 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-99c7fd34-9aca-4da4-9c63-151f8d6af1a2.800593e5-2ef8-477b-8d6e-662948bec85b Nov 06 11:55:28 devstack sudo[102096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:55:29 devstack sudo[102096]: pam_unix(sudo:session): session closed for user root Nov 06 11:55:29 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-21ebc8e2-8a0c-4310-b337-ca5f630f0c70 tempest-VolumesExtendTest-367270268 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-99c7fd34-9aca-4da4-9c63-151f8d6af1a2 -F qcow2 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-99c7fd34-9aca-4da4-9c63-151f8d6af1a2.800593e5-2ef8-477b-8d6e-662948bec85b" returned: 0 in 0.306s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:55:29 devstack cinder-volume[87116]: WARNING cinder.volume.drivers.remotefs [None req-21ebc8e2-8a0c-4310-b337-ca5f630f0c70 tempest-VolumesExtendTest-367270268 None] /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-99c7fd34-9aca-4da4-9c63-151f8d6af1a2.800593e5-2ef8-477b-8d6e-662948bec85b is being set with open permissions: ugo+rw Nov 06 11:55:29 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-21ebc8e2-8a0c-4310-b337-ca5f630f0c70 tempest-VolumesExtendTest-367270268 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-99c7fd34-9aca-4da4-9c63-151f8d6af1a2.800593e5-2ef8-477b-8d6e-662948bec85b {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:55:29 devstack sudo[102101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-99c7fd34-9aca-4da4-9c63-151f8d6af1a2.800593e5-2ef8-477b-8d6e-662948bec85b Nov 06 11:55:29 devstack sudo[102101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:55:29 devstack sudo[102101]: pam_unix(sudo:session): session closed for user root Nov 06 11:55:29 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-21ebc8e2-8a0c-4310-b337-ca5f630f0c70 tempest-VolumesExtendTest-367270268 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-99c7fd34-9aca-4da4-9c63-151f8d6af1a2.800593e5-2ef8-477b-8d6e-662948bec85b" returned: 0 in 0.285s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:55:29 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-21ebc8e2-8a0c-4310-b337-ca5f630f0c70 tempest-VolumesExtendTest-367270268 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-99c7fd34-9aca-4da4-9c63-151f8d6af1a2.info {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:55:29 devstack sudo[102104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-99c7fd34-9aca-4da4-9c63-151f8d6af1a2.info Nov 06 11:55:29 devstack sudo[102104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:55:29 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-abf9a063-6f22-45d8-9fb6-f212464e4f11 tempest-VolumesGetTest-482783544 None] Acquiring lock "cinder-0cc4181c-7a27-4877-be92-80385ed838b2-delete_volume" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 11:55:29 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-abf9a063-6f22-45d8-9fb6-f212464e4f11 tempest-VolumesGetTest-482783544 None] Lock "cinder-0cc4181c-7a27-4877-be92-80385ed838b2-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 11:55:29 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-abf9a063-6f22-45d8-9fb6-f212464e4f11 tempest-VolumesGetTest-482783544 None] Acquiring lock "cinder-quobyte-0cc4181c-7a27-4877-be92-80385ed838b2" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 11:55:29 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-abf9a063-6f22-45d8-9fb6-f212464e4f11 tempest-VolumesGetTest-482783544 None] Lock "cinder-quobyte-0cc4181c-7a27-4877-be92-80385ed838b2" acquired by "delete_volume" :: waited 0.017s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 11:55:29 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[09b1723f-a2b0-46ce-9920-42065939c7e3]: (4, 'qcow2') {{(pid=88420) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 11:55:29 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-abf9a063-6f22-45d8-9fb6-f212464e4f11 tempest-VolumesGetTest-482783544 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-0cc4181c-7a27-4877-be92-80385ed838b2 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:55:29 devstack sudo[102106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-0cc4181c-7a27-4877-be92-80385ed838b2 Nov 06 11:55:29 devstack sudo[102106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:55:29 devstack sudo[102104]: pam_unix(sudo:session): session closed for user root Nov 06 11:55:29 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-21ebc8e2-8a0c-4310-b337-ca5f630f0c70 tempest-VolumesExtendTest-367270268 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-99c7fd34-9aca-4da4-9c63-151f8d6af1a2.info" returned: 0 in 0.314s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:55:29 devstack cinder-volume[87116]: WARNING cinder.volume.drivers.remotefs [None req-21ebc8e2-8a0c-4310-b337-ca5f630f0c70 tempest-VolumesExtendTest-367270268 None] /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-99c7fd34-9aca-4da4-9c63-151f8d6af1a2.info is being set with open permissions: ugo+rw Nov 06 11:55:29 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-21ebc8e2-8a0c-4310-b337-ca5f630f0c70 tempest-VolumesExtendTest-367270268 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-99c7fd34-9aca-4da4-9c63-151f8d6af1a2.info {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:55:29 devstack sudo[102109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-99c7fd34-9aca-4da4-9c63-151f8d6af1a2.info Nov 06 11:55:29 devstack sudo[102109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:55:30 devstack sudo[102106]: pam_unix(sudo:session): session closed for user root Nov 06 11:55:30 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-abf9a063-6f22-45d8-9fb6-f212464e4f11 tempest-VolumesGetTest-482783544 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-0cc4181c-7a27-4877-be92-80385ed838b2" returned: 0 in 0.391s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:55:30 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-abf9a063-6f22-45d8-9fb6-f212464e4f11 tempest-VolumesGetTest-482783544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-0cc4181c-7a27-4877-be92-80385ed838b2 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:55:30 devstack sudo[102115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-0cc4181c-7a27-4877-be92-80385ed838b2 Nov 06 11:55:30 devstack sudo[102115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:55:30 devstack sudo[102109]: pam_unix(sudo:session): session closed for user root Nov 06 11:55:30 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-21ebc8e2-8a0c-4310-b337-ca5f630f0c70 tempest-VolumesExtendTest-367270268 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-99c7fd34-9aca-4da4-9c63-151f8d6af1a2.info" returned: 0 in 0.291s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:55:30 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-21ebc8e2-8a0c-4310-b337-ca5f630f0c70 tempest-VolumesExtendTest-367270268 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.277s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 11:55:30 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-21ebc8e2-8a0c-4310-b337-ca5f630f0c70 tempest-VolumesExtendTest-367270268 None] Create snapshot completed successfully Nov 06 11:55:30 devstack sudo[102115]: pam_unix(sudo:session): session closed for user root Nov 06 11:55:30 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-abf9a063-6f22-45d8-9fb6-f212464e4f11 tempest-VolumesGetTest-482783544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-0cc4181c-7a27-4877-be92-80385ed838b2" returned: 0 in 0.254s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:55:30 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-abf9a063-6f22-45d8-9fb6-f212464e4f11 tempest-VolumesGetTest-482783544 None] Lock "cinder-quobyte-0cc4181c-7a27-4877-be92-80385ed838b2" released by "delete_volume" :: held 0.707s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 11:55:30 devstack cinder-volume[87116]: DEBUG cinder.quota [None req-abf9a063-6f22-45d8-9fb6-f212464e4f11 tempest-VolumesGetTest-482783544 None] Created reservations ['98cbc756-26e3-4d17-9af7-bca0d28f0967', 'c9f81446-828b-4f0d-aad9-01eb0a8aa941', 'a4fb585c-6b18-4d83-adda-11f1a03f84b9', '7a3f315c-90db-4038-b743-d6ac49a9db8c'] {{(pid=87116) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 11:55:30 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-abf9a063-6f22-45d8-9fb6-f212464e4f11 tempest-VolumesGetTest-482783544 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 11:55:30 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-abf9a063-6f22-45d8-9fb6-f212464e4f11 tempest-VolumesGetTest-482783544 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 11:55:30 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-abf9a063-6f22-45d8-9fb6-f212464e4f11 tempest-VolumesGetTest-482783544 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 11:55:30 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-abf9a063-6f22-45d8-9fb6-f212464e4f11 tempest-VolumesGetTest-482783544 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 11:55:30 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-abf9a063-6f22-45d8-9fb6-f212464e4f11 tempest-VolumesGetTest-482783544 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 11:55:30 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-abf9a063-6f22-45d8-9fb6-f212464e4f11 tempest-VolumesGetTest-482783544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:55:30 devstack sudo[102118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756 Nov 06 11:55:30 devstack sudo[102118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:55:30 devstack sudo[102118]: pam_unix(sudo:session): session closed for user root Nov 06 11:55:30 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-abf9a063-6f22-45d8-9fb6-f212464e4f11 tempest-VolumesGetTest-482783544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756" returned: 0 in 0.277s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:55:30 devstack cinder-volume[87116]: DEBUG cinder.manager [None req-abf9a063-6f22-45d8-9fb6-f212464e4f11 tempest-VolumesGetTest-482783544 None] Notifying Schedulers of capabilities ... {{(pid=87116) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 11:55:30 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-abf9a063-6f22-45d8-9fb6-f212464e4f11 tempest-VolumesGetTest-482783544 None] Deleted volume successfully. Nov 06 11:55:30 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-abf9a063-6f22-45d8-9fb6-f212464e4f11 tempest-VolumesGetTest-482783544 None] Lock "cinder-0cc4181c-7a27-4877-be92-80385ed838b2-delete_volume" released by "delete_volume" :: held 1.220s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 11:55:31 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-d26190ec-64b9-4e8e-8da9-5cc5bd73e98b tempest-VolumesExtendTest-367270268 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 11:55:31 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-d26190ec-64b9-4e8e-8da9-5cc5bd73e98b tempest-VolumesExtendTest-367270268 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 11:55:31 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc479413-ef5b-43b9-843b-8871c1282a77]: (4, 'qcow2') {{(pid=88420) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 11:55:31 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-d26190ec-64b9-4e8e-8da9-5cc5bd73e98b tempest-VolumesExtendTest-367270268 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-99c7fd34-9aca-4da4-9c63-151f8d6af1a2 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:55:31 devstack sudo[102121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-99c7fd34-9aca-4da4-9c63-151f8d6af1a2 Nov 06 11:55:31 devstack sudo[102121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:55:31 devstack cinder-volume[87116]: DEBUG cinder.volume.flows.manager.create_volume [None req-cf4c4e76-b2a8-499e-a061-eca45352f674 tempest-VolumesGetTest-482783544 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87116) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 11:55:31 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-cf4c4e76-b2a8-499e-a061-eca45352f674 tempest-VolumesGetTest-482783544 None] Flow 'volume_create_manager' (412c3eb3-3281-4d9f-8855-1c3d2e4923df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 11:55:31 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-cf4c4e76-b2a8-499e-a061-eca45352f674 tempest-VolumesGetTest-482783544 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (19bc2b80-5be4-4219-b464-506811c01324) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:55:31 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-cf4c4e76-b2a8-499e-a061-eca45352f674 tempest-VolumesGetTest-482783544 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (19bc2b80-5be4-4219-b464-506811c01324) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T10:55:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1070880431',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8d959705-0a48-42d9-af64-7839a47895df,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='d7de355fe6574fb3803d0652cc58996c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T10:55:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T10:55:32Z,use_quota=True,user_id='0e7aa2fc2ce242719cef88bdfb0422e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(34d3b144-d9b7-480a-a2e3-01e45f3d54c1),volume_type_id=34d3b144-d9b7-480a-a2e3-01e45f3d54c1)' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:55:31 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-cf4c4e76-b2a8-499e-a061-eca45352f674 tempest-VolumesGetTest-482783544 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b9e46e2c-005a-4684-aafb-bd9c18fa5bfa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:55:31 devstack sudo[102121]: pam_unix(sudo:session): session closed for user root Nov 06 11:55:31 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-cf4c4e76-b2a8-499e-a061-eca45352f674 tempest-VolumesGetTest-482783544 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b9e46e2c-005a-4684-aafb-bd9c18fa5bfa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:55:31 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-cf4c4e76-b2a8-499e-a061-eca45352f674 tempest-VolumesGetTest-482783544 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (48fb1bc8-2b54-470c-9375-68b74934a960) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:55:31 devstack cinder-volume[87116]: DEBUG cinder.image.glance [None req-cf4c4e76-b2a8-499e-a061-eca45352f674 tempest-VolumesGetTest-482783544 None] Creating Keystone auth plugin from conf {{(pid=87116) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 06 11:55:31 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-d26190ec-64b9-4e8e-8da9-5cc5bd73e98b tempest-VolumesExtendTest-367270268 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-99c7fd34-9aca-4da4-9c63-151f8d6af1a2" returned: 0 in 0.455s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:55:31 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-d26190ec-64b9-4e8e-8da9-5cc5bd73e98b tempest-VolumesExtendTest-367270268 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-99c7fd34-9aca-4da4-9c63-151f8d6af1a2.800593e5-2ef8-477b-8d6e-662948bec85b 2G {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:55:31 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-d26190ec-64b9-4e8e-8da9-5cc5bd73e98b tempest-VolumesExtendTest-367270268 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-99c7fd34-9aca-4da4-9c63-151f8d6af1a2.800593e5-2ef8-477b-8d6e-662948bec85b 2G" returned: 0 in 0.148s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:55:31 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-d26190ec-64b9-4e8e-8da9-5cc5bd73e98b tempest-VolumesExtendTest-367270268 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.653s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 11:55:31 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-d26190ec-64b9-4e8e-8da9-5cc5bd73e98b tempest-VolumesExtendTest-367270268 None] Extend volume completed successfully. Nov 06 11:55:31 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-cf4c4e76-b2a8-499e-a061-eca45352f674 tempest-VolumesGetTest-482783544 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (48fb1bc8-2b54-470c-9375-68b74934a960) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '8d959705-0a48-42d9-af64-7839a47895df', 'volume_name': 'volume-8d959705-0a48-42d9-af64-7839a47895df', 'volume_size': 1, 'image_id': '423469e2-d15b-4cf9-87cd-88e68e947d3b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/423469e2-d15b-4cf9-87cd-88e68e947d3b', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b05f927c30c5407aad52949459346010', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '423469e2-d15b-4cf9-87cd-88e68e947d3b', 'created_at': datetime.datetime(2026, 11, 6, 10, 36, 49, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 6, 10, 36, 50, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/423469e2-d15b-4cf9-87cd-88e68e947d3b/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:55:31 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-cf4c4e76-b2a8-499e-a061-eca45352f674 tempest-VolumesGetTest-482783544 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (889dd77c-e53c-4690-8a25-a55a3999697d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:55:31 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-cf4c4e76-b2a8-499e-a061-eca45352f674 tempest-VolumesGetTest-482783544 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (889dd77c-e53c-4690-8a25-a55a3999697d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:55:31 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-cf4c4e76-b2a8-499e-a061-eca45352f674 tempest-VolumesGetTest-482783544 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c5e815a7-7c54-459b-b078-fc62996b7e39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:55:31 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-cf4c4e76-b2a8-499e-a061-eca45352f674 tempest-VolumesGetTest-482783544 None] Volume 8d959705-0a48-42d9-af64-7839a47895df: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-8d959705-0a48-42d9-af64-7839a47895df', 'volume_size': 1, 'image_id': '423469e2-d15b-4cf9-87cd-88e68e947d3b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/423469e2-d15b-4cf9-87cd-88e68e947d3b', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b05f927c30c5407aad52949459346010', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '423469e2-d15b-4cf9-87cd-88e68e947d3b', 'created_at': datetime.datetime(2026, 11, 6, 10, 36, 49, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 6, 10, 36, 50, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/423469e2-d15b-4cf9-87cd-88e68e947d3b/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Nov 06 11:55:31 devstack cinder-volume[87116]: DEBUG cinder.volume.flows.manager.create_volume [None req-cf4c4e76-b2a8-499e-a061-eca45352f674 tempest-VolumesGetTest-482783544 None] Trying to clone 8d959705-0a48-42d9-af64-7839a47895df from image 423469e2-d15b-4cf9-87cd-88e68e947d3b at location (None, [{'url': 'file:///opt/stack/data/glance/images/423469e2-d15b-4cf9-87cd-88e68e947d3b', 'metadata': {}}]). {{(pid=87116) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Nov 06 11:55:32 devstack cinder-volume[87116]: DEBUG cinder.image.image_utils [None req-cf4c4e76-b2a8-499e-a061-eca45352f674 tempest-VolumesGetTest-482783544 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_423469e2-d15b-4cf9-87cd-88e68e947d3b_0jyqhjh6devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87116) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Nov 06 11:55:32 devstack cinder-volume[87116]: INFO cinder.image.image_utils [None req-cf4c4e76-b2a8-499e-a061-eca45352f674 tempest-VolumesGetTest-482783544 None] Image download 20.69 MB at 20.69 MB/s Nov 06 11:55:32 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[51742290-a42f-49c7-81ed-fb3bc47816b0]: (4, 'qcow2') {{(pid=88420) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 11:55:32 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-cf4c4e76-b2a8-499e-a061-eca45352f674 tempest-VolumesGetTest-482783544 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_423469e2-d15b-4cf9-87cd-88e68e947d3b_0jyqhjh6devstack@QuobyteHD {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:55:32 devstack sudo[102135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_423469e2-d15b-4cf9-87cd-88e68e947d3b_0jyqhjh6devstack@QuobyteHD Nov 06 11:55:32 devstack sudo[102135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:55:32 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-877db301-4c3e-4b2f-b769-4736b6a9d339 tempest-VolumesExtendTest-367270268 None] Acquiring lock "cinder-800593e5-2ef8-477b-8d6e-662948bec85b-delete_snapshot" by "delete_snapshot" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 11:55:32 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-877db301-4c3e-4b2f-b769-4736b6a9d339 tempest-VolumesExtendTest-367270268 None] Lock "cinder-800593e5-2ef8-477b-8d6e-662948bec85b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.052s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 11:55:32 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-877db301-4c3e-4b2f-b769-4736b6a9d339 tempest-VolumesExtendTest-367270268 None] Acquiring lock "cinder-quobyte-99c7fd34-9aca-4da4-9c63-151f8d6af1a2" by "delete_snapshot" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 11:55:32 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-877db301-4c3e-4b2f-b769-4736b6a9d339 tempest-VolumesExtendTest-367270268 None] Lock "cinder-quobyte-99c7fd34-9aca-4da4-9c63-151f8d6af1a2" acquired by "delete_snapshot" :: waited 0.032s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 11:55:32 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-877db301-4c3e-4b2f-b769-4736b6a9d339 tempest-VolumesExtendTest-367270268 None] Acquiring lock "cinder-quobyte-800593e5-2ef8-477b-8d6e-662948bec85b" by "_delete_snapshot" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 11:55:32 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-877db301-4c3e-4b2f-b769-4736b6a9d339 tempest-VolumesExtendTest-367270268 None] Lock "cinder-quobyte-800593e5-2ef8-477b-8d6e-662948bec85b" acquired by "_delete_snapshot" :: waited 0.032s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 11:55:32 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-877db301-4c3e-4b2f-b769-4736b6a9d339 tempest-VolumesExtendTest-367270268 None] Deleting offline snapshot 800593e5-2ef8-477b-8d6e-662948bec85b of volume 99c7fd34-9aca-4da4-9c63-151f8d6af1a2 {{(pid=87116) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 06 11:55:32 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-877db301-4c3e-4b2f-b769-4736b6a9d339 tempest-VolumesExtendTest-367270268 None] snapshot_file for this snap is: volume-99c7fd34-9aca-4da4-9c63-151f8d6af1a2.800593e5-2ef8-477b-8d6e-662948bec85b {{(pid=87116) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 06 11:55:32 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[24c54914-f96a-4e66-aac6-a95253d8ea21]: (4, 'qcow2') {{(pid=88420) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 11:55:32 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-877db301-4c3e-4b2f-b769-4736b6a9d339 tempest-VolumesExtendTest-367270268 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-99c7fd34-9aca-4da4-9c63-151f8d6af1a2.800593e5-2ef8-477b-8d6e-662948bec85b {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:55:32 devstack sudo[102142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-99c7fd34-9aca-4da4-9c63-151f8d6af1a2.800593e5-2ef8-477b-8d6e-662948bec85b Nov 06 11:55:33 devstack sudo[102142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:55:33 devstack sudo[102135]: pam_unix(sudo:session): session closed for user root Nov 06 11:55:33 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-cf4c4e76-b2a8-499e-a061-eca45352f674 tempest-VolumesGetTest-482783544 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_423469e2-d15b-4cf9-87cd-88e68e947d3b_0jyqhjh6devstack@QuobyteHD" returned: 0 in 0.537s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:55:33 devstack cinder-volume[87116]: DEBUG cinder.image.image_utils [None req-cf4c4e76-b2a8-499e-a061-eca45352f674 tempest-VolumesGetTest-482783544 None] Temporary image 423469e2-d15b-4cf9-87cd-88e68e947d3b is fetched for user 0e7aa2fc2ce242719cef88bdfb0422e9. {{(pid=87116) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Nov 06 11:55:33 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3fcf3e4-ebfa-40f4-b399-7ece8387efc3]: (4, 'qcow2') {{(pid=88420) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 11:55:33 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-cf4c4e76-b2a8-499e-a061-eca45352f674 tempest-VolumesGetTest-482783544 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_423469e2-d15b-4cf9-87cd-88e68e947d3b_0jyqhjh6devstack@QuobyteHD {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:55:33 devstack sudo[102181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_423469e2-d15b-4cf9-87cd-88e68e947d3b_0jyqhjh6devstack@QuobyteHD Nov 06 11:55:33 devstack sudo[102181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:55:33 devstack sudo[102142]: pam_unix(sudo:session): session closed for user root Nov 06 11:55:33 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-877db301-4c3e-4b2f-b769-4736b6a9d339 tempest-VolumesExtendTest-367270268 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-99c7fd34-9aca-4da4-9c63-151f8d6af1a2.800593e5-2ef8-477b-8d6e-662948bec85b" returned: 0 in 0.536s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:55:33 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-877db301-4c3e-4b2f-b769-4736b6a9d339 tempest-VolumesExtendTest-367270268 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-99c7fd34-9aca-4da4-9c63-151f8d6af1a2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87116) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 11:55:33 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0791fa5-0f41-4113-a072-a1d4f397a6e1]: (4, 'qcow2') {{(pid=88420) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 11:55:33 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-877db301-4c3e-4b2f-b769-4736b6a9d339 tempest-VolumesExtendTest-367270268 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-99c7fd34-9aca-4da4-9c63-151f8d6af1a2 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:55:33 devstack sudo[102186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-99c7fd34-9aca-4da4-9c63-151f8d6af1a2 Nov 06 11:55:33 devstack sudo[102186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:55:33 devstack sudo[102181]: pam_unix(sudo:session): session closed for user root Nov 06 11:55:33 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-cf4c4e76-b2a8-499e-a061-eca45352f674 tempest-VolumesGetTest-482783544 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_423469e2-d15b-4cf9-87cd-88e68e947d3b_0jyqhjh6devstack@QuobyteHD" returned: 0 in 0.519s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:55:33 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-cf4c4e76-b2a8-499e-a061-eca45352f674 tempest-VolumesGetTest-482783544 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 11:55:33 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-cf4c4e76-b2a8-499e-a061-eca45352f674 tempest-VolumesGetTest-482783544 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.004s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 11:55:33 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-cf4c4e76-b2a8-499e-a061-eca45352f674 tempest-VolumesGetTest-482783544 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T10:55:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1070880431',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8d959705-0a48-42d9-af64-7839a47895df,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='d7de355fe6574fb3803d0652cc58996c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T10:55:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T10:55:32Z,use_quota=True,user_id='0e7aa2fc2ce242719cef88bdfb0422e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(34d3b144-d9b7-480a-a2e3-01e45f3d54c1),volume_type_id=34d3b144-d9b7-480a-a2e3-01e45f3d54c1)}" {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 11:55:33 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-cf4c4e76-b2a8-499e-a061-eca45352f674 tempest-VolumesGetTest-482783544 None] Creating volume 8d959705-0a48-42d9-af64-7839a47895df {{(pid=87116) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 11:55:33 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-cf4c4e76-b2a8-499e-a061-eca45352f674 tempest-VolumesGetTest-482783544 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 11:55:33 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-cf4c4e76-b2a8-499e-a061-eca45352f674 tempest-VolumesGetTest-482783544 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 11:55:33 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-cf4c4e76-b2a8-499e-a061-eca45352f674 tempest-VolumesGetTest-482783544 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 11:55:33 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-cf4c4e76-b2a8-499e-a061-eca45352f674 tempest-VolumesGetTest-482783544 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 11:55:33 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-cf4c4e76-b2a8-499e-a061-eca45352f674 tempest-VolumesGetTest-482783544 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 11:55:33 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-cf4c4e76-b2a8-499e-a061-eca45352f674 tempest-VolumesGetTest-482783544 None] Selected osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f as target Quobyte volume. {{(pid=87116) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 11:55:33 devstack cinder-volume[87116]: INFO cinder.volume.drivers.remotefs [None req-cf4c4e76-b2a8-499e-a061-eca45352f674 tempest-VolumesGetTest-482783544 None] casted to osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f Nov 06 11:55:33 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-cf4c4e76-b2a8-499e-a061-eca45352f674 tempest-VolumesGetTest-482783544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-8d959705-0a48-42d9-af64-7839a47895df 1073741824 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:55:33 devstack sudo[102193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-8d959705-0a48-42d9-af64-7839a47895df 1073741824 Nov 06 11:55:33 devstack sudo[102193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:55:33 devstack sudo[102186]: pam_unix(sudo:session): session closed for user root Nov 06 11:55:33 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-877db301-4c3e-4b2f-b769-4736b6a9d339 tempest-VolumesExtendTest-367270268 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-99c7fd34-9aca-4da4-9c63-151f8d6af1a2" returned: 0 in 0.499s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:55:33 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-877db301-4c3e-4b2f-b769-4736b6a9d339 tempest-VolumesExtendTest-367270268 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-99c7fd34-9aca-4da4-9c63-151f8d6af1a2.800593e5-2ef8-477b-8d6e-662948bec85b {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:55:33 devstack sudo[102198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-99c7fd34-9aca-4da4-9c63-151f8d6af1a2.800593e5-2ef8-477b-8d6e-662948bec85b Nov 06 11:55:33 devstack sudo[102198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:55:34 devstack sudo[102193]: pam_unix(sudo:session): session closed for user root Nov 06 11:55:34 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-cf4c4e76-b2a8-499e-a061-eca45352f674 tempest-VolumesGetTest-482783544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-8d959705-0a48-42d9-af64-7839a47895df 1073741824" returned: 0 in 0.524s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:55:34 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-cf4c4e76-b2a8-499e-a061-eca45352f674 tempest-VolumesGetTest-482783544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-8d959705-0a48-42d9-af64-7839a47895df {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:55:34 devstack sudo[102207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-8d959705-0a48-42d9-af64-7839a47895df Nov 06 11:55:34 devstack sudo[102207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:55:34 devstack sudo[102198]: pam_unix(sudo:session): session closed for user root Nov 06 11:55:34 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-877db301-4c3e-4b2f-b769-4736b6a9d339 tempest-VolumesExtendTest-367270268 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-99c7fd34-9aca-4da4-9c63-151f8d6af1a2.800593e5-2ef8-477b-8d6e-662948bec85b" returned: 0 in 0.492s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:55:34 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-877db301-4c3e-4b2f-b769-4736b6a9d339 tempest-VolumesExtendTest-367270268 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-99c7fd34-9aca-4da4-9c63-151f8d6af1a2.800593e5-2ef8-477b-8d6e-662948bec85b {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:55:34 devstack sudo[102210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-99c7fd34-9aca-4da4-9c63-151f8d6af1a2.800593e5-2ef8-477b-8d6e-662948bec85b Nov 06 11:55:34 devstack sudo[102210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:55:34 devstack sudo[102207]: pam_unix(sudo:session): session closed for user root Nov 06 11:55:34 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-cf4c4e76-b2a8-499e-a061-eca45352f674 tempest-VolumesGetTest-482783544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-8d959705-0a48-42d9-af64-7839a47895df" returned: 0 in 0.260s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:55:34 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-cf4c4e76-b2a8-499e-a061-eca45352f674 tempest-VolumesGetTest-482783544 None] <== create_volume: return (847ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f'} {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 11:55:34 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-cf4c4e76-b2a8-499e-a061-eca45352f674 tempest-VolumesGetTest-482783544 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.851s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 11:55:34 devstack cinder-volume[87116]: DEBUG cinder.volume.volume_utils [None req-cf4c4e76-b2a8-499e-a061-eca45352f674 tempest-VolumesGetTest-482783544 None] Attempting download of 423469e2-d15b-4cf9-87cd-88e68e947d3b ((None, [{'url': 'file:///opt/stack/data/glance/images/423469e2-d15b-4cf9-87cd-88e68e947d3b', 'metadata': {}}])) to volume 8d959705-0a48-42d9-af64-7839a47895df. {{(pid=87116) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Nov 06 11:55:34 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f9937f5-fdf7-4034-a487-af158ec9de7d]: (4, 'raw') {{(pid=88420) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 11:55:34 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-cf4c4e76-b2a8-499e-a061-eca45352f674 tempest-VolumesGetTest-482783544 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_423469e2-d15b-4cf9-87cd-88e68e947d3b_fzq7z1zq {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:55:34 devstack sudo[102210]: pam_unix(sudo:session): session closed for user root Nov 06 11:55:34 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-877db301-4c3e-4b2f-b769-4736b6a9d339 tempest-VolumesExtendTest-367270268 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-99c7fd34-9aca-4da4-9c63-151f8d6af1a2.800593e5-2ef8-477b-8d6e-662948bec85b" returned: 0 in 0.333s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:55:34 devstack sudo[102214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_423469e2-d15b-4cf9-87cd-88e68e947d3b_fzq7z1zq Nov 06 11:55:34 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-877db301-4c3e-4b2f-b769-4736b6a9d339 tempest-VolumesExtendTest-367270268 None] Lock "cinder-quobyte-800593e5-2ef8-477b-8d6e-662948bec85b" released by "_delete_snapshot" :: held 2.050s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 11:55:34 devstack sudo[102214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:55:34 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-877db301-4c3e-4b2f-b769-4736b6a9d339 tempest-VolumesExtendTest-367270268 None] Lock "cinder-quobyte-99c7fd34-9aca-4da4-9c63-151f8d6af1a2" released by "delete_snapshot" :: held 2.096s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 11:55:34 devstack cinder-volume[87116]: DEBUG cinder.quota [None req-877db301-4c3e-4b2f-b769-4736b6a9d339 tempest-VolumesExtendTest-367270268 None] Created reservations ['d3c31727-990b-45e1-a518-2cdbed7133a9', '96db27f1-4eaa-444f-b5e1-9e2d226b5182', '794dc8ec-c237-44d2-a9d5-e3e8dd256e09', '5bce3977-05df-4b83-bc93-ab589d433029'] {{(pid=87116) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 11:55:35 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-877db301-4c3e-4b2f-b769-4736b6a9d339 tempest-VolumesExtendTest-367270268 None] Delete snapshot completed successfully. Nov 06 11:55:35 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-877db301-4c3e-4b2f-b769-4736b6a9d339 tempest-VolumesExtendTest-367270268 None] Lock "cinder-800593e5-2ef8-477b-8d6e-662948bec85b-delete_snapshot" released by "delete_snapshot" :: held 2.325s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 11:55:35 devstack sudo[102214]: pam_unix(sudo:session): session closed for user root Nov 06 11:55:35 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-cf4c4e76-b2a8-499e-a061-eca45352f674 tempest-VolumesGetTest-482783544 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_423469e2-d15b-4cf9-87cd-88e68e947d3b_fzq7z1zq" returned: 0 in 0.508s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:55:35 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-cf4c4e76-b2a8-499e-a061-eca45352f674 tempest-VolumesGetTest-482783544 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_423469e2-d15b-4cf9-87cd-88e68e947d3b_fzq7z1zq {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:55:35 devstack sudo[102219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_423469e2-d15b-4cf9-87cd-88e68e947d3b_fzq7z1zq Nov 06 11:55:35 devstack sudo[102219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:55:35 devstack sudo[102219]: pam_unix(sudo:session): session closed for user root Nov 06 11:55:35 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-cf4c4e76-b2a8-499e-a061-eca45352f674 tempest-VolumesGetTest-482783544 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_423469e2-d15b-4cf9-87cd-88e68e947d3b_fzq7z1zq" returned: 1 in 0.336s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:55:35 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-cf4c4e76-b2a8-499e-a061-eca45352f674 tempest-VolumesGetTest-482783544 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_423469e2-d15b-4cf9-87cd-88e68e947d3b_fzq7z1zq' failed. Not Retrying. {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 06 11:55:35 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[c82f48c8-f434-4b01-8f1b-5b8704ed3f37]: (4, 'qcow2') {{(pid=88420) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 11:55:35 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-cf4c4e76-b2a8-499e-a061-eca45352f674 tempest-VolumesGetTest-482783544 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_423469e2-d15b-4cf9-87cd-88e68e947d3b_0jyqhjh6devstack@QuobyteHD {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:55:35 devstack sudo[102223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_423469e2-d15b-4cf9-87cd-88e68e947d3b_0jyqhjh6devstack@QuobyteHD Nov 06 11:55:35 devstack sudo[102223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:55:35 devstack sudo[102223]: pam_unix(sudo:session): session closed for user root Nov 06 11:55:35 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-cf4c4e76-b2a8-499e-a061-eca45352f674 tempest-VolumesGetTest-482783544 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_423469e2-d15b-4cf9-87cd-88e68e947d3b_0jyqhjh6devstack@QuobyteHD" returned: 0 in 0.340s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:55:35 devstack cinder-volume[87116]: DEBUG cinder.image.image_utils [None req-cf4c4e76-b2a8-499e-a061-eca45352f674 tempest-VolumesGetTest-482783544 None] 423469e2-d15b-4cf9-87cd-88e68e947d3b was qcow2, converting to qcow2 {{(pid=87116) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Nov 06 11:55:35 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-cf4c4e76-b2a8-499e-a061-eca45352f674 tempest-VolumesGetTest-482783544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_423469e2-d15b-4cf9-87cd-88e68e947d3b_0jyqhjh6devstack@QuobyteHD /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-8d959705-0a48-42d9-af64-7839a47895df {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:55:35 devstack sudo[102228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_423469e2-d15b-4cf9-87cd-88e68e947d3b_0jyqhjh6devstack@QuobyteHD /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-8d959705-0a48-42d9-af64-7839a47895df Nov 06 11:55:35 devstack sudo[102228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:55:36 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-0edc7784-0c8b-4da7-85e6-040ddfb3371e tempest-VolumesExtendTest-367270268 None] Acquiring lock "cinder-99c7fd34-9aca-4da4-9c63-151f8d6af1a2-delete_volume" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 11:55:36 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-0edc7784-0c8b-4da7-85e6-040ddfb3371e tempest-VolumesExtendTest-367270268 None] Lock "cinder-99c7fd34-9aca-4da4-9c63-151f8d6af1a2-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 11:55:36 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-0edc7784-0c8b-4da7-85e6-040ddfb3371e tempest-VolumesExtendTest-367270268 None] Acquiring lock "cinder-quobyte-99c7fd34-9aca-4da4-9c63-151f8d6af1a2" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 11:55:36 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-0edc7784-0c8b-4da7-85e6-040ddfb3371e tempest-VolumesExtendTest-367270268 None] Lock "cinder-quobyte-99c7fd34-9aca-4da4-9c63-151f8d6af1a2" acquired by "delete_volume" :: waited 0.018s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 11:55:36 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab03b276-a5c0-46c0-a0b0-de6d9f069a2d]: (4, 'qcow2') {{(pid=88420) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 11:55:36 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-0edc7784-0c8b-4da7-85e6-040ddfb3371e tempest-VolumesExtendTest-367270268 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-99c7fd34-9aca-4da4-9c63-151f8d6af1a2 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:55:36 devstack sudo[102234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-99c7fd34-9aca-4da4-9c63-151f8d6af1a2 Nov 06 11:55:36 devstack sudo[102234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:55:36 devstack sudo[102234]: pam_unix(sudo:session): session closed for user root Nov 06 11:55:36 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-0edc7784-0c8b-4da7-85e6-040ddfb3371e tempest-VolumesExtendTest-367270268 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-99c7fd34-9aca-4da4-9c63-151f8d6af1a2" returned: 0 in 0.420s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:55:36 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-0edc7784-0c8b-4da7-85e6-040ddfb3371e tempest-VolumesExtendTest-367270268 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-99c7fd34-9aca-4da4-9c63-151f8d6af1a2 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:55:36 devstack sudo[102244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-99c7fd34-9aca-4da4-9c63-151f8d6af1a2 Nov 06 11:55:36 devstack sudo[102244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:55:36 devstack sudo[102244]: pam_unix(sudo:session): session closed for user root Nov 06 11:55:36 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-0edc7784-0c8b-4da7-85e6-040ddfb3371e tempest-VolumesExtendTest-367270268 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-99c7fd34-9aca-4da4-9c63-151f8d6af1a2" returned: 0 in 0.259s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:55:36 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-0edc7784-0c8b-4da7-85e6-040ddfb3371e tempest-VolumesExtendTest-367270268 None] Lock "cinder-quobyte-99c7fd34-9aca-4da4-9c63-151f8d6af1a2" released by "delete_volume" :: held 0.755s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 11:55:36 devstack cinder-volume[87116]: DEBUG cinder.quota [None req-0edc7784-0c8b-4da7-85e6-040ddfb3371e tempest-VolumesExtendTest-367270268 None] Created reservations ['ddc2e6b3-b0b6-4d2b-bc65-2fe15c3a6023', '21239997-1755-4603-9fd7-a3d3b5d393b3', 'b6336799-59bb-4235-87b7-fcfad2980d9e', '3048a0f2-7a1b-413b-a1c9-1c7ebe3ddd9d'] {{(pid=87116) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 11:55:37 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-0edc7784-0c8b-4da7-85e6-040ddfb3371e tempest-VolumesExtendTest-367270268 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 11:55:37 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-0edc7784-0c8b-4da7-85e6-040ddfb3371e tempest-VolumesExtendTest-367270268 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 11:55:37 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-0edc7784-0c8b-4da7-85e6-040ddfb3371e tempest-VolumesExtendTest-367270268 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 11:55:37 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-0edc7784-0c8b-4da7-85e6-040ddfb3371e tempest-VolumesExtendTest-367270268 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 11:55:37 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-0edc7784-0c8b-4da7-85e6-040ddfb3371e tempest-VolumesExtendTest-367270268 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 11:55:37 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-0edc7784-0c8b-4da7-85e6-040ddfb3371e tempest-VolumesExtendTest-367270268 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:55:37 devstack sudo[102247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756 Nov 06 11:55:37 devstack sudo[102247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:55:37 devstack sudo[102247]: pam_unix(sudo:session): session closed for user root Nov 06 11:55:37 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-0edc7784-0c8b-4da7-85e6-040ddfb3371e tempest-VolumesExtendTest-367270268 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756" returned: 0 in 0.259s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:55:37 devstack cinder-volume[87116]: DEBUG cinder.manager [None req-0edc7784-0c8b-4da7-85e6-040ddfb3371e tempest-VolumesExtendTest-367270268 None] Notifying Schedulers of capabilities ... {{(pid=87116) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 11:55:37 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-0edc7784-0c8b-4da7-85e6-040ddfb3371e tempest-VolumesExtendTest-367270268 None] Deleted volume successfully. Nov 06 11:55:37 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-0edc7784-0c8b-4da7-85e6-040ddfb3371e tempest-VolumesExtendTest-367270268 None] Lock "cinder-99c7fd34-9aca-4da4-9c63-151f8d6af1a2-delete_volume" released by "delete_volume" :: held 1.268s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 11:55:37 devstack sudo[102228]: pam_unix(sudo:session): session closed for user root Nov 06 11:55:37 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-cf4c4e76-b2a8-499e-a061-eca45352f674 tempest-VolumesGetTest-482783544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_423469e2-d15b-4cf9-87cd-88e68e947d3b_0jyqhjh6devstack@QuobyteHD /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-8d959705-0a48-42d9-af64-7839a47895df" returned: 0 in 2.123s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:55:37 devstack cinder-volume[87116]: DEBUG cinder.image.image_utils [None req-cf4c4e76-b2a8-499e-a061-eca45352f674 tempest-VolumesGetTest-482783544 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_423469e2-d15b-4cf9-87cd-88e68e947d3b_0jyqhjh6devstack@QuobyteHD, size 112.00 MB, duration 2.12 sec, destination /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-8d959705-0a48-42d9-af64-7839a47895df {{(pid=87116) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 06 11:55:37 devstack cinder-volume[87116]: INFO cinder.image.image_utils [None req-cf4c4e76-b2a8-499e-a061-eca45352f674 tempest-VolumesGetTest-482783544 None] Converted 112.00 MB image at 52.72 MB/s Nov 06 11:55:38 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-cf4c4e76-b2a8-499e-a061-eca45352f674 tempest-VolumesGetTest-482783544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-8d959705-0a48-42d9-af64-7839a47895df 1G {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:55:38 devstack sudo[102256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-8d959705-0a48-42d9-af64-7839a47895df 1G Nov 06 11:55:38 devstack sudo[102256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:55:38 devstack sudo[102256]: pam_unix(sudo:session): session closed for user root Nov 06 11:55:38 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-cf4c4e76-b2a8-499e-a061-eca45352f674 tempest-VolumesGetTest-482783544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-8d959705-0a48-42d9-af64-7839a47895df 1G" returned: 0 in 0.392s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:55:38 devstack cinder-volume[87116]: DEBUG cinder.volume.volume_utils [None req-cf4c4e76-b2a8-499e-a061-eca45352f674 tempest-VolumesGetTest-482783544 None] Downloaded image 423469e2-d15b-4cf9-87cd-88e68e947d3b ((None, [{'url': 'file:///opt/stack/data/glance/images/423469e2-d15b-4cf9-87cd-88e68e947d3b', 'metadata': {}}])) to volume 8d959705-0a48-42d9-af64-7839a47895df successfully. {{(pid=87116) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Nov 06 11:55:38 devstack cinder-volume[87116]: DEBUG cinder.image.image_utils [None req-cf4c4e76-b2a8-499e-a061-eca45352f674 tempest-VolumesGetTest-482783544 None] Temporary image 423469e2-d15b-4cf9-87cd-88e68e947d3b for user 0e7aa2fc2ce242719cef88bdfb0422e9 is deleted. {{(pid=87116) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Nov 06 11:55:38 devstack cinder-volume[87116]: DEBUG cinder.volume.volume_utils [None req-cf4c4e76-b2a8-499e-a061-eca45352f674 tempest-VolumesGetTest-482783544 None] Marking volume 8d959705-0a48-42d9-af64-7839a47895df as bootable. {{(pid=87116) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Nov 06 11:55:38 devstack cinder-volume[87116]: DEBUG cinder.volume.flows.manager.create_volume [None req-cf4c4e76-b2a8-499e-a061-eca45352f674 tempest-VolumesGetTest-482783544 None] Copying metadata from image 423469e2-d15b-4cf9-87cd-88e68e947d3b to 8d959705-0a48-42d9-af64-7839a47895df. {{(pid=87116) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Nov 06 11:55:38 devstack cinder-volume[87116]: DEBUG cinder.volume.flows.manager.create_volume [None req-cf4c4e76-b2a8-499e-a061-eca45352f674 tempest-VolumesGetTest-482783544 None] Creating volume glance metadata for volume 8d959705-0a48-42d9-af64-7839a47895df backed by image 423469e2-d15b-4cf9-87cd-88e68e947d3b with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '423469e2-d15b-4cf9-87cd-88e68e947d3b', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87116) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Nov 06 11:55:38 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-cf4c4e76-b2a8-499e-a061-eca45352f674 tempest-VolumesGetTest-482783544 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c5e815a7-7c54-459b-b078-fc62996b7e39) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8d959705-0a48-42d9-af64-7839a47895df', 'volume_size': 1, 'image_id': '423469e2-d15b-4cf9-87cd-88e68e947d3b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/423469e2-d15b-4cf9-87cd-88e68e947d3b', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b05f927c30c5407aad52949459346010', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '423469e2-d15b-4cf9-87cd-88e68e947d3b', 'created_at': datetime.datetime(2026, 11, 6, 10, 36, 49, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 6, 10, 36, 50, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/423469e2-d15b-4cf9-87cd-88e68e947d3b/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:55:38 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-cf4c4e76-b2a8-499e-a061-eca45352f674 tempest-VolumesGetTest-482783544 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (51056e22-5c1b-494b-9a24-c79b901f52a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:55:38 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-cf4c4e76-b2a8-499e-a061-eca45352f674 tempest-VolumesGetTest-482783544 None] Volume volume-8d959705-0a48-42d9-af64-7839a47895df (8d959705-0a48-42d9-af64-7839a47895df): created successfully Nov 06 11:55:38 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-cf4c4e76-b2a8-499e-a061-eca45352f674 tempest-VolumesGetTest-482783544 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (51056e22-5c1b-494b-9a24-c79b901f52a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:55:38 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-cf4c4e76-b2a8-499e-a061-eca45352f674 tempest-VolumesGetTest-482783544 None] Flow 'volume_create_manager' (412c3eb3-3281-4d9f-8855-1c3d2e4923df) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 11:55:38 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-cf4c4e76-b2a8-499e-a061-eca45352f674 tempest-VolumesGetTest-482783544 None] Created volume successfully. Nov 06 11:55:39 devstack cinder-volume[87116]: DEBUG oslo_service.periodic_task [None req-4fab4816-ec2b-4b19-b2ff-8548f2084354 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87116) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 11:55:39 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-4fab4816-ec2b-4b19-b2ff-8548f2084354 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 11:55:39 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-4fab4816-ec2b-4b19-b2ff-8548f2084354 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 11:55:39 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-4fab4816-ec2b-4b19-b2ff-8548f2084354 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 11:55:39 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-4fab4816-ec2b-4b19-b2ff-8548f2084354 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 11:55:39 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-4fab4816-ec2b-4b19-b2ff-8548f2084354 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 11:55:39 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-4fab4816-ec2b-4b19-b2ff-8548f2084354 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:55:39 devstack sudo[102261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756 Nov 06 11:55:39 devstack sudo[102261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:55:39 devstack cinder-volume[87116]: DEBUG cinder.volume.flows.manager.create_volume [None req-ceb15cfc-2ab2-4241-b2e2-64fac4928c38 tempest-VolumesGetTest-482783544 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87116) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 11:55:40 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-ceb15cfc-2ab2-4241-b2e2-64fac4928c38 tempest-VolumesGetTest-482783544 None] Flow 'volume_create_manager' (a7bcb1f1-ba76-40d9-9b45-e35b45c8b8a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 11:55:40 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-ceb15cfc-2ab2-4241-b2e2-64fac4928c38 tempest-VolumesGetTest-482783544 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6ad3f741-2c73-48b7-93c4-abbb574d769e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:55:40 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-ceb15cfc-2ab2-4241-b2e2-64fac4928c38 tempest-VolumesGetTest-482783544 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6ad3f741-2c73-48b7-93c4-abbb574d769e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T10:55:40Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1674002209',display_name='tempest-VolumesGetTest-Volume-1347595456',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b2456356-b0fa-4916-8662-ca7570acc7ea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d7de355fe6574fb3803d0652cc58996c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T10:55:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T10:55:40Z,use_quota=True,user_id='0e7aa2fc2ce242719cef88bdfb0422e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(34d3b144-d9b7-480a-a2e3-01e45f3d54c1),volume_type_id=34d3b144-d9b7-480a-a2e3-01e45f3d54c1)' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:55:40 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-ceb15cfc-2ab2-4241-b2e2-64fac4928c38 tempest-VolumesGetTest-482783544 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b50378bd-7e29-4591-820a-9f7a34a0f2f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:55:40 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-ceb15cfc-2ab2-4241-b2e2-64fac4928c38 tempest-VolumesGetTest-482783544 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b50378bd-7e29-4591-820a-9f7a34a0f2f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:55:40 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-ceb15cfc-2ab2-4241-b2e2-64fac4928c38 tempest-VolumesGetTest-482783544 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dafe2fde-039e-408d-9aa0-b2a2dfc4d8b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:55:40 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-ceb15cfc-2ab2-4241-b2e2-64fac4928c38 tempest-VolumesGetTest-482783544 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dafe2fde-039e-408d-9aa0-b2a2dfc4d8b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b2456356-b0fa-4916-8662-ca7570acc7ea', 'volume_name': 'volume-b2456356-b0fa-4916-8662-ca7570acc7ea', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:55:40 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-ceb15cfc-2ab2-4241-b2e2-64fac4928c38 tempest-VolumesGetTest-482783544 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1fc7e50b-0efe-4028-835f-5d0e39874ff5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:55:40 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-ceb15cfc-2ab2-4241-b2e2-64fac4928c38 tempest-VolumesGetTest-482783544 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1fc7e50b-0efe-4028-835f-5d0e39874ff5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:55:40 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-ceb15cfc-2ab2-4241-b2e2-64fac4928c38 tempest-VolumesGetTest-482783544 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c3a99a06-906d-481a-a361-a3609918be06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:55:40 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-ceb15cfc-2ab2-4241-b2e2-64fac4928c38 tempest-VolumesGetTest-482783544 None] Volume b2456356-b0fa-4916-8662-ca7570acc7ea: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b2456356-b0fa-4916-8662-ca7570acc7ea', 'volume_size': 1} Nov 06 11:55:40 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-ceb15cfc-2ab2-4241-b2e2-64fac4928c38 tempest-VolumesGetTest-482783544 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 11:55:40 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-ceb15cfc-2ab2-4241-b2e2-64fac4928c38 tempest-VolumesGetTest-482783544 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 11:55:40 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-ceb15cfc-2ab2-4241-b2e2-64fac4928c38 tempest-VolumesGetTest-482783544 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T10:55:40Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1674002209',display_name='tempest-VolumesGetTest-Volume-1347595456',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b2456356-b0fa-4916-8662-ca7570acc7ea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d7de355fe6574fb3803d0652cc58996c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T10:55:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T10:55:40Z,use_quota=True,user_id='0e7aa2fc2ce242719cef88bdfb0422e9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(34d3b144-d9b7-480a-a2e3-01e45f3d54c1),volume_type_id=34d3b144-d9b7-480a-a2e3-01e45f3d54c1)}" {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 11:55:40 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-ceb15cfc-2ab2-4241-b2e2-64fac4928c38 tempest-VolumesGetTest-482783544 None] Creating volume b2456356-b0fa-4916-8662-ca7570acc7ea {{(pid=87116) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 11:55:40 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-ceb15cfc-2ab2-4241-b2e2-64fac4928c38 tempest-VolumesGetTest-482783544 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 11:55:40 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-ceb15cfc-2ab2-4241-b2e2-64fac4928c38 tempest-VolumesGetTest-482783544 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 11:55:40 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-ceb15cfc-2ab2-4241-b2e2-64fac4928c38 tempest-VolumesGetTest-482783544 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 11:55:40 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-ceb15cfc-2ab2-4241-b2e2-64fac4928c38 tempest-VolumesGetTest-482783544 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 11:55:40 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-ceb15cfc-2ab2-4241-b2e2-64fac4928c38 tempest-VolumesGetTest-482783544 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 11:55:40 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-ceb15cfc-2ab2-4241-b2e2-64fac4928c38 tempest-VolumesGetTest-482783544 None] Selected osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f as target Quobyte volume. {{(pid=87116) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 11:55:40 devstack cinder-volume[87116]: INFO cinder.volume.drivers.remotefs [None req-ceb15cfc-2ab2-4241-b2e2-64fac4928c38 tempest-VolumesGetTest-482783544 None] casted to osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f Nov 06 11:55:40 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-ceb15cfc-2ab2-4241-b2e2-64fac4928c38 tempest-VolumesGetTest-482783544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-b2456356-b0fa-4916-8662-ca7570acc7ea 1073741824 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:55:40 devstack sudo[102263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-b2456356-b0fa-4916-8662-ca7570acc7ea 1073741824 Nov 06 11:55:40 devstack sudo[102263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:55:40 devstack sudo[102261]: pam_unix(sudo:session): session closed for user root Nov 06 11:55:40 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-4fab4816-ec2b-4b19-b2ff-8548f2084354 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756" returned: 0 in 0.345s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:55:40 devstack cinder-volume[87116]: DEBUG cinder.manager [None req-4fab4816-ec2b-4b19-b2ff-8548f2084354 None None] Notifying Schedulers of capabilities ... {{(pid=87116) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 11:55:40 devstack cinder-volume[87116]: DEBUG oslo_service.periodic_task [None req-4fab4816-ec2b-4b19-b2ff-8548f2084354 None None] Running periodic task VolumeManager._thread_info {{(pid=87116) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 11:55:40 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-4fab4816-ec2b-4b19-b2ff-8548f2084354 None None] thread count: 28 {{(pid=87116) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 06 11:55:40 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-4fab4816-ec2b-4b19-b2ff-8548f2084354 None None] thread info: [<_MainThread(MainThread, started 131399520669824)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87116) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 06 11:55:40 devstack sudo[102263]: pam_unix(sudo:session): session closed for user root Nov 06 11:55:40 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-ceb15cfc-2ab2-4241-b2e2-64fac4928c38 tempest-VolumesGetTest-482783544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-b2456356-b0fa-4916-8662-ca7570acc7ea 1073741824" returned: 0 in 0.499s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:55:40 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-ceb15cfc-2ab2-4241-b2e2-64fac4928c38 tempest-VolumesGetTest-482783544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-b2456356-b0fa-4916-8662-ca7570acc7ea {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:55:40 devstack sudo[102270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-b2456356-b0fa-4916-8662-ca7570acc7ea Nov 06 11:55:40 devstack sudo[102270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:55:40 devstack sudo[102270]: pam_unix(sudo:session): session closed for user root Nov 06 11:55:40 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-ceb15cfc-2ab2-4241-b2e2-64fac4928c38 tempest-VolumesGetTest-482783544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-b2456356-b0fa-4916-8662-ca7570acc7ea" returned: 0 in 0.264s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:55:40 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-ceb15cfc-2ab2-4241-b2e2-64fac4928c38 tempest-VolumesGetTest-482783544 None] <== create_volume: return (815ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f'} {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 11:55:40 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-ceb15cfc-2ab2-4241-b2e2-64fac4928c38 tempest-VolumesGetTest-482783544 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.818s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 11:55:40 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-ceb15cfc-2ab2-4241-b2e2-64fac4928c38 tempest-VolumesGetTest-482783544 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c3a99a06-906d-481a-a361-a3609918be06) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b2456356-b0fa-4916-8662-ca7570acc7ea', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:55:40 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-ceb15cfc-2ab2-4241-b2e2-64fac4928c38 tempest-VolumesGetTest-482783544 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e1fc56b5-3220-4418-8789-f66bb8197ceb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:55:40 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-ceb15cfc-2ab2-4241-b2e2-64fac4928c38 tempest-VolumesGetTest-482783544 None] Volume volume-b2456356-b0fa-4916-8662-ca7570acc7ea (b2456356-b0fa-4916-8662-ca7570acc7ea): created successfully Nov 06 11:55:40 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-ceb15cfc-2ab2-4241-b2e2-64fac4928c38 tempest-VolumesGetTest-482783544 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e1fc56b5-3220-4418-8789-f66bb8197ceb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:55:40 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-ceb15cfc-2ab2-4241-b2e2-64fac4928c38 tempest-VolumesGetTest-482783544 None] Flow 'volume_create_manager' (a7bcb1f1-ba76-40d9-9b45-e35b45c8b8a5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 11:55:40 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-ceb15cfc-2ab2-4241-b2e2-64fac4928c38 tempest-VolumesGetTest-482783544 None] Created volume successfully. Nov 06 11:55:42 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-e9801f16-1707-4d6f-8367-1d185d4a19ca tempest-VolumesGetTest-482783544 None] Acquiring lock "cinder-b2456356-b0fa-4916-8662-ca7570acc7ea-delete_volume" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 11:55:42 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-e9801f16-1707-4d6f-8367-1d185d4a19ca tempest-VolumesGetTest-482783544 None] Lock "cinder-b2456356-b0fa-4916-8662-ca7570acc7ea-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 11:55:42 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-e9801f16-1707-4d6f-8367-1d185d4a19ca tempest-VolumesGetTest-482783544 None] Acquiring lock "cinder-quobyte-b2456356-b0fa-4916-8662-ca7570acc7ea" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 11:55:42 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-e9801f16-1707-4d6f-8367-1d185d4a19ca tempest-VolumesGetTest-482783544 None] Lock "cinder-quobyte-b2456356-b0fa-4916-8662-ca7570acc7ea" acquired by "delete_volume" :: waited 0.026s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 11:55:42 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[6198d230-c000-45b4-bbc0-f9c125838bcb]: (4, 'qcow2') {{(pid=88420) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 11:55:42 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-e9801f16-1707-4d6f-8367-1d185d4a19ca tempest-VolumesGetTest-482783544 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-b2456356-b0fa-4916-8662-ca7570acc7ea {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:55:42 devstack sudo[102273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-b2456356-b0fa-4916-8662-ca7570acc7ea Nov 06 11:55:42 devstack sudo[102273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:55:42 devstack sudo[102273]: pam_unix(sudo:session): session closed for user root Nov 06 11:55:42 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-e9801f16-1707-4d6f-8367-1d185d4a19ca tempest-VolumesGetTest-482783544 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-b2456356-b0fa-4916-8662-ca7570acc7ea" returned: 0 in 0.472s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:55:42 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-e9801f16-1707-4d6f-8367-1d185d4a19ca tempest-VolumesGetTest-482783544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-b2456356-b0fa-4916-8662-ca7570acc7ea {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:55:42 devstack sudo[102279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-b2456356-b0fa-4916-8662-ca7570acc7ea Nov 06 11:55:42 devstack sudo[102279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:55:43 devstack sudo[102279]: pam_unix(sudo:session): session closed for user root Nov 06 11:55:43 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-e9801f16-1707-4d6f-8367-1d185d4a19ca tempest-VolumesGetTest-482783544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-b2456356-b0fa-4916-8662-ca7570acc7ea" returned: 0 in 0.289s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:55:43 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-e9801f16-1707-4d6f-8367-1d185d4a19ca tempest-VolumesGetTest-482783544 None] Lock "cinder-quobyte-b2456356-b0fa-4916-8662-ca7570acc7ea" released by "delete_volume" :: held 0.843s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 11:55:43 devstack cinder-volume[87116]: DEBUG cinder.quota [None req-e9801f16-1707-4d6f-8367-1d185d4a19ca tempest-VolumesGetTest-482783544 None] Created reservations ['636a7396-7b23-4039-8487-a225b9eab31b', 'fe60d324-e8be-48fc-9f12-c045ca2a2122', '8c4f04e8-1a71-4f7b-a775-16945c577957', '1a793ae9-5326-49cd-8d00-b673ef01c4aa'] {{(pid=87116) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 11:55:43 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-e9801f16-1707-4d6f-8367-1d185d4a19ca tempest-VolumesGetTest-482783544 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 11:55:43 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-e9801f16-1707-4d6f-8367-1d185d4a19ca tempest-VolumesGetTest-482783544 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 11:55:43 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-e9801f16-1707-4d6f-8367-1d185d4a19ca tempest-VolumesGetTest-482783544 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 11:55:43 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-e9801f16-1707-4d6f-8367-1d185d4a19ca tempest-VolumesGetTest-482783544 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 11:55:43 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-e9801f16-1707-4d6f-8367-1d185d4a19ca tempest-VolumesGetTest-482783544 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 11:55:43 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-e9801f16-1707-4d6f-8367-1d185d4a19ca tempest-VolumesGetTest-482783544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:55:43 devstack sudo[102282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756 Nov 06 11:55:43 devstack sudo[102282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:55:43 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-f8681884-1e3e-4a16-bd1c-43cd915fe14f tempest-VolumesGetTest-482783544 None] Acquiring lock "cinder-8d959705-0a48-42d9-af64-7839a47895df-delete_volume" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 11:55:43 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-f8681884-1e3e-4a16-bd1c-43cd915fe14f tempest-VolumesGetTest-482783544 None] Lock "cinder-8d959705-0a48-42d9-af64-7839a47895df-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 11:55:43 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-f8681884-1e3e-4a16-bd1c-43cd915fe14f tempest-VolumesGetTest-482783544 None] Acquiring lock "cinder-quobyte-8d959705-0a48-42d9-af64-7839a47895df" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 11:55:43 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-f8681884-1e3e-4a16-bd1c-43cd915fe14f tempest-VolumesGetTest-482783544 None] Lock "cinder-quobyte-8d959705-0a48-42d9-af64-7839a47895df" acquired by "delete_volume" :: waited 0.027s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 11:55:43 devstack sudo[102282]: pam_unix(sudo:session): session closed for user root Nov 06 11:55:43 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-e9801f16-1707-4d6f-8367-1d185d4a19ca tempest-VolumesGetTest-482783544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756" returned: 0 in 0.363s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:55:43 devstack cinder-volume[87116]: DEBUG cinder.manager [None req-e9801f16-1707-4d6f-8367-1d185d4a19ca tempest-VolumesGetTest-482783544 None] Notifying Schedulers of capabilities ... {{(pid=87116) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 11:55:43 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-e9801f16-1707-4d6f-8367-1d185d4a19ca tempest-VolumesGetTest-482783544 None] Deleted volume successfully. Nov 06 11:55:43 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6d3483d-cdc1-4c8e-b87d-b5688a373090]: (4, 'qcow2') {{(pid=88420) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 11:55:43 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-f8681884-1e3e-4a16-bd1c-43cd915fe14f tempest-VolumesGetTest-482783544 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-8d959705-0a48-42d9-af64-7839a47895df {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:55:43 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-e9801f16-1707-4d6f-8367-1d185d4a19ca tempest-VolumesGetTest-482783544 None] Lock "cinder-b2456356-b0fa-4916-8662-ca7570acc7ea-delete_volume" released by "delete_volume" :: held 1.507s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 11:55:43 devstack sudo[102286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-8d959705-0a48-42d9-af64-7839a47895df Nov 06 11:55:43 devstack sudo[102286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:55:44 devstack sudo[102286]: pam_unix(sudo:session): session closed for user root Nov 06 11:55:44 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-f8681884-1e3e-4a16-bd1c-43cd915fe14f tempest-VolumesGetTest-482783544 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-8d959705-0a48-42d9-af64-7839a47895df" returned: 0 in 0.457s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:55:44 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-f8681884-1e3e-4a16-bd1c-43cd915fe14f tempest-VolumesGetTest-482783544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-8d959705-0a48-42d9-af64-7839a47895df {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:55:44 devstack sudo[102291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-8d959705-0a48-42d9-af64-7839a47895df Nov 06 11:55:44 devstack sudo[102291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:55:44 devstack sudo[102291]: pam_unix(sudo:session): session closed for user root Nov 06 11:55:44 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-f8681884-1e3e-4a16-bd1c-43cd915fe14f tempest-VolumesGetTest-482783544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-8d959705-0a48-42d9-af64-7839a47895df" returned: 0 in 0.260s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:55:44 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-f8681884-1e3e-4a16-bd1c-43cd915fe14f tempest-VolumesGetTest-482783544 None] Lock "cinder-quobyte-8d959705-0a48-42d9-af64-7839a47895df" released by "delete_volume" :: held 0.789s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 11:55:44 devstack cinder-volume[87116]: DEBUG cinder.quota [None req-f8681884-1e3e-4a16-bd1c-43cd915fe14f tempest-VolumesGetTest-482783544 None] Created reservations ['6b143182-a87b-47b8-ab7e-700addaaba06', '9a96ba43-6c9c-4493-ab8e-ac3daee84907', 'd4cc150a-c0d1-4e04-9f2e-3e0c607aaefd', '4219fc62-e558-4e73-b23e-0c0becd2c332'] {{(pid=87116) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 11:55:44 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-f8681884-1e3e-4a16-bd1c-43cd915fe14f tempest-VolumesGetTest-482783544 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 11:55:44 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-f8681884-1e3e-4a16-bd1c-43cd915fe14f tempest-VolumesGetTest-482783544 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 11:55:44 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-f8681884-1e3e-4a16-bd1c-43cd915fe14f tempest-VolumesGetTest-482783544 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 11:55:44 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-f8681884-1e3e-4a16-bd1c-43cd915fe14f tempest-VolumesGetTest-482783544 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 11:55:44 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-f8681884-1e3e-4a16-bd1c-43cd915fe14f tempest-VolumesGetTest-482783544 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 11:55:44 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-f8681884-1e3e-4a16-bd1c-43cd915fe14f tempest-VolumesGetTest-482783544 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:55:44 devstack sudo[102295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756 Nov 06 11:55:44 devstack sudo[102295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:55:44 devstack cinder-volume[87116]: DEBUG cinder.volume.flows.manager.create_volume [None req-2e127124-a298-44a1-8a02-fcfe195def58 tempest-VolumeAndVolumeTypeFromImageTest-791078357 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87116) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 11:55:44 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-2e127124-a298-44a1-8a02-fcfe195def58 tempest-VolumeAndVolumeTypeFromImageTest-791078357 None] Flow 'volume_create_manager' (e4f31331-0ab2-4dcf-860d-7bb040836e99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 11:55:44 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-2e127124-a298-44a1-8a02-fcfe195def58 tempest-VolumeAndVolumeTypeFromImageTest-791078357 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (31deb6b5-3a01-4d11-94b1-6893c18b5e98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:55:44 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-2e127124-a298-44a1-8a02-fcfe195def58 tempest-VolumeAndVolumeTypeFromImageTest-791078357 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (31deb6b5-3a01-4d11-94b1-6893c18b5e98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T10:55:44Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=48919537-c742-4ffc-a67d-34ae3dbab488,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='03bd8cf82b504b7aa5a7c16421034cac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T10:55:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T10:55:45Z,use_quota=True,user_id='4f839f3dba8f43a3b6412709443b50c9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d4ecefb5-8a4b-4724-b760-ecb5fb7689d3),volume_type_id=d4ecefb5-8a4b-4724-b760-ecb5fb7689d3)' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:55:44 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-2e127124-a298-44a1-8a02-fcfe195def58 tempest-VolumeAndVolumeTypeFromImageTest-791078357 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (36aa46ef-1094-48ad-b79e-dd20129205b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:55:44 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-2e127124-a298-44a1-8a02-fcfe195def58 tempest-VolumeAndVolumeTypeFromImageTest-791078357 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (36aa46ef-1094-48ad-b79e-dd20129205b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:55:44 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-2e127124-a298-44a1-8a02-fcfe195def58 tempest-VolumeAndVolumeTypeFromImageTest-791078357 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (54396b65-3024-4de8-8d89-dee13e3da20d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:55:44 devstack cinder-volume[87116]: DEBUG cinder.image.glance [None req-2e127124-a298-44a1-8a02-fcfe195def58 tempest-VolumeAndVolumeTypeFromImageTest-791078357 None] Creating Keystone auth plugin from conf {{(pid=87116) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 06 11:55:44 devstack sudo[102295]: pam_unix(sudo:session): session closed for user root Nov 06 11:55:44 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-f8681884-1e3e-4a16-bd1c-43cd915fe14f tempest-VolumesGetTest-482783544 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756" returned: 0 in 0.295s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:55:44 devstack cinder-volume[87116]: DEBUG cinder.manager [None req-f8681884-1e3e-4a16-bd1c-43cd915fe14f tempest-VolumesGetTest-482783544 None] Notifying Schedulers of capabilities ... {{(pid=87116) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 11:55:44 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-f8681884-1e3e-4a16-bd1c-43cd915fe14f tempest-VolumesGetTest-482783544 None] Deleted volume successfully. Nov 06 11:55:44 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-f8681884-1e3e-4a16-bd1c-43cd915fe14f tempest-VolumesGetTest-482783544 None] Lock "cinder-8d959705-0a48-42d9-af64-7839a47895df-delete_volume" released by "delete_volume" :: held 1.366s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 11:55:44 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-2e127124-a298-44a1-8a02-fcfe195def58 tempest-VolumeAndVolumeTypeFromImageTest-791078357 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (54396b65-3024-4de8-8d89-dee13e3da20d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '48919537-c742-4ffc-a67d-34ae3dbab488', 'volume_name': 'volume-48919537-c742-4ffc-a67d-34ae3dbab488', 'volume_size': 1, 'image_id': '5a117943-f003-4f5d-88e3-d64c60e08b56', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/5a117943-f003-4f5d-88e3-d64c60e08b56', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '125a6b364f1963c9e97c97dd4cf8a740', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '03bd8cf82b504b7aa5a7c16421034cac', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '76fcba2adbc5e6a4a233113ac70a771cd11dec8de46c05825e374f457c6757a006635bc6bd78740dbc523b7a805a9bb8e00f3a6fc6607123aacd46e64bf1af34', 'id': '5a117943-f003-4f5d-88e3-d64c60e08b56', 'created_at': datetime.datetime(2026, 11, 6, 10, 55, 42, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 6, 10, 55, 44, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5a117943-f003-4f5d-88e3-d64c60e08b56/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:55:44 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-2e127124-a298-44a1-8a02-fcfe195def58 tempest-VolumeAndVolumeTypeFromImageTest-791078357 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eafb91ee-c948-4a32-a6f0-d2538ae92434) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:55:44 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-2e127124-a298-44a1-8a02-fcfe195def58 tempest-VolumeAndVolumeTypeFromImageTest-791078357 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eafb91ee-c948-4a32-a6f0-d2538ae92434) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:55:45 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-2e127124-a298-44a1-8a02-fcfe195def58 tempest-VolumeAndVolumeTypeFromImageTest-791078357 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a6e52fc1-6c36-4cc8-9308-5db79b5bb685) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:55:45 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-2e127124-a298-44a1-8a02-fcfe195def58 tempest-VolumeAndVolumeTypeFromImageTest-791078357 None] Volume 48919537-c742-4ffc-a67d-34ae3dbab488: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-48919537-c742-4ffc-a67d-34ae3dbab488', 'volume_size': 1, 'image_id': '5a117943-f003-4f5d-88e3-d64c60e08b56', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/5a117943-f003-4f5d-88e3-d64c60e08b56', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '125a6b364f1963c9e97c97dd4cf8a740', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '03bd8cf82b504b7aa5a7c16421034cac', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '76fcba2adbc5e6a4a233113ac70a771cd11dec8de46c05825e374f457c6757a006635bc6bd78740dbc523b7a805a9bb8e00f3a6fc6607123aacd46e64bf1af34', 'id': '5a117943-f003-4f5d-88e3-d64c60e08b56', 'created_at': datetime.datetime(2026, 11, 6, 10, 55, 42, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 6, 10, 55, 44, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5a117943-f003-4f5d-88e3-d64c60e08b56/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Nov 06 11:55:45 devstack cinder-volume[87116]: DEBUG cinder.volume.flows.manager.create_volume [None req-2e127124-a298-44a1-8a02-fcfe195def58 tempest-VolumeAndVolumeTypeFromImageTest-791078357 None] Trying to clone 48919537-c742-4ffc-a67d-34ae3dbab488 from image 5a117943-f003-4f5d-88e3-d64c60e08b56 at location (None, [{'url': 'file:///opt/stack/data/glance/images/5a117943-f003-4f5d-88e3-d64c60e08b56', 'metadata': {}}]). {{(pid=87116) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Nov 06 11:55:45 devstack cinder-volume[87116]: DEBUG cinder.image.image_utils [None req-2e127124-a298-44a1-8a02-fcfe195def58 tempest-VolumeAndVolumeTypeFromImageTest-791078357 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_5a117943-f003-4f5d-88e3-d64c60e08b56_dsfrmjdtdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87116) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Nov 06 11:55:45 devstack cinder-volume[87116]: INFO cinder.image.image_utils [None req-2e127124-a298-44a1-8a02-fcfe195def58 tempest-VolumeAndVolumeTypeFromImageTest-791078357 None] Image download 0.00 MB at 0.00 MB/s Nov 06 11:55:45 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdfb34cc-3d15-4b98-ac6d-d599b1cfa81f]: (4, 'raw') {{(pid=88420) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 11:55:45 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-2e127124-a298-44a1-8a02-fcfe195def58 tempest-VolumeAndVolumeTypeFromImageTest-791078357 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5a117943-f003-4f5d-88e3-d64c60e08b56_dsfrmjdtdevstack@QuobyteHD {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:55:45 devstack sudo[102298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5a117943-f003-4f5d-88e3-d64c60e08b56_dsfrmjdtdevstack@QuobyteHD Nov 06 11:55:45 devstack sudo[102298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:55:45 devstack sudo[102298]: pam_unix(sudo:session): session closed for user root Nov 06 11:55:45 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-2e127124-a298-44a1-8a02-fcfe195def58 tempest-VolumeAndVolumeTypeFromImageTest-791078357 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5a117943-f003-4f5d-88e3-d64c60e08b56_dsfrmjdtdevstack@QuobyteHD" returned: 0 in 0.388s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:55:45 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-2e127124-a298-44a1-8a02-fcfe195def58 tempest-VolumeAndVolumeTypeFromImageTest-791078357 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5a117943-f003-4f5d-88e3-d64c60e08b56_dsfrmjdtdevstack@QuobyteHD {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:55:45 devstack sudo[102302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5a117943-f003-4f5d-88e3-d64c60e08b56_dsfrmjdtdevstack@QuobyteHD Nov 06 11:55:45 devstack sudo[102302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:55:45 devstack sudo[102302]: pam_unix(sudo:session): session closed for user root Nov 06 11:55:45 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-2e127124-a298-44a1-8a02-fcfe195def58 tempest-VolumeAndVolumeTypeFromImageTest-791078357 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5a117943-f003-4f5d-88e3-d64c60e08b56_dsfrmjdtdevstack@QuobyteHD" returned: 1 in 0.367s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:55:45 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-2e127124-a298-44a1-8a02-fcfe195def58 tempest-VolumeAndVolumeTypeFromImageTest-791078357 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5a117943-f003-4f5d-88e3-d64c60e08b56_dsfrmjdtdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 06 11:55:45 devstack cinder-volume[87116]: DEBUG cinder.image.image_utils [None req-2e127124-a298-44a1-8a02-fcfe195def58 tempest-VolumeAndVolumeTypeFromImageTest-791078357 None] Temporary image 5a117943-f003-4f5d-88e3-d64c60e08b56 is fetched for user 4f839f3dba8f43a3b6412709443b50c9. {{(pid=87116) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Nov 06 11:55:45 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[96149b8b-770a-47cb-ad56-71f9b6c027e8]: (4, 'raw') {{(pid=88420) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 11:55:45 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-2e127124-a298-44a1-8a02-fcfe195def58 tempest-VolumeAndVolumeTypeFromImageTest-791078357 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5a117943-f003-4f5d-88e3-d64c60e08b56_dsfrmjdtdevstack@QuobyteHD {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:55:46 devstack sudo[102307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5a117943-f003-4f5d-88e3-d64c60e08b56_dsfrmjdtdevstack@QuobyteHD Nov 06 11:55:46 devstack sudo[102307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:55:46 devstack sudo[102307]: pam_unix(sudo:session): session closed for user root Nov 06 11:55:46 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-2e127124-a298-44a1-8a02-fcfe195def58 tempest-VolumeAndVolumeTypeFromImageTest-791078357 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5a117943-f003-4f5d-88e3-d64c60e08b56_dsfrmjdtdevstack@QuobyteHD" returned: 0 in 0.371s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:55:46 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-2e127124-a298-44a1-8a02-fcfe195def58 tempest-VolumeAndVolumeTypeFromImageTest-791078357 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5a117943-f003-4f5d-88e3-d64c60e08b56_dsfrmjdtdevstack@QuobyteHD {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:55:46 devstack sudo[102311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5a117943-f003-4f5d-88e3-d64c60e08b56_dsfrmjdtdevstack@QuobyteHD Nov 06 11:55:46 devstack sudo[102311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:55:46 devstack sudo[102311]: pam_unix(sudo:session): session closed for user root Nov 06 11:55:46 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-2e127124-a298-44a1-8a02-fcfe195def58 tempest-VolumeAndVolumeTypeFromImageTest-791078357 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5a117943-f003-4f5d-88e3-d64c60e08b56_dsfrmjdtdevstack@QuobyteHD" returned: 1 in 0.365s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:55:46 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-2e127124-a298-44a1-8a02-fcfe195def58 tempest-VolumeAndVolumeTypeFromImageTest-791078357 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5a117943-f003-4f5d-88e3-d64c60e08b56_dsfrmjdtdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 06 11:55:46 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-2e127124-a298-44a1-8a02-fcfe195def58 tempest-VolumeAndVolumeTypeFromImageTest-791078357 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 11:55:46 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-2e127124-a298-44a1-8a02-fcfe195def58 tempest-VolumeAndVolumeTypeFromImageTest-791078357 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 11:55:46 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-2e127124-a298-44a1-8a02-fcfe195def58 tempest-VolumeAndVolumeTypeFromImageTest-791078357 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T10:55:44Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=48919537-c742-4ffc-a67d-34ae3dbab488,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='03bd8cf82b504b7aa5a7c16421034cac',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T10:55:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T10:55:45Z,use_quota=True,user_id='4f839f3dba8f43a3b6412709443b50c9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d4ecefb5-8a4b-4724-b760-ecb5fb7689d3),volume_type_id=d4ecefb5-8a4b-4724-b760-ecb5fb7689d3)}" {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 11:55:46 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-2e127124-a298-44a1-8a02-fcfe195def58 tempest-VolumeAndVolumeTypeFromImageTest-791078357 None] Creating volume 48919537-c742-4ffc-a67d-34ae3dbab488 {{(pid=87116) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 11:55:46 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-2e127124-a298-44a1-8a02-fcfe195def58 tempest-VolumeAndVolumeTypeFromImageTest-791078357 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 11:55:46 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-2e127124-a298-44a1-8a02-fcfe195def58 tempest-VolumeAndVolumeTypeFromImageTest-791078357 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 11:55:46 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-2e127124-a298-44a1-8a02-fcfe195def58 tempest-VolumeAndVolumeTypeFromImageTest-791078357 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 11:55:46 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-2e127124-a298-44a1-8a02-fcfe195def58 tempest-VolumeAndVolumeTypeFromImageTest-791078357 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 11:55:46 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-2e127124-a298-44a1-8a02-fcfe195def58 tempest-VolumeAndVolumeTypeFromImageTest-791078357 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 11:55:46 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-2e127124-a298-44a1-8a02-fcfe195def58 tempest-VolumeAndVolumeTypeFromImageTest-791078357 None] Selected osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f as target Quobyte volume. {{(pid=87116) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 11:55:46 devstack cinder-volume[87116]: INFO cinder.volume.drivers.remotefs [None req-2e127124-a298-44a1-8a02-fcfe195def58 tempest-VolumeAndVolumeTypeFromImageTest-791078357 None] casted to osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f Nov 06 11:55:46 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-2e127124-a298-44a1-8a02-fcfe195def58 tempest-VolumeAndVolumeTypeFromImageTest-791078357 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-48919537-c742-4ffc-a67d-34ae3dbab488 1073741824 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:55:46 devstack sudo[102316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-48919537-c742-4ffc-a67d-34ae3dbab488 1073741824 Nov 06 11:55:46 devstack sudo[102316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:55:47 devstack sudo[102316]: pam_unix(sudo:session): session closed for user root Nov 06 11:55:47 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-2e127124-a298-44a1-8a02-fcfe195def58 tempest-VolumeAndVolumeTypeFromImageTest-791078357 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-48919537-c742-4ffc-a67d-34ae3dbab488 1073741824" returned: 0 in 0.482s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:55:47 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-2e127124-a298-44a1-8a02-fcfe195def58 tempest-VolumeAndVolumeTypeFromImageTest-791078357 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-48919537-c742-4ffc-a67d-34ae3dbab488 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:55:47 devstack sudo[102324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-48919537-c742-4ffc-a67d-34ae3dbab488 Nov 06 11:55:47 devstack sudo[102324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:55:47 devstack sudo[102324]: pam_unix(sudo:session): session closed for user root Nov 06 11:55:47 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-2e127124-a298-44a1-8a02-fcfe195def58 tempest-VolumeAndVolumeTypeFromImageTest-791078357 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-48919537-c742-4ffc-a67d-34ae3dbab488" returned: 0 in 0.281s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:55:47 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-2e127124-a298-44a1-8a02-fcfe195def58 tempest-VolumeAndVolumeTypeFromImageTest-791078357 None] <== create_volume: return (810ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f'} {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 11:55:47 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-2e127124-a298-44a1-8a02-fcfe195def58 tempest-VolumeAndVolumeTypeFromImageTest-791078357 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.815s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 11:55:47 devstack cinder-volume[87116]: DEBUG cinder.volume.volume_utils [None req-2e127124-a298-44a1-8a02-fcfe195def58 tempest-VolumeAndVolumeTypeFromImageTest-791078357 None] Attempting download of 5a117943-f003-4f5d-88e3-d64c60e08b56 ((None, [{'url': 'file:///opt/stack/data/glance/images/5a117943-f003-4f5d-88e3-d64c60e08b56', 'metadata': {}}])) to volume 48919537-c742-4ffc-a67d-34ae3dbab488. {{(pid=87116) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Nov 06 11:55:47 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[48e2e29d-e4cb-43ce-a0b4-23bafb5a730d]: (4, 'raw') {{(pid=88420) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 11:55:47 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-2e127124-a298-44a1-8a02-fcfe195def58 tempest-VolumeAndVolumeTypeFromImageTest-791078357 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_5a117943-f003-4f5d-88e3-d64c60e08b56_u1z6vs58 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:55:47 devstack sudo[102329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_5a117943-f003-4f5d-88e3-d64c60e08b56_u1z6vs58 Nov 06 11:55:47 devstack sudo[102329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:55:48 devstack sudo[102329]: pam_unix(sudo:session): session closed for user root Nov 06 11:55:48 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-2e127124-a298-44a1-8a02-fcfe195def58 tempest-VolumeAndVolumeTypeFromImageTest-791078357 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_5a117943-f003-4f5d-88e3-d64c60e08b56_u1z6vs58" returned: 0 in 0.401s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:55:48 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-2e127124-a298-44a1-8a02-fcfe195def58 tempest-VolumeAndVolumeTypeFromImageTest-791078357 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5a117943-f003-4f5d-88e3-d64c60e08b56_u1z6vs58 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:55:48 devstack sudo[102333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5a117943-f003-4f5d-88e3-d64c60e08b56_u1z6vs58 Nov 06 11:55:48 devstack sudo[102333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:55:48 devstack sudo[102333]: pam_unix(sudo:session): session closed for user root Nov 06 11:55:48 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-2e127124-a298-44a1-8a02-fcfe195def58 tempest-VolumeAndVolumeTypeFromImageTest-791078357 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5a117943-f003-4f5d-88e3-d64c60e08b56_u1z6vs58" returned: 1 in 0.413s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:55:48 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-2e127124-a298-44a1-8a02-fcfe195def58 tempest-VolumeAndVolumeTypeFromImageTest-791078357 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_5a117943-f003-4f5d-88e3-d64c60e08b56_u1z6vs58' failed. Not Retrying. {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 06 11:55:48 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[da2f0acb-aa6d-44e8-a5c3-b92c3af1fda5]: (4, 'raw') {{(pid=88420) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 11:55:48 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-2e127124-a298-44a1-8a02-fcfe195def58 tempest-VolumeAndVolumeTypeFromImageTest-791078357 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5a117943-f003-4f5d-88e3-d64c60e08b56_dsfrmjdtdevstack@QuobyteHD {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:55:48 devstack sudo[102339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5a117943-f003-4f5d-88e3-d64c60e08b56_dsfrmjdtdevstack@QuobyteHD Nov 06 11:55:48 devstack sudo[102339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:55:49 devstack sudo[102339]: pam_unix(sudo:session): session closed for user root Nov 06 11:55:49 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-2e127124-a298-44a1-8a02-fcfe195def58 tempest-VolumeAndVolumeTypeFromImageTest-791078357 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_5a117943-f003-4f5d-88e3-d64c60e08b56_dsfrmjdtdevstack@QuobyteHD" returned: 0 in 0.549s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:55:49 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-2e127124-a298-44a1-8a02-fcfe195def58 tempest-VolumeAndVolumeTypeFromImageTest-791078357 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5a117943-f003-4f5d-88e3-d64c60e08b56_dsfrmjdtdevstack@QuobyteHD {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:55:49 devstack sudo[102344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5a117943-f003-4f5d-88e3-d64c60e08b56_dsfrmjdtdevstack@QuobyteHD Nov 06 11:55:49 devstack sudo[102344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:55:49 devstack sudo[102344]: pam_unix(sudo:session): session closed for user root Nov 06 11:55:49 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-2e127124-a298-44a1-8a02-fcfe195def58 tempest-VolumeAndVolumeTypeFromImageTest-791078357 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5a117943-f003-4f5d-88e3-d64c60e08b56_dsfrmjdtdevstack@QuobyteHD" returned: 1 in 0.560s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:55:49 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-2e127124-a298-44a1-8a02-fcfe195def58 tempest-VolumeAndVolumeTypeFromImageTest-791078357 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_5a117943-f003-4f5d-88e3-d64c60e08b56_dsfrmjdtdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 06 11:55:49 devstack cinder-volume[87116]: DEBUG cinder.image.image_utils [None req-2e127124-a298-44a1-8a02-fcfe195def58 tempest-VolumeAndVolumeTypeFromImageTest-791078357 None] 5a117943-f003-4f5d-88e3-d64c60e08b56 was raw, converting to qcow2 {{(pid=87116) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Nov 06 11:55:49 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-2e127124-a298-44a1-8a02-fcfe195def58 tempest-VolumeAndVolumeTypeFromImageTest-791078357 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_5a117943-f003-4f5d-88e3-d64c60e08b56_dsfrmjdtdevstack@QuobyteHD /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-48919537-c742-4ffc-a67d-34ae3dbab488 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:55:49 devstack sudo[102368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_5a117943-f003-4f5d-88e3-d64c60e08b56_dsfrmjdtdevstack@QuobyteHD /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-48919537-c742-4ffc-a67d-34ae3dbab488 Nov 06 11:55:49 devstack sudo[102368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:55:50 devstack sudo[102368]: pam_unix(sudo:session): session closed for user root Nov 06 11:55:50 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-2e127124-a298-44a1-8a02-fcfe195def58 tempest-VolumeAndVolumeTypeFromImageTest-791078357 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_5a117943-f003-4f5d-88e3-d64c60e08b56_dsfrmjdtdevstack@QuobyteHD /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-48919537-c742-4ffc-a67d-34ae3dbab488" returned: 0 in 0.583s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:55:50 devstack cinder-volume[87116]: DEBUG cinder.image.image_utils [None req-2e127124-a298-44a1-8a02-fcfe195def58 tempest-VolumeAndVolumeTypeFromImageTest-791078357 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_5a117943-f003-4f5d-88e3-d64c60e08b56_dsfrmjdtdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-48919537-c742-4ffc-a67d-34ae3dbab488 {{(pid=87116) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 06 11:55:50 devstack cinder-volume[87116]: INFO cinder.image.image_utils [None req-2e127124-a298-44a1-8a02-fcfe195def58 tempest-VolumeAndVolumeTypeFromImageTest-791078357 None] Converted 0.00 MB image at 0.00 MB/s Nov 06 11:55:50 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-2e127124-a298-44a1-8a02-fcfe195def58 tempest-VolumeAndVolumeTypeFromImageTest-791078357 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-48919537-c742-4ffc-a67d-34ae3dbab488 1G {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:55:50 devstack sudo[102375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-48919537-c742-4ffc-a67d-34ae3dbab488 1G Nov 06 11:55:50 devstack sudo[102375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:55:50 devstack cinder-volume[87116]: INFO cinder.volume.manager [req-8a59d001-0146-43b3-8c83-dd75e74b6db3 req-a77c4541-6a9b-479c-a344-7e3d9d0e465a tempest-TestShelveInstance-1615912961 None] Terminate volume connection completed successfully. Nov 06 11:55:50 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [req-8a59d001-0146-43b3-8c83-dd75e74b6db3 req-a77c4541-6a9b-479c-a344-7e3d9d0e465a tempest-TestShelveInstance-1615912961 None] Deleting attachment 6bc7b301-215e-4ef7-bcad-2291aa219c75. {{(pid=87116) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 06 11:55:50 devstack sudo[102375]: pam_unix(sudo:session): session closed for user root Nov 06 11:55:50 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-2e127124-a298-44a1-8a02-fcfe195def58 tempest-VolumeAndVolumeTypeFromImageTest-791078357 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-48919537-c742-4ffc-a67d-34ae3dbab488 1G" returned: 0 in 0.487s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:55:50 devstack cinder-volume[87116]: DEBUG cinder.volume.volume_utils [None req-2e127124-a298-44a1-8a02-fcfe195def58 tempest-VolumeAndVolumeTypeFromImageTest-791078357 None] Downloaded image 5a117943-f003-4f5d-88e3-d64c60e08b56 ((None, [{'url': 'file:///opt/stack/data/glance/images/5a117943-f003-4f5d-88e3-d64c60e08b56', 'metadata': {}}])) to volume 48919537-c742-4ffc-a67d-34ae3dbab488 successfully. {{(pid=87116) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Nov 06 11:55:50 devstack cinder-volume[87116]: DEBUG cinder.image.image_utils [None req-2e127124-a298-44a1-8a02-fcfe195def58 tempest-VolumeAndVolumeTypeFromImageTest-791078357 None] Temporary image 5a117943-f003-4f5d-88e3-d64c60e08b56 for user 4f839f3dba8f43a3b6412709443b50c9 is deleted. {{(pid=87116) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Nov 06 11:55:50 devstack cinder-volume[87116]: DEBUG cinder.volume.volume_utils [None req-2e127124-a298-44a1-8a02-fcfe195def58 tempest-VolumeAndVolumeTypeFromImageTest-791078357 None] Marking volume 48919537-c742-4ffc-a67d-34ae3dbab488 as bootable. {{(pid=87116) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Nov 06 11:55:50 devstack cinder-volume[87116]: DEBUG cinder.volume.flows.manager.create_volume [None req-2e127124-a298-44a1-8a02-fcfe195def58 tempest-VolumeAndVolumeTypeFromImageTest-791078357 None] Copying metadata from image 5a117943-f003-4f5d-88e3-d64c60e08b56 to 48919537-c742-4ffc-a67d-34ae3dbab488. {{(pid=87116) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Nov 06 11:55:50 devstack cinder-volume[87116]: DEBUG cinder.volume.flows.manager.create_volume [None req-2e127124-a298-44a1-8a02-fcfe195def58 tempest-VolumeAndVolumeTypeFromImageTest-791078357 None] Creating volume glance metadata for volume 48919537-c742-4ffc-a67d-34ae3dbab488 backed by image 5a117943-f003-4f5d-88e3-d64c60e08b56 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '5a117943-f003-4f5d-88e3-d64c60e08b56', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '125a6b364f1963c9e97c97dd4cf8a740', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87116) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Nov 06 11:55:50 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-2e127124-a298-44a1-8a02-fcfe195def58 tempest-VolumeAndVolumeTypeFromImageTest-791078357 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a6e52fc1-6c36-4cc8-9308-5db79b5bb685) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-48919537-c742-4ffc-a67d-34ae3dbab488', 'volume_size': 1, 'image_id': '5a117943-f003-4f5d-88e3-d64c60e08b56', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/5a117943-f003-4f5d-88e3-d64c60e08b56', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '125a6b364f1963c9e97c97dd4cf8a740', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '03bd8cf82b504b7aa5a7c16421034cac', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '76fcba2adbc5e6a4a233113ac70a771cd11dec8de46c05825e374f457c6757a006635bc6bd78740dbc523b7a805a9bb8e00f3a6fc6607123aacd46e64bf1af34', 'id': '5a117943-f003-4f5d-88e3-d64c60e08b56', 'created_at': datetime.datetime(2026, 11, 6, 10, 55, 42, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 6, 10, 55, 44, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/5a117943-f003-4f5d-88e3-d64c60e08b56/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:55:50 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-2e127124-a298-44a1-8a02-fcfe195def58 tempest-VolumeAndVolumeTypeFromImageTest-791078357 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d4133aac-6a0c-4305-ab91-efc7ea090318) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:55:50 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-2e127124-a298-44a1-8a02-fcfe195def58 tempest-VolumeAndVolumeTypeFromImageTest-791078357 None] Volume volume-48919537-c742-4ffc-a67d-34ae3dbab488 (48919537-c742-4ffc-a67d-34ae3dbab488): created successfully Nov 06 11:55:50 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-2e127124-a298-44a1-8a02-fcfe195def58 tempest-VolumeAndVolumeTypeFromImageTest-791078357 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d4133aac-6a0c-4305-ab91-efc7ea090318) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:55:50 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-2e127124-a298-44a1-8a02-fcfe195def58 tempest-VolumeAndVolumeTypeFromImageTest-791078357 None] Flow 'volume_create_manager' (e4f31331-0ab2-4dcf-860d-7bb040836e99) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 11:55:50 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-2e127124-a298-44a1-8a02-fcfe195def58 tempest-VolumeAndVolumeTypeFromImageTest-791078357 None] Created volume successfully. Nov 06 11:55:50 devstack cinder-volume[87116]: DEBUG cinder.coordination [req-8a59d001-0146-43b3-8c83-dd75e74b6db3 req-6c911f85-fcc3-4b50-98df-02161c6c76e7 tempest-TestShelveInstance-1615912961 None] Acquiring lock "cinder-14e75353-8e88-4e4d-93b1-ac70324e53c9-delete_volume" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 11:55:50 devstack cinder-volume[87116]: DEBUG cinder.coordination [req-8a59d001-0146-43b3-8c83-dd75e74b6db3 req-6c911f85-fcc3-4b50-98df-02161c6c76e7 tempest-TestShelveInstance-1615912961 None] Lock "cinder-14e75353-8e88-4e4d-93b1-ac70324e53c9-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 11:55:50 devstack cinder-volume[87116]: DEBUG cinder.coordination [req-8a59d001-0146-43b3-8c83-dd75e74b6db3 req-6c911f85-fcc3-4b50-98df-02161c6c76e7 tempest-TestShelveInstance-1615912961 None] Acquiring lock "cinder-quobyte-14e75353-8e88-4e4d-93b1-ac70324e53c9" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 11:55:50 devstack cinder-volume[87116]: DEBUG cinder.coordination [req-8a59d001-0146-43b3-8c83-dd75e74b6db3 req-6c911f85-fcc3-4b50-98df-02161c6c76e7 tempest-TestShelveInstance-1615912961 None] Lock "cinder-quobyte-14e75353-8e88-4e4d-93b1-ac70324e53c9" acquired by "delete_volume" :: waited 0.019s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 11:55:50 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[04b8ec02-aa34-4592-b126-819f7781cb68]: (4, 'qcow2') {{(pid=88420) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 11:55:50 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [req-8a59d001-0146-43b3-8c83-dd75e74b6db3 req-6c911f85-fcc3-4b50-98df-02161c6c76e7 tempest-TestShelveInstance-1615912961 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-14e75353-8e88-4e4d-93b1-ac70324e53c9 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:55:51 devstack sudo[102383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-14e75353-8e88-4e4d-93b1-ac70324e53c9 Nov 06 11:55:51 devstack sudo[102383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:55:51 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-169c7aca-1b52-4d70-a662-1f6a0ef99291 tempest-VolumeAndVolumeTypeFromImageTest-791078357 None] Acquiring lock "cinder-48919537-c742-4ffc-a67d-34ae3dbab488-delete_volume" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 11:55:51 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-169c7aca-1b52-4d70-a662-1f6a0ef99291 tempest-VolumeAndVolumeTypeFromImageTest-791078357 None] Lock "cinder-48919537-c742-4ffc-a67d-34ae3dbab488-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 11:55:51 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-169c7aca-1b52-4d70-a662-1f6a0ef99291 tempest-VolumeAndVolumeTypeFromImageTest-791078357 None] Acquiring lock "cinder-quobyte-48919537-c742-4ffc-a67d-34ae3dbab488" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 11:55:51 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-169c7aca-1b52-4d70-a662-1f6a0ef99291 tempest-VolumeAndVolumeTypeFromImageTest-791078357 None] Lock "cinder-quobyte-48919537-c742-4ffc-a67d-34ae3dbab488" acquired by "delete_volume" :: waited 0.017s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 11:55:51 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f4c0f78-e97b-49a2-a24d-c6abb9fcea28]: (4, 'qcow2') {{(pid=88420) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 11:55:51 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-169c7aca-1b52-4d70-a662-1f6a0ef99291 tempest-VolumeAndVolumeTypeFromImageTest-791078357 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-48919537-c742-4ffc-a67d-34ae3dbab488 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:55:51 devstack sudo[102385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-48919537-c742-4ffc-a67d-34ae3dbab488 Nov 06 11:55:51 devstack sudo[102385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:55:51 devstack sudo[102383]: pam_unix(sudo:session): session closed for user root Nov 06 11:55:51 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [req-8a59d001-0146-43b3-8c83-dd75e74b6db3 req-6c911f85-fcc3-4b50-98df-02161c6c76e7 tempest-TestShelveInstance-1615912961 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-14e75353-8e88-4e4d-93b1-ac70324e53c9" returned: 0 in 0.541s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:55:51 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [req-8a59d001-0146-43b3-8c83-dd75e74b6db3 req-6c911f85-fcc3-4b50-98df-02161c6c76e7 tempest-TestShelveInstance-1615912961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-14e75353-8e88-4e4d-93b1-ac70324e53c9 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:55:51 devstack sudo[102390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-14e75353-8e88-4e4d-93b1-ac70324e53c9 Nov 06 11:55:51 devstack sudo[102390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:55:51 devstack sudo[102385]: pam_unix(sudo:session): session closed for user root Nov 06 11:55:51 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-169c7aca-1b52-4d70-a662-1f6a0ef99291 tempest-VolumeAndVolumeTypeFromImageTest-791078357 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-48919537-c742-4ffc-a67d-34ae3dbab488" returned: 0 in 0.501s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:55:51 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-169c7aca-1b52-4d70-a662-1f6a0ef99291 tempest-VolumeAndVolumeTypeFromImageTest-791078357 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-48919537-c742-4ffc-a67d-34ae3dbab488 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:55:51 devstack sudo[102390]: pam_unix(sudo:session): session closed for user root Nov 06 11:55:51 devstack sudo[102396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-48919537-c742-4ffc-a67d-34ae3dbab488 Nov 06 11:55:51 devstack sudo[102396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:55:51 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [req-8a59d001-0146-43b3-8c83-dd75e74b6db3 req-6c911f85-fcc3-4b50-98df-02161c6c76e7 tempest-TestShelveInstance-1615912961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-14e75353-8e88-4e4d-93b1-ac70324e53c9" returned: 0 in 0.322s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:55:51 devstack cinder-volume[87116]: DEBUG cinder.coordination [req-8a59d001-0146-43b3-8c83-dd75e74b6db3 req-6c911f85-fcc3-4b50-98df-02161c6c76e7 tempest-TestShelveInstance-1615912961 None] Lock "cinder-quobyte-14e75353-8e88-4e4d-93b1-ac70324e53c9" released by "delete_volume" :: held 0.925s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 11:55:51 devstack cinder-volume[87116]: DEBUG cinder.quota [req-8a59d001-0146-43b3-8c83-dd75e74b6db3 req-6c911f85-fcc3-4b50-98df-02161c6c76e7 tempest-TestShelveInstance-1615912961 None] Created reservations ['01f5e22c-a91b-4057-801c-c9d76e8e011e', 'cb7c79ab-67a2-444d-99d0-3839f41ff2e8', 'bc23a0c1-1224-4145-b7c1-9a2e8093cb0e', 'd8967b32-18a7-4735-bdbc-13da1ee00da7'] {{(pid=87116) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 11:55:52 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [req-8a59d001-0146-43b3-8c83-dd75e74b6db3 req-6c911f85-fcc3-4b50-98df-02161c6c76e7 tempest-TestShelveInstance-1615912961 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 11:55:52 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [req-8a59d001-0146-43b3-8c83-dd75e74b6db3 req-6c911f85-fcc3-4b50-98df-02161c6c76e7 tempest-TestShelveInstance-1615912961 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 11:55:52 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [req-8a59d001-0146-43b3-8c83-dd75e74b6db3 req-6c911f85-fcc3-4b50-98df-02161c6c76e7 tempest-TestShelveInstance-1615912961 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 11:55:52 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [req-8a59d001-0146-43b3-8c83-dd75e74b6db3 req-6c911f85-fcc3-4b50-98df-02161c6c76e7 tempest-TestShelveInstance-1615912961 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 11:55:52 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [req-8a59d001-0146-43b3-8c83-dd75e74b6db3 req-6c911f85-fcc3-4b50-98df-02161c6c76e7 tempest-TestShelveInstance-1615912961 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 11:55:52 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [req-8a59d001-0146-43b3-8c83-dd75e74b6db3 req-6c911f85-fcc3-4b50-98df-02161c6c76e7 tempest-TestShelveInstance-1615912961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:55:52 devstack sudo[102396]: pam_unix(sudo:session): session closed for user root Nov 06 11:55:52 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-169c7aca-1b52-4d70-a662-1f6a0ef99291 tempest-VolumeAndVolumeTypeFromImageTest-791078357 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-48919537-c742-4ffc-a67d-34ae3dbab488" returned: 0 in 0.321s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:55:52 devstack sudo[102399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756 Nov 06 11:55:52 devstack sudo[102399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:55:52 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-169c7aca-1b52-4d70-a662-1f6a0ef99291 tempest-VolumeAndVolumeTypeFromImageTest-791078357 None] Lock "cinder-quobyte-48919537-c742-4ffc-a67d-34ae3dbab488" released by "delete_volume" :: held 0.883s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 11:55:52 devstack cinder-volume[87116]: WARNING cinder.quota [None req-169c7aca-1b52-4d70-a662-1f6a0ef99291 tempest-VolumeAndVolumeTypeFromImageTest-791078357 None] Deprecated: Default quota for resource: volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Nov 06 11:55:52 devstack cinder-volume[87116]: WARNING cinder.quota [None req-169c7aca-1b52-4d70-a662-1f6a0ef99291 tempest-VolumeAndVolumeTypeFromImageTest-791078357 None] Deprecated: Default quota for resource: gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Nov 06 11:55:52 devstack cinder-volume[87116]: DEBUG cinder.quota [None req-169c7aca-1b52-4d70-a662-1f6a0ef99291 tempest-VolumeAndVolumeTypeFromImageTest-791078357 None] Created reservations ['167e2e25-3101-4c12-8aef-019cf70d40a6', '2ecc0ba3-0c6c-4aea-b138-6d7f05e7eee5', 'f8e3635b-2383-435f-b9b8-5076285b27fa', '88df2552-18d1-430c-b050-f18ee4d08877'] {{(pid=87116) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 11:55:52 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-169c7aca-1b52-4d70-a662-1f6a0ef99291 tempest-VolumeAndVolumeTypeFromImageTest-791078357 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 11:55:52 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-169c7aca-1b52-4d70-a662-1f6a0ef99291 tempest-VolumeAndVolumeTypeFromImageTest-791078357 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 11:55:52 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-169c7aca-1b52-4d70-a662-1f6a0ef99291 tempest-VolumeAndVolumeTypeFromImageTest-791078357 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 11:55:52 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-169c7aca-1b52-4d70-a662-1f6a0ef99291 tempest-VolumeAndVolumeTypeFromImageTest-791078357 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 11:55:52 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-169c7aca-1b52-4d70-a662-1f6a0ef99291 tempest-VolumeAndVolumeTypeFromImageTest-791078357 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 11:55:52 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-169c7aca-1b52-4d70-a662-1f6a0ef99291 tempest-VolumeAndVolumeTypeFromImageTest-791078357 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:55:52 devstack sudo[102401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756 Nov 06 11:55:52 devstack sudo[102401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:55:52 devstack sudo[102399]: pam_unix(sudo:session): session closed for user root Nov 06 11:55:52 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [req-8a59d001-0146-43b3-8c83-dd75e74b6db3 req-6c911f85-fcc3-4b50-98df-02161c6c76e7 tempest-TestShelveInstance-1615912961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756" returned: 0 in 0.413s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:55:52 devstack cinder-volume[87116]: DEBUG cinder.manager [req-8a59d001-0146-43b3-8c83-dd75e74b6db3 req-6c911f85-fcc3-4b50-98df-02161c6c76e7 tempest-TestShelveInstance-1615912961 None] Notifying Schedulers of capabilities ... {{(pid=87116) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 11:55:52 devstack cinder-volume[87116]: INFO cinder.volume.manager [req-8a59d001-0146-43b3-8c83-dd75e74b6db3 req-6c911f85-fcc3-4b50-98df-02161c6c76e7 tempest-TestShelveInstance-1615912961 None] Deleted volume successfully. Nov 06 11:55:52 devstack cinder-volume[87116]: DEBUG cinder.coordination [req-8a59d001-0146-43b3-8c83-dd75e74b6db3 req-6c911f85-fcc3-4b50-98df-02161c6c76e7 tempest-TestShelveInstance-1615912961 None] Lock "cinder-14e75353-8e88-4e4d-93b1-ac70324e53c9-delete_volume" released by "delete_volume" :: held 1.761s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 11:55:52 devstack sudo[102401]: pam_unix(sudo:session): session closed for user root Nov 06 11:55:52 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-169c7aca-1b52-4d70-a662-1f6a0ef99291 tempest-VolumeAndVolumeTypeFromImageTest-791078357 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756" returned: 0 in 0.460s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:55:52 devstack cinder-volume[87116]: DEBUG cinder.manager [None req-169c7aca-1b52-4d70-a662-1f6a0ef99291 tempest-VolumeAndVolumeTypeFromImageTest-791078357 None] Notifying Schedulers of capabilities ... {{(pid=87116) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 11:55:52 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-169c7aca-1b52-4d70-a662-1f6a0ef99291 tempest-VolumeAndVolumeTypeFromImageTest-791078357 None] Deleted volume successfully. Nov 06 11:55:52 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-169c7aca-1b52-4d70-a662-1f6a0ef99291 tempest-VolumeAndVolumeTypeFromImageTest-791078357 None] Lock "cinder-48919537-c742-4ffc-a67d-34ae3dbab488-delete_volume" released by "delete_volume" :: held 1.642s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 11:56:01 devstack cinder-volume[87116]: DEBUG cinder.volume.flows.manager.create_volume [None req-8616811d-2b1d-46c7-a6c3-cd1cbdac4644 tempest-CreateVolumesFromImageTest-1665643559 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87116) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 11:56:01 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-8616811d-2b1d-46c7-a6c3-cd1cbdac4644 tempest-CreateVolumesFromImageTest-1665643559 None] Flow 'volume_create_manager' (c801bb02-8f65-41e6-900c-116ac8404bc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 11:56:01 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-8616811d-2b1d-46c7-a6c3-cd1cbdac4644 tempest-CreateVolumesFromImageTest-1665643559 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f558eb23-2cfe-4b07-b796-d7b6b71d4c03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:56:01 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-8616811d-2b1d-46c7-a6c3-cd1cbdac4644 tempest-CreateVolumesFromImageTest-1665643559 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f558eb23-2cfe-4b07-b796-d7b6b71d4c03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T10:56:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-879777224',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5a967410-6f34-4282-acc4-db9b5fe72257,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bd6d36bdcbd448bfb7dc97783d31d163',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T10:56:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T10:56:01Z,use_quota=True,user_id='bba1fd78db734bd0bec7619ce421f36d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(34d3b144-d9b7-480a-a2e3-01e45f3d54c1),volume_type_id=34d3b144-d9b7-480a-a2e3-01e45f3d54c1)' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:56:01 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-8616811d-2b1d-46c7-a6c3-cd1cbdac4644 tempest-CreateVolumesFromImageTest-1665643559 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a2f0bec0-a18f-42bb-88a0-b89fe654dc0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:56:01 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-8616811d-2b1d-46c7-a6c3-cd1cbdac4644 tempest-CreateVolumesFromImageTest-1665643559 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a2f0bec0-a18f-42bb-88a0-b89fe654dc0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:56:01 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-8616811d-2b1d-46c7-a6c3-cd1cbdac4644 tempest-CreateVolumesFromImageTest-1665643559 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (25695696-7125-4a15-8922-e2070fc9ab53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:56:01 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-8616811d-2b1d-46c7-a6c3-cd1cbdac4644 tempest-CreateVolumesFromImageTest-1665643559 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (25695696-7125-4a15-8922-e2070fc9ab53) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5a967410-6f34-4282-acc4-db9b5fe72257', 'volume_name': 'volume-5a967410-6f34-4282-acc4-db9b5fe72257', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:56:01 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-8616811d-2b1d-46c7-a6c3-cd1cbdac4644 tempest-CreateVolumesFromImageTest-1665643559 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4532f546-03dd-40a2-800f-37adefdc0319) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:56:01 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-8616811d-2b1d-46c7-a6c3-cd1cbdac4644 tempest-CreateVolumesFromImageTest-1665643559 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4532f546-03dd-40a2-800f-37adefdc0319) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:56:01 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-8616811d-2b1d-46c7-a6c3-cd1cbdac4644 tempest-CreateVolumesFromImageTest-1665643559 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8549b392-362a-4a56-af86-cebefbacdd3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:56:01 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-8616811d-2b1d-46c7-a6c3-cd1cbdac4644 tempest-CreateVolumesFromImageTest-1665643559 None] Volume 5a967410-6f34-4282-acc4-db9b5fe72257: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5a967410-6f34-4282-acc4-db9b5fe72257', 'volume_size': 1} Nov 06 11:56:01 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-8616811d-2b1d-46c7-a6c3-cd1cbdac4644 tempest-CreateVolumesFromImageTest-1665643559 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 11:56:01 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-8616811d-2b1d-46c7-a6c3-cd1cbdac4644 tempest-CreateVolumesFromImageTest-1665643559 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 11:56:01 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-8616811d-2b1d-46c7-a6c3-cd1cbdac4644 tempest-CreateVolumesFromImageTest-1665643559 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T10:56:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-879777224',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5a967410-6f34-4282-acc4-db9b5fe72257,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bd6d36bdcbd448bfb7dc97783d31d163',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T10:56:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T10:56:01Z,use_quota=True,user_id='bba1fd78db734bd0bec7619ce421f36d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(34d3b144-d9b7-480a-a2e3-01e45f3d54c1),volume_type_id=34d3b144-d9b7-480a-a2e3-01e45f3d54c1)}" {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 11:56:01 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-8616811d-2b1d-46c7-a6c3-cd1cbdac4644 tempest-CreateVolumesFromImageTest-1665643559 None] Creating volume 5a967410-6f34-4282-acc4-db9b5fe72257 {{(pid=87116) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 11:56:01 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-8616811d-2b1d-46c7-a6c3-cd1cbdac4644 tempest-CreateVolumesFromImageTest-1665643559 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 11:56:01 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-8616811d-2b1d-46c7-a6c3-cd1cbdac4644 tempest-CreateVolumesFromImageTest-1665643559 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 11:56:01 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-8616811d-2b1d-46c7-a6c3-cd1cbdac4644 tempest-CreateVolumesFromImageTest-1665643559 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 11:56:01 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-8616811d-2b1d-46c7-a6c3-cd1cbdac4644 tempest-CreateVolumesFromImageTest-1665643559 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 11:56:01 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-8616811d-2b1d-46c7-a6c3-cd1cbdac4644 tempest-CreateVolumesFromImageTest-1665643559 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 11:56:01 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-8616811d-2b1d-46c7-a6c3-cd1cbdac4644 tempest-CreateVolumesFromImageTest-1665643559 None] Selected osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f as target Quobyte volume. {{(pid=87116) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 11:56:01 devstack cinder-volume[87116]: INFO cinder.volume.drivers.remotefs [None req-8616811d-2b1d-46c7-a6c3-cd1cbdac4644 tempest-CreateVolumesFromImageTest-1665643559 None] casted to osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f Nov 06 11:56:01 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-8616811d-2b1d-46c7-a6c3-cd1cbdac4644 tempest-CreateVolumesFromImageTest-1665643559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-5a967410-6f34-4282-acc4-db9b5fe72257 1073741824 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:56:01 devstack sudo[102413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-5a967410-6f34-4282-acc4-db9b5fe72257 1073741824 Nov 06 11:56:01 devstack sudo[102413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:56:01 devstack cinder-volume[87116]: DEBUG cinder.volume.flows.manager.create_volume [None req-c6c2bc86-2a2e-4733-9c77-54547bd39798 tempest-CreateVolumesFromImageTest-1665643559 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87116) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 11:56:01 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-c6c2bc86-2a2e-4733-9c77-54547bd39798 tempest-CreateVolumesFromImageTest-1665643559 None] Flow 'volume_create_manager' (bf7a28ef-c5de-40d9-9690-400035124b44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 11:56:01 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-c6c2bc86-2a2e-4733-9c77-54547bd39798 tempest-CreateVolumesFromImageTest-1665643559 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0400c85a-4320-4b8f-aa54-3757e5be768e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:56:01 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-c6c2bc86-2a2e-4733-9c77-54547bd39798 tempest-CreateVolumesFromImageTest-1665643559 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0400c85a-4320-4b8f-aa54-3757e5be768e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T10:56:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-744085007',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9b89d289-e360-4dbc-9b72-eba1d2f35596,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bd6d36bdcbd448bfb7dc97783d31d163',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T10:56:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T10:56:02Z,use_quota=True,user_id='bba1fd78db734bd0bec7619ce421f36d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(34d3b144-d9b7-480a-a2e3-01e45f3d54c1),volume_type_id=34d3b144-d9b7-480a-a2e3-01e45f3d54c1)' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:56:01 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-c6c2bc86-2a2e-4733-9c77-54547bd39798 tempest-CreateVolumesFromImageTest-1665643559 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (01f97c1d-9fcb-467f-ae8b-f0c12b7f0d89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:56:01 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-c6c2bc86-2a2e-4733-9c77-54547bd39798 tempest-CreateVolumesFromImageTest-1665643559 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (01f97c1d-9fcb-467f-ae8b-f0c12b7f0d89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:56:01 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-c6c2bc86-2a2e-4733-9c77-54547bd39798 tempest-CreateVolumesFromImageTest-1665643559 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f953a25-9202-48dc-806f-5a15056a288a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:56:01 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-c6c2bc86-2a2e-4733-9c77-54547bd39798 tempest-CreateVolumesFromImageTest-1665643559 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f953a25-9202-48dc-806f-5a15056a288a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9b89d289-e360-4dbc-9b72-eba1d2f35596', 'volume_name': 'volume-9b89d289-e360-4dbc-9b72-eba1d2f35596', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:56:01 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-c6c2bc86-2a2e-4733-9c77-54547bd39798 tempest-CreateVolumesFromImageTest-1665643559 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b69b1a5-240c-4073-8f33-35e16483aa46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:56:01 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-c6c2bc86-2a2e-4733-9c77-54547bd39798 tempest-CreateVolumesFromImageTest-1665643559 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b69b1a5-240c-4073-8f33-35e16483aa46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:56:01 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-c6c2bc86-2a2e-4733-9c77-54547bd39798 tempest-CreateVolumesFromImageTest-1665643559 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ba23901-da58-4e32-9ea5-7f29763d8d90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:56:01 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-c6c2bc86-2a2e-4733-9c77-54547bd39798 tempest-CreateVolumesFromImageTest-1665643559 None] Volume 9b89d289-e360-4dbc-9b72-eba1d2f35596: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9b89d289-e360-4dbc-9b72-eba1d2f35596', 'volume_size': 1} Nov 06 11:56:01 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-c6c2bc86-2a2e-4733-9c77-54547bd39798 tempest-CreateVolumesFromImageTest-1665643559 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 11:56:02 devstack sudo[102413]: pam_unix(sudo:session): session closed for user root Nov 06 11:56:02 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-8616811d-2b1d-46c7-a6c3-cd1cbdac4644 tempest-CreateVolumesFromImageTest-1665643559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-5a967410-6f34-4282-acc4-db9b5fe72257 1073741824" returned: 0 in 0.837s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:56:02 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-8616811d-2b1d-46c7-a6c3-cd1cbdac4644 tempest-CreateVolumesFromImageTest-1665643559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-5a967410-6f34-4282-acc4-db9b5fe72257 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:56:02 devstack sudo[102419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-5a967410-6f34-4282-acc4-db9b5fe72257 Nov 06 11:56:02 devstack sudo[102419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:56:02 devstack cinder-volume[87116]: DEBUG cinder.volume.flows.manager.create_volume [None req-52fe24c8-2ef7-4ad5-9b7f-77111c8a7feb tempest-CreateVolumesFromImageTest-1665643559 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87116) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 11:56:02 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-52fe24c8-2ef7-4ad5-9b7f-77111c8a7feb tempest-CreateVolumesFromImageTest-1665643559 None] Flow 'volume_create_manager' (f6be2aae-1917-4e79-baca-5ae29a9f7087) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 11:56:02 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-52fe24c8-2ef7-4ad5-9b7f-77111c8a7feb tempest-CreateVolumesFromImageTest-1665643559 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c28153b6-f0fc-445a-87af-d2c6346256bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:56:02 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-52fe24c8-2ef7-4ad5-9b7f-77111c8a7feb tempest-CreateVolumesFromImageTest-1665643559 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c28153b6-f0fc-445a-87af-d2c6346256bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T10:56:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1827056973',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b1811cf0-faa4-4ca2-8fd7-61f67b7d18e3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bd6d36bdcbd448bfb7dc97783d31d163',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T10:56:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T10:56:02Z,use_quota=True,user_id='bba1fd78db734bd0bec7619ce421f36d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(34d3b144-d9b7-480a-a2e3-01e45f3d54c1),volume_type_id=34d3b144-d9b7-480a-a2e3-01e45f3d54c1)' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:56:02 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-52fe24c8-2ef7-4ad5-9b7f-77111c8a7feb tempest-CreateVolumesFromImageTest-1665643559 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd7e5a57-426a-42f4-9b58-b9411b439e09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:56:02 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-52fe24c8-2ef7-4ad5-9b7f-77111c8a7feb tempest-CreateVolumesFromImageTest-1665643559 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd7e5a57-426a-42f4-9b58-b9411b439e09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:56:02 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-52fe24c8-2ef7-4ad5-9b7f-77111c8a7feb tempest-CreateVolumesFromImageTest-1665643559 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8b4a3d52-5e72-4ecb-8a8d-84f1276ff0a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:56:02 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-52fe24c8-2ef7-4ad5-9b7f-77111c8a7feb tempest-CreateVolumesFromImageTest-1665643559 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8b4a3d52-5e72-4ecb-8a8d-84f1276ff0a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b1811cf0-faa4-4ca2-8fd7-61f67b7d18e3', 'volume_name': 'volume-b1811cf0-faa4-4ca2-8fd7-61f67b7d18e3', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:56:02 devstack sudo[102419]: pam_unix(sudo:session): session closed for user root Nov 06 11:56:02 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-52fe24c8-2ef7-4ad5-9b7f-77111c8a7feb tempest-CreateVolumesFromImageTest-1665643559 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (02342c09-b167-47c0-a1bb-e3a8e21a3dbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:56:02 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-52fe24c8-2ef7-4ad5-9b7f-77111c8a7feb tempest-CreateVolumesFromImageTest-1665643559 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (02342c09-b167-47c0-a1bb-e3a8e21a3dbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:56:02 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-52fe24c8-2ef7-4ad5-9b7f-77111c8a7feb tempest-CreateVolumesFromImageTest-1665643559 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dd4d57b3-4f8f-4ee5-9f41-6c6fead368fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:56:02 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-52fe24c8-2ef7-4ad5-9b7f-77111c8a7feb tempest-CreateVolumesFromImageTest-1665643559 None] Volume b1811cf0-faa4-4ca2-8fd7-61f67b7d18e3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b1811cf0-faa4-4ca2-8fd7-61f67b7d18e3', 'volume_size': 1} Nov 06 11:56:02 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-52fe24c8-2ef7-4ad5-9b7f-77111c8a7feb tempest-CreateVolumesFromImageTest-1665643559 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 11:56:02 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-8616811d-2b1d-46c7-a6c3-cd1cbdac4644 tempest-CreateVolumesFromImageTest-1665643559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-5a967410-6f34-4282-acc4-db9b5fe72257" returned: 0 in 0.630s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:56:02 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-8616811d-2b1d-46c7-a6c3-cd1cbdac4644 tempest-CreateVolumesFromImageTest-1665643559 None] <== create_volume: return (1538ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f'} {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 11:56:02 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-8616811d-2b1d-46c7-a6c3-cd1cbdac4644 tempest-CreateVolumesFromImageTest-1665643559 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.540s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 11:56:02 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-c6c2bc86-2a2e-4733-9c77-54547bd39798 tempest-CreateVolumesFromImageTest-1665643559 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.780s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 11:56:02 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-c6c2bc86-2a2e-4733-9c77-54547bd39798 tempest-CreateVolumesFromImageTest-1665643559 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T10:56:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-744085007',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9b89d289-e360-4dbc-9b72-eba1d2f35596,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bd6d36bdcbd448bfb7dc97783d31d163',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T10:56:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T10:56:02Z,use_quota=True,user_id='bba1fd78db734bd0bec7619ce421f36d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(34d3b144-d9b7-480a-a2e3-01e45f3d54c1),volume_type_id=34d3b144-d9b7-480a-a2e3-01e45f3d54c1)}" {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 11:56:02 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-c6c2bc86-2a2e-4733-9c77-54547bd39798 tempest-CreateVolumesFromImageTest-1665643559 None] Creating volume 9b89d289-e360-4dbc-9b72-eba1d2f35596 {{(pid=87116) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 11:56:02 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-c6c2bc86-2a2e-4733-9c77-54547bd39798 tempest-CreateVolumesFromImageTest-1665643559 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 11:56:02 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-c6c2bc86-2a2e-4733-9c77-54547bd39798 tempest-CreateVolumesFromImageTest-1665643559 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 11:56:02 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-c6c2bc86-2a2e-4733-9c77-54547bd39798 tempest-CreateVolumesFromImageTest-1665643559 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 11:56:02 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-c6c2bc86-2a2e-4733-9c77-54547bd39798 tempest-CreateVolumesFromImageTest-1665643559 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 11:56:02 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-c6c2bc86-2a2e-4733-9c77-54547bd39798 tempest-CreateVolumesFromImageTest-1665643559 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 11:56:02 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-c6c2bc86-2a2e-4733-9c77-54547bd39798 tempest-CreateVolumesFromImageTest-1665643559 None] Selected osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f as target Quobyte volume. {{(pid=87116) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 11:56:02 devstack cinder-volume[87116]: INFO cinder.volume.drivers.remotefs [None req-c6c2bc86-2a2e-4733-9c77-54547bd39798 tempest-CreateVolumesFromImageTest-1665643559 None] casted to osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f Nov 06 11:56:02 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-c6c2bc86-2a2e-4733-9c77-54547bd39798 tempest-CreateVolumesFromImageTest-1665643559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-9b89d289-e360-4dbc-9b72-eba1d2f35596 1073741824 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:56:02 devstack sudo[102423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-9b89d289-e360-4dbc-9b72-eba1d2f35596 1073741824 Nov 06 11:56:02 devstack sudo[102423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:56:02 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-8616811d-2b1d-46c7-a6c3-cd1cbdac4644 tempest-CreateVolumesFromImageTest-1665643559 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8549b392-362a-4a56-af86-cebefbacdd3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5a967410-6f34-4282-acc4-db9b5fe72257', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:56:02 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-8616811d-2b1d-46c7-a6c3-cd1cbdac4644 tempest-CreateVolumesFromImageTest-1665643559 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (367ad24e-52ef-4d5b-8504-492324000ce5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:56:02 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-8616811d-2b1d-46c7-a6c3-cd1cbdac4644 tempest-CreateVolumesFromImageTest-1665643559 None] Volume volume-5a967410-6f34-4282-acc4-db9b5fe72257 (5a967410-6f34-4282-acc4-db9b5fe72257): created successfully Nov 06 11:56:02 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-8616811d-2b1d-46c7-a6c3-cd1cbdac4644 tempest-CreateVolumesFromImageTest-1665643559 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (367ad24e-52ef-4d5b-8504-492324000ce5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:56:02 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-8616811d-2b1d-46c7-a6c3-cd1cbdac4644 tempest-CreateVolumesFromImageTest-1665643559 None] Flow 'volume_create_manager' (c801bb02-8f65-41e6-900c-116ac8404bc4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 11:56:02 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-8616811d-2b1d-46c7-a6c3-cd1cbdac4644 tempest-CreateVolumesFromImageTest-1665643559 None] Created volume successfully. Nov 06 11:56:03 devstack cinder-volume[87116]: DEBUG cinder.volume.flows.manager.create_volume [None req-28e0d040-3584-4a78-a354-4e5745565bea tempest-CreateVolumesFromImageTest-1665643559 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87116) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 11:56:03 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-28e0d040-3584-4a78-a354-4e5745565bea tempest-CreateVolumesFromImageTest-1665643559 None] Flow 'volume_create_manager' (f7a97ac4-975e-4f61-9021-042480397dee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 11:56:03 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-28e0d040-3584-4a78-a354-4e5745565bea tempest-CreateVolumesFromImageTest-1665643559 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bbf18761-cd4b-41cc-9fea-46e023cecee7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:56:03 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-28e0d040-3584-4a78-a354-4e5745565bea tempest-CreateVolumesFromImageTest-1665643559 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bbf18761-cd4b-41cc-9fea-46e023cecee7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T10:56:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1963954130',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=04a6123f-d8a9-46bd-bc05-c0f12017e993,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bd6d36bdcbd448bfb7dc97783d31d163',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T10:56:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T10:56:03Z,use_quota=True,user_id='bba1fd78db734bd0bec7619ce421f36d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(34d3b144-d9b7-480a-a2e3-01e45f3d54c1),volume_type_id=34d3b144-d9b7-480a-a2e3-01e45f3d54c1)' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:56:03 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-28e0d040-3584-4a78-a354-4e5745565bea tempest-CreateVolumesFromImageTest-1665643559 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c5ef5b55-cc72-460c-90d6-a0915e1948e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:56:03 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-28e0d040-3584-4a78-a354-4e5745565bea tempest-CreateVolumesFromImageTest-1665643559 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c5ef5b55-cc72-460c-90d6-a0915e1948e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:56:03 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-28e0d040-3584-4a78-a354-4e5745565bea tempest-CreateVolumesFromImageTest-1665643559 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f8c928c0-5118-4580-a656-bf8c09700825) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:56:03 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-28e0d040-3584-4a78-a354-4e5745565bea tempest-CreateVolumesFromImageTest-1665643559 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f8c928c0-5118-4580-a656-bf8c09700825) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '04a6123f-d8a9-46bd-bc05-c0f12017e993', 'volume_name': 'volume-04a6123f-d8a9-46bd-bc05-c0f12017e993', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:56:03 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-28e0d040-3584-4a78-a354-4e5745565bea tempest-CreateVolumesFromImageTest-1665643559 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3af85d29-099f-4509-ba43-2024dd51dcd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:56:03 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-28e0d040-3584-4a78-a354-4e5745565bea tempest-CreateVolumesFromImageTest-1665643559 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3af85d29-099f-4509-ba43-2024dd51dcd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:56:03 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-28e0d040-3584-4a78-a354-4e5745565bea tempest-CreateVolumesFromImageTest-1665643559 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (020f8ec7-72b1-4df0-b936-21860f0e43a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:56:03 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-28e0d040-3584-4a78-a354-4e5745565bea tempest-CreateVolumesFromImageTest-1665643559 None] Volume 04a6123f-d8a9-46bd-bc05-c0f12017e993: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-04a6123f-d8a9-46bd-bc05-c0f12017e993', 'volume_size': 1} Nov 06 11:56:03 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-28e0d040-3584-4a78-a354-4e5745565bea tempest-CreateVolumesFromImageTest-1665643559 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 11:56:03 devstack sudo[102423]: pam_unix(sudo:session): session closed for user root Nov 06 11:56:03 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-c6c2bc86-2a2e-4733-9c77-54547bd39798 tempest-CreateVolumesFromImageTest-1665643559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-9b89d289-e360-4dbc-9b72-eba1d2f35596 1073741824" returned: 0 in 0.756s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:56:03 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-c6c2bc86-2a2e-4733-9c77-54547bd39798 tempest-CreateVolumesFromImageTest-1665643559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-9b89d289-e360-4dbc-9b72-eba1d2f35596 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:56:03 devstack sudo[102429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-9b89d289-e360-4dbc-9b72-eba1d2f35596 Nov 06 11:56:03 devstack sudo[102429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:56:03 devstack cinder-volume[87116]: DEBUG cinder.volume.flows.manager.create_volume [None req-7f098eb9-84bc-4e7c-a55b-a320deba6a09 tempest-CreateVolumesFromImageTest-1665643559 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87116) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 11:56:03 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-7f098eb9-84bc-4e7c-a55b-a320deba6a09 tempest-CreateVolumesFromImageTest-1665643559 None] Flow 'volume_create_manager' (e6e1f2bf-de22-44db-a01b-fd2e58532677) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 11:56:03 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-7f098eb9-84bc-4e7c-a55b-a320deba6a09 tempest-CreateVolumesFromImageTest-1665643559 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c87506b1-7127-48ba-b2aa-074904d81009) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:56:03 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-7f098eb9-84bc-4e7c-a55b-a320deba6a09 tempest-CreateVolumesFromImageTest-1665643559 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c87506b1-7127-48ba-b2aa-074904d81009) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T10:56:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1612130148',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8ea8924a-5343-40ca-b4b9-8d8e129c05e3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bd6d36bdcbd448bfb7dc97783d31d163',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T10:56:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T10:56:04Z,use_quota=True,user_id='bba1fd78db734bd0bec7619ce421f36d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(34d3b144-d9b7-480a-a2e3-01e45f3d54c1),volume_type_id=34d3b144-d9b7-480a-a2e3-01e45f3d54c1)' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:56:03 devstack sudo[102429]: pam_unix(sudo:session): session closed for user root Nov 06 11:56:03 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-7f098eb9-84bc-4e7c-a55b-a320deba6a09 tempest-CreateVolumesFromImageTest-1665643559 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (98baef09-5161-49fa-bdf7-49559d257275) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:56:03 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-7f098eb9-84bc-4e7c-a55b-a320deba6a09 tempest-CreateVolumesFromImageTest-1665643559 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (98baef09-5161-49fa-bdf7-49559d257275) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:56:03 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-7f098eb9-84bc-4e7c-a55b-a320deba6a09 tempest-CreateVolumesFromImageTest-1665643559 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5e50061d-a764-4716-a513-5cc373240e82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:56:03 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-7f098eb9-84bc-4e7c-a55b-a320deba6a09 tempest-CreateVolumesFromImageTest-1665643559 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5e50061d-a764-4716-a513-5cc373240e82) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8ea8924a-5343-40ca-b4b9-8d8e129c05e3', 'volume_name': 'volume-8ea8924a-5343-40ca-b4b9-8d8e129c05e3', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:56:03 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-7f098eb9-84bc-4e7c-a55b-a320deba6a09 tempest-CreateVolumesFromImageTest-1665643559 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d3093ece-fc59-4bdd-bf5b-a6c09878b030) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:56:03 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-7f098eb9-84bc-4e7c-a55b-a320deba6a09 tempest-CreateVolumesFromImageTest-1665643559 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d3093ece-fc59-4bdd-bf5b-a6c09878b030) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:56:03 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-7f098eb9-84bc-4e7c-a55b-a320deba6a09 tempest-CreateVolumesFromImageTest-1665643559 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8e68cb50-0954-4c56-bbe9-63d831ef1a4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:56:03 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-7f098eb9-84bc-4e7c-a55b-a320deba6a09 tempest-CreateVolumesFromImageTest-1665643559 None] Volume 8ea8924a-5343-40ca-b4b9-8d8e129c05e3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8ea8924a-5343-40ca-b4b9-8d8e129c05e3', 'volume_size': 1} Nov 06 11:56:03 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-7f098eb9-84bc-4e7c-a55b-a320deba6a09 tempest-CreateVolumesFromImageTest-1665643559 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 11:56:04 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-c6c2bc86-2a2e-4733-9c77-54547bd39798 tempest-CreateVolumesFromImageTest-1665643559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-9b89d289-e360-4dbc-9b72-eba1d2f35596" returned: 0 in 0.440s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:56:04 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-c6c2bc86-2a2e-4733-9c77-54547bd39798 tempest-CreateVolumesFromImageTest-1665643559 None] <== create_volume: return (1282ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f'} {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 11:56:04 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-c6c2bc86-2a2e-4733-9c77-54547bd39798 tempest-CreateVolumesFromImageTest-1665643559 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.287s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 11:56:04 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-52fe24c8-2ef7-4ad5-9b7f-77111c8a7feb tempest-CreateVolumesFromImageTest-1665643559 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.299s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 11:56:04 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-52fe24c8-2ef7-4ad5-9b7f-77111c8a7feb tempest-CreateVolumesFromImageTest-1665643559 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T10:56:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1827056973',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b1811cf0-faa4-4ca2-8fd7-61f67b7d18e3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bd6d36bdcbd448bfb7dc97783d31d163',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T10:56:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T10:56:02Z,use_quota=True,user_id='bba1fd78db734bd0bec7619ce421f36d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(34d3b144-d9b7-480a-a2e3-01e45f3d54c1),volume_type_id=34d3b144-d9b7-480a-a2e3-01e45f3d54c1)}" {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 11:56:04 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-52fe24c8-2ef7-4ad5-9b7f-77111c8a7feb tempest-CreateVolumesFromImageTest-1665643559 None] Creating volume b1811cf0-faa4-4ca2-8fd7-61f67b7d18e3 {{(pid=87116) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 11:56:04 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-52fe24c8-2ef7-4ad5-9b7f-77111c8a7feb tempest-CreateVolumesFromImageTest-1665643559 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 11:56:04 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-52fe24c8-2ef7-4ad5-9b7f-77111c8a7feb tempest-CreateVolumesFromImageTest-1665643559 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 11:56:04 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-52fe24c8-2ef7-4ad5-9b7f-77111c8a7feb tempest-CreateVolumesFromImageTest-1665643559 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 11:56:04 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-52fe24c8-2ef7-4ad5-9b7f-77111c8a7feb tempest-CreateVolumesFromImageTest-1665643559 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 11:56:04 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-52fe24c8-2ef7-4ad5-9b7f-77111c8a7feb tempest-CreateVolumesFromImageTest-1665643559 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 11:56:04 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-52fe24c8-2ef7-4ad5-9b7f-77111c8a7feb tempest-CreateVolumesFromImageTest-1665643559 None] Selected osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f as target Quobyte volume. {{(pid=87116) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 11:56:04 devstack cinder-volume[87116]: INFO cinder.volume.drivers.remotefs [None req-52fe24c8-2ef7-4ad5-9b7f-77111c8a7feb tempest-CreateVolumesFromImageTest-1665643559 None] casted to osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f Nov 06 11:56:04 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-52fe24c8-2ef7-4ad5-9b7f-77111c8a7feb tempest-CreateVolumesFromImageTest-1665643559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-b1811cf0-faa4-4ca2-8fd7-61f67b7d18e3 1073741824 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:56:04 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-c6c2bc86-2a2e-4733-9c77-54547bd39798 tempest-CreateVolumesFromImageTest-1665643559 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ba23901-da58-4e32-9ea5-7f29763d8d90) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9b89d289-e360-4dbc-9b72-eba1d2f35596', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:56:04 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-c6c2bc86-2a2e-4733-9c77-54547bd39798 tempest-CreateVolumesFromImageTest-1665643559 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7173f9df-aebb-44bc-ac02-61a2d2e92276) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:56:04 devstack sudo[102433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-b1811cf0-faa4-4ca2-8fd7-61f67b7d18e3 1073741824 Nov 06 11:56:04 devstack sudo[102433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:56:04 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-c6c2bc86-2a2e-4733-9c77-54547bd39798 tempest-CreateVolumesFromImageTest-1665643559 None] Volume volume-9b89d289-e360-4dbc-9b72-eba1d2f35596 (9b89d289-e360-4dbc-9b72-eba1d2f35596): created successfully Nov 06 11:56:04 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-c6c2bc86-2a2e-4733-9c77-54547bd39798 tempest-CreateVolumesFromImageTest-1665643559 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7173f9df-aebb-44bc-ac02-61a2d2e92276) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:56:04 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-c6c2bc86-2a2e-4733-9c77-54547bd39798 tempest-CreateVolumesFromImageTest-1665643559 None] Flow 'volume_create_manager' (bf7a28ef-c5de-40d9-9690-400035124b44) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 11:56:04 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-c6c2bc86-2a2e-4733-9c77-54547bd39798 tempest-CreateVolumesFromImageTest-1665643559 None] Created volume successfully. Nov 06 11:56:04 devstack cinder-volume[87116]: DEBUG cinder.volume.flows.manager.create_volume [None req-bea82b96-5a9c-4207-86a3-3836b482149f tempest-VolumesSnapshotTestJSON-1873011056 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87116) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 11:56:04 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-bea82b96-5a9c-4207-86a3-3836b482149f tempest-VolumesSnapshotTestJSON-1873011056 None] Flow 'volume_create_manager' (bc0e8daf-d78b-4752-aef3-9d918d421c87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 11:56:04 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-bea82b96-5a9c-4207-86a3-3836b482149f tempest-VolumesSnapshotTestJSON-1873011056 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c2c38b78-f2bf-4469-8616-a82c3044afd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:56:04 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-bea82b96-5a9c-4207-86a3-3836b482149f tempest-VolumesSnapshotTestJSON-1873011056 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c2c38b78-f2bf-4469-8616-a82c3044afd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T10:56:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-198424884',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e429f0ec-80ae-461a-8eaf-d82cfc9e6ac6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3bf9e5851f734e6098653da76bb11005',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T10:56:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T10:56:04Z,use_quota=True,user_id='2346ada21cbb4d2b9cf86ef1315c49dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(34d3b144-d9b7-480a-a2e3-01e45f3d54c1),volume_type_id=34d3b144-d9b7-480a-a2e3-01e45f3d54c1)' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:56:04 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-bea82b96-5a9c-4207-86a3-3836b482149f tempest-VolumesSnapshotTestJSON-1873011056 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9878f56d-1b92-4e06-a4a2-5163a88775c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:56:04 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-bea82b96-5a9c-4207-86a3-3836b482149f tempest-VolumesSnapshotTestJSON-1873011056 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9878f56d-1b92-4e06-a4a2-5163a88775c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:56:04 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-bea82b96-5a9c-4207-86a3-3836b482149f tempest-VolumesSnapshotTestJSON-1873011056 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2d196016-a21f-4d9c-8d5b-91f8b1f8dfff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:56:04 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-bea82b96-5a9c-4207-86a3-3836b482149f tempest-VolumesSnapshotTestJSON-1873011056 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2d196016-a21f-4d9c-8d5b-91f8b1f8dfff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e429f0ec-80ae-461a-8eaf-d82cfc9e6ac6', 'volume_name': 'volume-e429f0ec-80ae-461a-8eaf-d82cfc9e6ac6', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:56:04 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-bea82b96-5a9c-4207-86a3-3836b482149f tempest-VolumesSnapshotTestJSON-1873011056 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7bb51a39-47ac-4a3d-86ad-b78d7186058f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:56:04 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-bea82b96-5a9c-4207-86a3-3836b482149f tempest-VolumesSnapshotTestJSON-1873011056 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7bb51a39-47ac-4a3d-86ad-b78d7186058f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:56:04 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-bea82b96-5a9c-4207-86a3-3836b482149f tempest-VolumesSnapshotTestJSON-1873011056 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7a7194d0-8107-439f-a2fa-35e7d2831c66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:56:04 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-bea82b96-5a9c-4207-86a3-3836b482149f tempest-VolumesSnapshotTestJSON-1873011056 None] Volume e429f0ec-80ae-461a-8eaf-d82cfc9e6ac6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e429f0ec-80ae-461a-8eaf-d82cfc9e6ac6', 'volume_size': 1} Nov 06 11:56:04 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-bea82b96-5a9c-4207-86a3-3836b482149f tempest-VolumesSnapshotTestJSON-1873011056 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 11:56:04 devstack sudo[102433]: pam_unix(sudo:session): session closed for user root Nov 06 11:56:04 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-52fe24c8-2ef7-4ad5-9b7f-77111c8a7feb tempest-CreateVolumesFromImageTest-1665643559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-b1811cf0-faa4-4ca2-8fd7-61f67b7d18e3 1073741824" returned: 0 in 0.620s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:56:04 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-52fe24c8-2ef7-4ad5-9b7f-77111c8a7feb tempest-CreateVolumesFromImageTest-1665643559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-b1811cf0-faa4-4ca2-8fd7-61f67b7d18e3 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:56:04 devstack sudo[102440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-b1811cf0-faa4-4ca2-8fd7-61f67b7d18e3 Nov 06 11:56:04 devstack sudo[102440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:56:05 devstack sudo[102440]: pam_unix(sudo:session): session closed for user root Nov 06 11:56:05 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-52fe24c8-2ef7-4ad5-9b7f-77111c8a7feb tempest-CreateVolumesFromImageTest-1665643559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-b1811cf0-faa4-4ca2-8fd7-61f67b7d18e3" returned: 0 in 0.315s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:56:05 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-52fe24c8-2ef7-4ad5-9b7f-77111c8a7feb tempest-CreateVolumesFromImageTest-1665643559 None] <== create_volume: return (1043ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f'} {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 11:56:05 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-52fe24c8-2ef7-4ad5-9b7f-77111c8a7feb tempest-CreateVolumesFromImageTest-1665643559 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.045s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 11:56:05 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-28e0d040-3584-4a78-a354-4e5745565bea tempest-CreateVolumesFromImageTest-1665643559 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.734s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 11:56:05 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-28e0d040-3584-4a78-a354-4e5745565bea tempest-CreateVolumesFromImageTest-1665643559 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T10:56:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1963954130',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=04a6123f-d8a9-46bd-bc05-c0f12017e993,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bd6d36bdcbd448bfb7dc97783d31d163',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T10:56:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T10:56:03Z,use_quota=True,user_id='bba1fd78db734bd0bec7619ce421f36d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(34d3b144-d9b7-480a-a2e3-01e45f3d54c1),volume_type_id=34d3b144-d9b7-480a-a2e3-01e45f3d54c1)}" {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 11:56:05 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-28e0d040-3584-4a78-a354-4e5745565bea tempest-CreateVolumesFromImageTest-1665643559 None] Creating volume 04a6123f-d8a9-46bd-bc05-c0f12017e993 {{(pid=87116) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 11:56:05 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-28e0d040-3584-4a78-a354-4e5745565bea tempest-CreateVolumesFromImageTest-1665643559 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 11:56:05 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-28e0d040-3584-4a78-a354-4e5745565bea tempest-CreateVolumesFromImageTest-1665643559 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 11:56:05 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-28e0d040-3584-4a78-a354-4e5745565bea tempest-CreateVolumesFromImageTest-1665643559 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 11:56:05 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-28e0d040-3584-4a78-a354-4e5745565bea tempest-CreateVolumesFromImageTest-1665643559 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 11:56:05 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-28e0d040-3584-4a78-a354-4e5745565bea tempest-CreateVolumesFromImageTest-1665643559 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 11:56:05 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-28e0d040-3584-4a78-a354-4e5745565bea tempest-CreateVolumesFromImageTest-1665643559 None] Selected osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f as target Quobyte volume. {{(pid=87116) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 11:56:05 devstack cinder-volume[87116]: INFO cinder.volume.drivers.remotefs [None req-28e0d040-3584-4a78-a354-4e5745565bea tempest-CreateVolumesFromImageTest-1665643559 None] casted to osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f Nov 06 11:56:05 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-28e0d040-3584-4a78-a354-4e5745565bea tempest-CreateVolumesFromImageTest-1665643559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-04a6123f-d8a9-46bd-bc05-c0f12017e993 1073741824 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:56:05 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-52fe24c8-2ef7-4ad5-9b7f-77111c8a7feb tempest-CreateVolumesFromImageTest-1665643559 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dd4d57b3-4f8f-4ee5-9f41-6c6fead368fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b1811cf0-faa4-4ca2-8fd7-61f67b7d18e3', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:56:05 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-52fe24c8-2ef7-4ad5-9b7f-77111c8a7feb tempest-CreateVolumesFromImageTest-1665643559 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (928dcdd4-658b-46e8-8feb-8cd213d8b30a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:56:05 devstack sudo[102443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-04a6123f-d8a9-46bd-bc05-c0f12017e993 1073741824 Nov 06 11:56:05 devstack sudo[102443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:56:05 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-52fe24c8-2ef7-4ad5-9b7f-77111c8a7feb tempest-CreateVolumesFromImageTest-1665643559 None] Volume volume-b1811cf0-faa4-4ca2-8fd7-61f67b7d18e3 (b1811cf0-faa4-4ca2-8fd7-61f67b7d18e3): created successfully Nov 06 11:56:05 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-52fe24c8-2ef7-4ad5-9b7f-77111c8a7feb tempest-CreateVolumesFromImageTest-1665643559 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (928dcdd4-658b-46e8-8feb-8cd213d8b30a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:56:05 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-52fe24c8-2ef7-4ad5-9b7f-77111c8a7feb tempest-CreateVolumesFromImageTest-1665643559 None] Flow 'volume_create_manager' (f6be2aae-1917-4e79-baca-5ae29a9f7087) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 11:56:05 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-52fe24c8-2ef7-4ad5-9b7f-77111c8a7feb tempest-CreateVolumesFromImageTest-1665643559 None] Created volume successfully. Nov 06 11:56:05 devstack sudo[102443]: pam_unix(sudo:session): session closed for user root Nov 06 11:56:05 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-28e0d040-3584-4a78-a354-4e5745565bea tempest-CreateVolumesFromImageTest-1665643559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-04a6123f-d8a9-46bd-bc05-c0f12017e993 1073741824" returned: 0 in 0.606s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:56:05 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-28e0d040-3584-4a78-a354-4e5745565bea tempest-CreateVolumesFromImageTest-1665643559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-04a6123f-d8a9-46bd-bc05-c0f12017e993 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:56:05 devstack sudo[102452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-04a6123f-d8a9-46bd-bc05-c0f12017e993 Nov 06 11:56:05 devstack sudo[102452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:56:06 devstack sudo[102452]: pam_unix(sudo:session): session closed for user root Nov 06 11:56:06 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-28e0d040-3584-4a78-a354-4e5745565bea tempest-CreateVolumesFromImageTest-1665643559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-04a6123f-d8a9-46bd-bc05-c0f12017e993" returned: 0 in 0.462s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:56:06 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-28e0d040-3584-4a78-a354-4e5745565bea tempest-CreateVolumesFromImageTest-1665643559 None] <== create_volume: return (1134ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f'} {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 11:56:06 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-28e0d040-3584-4a78-a354-4e5745565bea tempest-CreateVolumesFromImageTest-1665643559 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.141s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 11:56:06 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-7f098eb9-84bc-4e7c-a55b-a320deba6a09 tempest-CreateVolumesFromImageTest-1665643559 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.203s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 11:56:06 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-7f098eb9-84bc-4e7c-a55b-a320deba6a09 tempest-CreateVolumesFromImageTest-1665643559 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T10:56:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1612130148',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8ea8924a-5343-40ca-b4b9-8d8e129c05e3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bd6d36bdcbd448bfb7dc97783d31d163',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T10:56:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T10:56:04Z,use_quota=True,user_id='bba1fd78db734bd0bec7619ce421f36d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(34d3b144-d9b7-480a-a2e3-01e45f3d54c1),volume_type_id=34d3b144-d9b7-480a-a2e3-01e45f3d54c1)}" {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 11:56:06 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-7f098eb9-84bc-4e7c-a55b-a320deba6a09 tempest-CreateVolumesFromImageTest-1665643559 None] Creating volume 8ea8924a-5343-40ca-b4b9-8d8e129c05e3 {{(pid=87116) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 11:56:06 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-7f098eb9-84bc-4e7c-a55b-a320deba6a09 tempest-CreateVolumesFromImageTest-1665643559 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 11:56:06 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-7f098eb9-84bc-4e7c-a55b-a320deba6a09 tempest-CreateVolumesFromImageTest-1665643559 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 11:56:06 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-7f098eb9-84bc-4e7c-a55b-a320deba6a09 tempest-CreateVolumesFromImageTest-1665643559 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 11:56:06 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-7f098eb9-84bc-4e7c-a55b-a320deba6a09 tempest-CreateVolumesFromImageTest-1665643559 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 11:56:06 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-7f098eb9-84bc-4e7c-a55b-a320deba6a09 tempest-CreateVolumesFromImageTest-1665643559 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 11:56:06 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-7f098eb9-84bc-4e7c-a55b-a320deba6a09 tempest-CreateVolumesFromImageTest-1665643559 None] Selected osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f as target Quobyte volume. {{(pid=87116) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 11:56:06 devstack cinder-volume[87116]: INFO cinder.volume.drivers.remotefs [None req-7f098eb9-84bc-4e7c-a55b-a320deba6a09 tempest-CreateVolumesFromImageTest-1665643559 None] casted to osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f Nov 06 11:56:06 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-7f098eb9-84bc-4e7c-a55b-a320deba6a09 tempest-CreateVolumesFromImageTest-1665643559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-8ea8924a-5343-40ca-b4b9-8d8e129c05e3 1073741824 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:56:06 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-28e0d040-3584-4a78-a354-4e5745565bea tempest-CreateVolumesFromImageTest-1665643559 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (020f8ec7-72b1-4df0-b936-21860f0e43a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-04a6123f-d8a9-46bd-bc05-c0f12017e993', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:56:06 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-28e0d040-3584-4a78-a354-4e5745565bea tempest-CreateVolumesFromImageTest-1665643559 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b41f9d25-7687-4033-aa74-a0449cd438bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:56:06 devstack sudo[102455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-8ea8924a-5343-40ca-b4b9-8d8e129c05e3 1073741824 Nov 06 11:56:06 devstack sudo[102455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:56:06 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-28e0d040-3584-4a78-a354-4e5745565bea tempest-CreateVolumesFromImageTest-1665643559 None] Volume volume-04a6123f-d8a9-46bd-bc05-c0f12017e993 (04a6123f-d8a9-46bd-bc05-c0f12017e993): created successfully Nov 06 11:56:06 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-28e0d040-3584-4a78-a354-4e5745565bea tempest-CreateVolumesFromImageTest-1665643559 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b41f9d25-7687-4033-aa74-a0449cd438bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:56:06 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-28e0d040-3584-4a78-a354-4e5745565bea tempest-CreateVolumesFromImageTest-1665643559 None] Flow 'volume_create_manager' (f7a97ac4-975e-4f61-9021-042480397dee) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 11:56:06 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-28e0d040-3584-4a78-a354-4e5745565bea tempest-CreateVolumesFromImageTest-1665643559 None] Created volume successfully. Nov 06 11:56:06 devstack cinder-volume[87116]: INFO cinder.volume.manager [req-7d4d4ccb-691a-49fb-b2ef-31dd9e56007e req-9dd5bbd7-535d-4c28-a1e1-f39f81d3a992 tempest-TestMinimumBasicScenario-1835675095 None] Terminate volume connection completed successfully. Nov 06 11:56:06 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [req-7d4d4ccb-691a-49fb-b2ef-31dd9e56007e req-9dd5bbd7-535d-4c28-a1e1-f39f81d3a992 tempest-TestMinimumBasicScenario-1835675095 None] Deleting attachment 9b8ca8ca-7b65-444a-bc43-fcc791ae483d. {{(pid=87116) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 06 11:56:06 devstack sudo[102455]: pam_unix(sudo:session): session closed for user root Nov 06 11:56:06 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-7f098eb9-84bc-4e7c-a55b-a320deba6a09 tempest-CreateVolumesFromImageTest-1665643559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-8ea8924a-5343-40ca-b4b9-8d8e129c05e3 1073741824" returned: 0 in 0.651s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:56:06 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-7f098eb9-84bc-4e7c-a55b-a320deba6a09 tempest-CreateVolumesFromImageTest-1665643559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-8ea8924a-5343-40ca-b4b9-8d8e129c05e3 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:56:06 devstack sudo[102464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-8ea8924a-5343-40ca-b4b9-8d8e129c05e3 Nov 06 11:56:06 devstack sudo[102464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:56:07 devstack sudo[102464]: pam_unix(sudo:session): session closed for user root Nov 06 11:56:07 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-7f098eb9-84bc-4e7c-a55b-a320deba6a09 tempest-CreateVolumesFromImageTest-1665643559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-8ea8924a-5343-40ca-b4b9-8d8e129c05e3" returned: 0 in 0.299s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:56:07 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-7f098eb9-84bc-4e7c-a55b-a320deba6a09 tempest-CreateVolumesFromImageTest-1665643559 None] <== create_volume: return (998ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f'} {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 11:56:07 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-7f098eb9-84bc-4e7c-a55b-a320deba6a09 tempest-CreateVolumesFromImageTest-1665643559 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 11:56:07 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-bea82b96-5a9c-4207-86a3-3836b482149f tempest-VolumesSnapshotTestJSON-1873011056 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.855s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 11:56:07 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-bea82b96-5a9c-4207-86a3-3836b482149f tempest-VolumesSnapshotTestJSON-1873011056 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T10:56:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-198424884',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e429f0ec-80ae-461a-8eaf-d82cfc9e6ac6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3bf9e5851f734e6098653da76bb11005',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T10:56:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T10:56:04Z,use_quota=True,user_id='2346ada21cbb4d2b9cf86ef1315c49dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(34d3b144-d9b7-480a-a2e3-01e45f3d54c1),volume_type_id=34d3b144-d9b7-480a-a2e3-01e45f3d54c1)}" {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 11:56:07 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-bea82b96-5a9c-4207-86a3-3836b482149f tempest-VolumesSnapshotTestJSON-1873011056 None] Creating volume e429f0ec-80ae-461a-8eaf-d82cfc9e6ac6 {{(pid=87116) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 11:56:07 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-bea82b96-5a9c-4207-86a3-3836b482149f tempest-VolumesSnapshotTestJSON-1873011056 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 11:56:07 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-bea82b96-5a9c-4207-86a3-3836b482149f tempest-VolumesSnapshotTestJSON-1873011056 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 11:56:07 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-bea82b96-5a9c-4207-86a3-3836b482149f tempest-VolumesSnapshotTestJSON-1873011056 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 11:56:07 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-bea82b96-5a9c-4207-86a3-3836b482149f tempest-VolumesSnapshotTestJSON-1873011056 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 11:56:07 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-bea82b96-5a9c-4207-86a3-3836b482149f tempest-VolumesSnapshotTestJSON-1873011056 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 11:56:07 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-bea82b96-5a9c-4207-86a3-3836b482149f tempest-VolumesSnapshotTestJSON-1873011056 None] Selected osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f as target Quobyte volume. {{(pid=87116) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 11:56:07 devstack cinder-volume[87116]: INFO cinder.volume.drivers.remotefs [None req-bea82b96-5a9c-4207-86a3-3836b482149f tempest-VolumesSnapshotTestJSON-1873011056 None] casted to osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f Nov 06 11:56:07 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-bea82b96-5a9c-4207-86a3-3836b482149f tempest-VolumesSnapshotTestJSON-1873011056 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-e429f0ec-80ae-461a-8eaf-d82cfc9e6ac6 1073741824 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:56:07 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-7f098eb9-84bc-4e7c-a55b-a320deba6a09 tempest-CreateVolumesFromImageTest-1665643559 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8e68cb50-0954-4c56-bbe9-63d831ef1a4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8ea8924a-5343-40ca-b4b9-8d8e129c05e3', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:56:07 devstack sudo[102467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-e429f0ec-80ae-461a-8eaf-d82cfc9e6ac6 1073741824 Nov 06 11:56:07 devstack sudo[102467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:56:07 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-7f098eb9-84bc-4e7c-a55b-a320deba6a09 tempest-CreateVolumesFromImageTest-1665643559 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (73303ab8-0647-4217-bfed-857ead72cfea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:56:07 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-7f098eb9-84bc-4e7c-a55b-a320deba6a09 tempest-CreateVolumesFromImageTest-1665643559 None] Volume volume-8ea8924a-5343-40ca-b4b9-8d8e129c05e3 (8ea8924a-5343-40ca-b4b9-8d8e129c05e3): created successfully Nov 06 11:56:07 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-7f098eb9-84bc-4e7c-a55b-a320deba6a09 tempest-CreateVolumesFromImageTest-1665643559 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (73303ab8-0647-4217-bfed-857ead72cfea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:56:07 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-7f098eb9-84bc-4e7c-a55b-a320deba6a09 tempest-CreateVolumesFromImageTest-1665643559 None] Flow 'volume_create_manager' (e6e1f2bf-de22-44db-a01b-fd2e58532677) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 11:56:07 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-9729dd6d-4053-4d04-a4d1-10c55c52ada1 tempest-TestMinimumBasicScenario-1835675095 None] Acquiring lock "cinder-152f72a7-ed4e-4940-9668-1074ef10555b-delete_volume" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 11:56:07 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-7f098eb9-84bc-4e7c-a55b-a320deba6a09 tempest-CreateVolumesFromImageTest-1665643559 None] Created volume successfully. Nov 06 11:56:07 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-9729dd6d-4053-4d04-a4d1-10c55c52ada1 tempest-TestMinimumBasicScenario-1835675095 None] Lock "cinder-152f72a7-ed4e-4940-9668-1074ef10555b-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 11:56:07 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-9729dd6d-4053-4d04-a4d1-10c55c52ada1 tempest-TestMinimumBasicScenario-1835675095 None] Acquiring lock "cinder-quobyte-152f72a7-ed4e-4940-9668-1074ef10555b" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 11:56:07 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-9729dd6d-4053-4d04-a4d1-10c55c52ada1 tempest-TestMinimumBasicScenario-1835675095 None] Lock "cinder-quobyte-152f72a7-ed4e-4940-9668-1074ef10555b" acquired by "delete_volume" :: waited 0.021s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 11:56:07 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0a899ff-97b2-4284-83ad-e3c672271c07]: (4, 'qcow2') {{(pid=88420) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 11:56:07 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-9729dd6d-4053-4d04-a4d1-10c55c52ada1 tempest-TestMinimumBasicScenario-1835675095 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-152f72a7-ed4e-4940-9668-1074ef10555b {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:56:07 devstack sudo[102470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-152f72a7-ed4e-4940-9668-1074ef10555b Nov 06 11:56:07 devstack sudo[102470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:56:07 devstack sudo[102467]: pam_unix(sudo:session): session closed for user root Nov 06 11:56:07 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-bea82b96-5a9c-4207-86a3-3836b482149f tempest-VolumesSnapshotTestJSON-1873011056 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-e429f0ec-80ae-461a-8eaf-d82cfc9e6ac6 1073741824" returned: 0 in 0.515s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:56:07 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-bea82b96-5a9c-4207-86a3-3836b482149f tempest-VolumesSnapshotTestJSON-1873011056 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-e429f0ec-80ae-461a-8eaf-d82cfc9e6ac6 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:56:07 devstack sudo[102476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-e429f0ec-80ae-461a-8eaf-d82cfc9e6ac6 Nov 06 11:56:07 devstack sudo[102476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:56:07 devstack sudo[102470]: pam_unix(sudo:session): session closed for user root Nov 06 11:56:07 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-9729dd6d-4053-4d04-a4d1-10c55c52ada1 tempest-TestMinimumBasicScenario-1835675095 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-152f72a7-ed4e-4940-9668-1074ef10555b" returned: 0 in 0.396s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:56:07 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-9729dd6d-4053-4d04-a4d1-10c55c52ada1 tempest-TestMinimumBasicScenario-1835675095 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-152f72a7-ed4e-4940-9668-1074ef10555b {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:56:07 devstack sudo[102480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-152f72a7-ed4e-4940-9668-1074ef10555b Nov 06 11:56:07 devstack sudo[102480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:56:08 devstack sudo[102476]: pam_unix(sudo:session): session closed for user root Nov 06 11:56:08 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-bea82b96-5a9c-4207-86a3-3836b482149f tempest-VolumesSnapshotTestJSON-1873011056 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-e429f0ec-80ae-461a-8eaf-d82cfc9e6ac6" returned: 0 in 0.261s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:56:08 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-bea82b96-5a9c-4207-86a3-3836b482149f tempest-VolumesSnapshotTestJSON-1873011056 None] <== create_volume: return (826ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f'} {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 11:56:08 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-bea82b96-5a9c-4207-86a3-3836b482149f tempest-VolumesSnapshotTestJSON-1873011056 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.829s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 11:56:08 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-bea82b96-5a9c-4207-86a3-3836b482149f tempest-VolumesSnapshotTestJSON-1873011056 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7a7194d0-8107-439f-a2fa-35e7d2831c66) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e429f0ec-80ae-461a-8eaf-d82cfc9e6ac6', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:56:08 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-bea82b96-5a9c-4207-86a3-3836b482149f tempest-VolumesSnapshotTestJSON-1873011056 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f7ade108-cc9c-41a3-885e-3c04ac546db4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:56:08 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-bea82b96-5a9c-4207-86a3-3836b482149f tempest-VolumesSnapshotTestJSON-1873011056 None] Volume volume-e429f0ec-80ae-461a-8eaf-d82cfc9e6ac6 (e429f0ec-80ae-461a-8eaf-d82cfc9e6ac6): created successfully Nov 06 11:56:08 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-bea82b96-5a9c-4207-86a3-3836b482149f tempest-VolumesSnapshotTestJSON-1873011056 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f7ade108-cc9c-41a3-885e-3c04ac546db4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:56:08 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-bea82b96-5a9c-4207-86a3-3836b482149f tempest-VolumesSnapshotTestJSON-1873011056 None] Flow 'volume_create_manager' (bc0e8daf-d78b-4752-aef3-9d918d421c87) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 11:56:08 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-bea82b96-5a9c-4207-86a3-3836b482149f tempest-VolumesSnapshotTestJSON-1873011056 None] Created volume successfully. Nov 06 11:56:08 devstack sudo[102480]: pam_unix(sudo:session): session closed for user root Nov 06 11:56:08 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-9729dd6d-4053-4d04-a4d1-10c55c52ada1 tempest-TestMinimumBasicScenario-1835675095 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-152f72a7-ed4e-4940-9668-1074ef10555b" returned: 0 in 0.288s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:56:08 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-9729dd6d-4053-4d04-a4d1-10c55c52ada1 tempest-TestMinimumBasicScenario-1835675095 None] Lock "cinder-quobyte-152f72a7-ed4e-4940-9668-1074ef10555b" released by "delete_volume" :: held 0.738s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 11:56:08 devstack cinder-volume[87116]: DEBUG cinder.quota [None req-9729dd6d-4053-4d04-a4d1-10c55c52ada1 tempest-TestMinimumBasicScenario-1835675095 None] Created reservations ['68b24cc2-8142-45ef-9ec9-2f88bd0c74f6', '33741986-2cbc-47ac-8d63-398618565d09', '9f9b0831-072a-448e-94b7-6ccfbe4ab9ce', '5200e9f3-73bc-4c81-a774-d69623c5dbb8'] {{(pid=87116) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 11:56:08 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-9729dd6d-4053-4d04-a4d1-10c55c52ada1 tempest-TestMinimumBasicScenario-1835675095 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 11:56:08 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-9729dd6d-4053-4d04-a4d1-10c55c52ada1 tempest-TestMinimumBasicScenario-1835675095 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 11:56:08 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-9729dd6d-4053-4d04-a4d1-10c55c52ada1 tempest-TestMinimumBasicScenario-1835675095 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 11:56:08 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-9729dd6d-4053-4d04-a4d1-10c55c52ada1 tempest-TestMinimumBasicScenario-1835675095 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 11:56:08 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-9729dd6d-4053-4d04-a4d1-10c55c52ada1 tempest-TestMinimumBasicScenario-1835675095 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 11:56:08 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-9729dd6d-4053-4d04-a4d1-10c55c52ada1 tempest-TestMinimumBasicScenario-1835675095 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:56:08 devstack sudo[102484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756 Nov 06 11:56:08 devstack sudo[102484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:56:08 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-b183492a-d5f0-49c0-b33a-9456dce39403 tempest-CreateVolumesFromImageTest-1665643559 None] Acquiring lock "cinder-8ea8924a-5343-40ca-b4b9-8d8e129c05e3-delete_volume" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 11:56:08 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-b183492a-d5f0-49c0-b33a-9456dce39403 tempest-CreateVolumesFromImageTest-1665643559 None] Lock "cinder-8ea8924a-5343-40ca-b4b9-8d8e129c05e3-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 11:56:08 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-b183492a-d5f0-49c0-b33a-9456dce39403 tempest-CreateVolumesFromImageTest-1665643559 None] Acquiring lock "cinder-quobyte-8ea8924a-5343-40ca-b4b9-8d8e129c05e3" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 11:56:08 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-b183492a-d5f0-49c0-b33a-9456dce39403 tempest-CreateVolumesFromImageTest-1665643559 None] Lock "cinder-quobyte-8ea8924a-5343-40ca-b4b9-8d8e129c05e3" acquired by "delete_volume" :: waited 0.029s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 11:56:08 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[756f491a-1d38-4929-9706-3620ca1a12f3]: (4, 'qcow2') {{(pid=88420) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 11:56:08 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-b183492a-d5f0-49c0-b33a-9456dce39403 tempest-CreateVolumesFromImageTest-1665643559 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-8ea8924a-5343-40ca-b4b9-8d8e129c05e3 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:56:08 devstack sudo[102484]: pam_unix(sudo:session): session closed for user root Nov 06 11:56:08 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-9729dd6d-4053-4d04-a4d1-10c55c52ada1 tempest-TestMinimumBasicScenario-1835675095 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756" returned: 0 in 0.487s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:56:08 devstack cinder-volume[87116]: DEBUG cinder.manager [None req-9729dd6d-4053-4d04-a4d1-10c55c52ada1 tempest-TestMinimumBasicScenario-1835675095 None] Notifying Schedulers of capabilities ... {{(pid=87116) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 11:56:08 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-9729dd6d-4053-4d04-a4d1-10c55c52ada1 tempest-TestMinimumBasicScenario-1835675095 None] Deleted volume successfully. Nov 06 11:56:08 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-9729dd6d-4053-4d04-a4d1-10c55c52ada1 tempest-TestMinimumBasicScenario-1835675095 None] Lock "cinder-152f72a7-ed4e-4940-9668-1074ef10555b-delete_volume" released by "delete_volume" :: held 1.565s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 11:56:08 devstack sudo[102486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-8ea8924a-5343-40ca-b4b9-8d8e129c05e3 Nov 06 11:56:08 devstack sudo[102486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:56:09 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-500198f3-d1a5-42ea-af43-8d0f4c94cc17 tempest-VolumesSnapshotTestJSON-1873011056 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 11:56:09 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-500198f3-d1a5-42ea-af43-8d0f4c94cc17 tempest-VolumesSnapshotTestJSON-1873011056 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 11:56:09 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-500198f3-d1a5-42ea-af43-8d0f4c94cc17 tempest-VolumesSnapshotTestJSON-1873011056 None] Creating offline snapshot 848dedba-f889-4707-baf3-6898a60a414f of volume e429f0ec-80ae-461a-8eaf-d82cfc9e6ac6 {{(pid=87116) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 06 11:56:09 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[de13fe3d-ae8d-4928-bbca-fddb672691bb]: (4, 'qcow2') {{(pid=88420) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 11:56:09 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-500198f3-d1a5-42ea-af43-8d0f4c94cc17 tempest-VolumesSnapshotTestJSON-1873011056 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-e429f0ec-80ae-461a-8eaf-d82cfc9e6ac6 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:56:09 devstack sudo[102486]: pam_unix(sudo:session): session closed for user root Nov 06 11:56:09 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-b183492a-d5f0-49c0-b33a-9456dce39403 tempest-CreateVolumesFromImageTest-1665643559 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-8ea8924a-5343-40ca-b4b9-8d8e129c05e3" returned: 0 in 0.749s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:56:09 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-b183492a-d5f0-49c0-b33a-9456dce39403 tempest-CreateVolumesFromImageTest-1665643559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-8ea8924a-5343-40ca-b4b9-8d8e129c05e3 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:56:09 devstack sudo[102508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-8ea8924a-5343-40ca-b4b9-8d8e129c05e3 Nov 06 11:56:09 devstack sudo[102508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:56:09 devstack sudo[102506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-e429f0ec-80ae-461a-8eaf-d82cfc9e6ac6 Nov 06 11:56:09 devstack sudo[102506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:56:09 devstack sudo[102508]: pam_unix(sudo:session): session closed for user root Nov 06 11:56:09 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-b183492a-d5f0-49c0-b33a-9456dce39403 tempest-CreateVolumesFromImageTest-1665643559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-8ea8924a-5343-40ca-b4b9-8d8e129c05e3" returned: 0 in 0.411s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:56:09 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-b183492a-d5f0-49c0-b33a-9456dce39403 tempest-CreateVolumesFromImageTest-1665643559 None] Lock "cinder-quobyte-8ea8924a-5343-40ca-b4b9-8d8e129c05e3" released by "delete_volume" :: held 1.260s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 11:56:09 devstack cinder-volume[87116]: DEBUG cinder.quota [None req-b183492a-d5f0-49c0-b33a-9456dce39403 tempest-CreateVolumesFromImageTest-1665643559 None] Created reservations ['f759a818-f4df-4a82-a619-a96025d71188', '06de6cae-b3b0-4eac-8df6-594359a921e2', 'a4a7af0f-ef14-4f71-a06c-8e906f234144', 'b2d169fc-7696-4386-9e36-ecc189f54b99'] {{(pid=87116) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 11:56:09 devstack sudo[102506]: pam_unix(sudo:session): session closed for user root Nov 06 11:56:09 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-500198f3-d1a5-42ea-af43-8d0f4c94cc17 tempest-VolumesSnapshotTestJSON-1873011056 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-e429f0ec-80ae-461a-8eaf-d82cfc9e6ac6" returned: 0 in 0.637s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:56:09 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-500198f3-d1a5-42ea-af43-8d0f4c94cc17 tempest-VolumesSnapshotTestJSON-1873011056 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-e429f0ec-80ae-461a-8eaf-d82cfc9e6ac6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-e429f0ec-80ae-461a-8eaf-d82cfc9e6ac6.848dedba-f889-4707-baf3-6898a60a414f 1G {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:56:10 devstack sudo[102520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-e429f0ec-80ae-461a-8eaf-d82cfc9e6ac6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-e429f0ec-80ae-461a-8eaf-d82cfc9e6ac6.848dedba-f889-4707-baf3-6898a60a414f 1G Nov 06 11:56:10 devstack sudo[102520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:56:10 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-b183492a-d5f0-49c0-b33a-9456dce39403 tempest-CreateVolumesFromImageTest-1665643559 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 11:56:10 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-b183492a-d5f0-49c0-b33a-9456dce39403 tempest-CreateVolumesFromImageTest-1665643559 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 11:56:10 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-b183492a-d5f0-49c0-b33a-9456dce39403 tempest-CreateVolumesFromImageTest-1665643559 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 11:56:10 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-b183492a-d5f0-49c0-b33a-9456dce39403 tempest-CreateVolumesFromImageTest-1665643559 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 11:56:10 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-b183492a-d5f0-49c0-b33a-9456dce39403 tempest-CreateVolumesFromImageTest-1665643559 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 11:56:10 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-b183492a-d5f0-49c0-b33a-9456dce39403 tempest-CreateVolumesFromImageTest-1665643559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:56:10 devstack sudo[102522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756 Nov 06 11:56:10 devstack sudo[102522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:56:10 devstack sudo[102522]: pam_unix(sudo:session): session closed for user root Nov 06 11:56:10 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-b183492a-d5f0-49c0-b33a-9456dce39403 tempest-CreateVolumesFromImageTest-1665643559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756" returned: 0 in 0.438s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:56:10 devstack cinder-volume[87116]: DEBUG cinder.manager [None req-b183492a-d5f0-49c0-b33a-9456dce39403 tempest-CreateVolumesFromImageTest-1665643559 None] Notifying Schedulers of capabilities ... {{(pid=87116) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 11:56:10 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-b183492a-d5f0-49c0-b33a-9456dce39403 tempest-CreateVolumesFromImageTest-1665643559 None] Deleted volume successfully. Nov 06 11:56:10 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-b183492a-d5f0-49c0-b33a-9456dce39403 tempest-CreateVolumesFromImageTest-1665643559 None] Lock "cinder-8ea8924a-5343-40ca-b4b9-8d8e129c05e3-delete_volume" released by "delete_volume" :: held 2.128s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 11:56:10 devstack sudo[102520]: pam_unix(sudo:session): session closed for user root Nov 06 11:56:10 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-0edd70da-b5de-4b85-8846-c34aebf4e434 tempest-CreateVolumesFromImageTest-1665643559 None] Acquiring lock "cinder-04a6123f-d8a9-46bd-bc05-c0f12017e993-delete_volume" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 11:56:10 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-500198f3-d1a5-42ea-af43-8d0f4c94cc17 tempest-VolumesSnapshotTestJSON-1873011056 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-e429f0ec-80ae-461a-8eaf-d82cfc9e6ac6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-e429f0ec-80ae-461a-8eaf-d82cfc9e6ac6.848dedba-f889-4707-baf3-6898a60a414f 1G" returned: 0 in 0.831s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:56:10 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-500198f3-d1a5-42ea-af43-8d0f4c94cc17 tempest-VolumesSnapshotTestJSON-1873011056 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e429f0ec-80ae-461a-8eaf-d82cfc9e6ac6 -F qcow2 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-e429f0ec-80ae-461a-8eaf-d82cfc9e6ac6.848dedba-f889-4707-baf3-6898a60a414f {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:56:10 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-0edd70da-b5de-4b85-8846-c34aebf4e434 tempest-CreateVolumesFromImageTest-1665643559 None] Lock "cinder-04a6123f-d8a9-46bd-bc05-c0f12017e993-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 11:56:10 devstack sudo[102531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e429f0ec-80ae-461a-8eaf-d82cfc9e6ac6 -F qcow2 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-e429f0ec-80ae-461a-8eaf-d82cfc9e6ac6.848dedba-f889-4707-baf3-6898a60a414f Nov 06 11:56:10 devstack sudo[102531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:56:10 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-0edd70da-b5de-4b85-8846-c34aebf4e434 tempest-CreateVolumesFromImageTest-1665643559 None] Acquiring lock "cinder-quobyte-04a6123f-d8a9-46bd-bc05-c0f12017e993" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 11:56:10 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-0edd70da-b5de-4b85-8846-c34aebf4e434 tempest-CreateVolumesFromImageTest-1665643559 None] Lock "cinder-quobyte-04a6123f-d8a9-46bd-bc05-c0f12017e993" acquired by "delete_volume" :: waited 0.032s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 11:56:10 devstack cinder-volume[87116]: DEBUG cinder.volume.flows.manager.create_volume [None req-4924962b-e663-4509-9813-30b600d4b92e tempest-CreateVolumesFromSnapshotTest-1293587525 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87116) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 11:56:10 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-4924962b-e663-4509-9813-30b600d4b92e tempest-CreateVolumesFromSnapshotTest-1293587525 None] Flow 'volume_create_manager' (9872d6a8-c224-4d9c-8642-225cb1c5188e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 11:56:10 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-4924962b-e663-4509-9813-30b600d4b92e tempest-CreateVolumesFromSnapshotTest-1293587525 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a19eb5a-ae8e-416f-b7b9-5f835ca151e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:56:10 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[a17883d2-5513-405d-bb44-9e18a7a3a39f]: (4, 'qcow2') {{(pid=88420) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 11:56:10 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-0edd70da-b5de-4b85-8846-c34aebf4e434 tempest-CreateVolumesFromImageTest-1665643559 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-04a6123f-d8a9-46bd-bc05-c0f12017e993 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:56:11 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-4924962b-e663-4509-9813-30b600d4b92e tempest-CreateVolumesFromSnapshotTest-1293587525 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a19eb5a-ae8e-416f-b7b9-5f835ca151e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T10:56:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-493692077',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=56b47392-5f46-4396-934c-9477ffc90354,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='df4930ad1b4940eda7fad4b2a8f44c0f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T10:56:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T10:56:11Z,use_quota=True,user_id='9eddd86089bc4e90b3371666f9e7e370',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(34d3b144-d9b7-480a-a2e3-01e45f3d54c1),volume_type_id=34d3b144-d9b7-480a-a2e3-01e45f3d54c1)' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:56:11 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-4924962b-e663-4509-9813-30b600d4b92e tempest-CreateVolumesFromSnapshotTest-1293587525 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a7929da8-e4a4-428e-818d-59c7ada187cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:56:11 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-4924962b-e663-4509-9813-30b600d4b92e tempest-CreateVolumesFromSnapshotTest-1293587525 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a7929da8-e4a4-428e-818d-59c7ada187cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:56:11 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-4924962b-e663-4509-9813-30b600d4b92e tempest-CreateVolumesFromSnapshotTest-1293587525 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dbe7931f-0760-40dd-bf23-912fca35fd36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:56:11 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-4924962b-e663-4509-9813-30b600d4b92e tempest-CreateVolumesFromSnapshotTest-1293587525 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dbe7931f-0760-40dd-bf23-912fca35fd36) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '56b47392-5f46-4396-934c-9477ffc90354', 'volume_name': 'volume-56b47392-5f46-4396-934c-9477ffc90354', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:56:11 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-4924962b-e663-4509-9813-30b600d4b92e tempest-CreateVolumesFromSnapshotTest-1293587525 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8cc20ffd-b9d0-4830-9f10-2220fb5a685f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:56:11 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-4924962b-e663-4509-9813-30b600d4b92e tempest-CreateVolumesFromSnapshotTest-1293587525 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8cc20ffd-b9d0-4830-9f10-2220fb5a685f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:56:11 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-4924962b-e663-4509-9813-30b600d4b92e tempest-CreateVolumesFromSnapshotTest-1293587525 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2323c943-96f9-49bd-a494-1ae496952c65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:56:11 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-4924962b-e663-4509-9813-30b600d4b92e tempest-CreateVolumesFromSnapshotTest-1293587525 None] Volume 56b47392-5f46-4396-934c-9477ffc90354: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-56b47392-5f46-4396-934c-9477ffc90354', 'volume_size': 1} Nov 06 11:56:11 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-4924962b-e663-4509-9813-30b600d4b92e tempest-CreateVolumesFromSnapshotTest-1293587525 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 11:56:11 devstack sudo[102533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-04a6123f-d8a9-46bd-bc05-c0f12017e993 Nov 06 11:56:11 devstack sudo[102533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:56:11 devstack sudo[102531]: pam_unix(sudo:session): session closed for user root Nov 06 11:56:11 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-500198f3-d1a5-42ea-af43-8d0f4c94cc17 tempest-VolumesSnapshotTestJSON-1873011056 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e429f0ec-80ae-461a-8eaf-d82cfc9e6ac6 -F qcow2 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-e429f0ec-80ae-461a-8eaf-d82cfc9e6ac6.848dedba-f889-4707-baf3-6898a60a414f" returned: 0 in 0.373s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:56:11 devstack cinder-volume[87116]: WARNING cinder.volume.drivers.remotefs [None req-500198f3-d1a5-42ea-af43-8d0f4c94cc17 tempest-VolumesSnapshotTestJSON-1873011056 None] /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-e429f0ec-80ae-461a-8eaf-d82cfc9e6ac6.848dedba-f889-4707-baf3-6898a60a414f is being set with open permissions: ugo+rw Nov 06 11:56:11 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-500198f3-d1a5-42ea-af43-8d0f4c94cc17 tempest-VolumesSnapshotTestJSON-1873011056 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-e429f0ec-80ae-461a-8eaf-d82cfc9e6ac6.848dedba-f889-4707-baf3-6898a60a414f {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:56:11 devstack sudo[102538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-e429f0ec-80ae-461a-8eaf-d82cfc9e6ac6.848dedba-f889-4707-baf3-6898a60a414f Nov 06 11:56:11 devstack sudo[102538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:56:11 devstack sudo[102533]: pam_unix(sudo:session): session closed for user root Nov 06 11:56:11 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-0edd70da-b5de-4b85-8846-c34aebf4e434 tempest-CreateVolumesFromImageTest-1665643559 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-04a6123f-d8a9-46bd-bc05-c0f12017e993" returned: 0 in 0.406s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:56:11 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-0edd70da-b5de-4b85-8846-c34aebf4e434 tempest-CreateVolumesFromImageTest-1665643559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-04a6123f-d8a9-46bd-bc05-c0f12017e993 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:56:11 devstack sudo[102543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-04a6123f-d8a9-46bd-bc05-c0f12017e993 Nov 06 11:56:11 devstack sudo[102543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:56:11 devstack sudo[102538]: pam_unix(sudo:session): session closed for user root Nov 06 11:56:11 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-500198f3-d1a5-42ea-af43-8d0f4c94cc17 tempest-VolumesSnapshotTestJSON-1873011056 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-e429f0ec-80ae-461a-8eaf-d82cfc9e6ac6.848dedba-f889-4707-baf3-6898a60a414f" returned: 0 in 0.255s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:56:11 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-500198f3-d1a5-42ea-af43-8d0f4c94cc17 tempest-VolumesSnapshotTestJSON-1873011056 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-e429f0ec-80ae-461a-8eaf-d82cfc9e6ac6.info {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:56:11 devstack sudo[102546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-e429f0ec-80ae-461a-8eaf-d82cfc9e6ac6.info Nov 06 11:56:11 devstack sudo[102546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:56:11 devstack sudo[102543]: pam_unix(sudo:session): session closed for user root Nov 06 11:56:11 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-0edd70da-b5de-4b85-8846-c34aebf4e434 tempest-CreateVolumesFromImageTest-1665643559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-04a6123f-d8a9-46bd-bc05-c0f12017e993" returned: 0 in 0.255s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:56:11 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-0edd70da-b5de-4b85-8846-c34aebf4e434 tempest-CreateVolumesFromImageTest-1665643559 None] Lock "cinder-quobyte-04a6123f-d8a9-46bd-bc05-c0f12017e993" released by "delete_volume" :: held 0.749s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 11:56:11 devstack cinder-volume[87116]: DEBUG cinder.quota [None req-0edd70da-b5de-4b85-8846-c34aebf4e434 tempest-CreateVolumesFromImageTest-1665643559 None] Created reservations ['429614a1-aaae-460d-95f7-1f4e39927d7a', '156ff8e3-8d04-4a16-844f-80d35549c2fa', 'e60d2be6-429b-4821-bbde-0a1bdec217ba', '22a642ae-34e0-4360-b8a8-7d95a2ff83d9'] {{(pid=87116) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 11:56:11 devstack sudo[102546]: pam_unix(sudo:session): session closed for user root Nov 06 11:56:11 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-500198f3-d1a5-42ea-af43-8d0f4c94cc17 tempest-VolumesSnapshotTestJSON-1873011056 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-e429f0ec-80ae-461a-8eaf-d82cfc9e6ac6.info" returned: 0 in 0.272s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:56:11 devstack cinder-volume[87116]: WARNING cinder.volume.drivers.remotefs [None req-500198f3-d1a5-42ea-af43-8d0f4c94cc17 tempest-VolumesSnapshotTestJSON-1873011056 None] /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-e429f0ec-80ae-461a-8eaf-d82cfc9e6ac6.info is being set with open permissions: ugo+rw Nov 06 11:56:11 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-500198f3-d1a5-42ea-af43-8d0f4c94cc17 tempest-VolumesSnapshotTestJSON-1873011056 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-e429f0ec-80ae-461a-8eaf-d82cfc9e6ac6.info {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:56:11 devstack sudo[102550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-e429f0ec-80ae-461a-8eaf-d82cfc9e6ac6.info Nov 06 11:56:11 devstack sudo[102550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:56:11 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-0edd70da-b5de-4b85-8846-c34aebf4e434 tempest-CreateVolumesFromImageTest-1665643559 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 11:56:11 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-0edd70da-b5de-4b85-8846-c34aebf4e434 tempest-CreateVolumesFromImageTest-1665643559 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 11:56:11 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-0edd70da-b5de-4b85-8846-c34aebf4e434 tempest-CreateVolumesFromImageTest-1665643559 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 11:56:11 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-0edd70da-b5de-4b85-8846-c34aebf4e434 tempest-CreateVolumesFromImageTest-1665643559 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 11:56:11 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-0edd70da-b5de-4b85-8846-c34aebf4e434 tempest-CreateVolumesFromImageTest-1665643559 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 11:56:11 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-0edd70da-b5de-4b85-8846-c34aebf4e434 tempest-CreateVolumesFromImageTest-1665643559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:56:11 devstack sudo[102552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756 Nov 06 11:56:11 devstack sudo[102552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:56:12 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-2f587374-c2f4-421b-8ed8-b6129ea46c5e tempest-CreateVolumesFromImageTest-1665643559 None] Acquiring lock "cinder-b1811cf0-faa4-4ca2-8fd7-61f67b7d18e3-delete_volume" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 11:56:12 devstack sudo[102550]: pam_unix(sudo:session): session closed for user root Nov 06 11:56:12 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-500198f3-d1a5-42ea-af43-8d0f4c94cc17 tempest-VolumesSnapshotTestJSON-1873011056 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-e429f0ec-80ae-461a-8eaf-d82cfc9e6ac6.info" returned: 0 in 0.333s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:56:12 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-500198f3-d1a5-42ea-af43-8d0f4c94cc17 tempest-VolumesSnapshotTestJSON-1873011056 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.903s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 11:56:12 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-2f587374-c2f4-421b-8ed8-b6129ea46c5e tempest-CreateVolumesFromImageTest-1665643559 None] Lock "cinder-b1811cf0-faa4-4ca2-8fd7-61f67b7d18e3-delete_volume" acquired by "delete_volume" :: waited 0.064s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 11:56:12 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-4924962b-e663-4509-9813-30b600d4b92e tempest-CreateVolumesFromSnapshotTest-1293587525 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.067s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 11:56:12 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-4924962b-e663-4509-9813-30b600d4b92e tempest-CreateVolumesFromSnapshotTest-1293587525 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T10:56:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-493692077',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=56b47392-5f46-4396-934c-9477ffc90354,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='df4930ad1b4940eda7fad4b2a8f44c0f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T10:56:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T10:56:11Z,use_quota=True,user_id='9eddd86089bc4e90b3371666f9e7e370',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(34d3b144-d9b7-480a-a2e3-01e45f3d54c1),volume_type_id=34d3b144-d9b7-480a-a2e3-01e45f3d54c1)}" {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 11:56:12 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-4924962b-e663-4509-9813-30b600d4b92e tempest-CreateVolumesFromSnapshotTest-1293587525 None] Creating volume 56b47392-5f46-4396-934c-9477ffc90354 {{(pid=87116) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 11:56:12 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-4924962b-e663-4509-9813-30b600d4b92e tempest-CreateVolumesFromSnapshotTest-1293587525 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 11:56:12 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-4924962b-e663-4509-9813-30b600d4b92e tempest-CreateVolumesFromSnapshotTest-1293587525 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 11:56:12 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-4924962b-e663-4509-9813-30b600d4b92e tempest-CreateVolumesFromSnapshotTest-1293587525 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 11:56:12 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-4924962b-e663-4509-9813-30b600d4b92e tempest-CreateVolumesFromSnapshotTest-1293587525 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 11:56:12 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-4924962b-e663-4509-9813-30b600d4b92e tempest-CreateVolumesFromSnapshotTest-1293587525 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 11:56:12 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-4924962b-e663-4509-9813-30b600d4b92e tempest-CreateVolumesFromSnapshotTest-1293587525 None] Selected osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f as target Quobyte volume. {{(pid=87116) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 11:56:12 devstack cinder-volume[87116]: INFO cinder.volume.drivers.remotefs [None req-4924962b-e663-4509-9813-30b600d4b92e tempest-CreateVolumesFromSnapshotTest-1293587525 None] casted to osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f Nov 06 11:56:12 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-4924962b-e663-4509-9813-30b600d4b92e tempest-CreateVolumesFromSnapshotTest-1293587525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-56b47392-5f46-4396-934c-9477ffc90354 1073741824 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:56:12 devstack sudo[102552]: pam_unix(sudo:session): session closed for user root Nov 06 11:56:12 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-0edd70da-b5de-4b85-8846-c34aebf4e434 tempest-CreateVolumesFromImageTest-1665643559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756" returned: 0 in 0.326s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:56:12 devstack cinder-volume[87116]: DEBUG cinder.manager [None req-0edd70da-b5de-4b85-8846-c34aebf4e434 tempest-CreateVolumesFromImageTest-1665643559 None] Notifying Schedulers of capabilities ... {{(pid=87116) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 11:56:12 devstack sudo[102556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-56b47392-5f46-4396-934c-9477ffc90354 1073741824 Nov 06 11:56:12 devstack sudo[102556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:56:12 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-0edd70da-b5de-4b85-8846-c34aebf4e434 tempest-CreateVolumesFromImageTest-1665643559 None] Deleted volume successfully. Nov 06 11:56:12 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-2f587374-c2f4-421b-8ed8-b6129ea46c5e tempest-CreateVolumesFromImageTest-1665643559 None] Acquiring lock "cinder-quobyte-b1811cf0-faa4-4ca2-8fd7-61f67b7d18e3" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 11:56:12 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-0edd70da-b5de-4b85-8846-c34aebf4e434 tempest-CreateVolumesFromImageTest-1665643559 None] Lock "cinder-04a6123f-d8a9-46bd-bc05-c0f12017e993-delete_volume" released by "delete_volume" :: held 1.388s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 11:56:12 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-2f587374-c2f4-421b-8ed8-b6129ea46c5e tempest-CreateVolumesFromImageTest-1665643559 None] Lock "cinder-quobyte-b1811cf0-faa4-4ca2-8fd7-61f67b7d18e3" acquired by "delete_volume" :: waited 0.026s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 11:56:12 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-500198f3-d1a5-42ea-af43-8d0f4c94cc17 tempest-VolumesSnapshotTestJSON-1873011056 None] Create snapshot completed successfully Nov 06 11:56:12 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[84d9c976-338e-4cfb-9278-fe2796044da9]: (4, 'qcow2') {{(pid=88420) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 11:56:12 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-2f587374-c2f4-421b-8ed8-b6129ea46c5e tempest-CreateVolumesFromImageTest-1665643559 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-b1811cf0-faa4-4ca2-8fd7-61f67b7d18e3 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:56:12 devstack sudo[102558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-b1811cf0-faa4-4ca2-8fd7-61f67b7d18e3 Nov 06 11:56:12 devstack sudo[102558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:56:12 devstack sudo[102556]: pam_unix(sudo:session): session closed for user root Nov 06 11:56:12 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-4924962b-e663-4509-9813-30b600d4b92e tempest-CreateVolumesFromSnapshotTest-1293587525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-56b47392-5f46-4396-934c-9477ffc90354 1073741824" returned: 0 in 0.443s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:56:12 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-4924962b-e663-4509-9813-30b600d4b92e tempest-CreateVolumesFromSnapshotTest-1293587525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-56b47392-5f46-4396-934c-9477ffc90354 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:56:12 devstack sudo[102567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-56b47392-5f46-4396-934c-9477ffc90354 Nov 06 11:56:12 devstack sudo[102567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:56:12 devstack sudo[102558]: pam_unix(sudo:session): session closed for user root Nov 06 11:56:12 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-2f587374-c2f4-421b-8ed8-b6129ea46c5e tempest-CreateVolumesFromImageTest-1665643559 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-b1811cf0-faa4-4ca2-8fd7-61f67b7d18e3" returned: 0 in 0.408s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:56:12 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-2f587374-c2f4-421b-8ed8-b6129ea46c5e tempest-CreateVolumesFromImageTest-1665643559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-b1811cf0-faa4-4ca2-8fd7-61f67b7d18e3 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:56:12 devstack sudo[102570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-b1811cf0-faa4-4ca2-8fd7-61f67b7d18e3 Nov 06 11:56:12 devstack sudo[102570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:56:12 devstack sudo[102567]: pam_unix(sudo:session): session closed for user root Nov 06 11:56:12 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-4924962b-e663-4509-9813-30b600d4b92e tempest-CreateVolumesFromSnapshotTest-1293587525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-56b47392-5f46-4396-934c-9477ffc90354" returned: 0 in 0.281s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:56:12 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-4924962b-e663-4509-9813-30b600d4b92e tempest-CreateVolumesFromSnapshotTest-1293587525 None] <== create_volume: return (777ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f'} {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 11:56:12 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-4924962b-e663-4509-9813-30b600d4b92e tempest-CreateVolumesFromSnapshotTest-1293587525 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.780s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 11:56:12 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-4924962b-e663-4509-9813-30b600d4b92e tempest-CreateVolumesFromSnapshotTest-1293587525 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2323c943-96f9-49bd-a494-1ae496952c65) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-56b47392-5f46-4396-934c-9477ffc90354', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:56:12 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-4924962b-e663-4509-9813-30b600d4b92e tempest-CreateVolumesFromSnapshotTest-1293587525 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (279c1d2c-46a4-484d-aa3d-c7c71f6b3967) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:56:12 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-4924962b-e663-4509-9813-30b600d4b92e tempest-CreateVolumesFromSnapshotTest-1293587525 None] Volume volume-56b47392-5f46-4396-934c-9477ffc90354 (56b47392-5f46-4396-934c-9477ffc90354): created successfully Nov 06 11:56:12 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-4924962b-e663-4509-9813-30b600d4b92e tempest-CreateVolumesFromSnapshotTest-1293587525 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (279c1d2c-46a4-484d-aa3d-c7c71f6b3967) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:56:12 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-4924962b-e663-4509-9813-30b600d4b92e tempest-CreateVolumesFromSnapshotTest-1293587525 None] Flow 'volume_create_manager' (9872d6a8-c224-4d9c-8642-225cb1c5188e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 11:56:12 devstack sudo[102570]: pam_unix(sudo:session): session closed for user root Nov 06 11:56:12 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-2f587374-c2f4-421b-8ed8-b6129ea46c5e tempest-CreateVolumesFromImageTest-1665643559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-b1811cf0-faa4-4ca2-8fd7-61f67b7d18e3" returned: 0 in 0.274s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:56:12 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-4924962b-e663-4509-9813-30b600d4b92e tempest-CreateVolumesFromSnapshotTest-1293587525 None] Created volume successfully. Nov 06 11:56:12 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-2f587374-c2f4-421b-8ed8-b6129ea46c5e tempest-CreateVolumesFromImageTest-1665643559 None] Lock "cinder-quobyte-b1811cf0-faa4-4ca2-8fd7-61f67b7d18e3" released by "delete_volume" :: held 0.738s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 11:56:13 devstack cinder-volume[87116]: DEBUG cinder.quota [None req-2f587374-c2f4-421b-8ed8-b6129ea46c5e tempest-CreateVolumesFromImageTest-1665643559 None] Created reservations ['ab9f29d0-7a70-42d8-9ecd-f4a29add98c6', '737893d8-e7c4-49ec-9b54-50dccc4e052a', 'c4ebc28b-730a-4c02-b5a9-5ed1c70f6d74', '43b35133-abf8-4bde-9732-ec5a8bc0cf11'] {{(pid=87116) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 11:56:13 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-2f587374-c2f4-421b-8ed8-b6129ea46c5e tempest-CreateVolumesFromImageTest-1665643559 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 11:56:13 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-2f587374-c2f4-421b-8ed8-b6129ea46c5e tempest-CreateVolumesFromImageTest-1665643559 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 11:56:13 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-2f587374-c2f4-421b-8ed8-b6129ea46c5e tempest-CreateVolumesFromImageTest-1665643559 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 11:56:13 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-2f587374-c2f4-421b-8ed8-b6129ea46c5e tempest-CreateVolumesFromImageTest-1665643559 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 11:56:13 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-2f587374-c2f4-421b-8ed8-b6129ea46c5e tempest-CreateVolumesFromImageTest-1665643559 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 11:56:13 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-2f587374-c2f4-421b-8ed8-b6129ea46c5e tempest-CreateVolumesFromImageTest-1665643559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:56:13 devstack sudo[102574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756 Nov 06 11:56:13 devstack sudo[102574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:56:13 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-fe3d80fc-bf6f-4b6c-9c48-61612b46a995 tempest-CreateVolumesFromImageTest-1665643559 None] Acquiring lock "cinder-9b89d289-e360-4dbc-9b72-eba1d2f35596-delete_volume" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 11:56:13 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-fe3d80fc-bf6f-4b6c-9c48-61612b46a995 tempest-CreateVolumesFromImageTest-1665643559 None] Lock "cinder-9b89d289-e360-4dbc-9b72-eba1d2f35596-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 11:56:13 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-fe3d80fc-bf6f-4b6c-9c48-61612b46a995 tempest-CreateVolumesFromImageTest-1665643559 None] Acquiring lock "cinder-quobyte-9b89d289-e360-4dbc-9b72-eba1d2f35596" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 11:56:13 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-fe3d80fc-bf6f-4b6c-9c48-61612b46a995 tempest-CreateVolumesFromImageTest-1665643559 None] Lock "cinder-quobyte-9b89d289-e360-4dbc-9b72-eba1d2f35596" acquired by "delete_volume" :: waited 0.021s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 11:56:13 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d08abd1-eb3b-4c48-81d2-de87a24662d1]: (4, 'qcow2') {{(pid=88420) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 11:56:13 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-fe3d80fc-bf6f-4b6c-9c48-61612b46a995 tempest-CreateVolumesFromImageTest-1665643559 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-9b89d289-e360-4dbc-9b72-eba1d2f35596 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:56:13 devstack sudo[102574]: pam_unix(sudo:session): session closed for user root Nov 06 11:56:13 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-2f587374-c2f4-421b-8ed8-b6129ea46c5e tempest-CreateVolumesFromImageTest-1665643559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756" returned: 0 in 0.323s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:56:13 devstack cinder-volume[87116]: DEBUG cinder.manager [None req-2f587374-c2f4-421b-8ed8-b6129ea46c5e tempest-CreateVolumesFromImageTest-1665643559 None] Notifying Schedulers of capabilities ... {{(pid=87116) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 11:56:13 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-2f587374-c2f4-421b-8ed8-b6129ea46c5e tempest-CreateVolumesFromImageTest-1665643559 None] Deleted volume successfully. Nov 06 11:56:13 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-2f587374-c2f4-421b-8ed8-b6129ea46c5e tempest-CreateVolumesFromImageTest-1665643559 None] Lock "cinder-b1811cf0-faa4-4ca2-8fd7-61f67b7d18e3-delete_volume" released by "delete_volume" :: held 1.357s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 11:56:13 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-96e469b3-1dfe-4c8a-8bfc-51cfc4554aa8 tempest-VolumesSnapshotTestJSON-1873011056 None] Acquiring lock "cinder-848dedba-f889-4707-baf3-6898a60a414f-delete_snapshot" by "delete_snapshot" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 11:56:13 devstack sudo[102577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-9b89d289-e360-4dbc-9b72-eba1d2f35596 Nov 06 11:56:13 devstack sudo[102577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:56:13 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-96e469b3-1dfe-4c8a-8bfc-51cfc4554aa8 tempest-VolumesSnapshotTestJSON-1873011056 None] Lock "cinder-848dedba-f889-4707-baf3-6898a60a414f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.032s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 11:56:13 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-96e469b3-1dfe-4c8a-8bfc-51cfc4554aa8 tempest-VolumesSnapshotTestJSON-1873011056 None] Acquiring lock "cinder-quobyte-e429f0ec-80ae-461a-8eaf-d82cfc9e6ac6" by "delete_snapshot" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 11:56:13 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-96e469b3-1dfe-4c8a-8bfc-51cfc4554aa8 tempest-VolumesSnapshotTestJSON-1873011056 None] Lock "cinder-quobyte-e429f0ec-80ae-461a-8eaf-d82cfc9e6ac6" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 11:56:13 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-96e469b3-1dfe-4c8a-8bfc-51cfc4554aa8 tempest-VolumesSnapshotTestJSON-1873011056 None] Acquiring lock "cinder-quobyte-848dedba-f889-4707-baf3-6898a60a414f" by "_delete_snapshot" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 11:56:13 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-96e469b3-1dfe-4c8a-8bfc-51cfc4554aa8 tempest-VolumesSnapshotTestJSON-1873011056 None] Lock "cinder-quobyte-848dedba-f889-4707-baf3-6898a60a414f" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 11:56:13 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-96e469b3-1dfe-4c8a-8bfc-51cfc4554aa8 tempest-VolumesSnapshotTestJSON-1873011056 None] Deleting offline snapshot 848dedba-f889-4707-baf3-6898a60a414f of volume e429f0ec-80ae-461a-8eaf-d82cfc9e6ac6 {{(pid=87116) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 06 11:56:13 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-96e469b3-1dfe-4c8a-8bfc-51cfc4554aa8 tempest-VolumesSnapshotTestJSON-1873011056 None] snapshot_file for this snap is: volume-e429f0ec-80ae-461a-8eaf-d82cfc9e6ac6.848dedba-f889-4707-baf3-6898a60a414f {{(pid=87116) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 06 11:56:13 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ef92e24-ec21-4239-845d-45d3dda22e90]: (4, 'qcow2') {{(pid=88420) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 11:56:13 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-96e469b3-1dfe-4c8a-8bfc-51cfc4554aa8 tempest-VolumesSnapshotTestJSON-1873011056 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-e429f0ec-80ae-461a-8eaf-d82cfc9e6ac6.848dedba-f889-4707-baf3-6898a60a414f {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:56:13 devstack sudo[102579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-e429f0ec-80ae-461a-8eaf-d82cfc9e6ac6.848dedba-f889-4707-baf3-6898a60a414f Nov 06 11:56:13 devstack sudo[102579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:56:13 devstack sudo[102577]: pam_unix(sudo:session): session closed for user root Nov 06 11:56:13 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-fe3d80fc-bf6f-4b6c-9c48-61612b46a995 tempest-CreateVolumesFromImageTest-1665643559 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-9b89d289-e360-4dbc-9b72-eba1d2f35596" returned: 0 in 0.460s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:56:13 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-fe3d80fc-bf6f-4b6c-9c48-61612b46a995 tempest-CreateVolumesFromImageTest-1665643559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-9b89d289-e360-4dbc-9b72-eba1d2f35596 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:56:13 devstack sudo[102584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-9b89d289-e360-4dbc-9b72-eba1d2f35596 Nov 06 11:56:13 devstack sudo[102584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:56:14 devstack sudo[102584]: pam_unix(sudo:session): session closed for user root Nov 06 11:56:14 devstack sudo[102579]: pam_unix(sudo:session): session closed for user root Nov 06 11:56:14 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-fe3d80fc-bf6f-4b6c-9c48-61612b46a995 tempest-CreateVolumesFromImageTest-1665643559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-9b89d289-e360-4dbc-9b72-eba1d2f35596" returned: 0 in 0.268s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:56:14 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-96e469b3-1dfe-4c8a-8bfc-51cfc4554aa8 tempest-VolumesSnapshotTestJSON-1873011056 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-e429f0ec-80ae-461a-8eaf-d82cfc9e6ac6.848dedba-f889-4707-baf3-6898a60a414f" returned: 0 in 0.414s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:56:14 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-96e469b3-1dfe-4c8a-8bfc-51cfc4554aa8 tempest-VolumesSnapshotTestJSON-1873011056 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e429f0ec-80ae-461a-8eaf-d82cfc9e6ac6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87116) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 11:56:14 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-fe3d80fc-bf6f-4b6c-9c48-61612b46a995 tempest-CreateVolumesFromImageTest-1665643559 None] Lock "cinder-quobyte-9b89d289-e360-4dbc-9b72-eba1d2f35596" released by "delete_volume" :: held 0.825s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 11:56:14 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[31223ca1-2ea2-440f-8add-132beb1640d4]: (4, 'qcow2') {{(pid=88420) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 11:56:14 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-96e469b3-1dfe-4c8a-8bfc-51cfc4554aa8 tempest-VolumesSnapshotTestJSON-1873011056 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-e429f0ec-80ae-461a-8eaf-d82cfc9e6ac6 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:56:14 devstack cinder-volume[87116]: DEBUG cinder.quota [None req-fe3d80fc-bf6f-4b6c-9c48-61612b46a995 tempest-CreateVolumesFromImageTest-1665643559 None] Created reservations ['cbc3f77e-6eb7-46a2-935a-cd19b65ea4d1', '0a37af82-3813-4303-ac22-87a28974a55c', '693bd90e-1018-4079-b784-dc7ebccc6efe', 'ba24dc99-a032-429e-a4ec-7e1358ac89ee'] {{(pid=87116) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 11:56:14 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-5e6a5390-9f38-4139-977d-8e8c2ed00fc1 tempest-CreateVolumesFromSnapshotTest-1293587525 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 11:56:14 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-5e6a5390-9f38-4139-977d-8e8c2ed00fc1 tempest-CreateVolumesFromSnapshotTest-1293587525 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 11:56:14 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-5e6a5390-9f38-4139-977d-8e8c2ed00fc1 tempest-CreateVolumesFromSnapshotTest-1293587525 None] Creating offline snapshot 373327f7-e9f7-43dc-a12e-8d9b63440a62 of volume 56b47392-5f46-4396-934c-9477ffc90354 {{(pid=87116) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 06 11:56:14 devstack sudo[102590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-e429f0ec-80ae-461a-8eaf-d82cfc9e6ac6 Nov 06 11:56:14 devstack sudo[102590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:56:14 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fff0bcf-aa21-42e3-823a-64e547af1e3a]: (4, 'qcow2') {{(pid=88420) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 11:56:14 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-5e6a5390-9f38-4139-977d-8e8c2ed00fc1 tempest-CreateVolumesFromSnapshotTest-1293587525 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-56b47392-5f46-4396-934c-9477ffc90354 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:56:14 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-fe3d80fc-bf6f-4b6c-9c48-61612b46a995 tempest-CreateVolumesFromImageTest-1665643559 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 11:56:14 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-fe3d80fc-bf6f-4b6c-9c48-61612b46a995 tempest-CreateVolumesFromImageTest-1665643559 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 11:56:14 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-fe3d80fc-bf6f-4b6c-9c48-61612b46a995 tempest-CreateVolumesFromImageTest-1665643559 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 11:56:14 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-fe3d80fc-bf6f-4b6c-9c48-61612b46a995 tempest-CreateVolumesFromImageTest-1665643559 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 11:56:14 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-fe3d80fc-bf6f-4b6c-9c48-61612b46a995 tempest-CreateVolumesFromImageTest-1665643559 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 11:56:14 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-fe3d80fc-bf6f-4b6c-9c48-61612b46a995 tempest-CreateVolumesFromImageTest-1665643559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:56:14 devstack sudo[102594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756 Nov 06 11:56:14 devstack sudo[102594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:56:14 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-3c8bd5ea-1e1a-46ed-a1f0-c51739a30e0e tempest-CreateVolumesFromImageTest-1665643559 None] Acquiring lock "cinder-5a967410-6f34-4282-acc4-db9b5fe72257-delete_volume" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 11:56:14 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-3c8bd5ea-1e1a-46ed-a1f0-c51739a30e0e tempest-CreateVolumesFromImageTest-1665643559 None] Lock "cinder-5a967410-6f34-4282-acc4-db9b5fe72257-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 11:56:14 devstack sudo[102593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-56b47392-5f46-4396-934c-9477ffc90354 Nov 06 11:56:14 devstack sudo[102593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:56:14 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-3c8bd5ea-1e1a-46ed-a1f0-c51739a30e0e tempest-CreateVolumesFromImageTest-1665643559 None] Acquiring lock "cinder-quobyte-5a967410-6f34-4282-acc4-db9b5fe72257" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 11:56:14 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-3c8bd5ea-1e1a-46ed-a1f0-c51739a30e0e tempest-CreateVolumesFromImageTest-1665643559 None] Lock "cinder-quobyte-5a967410-6f34-4282-acc4-db9b5fe72257" acquired by "delete_volume" :: waited 0.031s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 11:56:14 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[df3618db-77ff-4dd8-98fd-c4c91292cd1a]: (4, 'qcow2') {{(pid=88420) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 11:56:14 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-3c8bd5ea-1e1a-46ed-a1f0-c51739a30e0e tempest-CreateVolumesFromImageTest-1665643559 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-5a967410-6f34-4282-acc4-db9b5fe72257 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:56:14 devstack sudo[102590]: pam_unix(sudo:session): session closed for user root Nov 06 11:56:14 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-96e469b3-1dfe-4c8a-8bfc-51cfc4554aa8 tempest-VolumesSnapshotTestJSON-1873011056 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-e429f0ec-80ae-461a-8eaf-d82cfc9e6ac6" returned: 0 in 0.621s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:56:14 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-96e469b3-1dfe-4c8a-8bfc-51cfc4554aa8 tempest-VolumesSnapshotTestJSON-1873011056 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-e429f0ec-80ae-461a-8eaf-d82cfc9e6ac6.848dedba-f889-4707-baf3-6898a60a414f {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:56:14 devstack sudo[102601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-e429f0ec-80ae-461a-8eaf-d82cfc9e6ac6.848dedba-f889-4707-baf3-6898a60a414f Nov 06 11:56:14 devstack sudo[102601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:56:14 devstack sudo[102594]: pam_unix(sudo:session): session closed for user root Nov 06 11:56:14 devstack sudo[102600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-5a967410-6f34-4282-acc4-db9b5fe72257 Nov 06 11:56:14 devstack sudo[102600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:56:14 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-fe3d80fc-bf6f-4b6c-9c48-61612b46a995 tempest-CreateVolumesFromImageTest-1665643559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756" returned: 0 in 0.443s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:56:14 devstack cinder-volume[87116]: DEBUG cinder.manager [None req-fe3d80fc-bf6f-4b6c-9c48-61612b46a995 tempest-CreateVolumesFromImageTest-1665643559 None] Notifying Schedulers of capabilities ... {{(pid=87116) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 11:56:14 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-fe3d80fc-bf6f-4b6c-9c48-61612b46a995 tempest-CreateVolumesFromImageTest-1665643559 None] Deleted volume successfully. Nov 06 11:56:14 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-fe3d80fc-bf6f-4b6c-9c48-61612b46a995 tempest-CreateVolumesFromImageTest-1665643559 None] Lock "cinder-9b89d289-e360-4dbc-9b72-eba1d2f35596-delete_volume" released by "delete_volume" :: held 1.662s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 11:56:14 devstack sudo[102593]: pam_unix(sudo:session): session closed for user root Nov 06 11:56:14 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-5e6a5390-9f38-4139-977d-8e8c2ed00fc1 tempest-CreateVolumesFromSnapshotTest-1293587525 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-56b47392-5f46-4396-934c-9477ffc90354" returned: 0 in 0.598s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:56:14 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-5e6a5390-9f38-4139-977d-8e8c2ed00fc1 tempest-CreateVolumesFromSnapshotTest-1293587525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-56b47392-5f46-4396-934c-9477ffc90354,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-56b47392-5f46-4396-934c-9477ffc90354.373327f7-e9f7-43dc-a12e-8d9b63440a62 1G {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:56:14 devstack sudo[102608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-56b47392-5f46-4396-934c-9477ffc90354,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-56b47392-5f46-4396-934c-9477ffc90354.373327f7-e9f7-43dc-a12e-8d9b63440a62 1G Nov 06 11:56:14 devstack sudo[102608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:56:15 devstack sudo[102600]: pam_unix(sudo:session): session closed for user root Nov 06 11:56:15 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-3c8bd5ea-1e1a-46ed-a1f0-c51739a30e0e tempest-CreateVolumesFromImageTest-1665643559 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-5a967410-6f34-4282-acc4-db9b5fe72257" returned: 0 in 0.452s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:56:15 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-3c8bd5ea-1e1a-46ed-a1f0-c51739a30e0e tempest-CreateVolumesFromImageTest-1665643559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-5a967410-6f34-4282-acc4-db9b5fe72257 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:56:15 devstack sudo[102617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-5a967410-6f34-4282-acc4-db9b5fe72257 Nov 06 11:56:15 devstack sudo[102617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:56:15 devstack sudo[102601]: pam_unix(sudo:session): session closed for user root Nov 06 11:56:15 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-96e469b3-1dfe-4c8a-8bfc-51cfc4554aa8 tempest-VolumesSnapshotTestJSON-1873011056 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-e429f0ec-80ae-461a-8eaf-d82cfc9e6ac6.848dedba-f889-4707-baf3-6898a60a414f" returned: 0 in 0.447s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:56:15 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-96e469b3-1dfe-4c8a-8bfc-51cfc4554aa8 tempest-VolumesSnapshotTestJSON-1873011056 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-e429f0ec-80ae-461a-8eaf-d82cfc9e6ac6.848dedba-f889-4707-baf3-6898a60a414f {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:56:15 devstack sudo[102622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-e429f0ec-80ae-461a-8eaf-d82cfc9e6ac6.848dedba-f889-4707-baf3-6898a60a414f Nov 06 11:56:15 devstack sudo[102622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:56:15 devstack sudo[102608]: pam_unix(sudo:session): session closed for user root Nov 06 11:56:15 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-5e6a5390-9f38-4139-977d-8e8c2ed00fc1 tempest-CreateVolumesFromSnapshotTest-1293587525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-56b47392-5f46-4396-934c-9477ffc90354,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-56b47392-5f46-4396-934c-9477ffc90354.373327f7-e9f7-43dc-a12e-8d9b63440a62 1G" returned: 0 in 0.479s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:56:15 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-5e6a5390-9f38-4139-977d-8e8c2ed00fc1 tempest-CreateVolumesFromSnapshotTest-1293587525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-56b47392-5f46-4396-934c-9477ffc90354 -F qcow2 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-56b47392-5f46-4396-934c-9477ffc90354.373327f7-e9f7-43dc-a12e-8d9b63440a62 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:56:15 devstack sudo[102617]: pam_unix(sudo:session): session closed for user root Nov 06 11:56:15 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-3c8bd5ea-1e1a-46ed-a1f0-c51739a30e0e tempest-CreateVolumesFromImageTest-1665643559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-5a967410-6f34-4282-acc4-db9b5fe72257" returned: 0 in 0.296s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:56:15 devstack sudo[102625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-56b47392-5f46-4396-934c-9477ffc90354 -F qcow2 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-56b47392-5f46-4396-934c-9477ffc90354.373327f7-e9f7-43dc-a12e-8d9b63440a62 Nov 06 11:56:15 devstack sudo[102625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:56:15 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-3c8bd5ea-1e1a-46ed-a1f0-c51739a30e0e tempest-CreateVolumesFromImageTest-1665643559 None] Lock "cinder-quobyte-5a967410-6f34-4282-acc4-db9b5fe72257" released by "delete_volume" :: held 0.820s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 11:56:15 devstack sudo[102622]: pam_unix(sudo:session): session closed for user root Nov 06 11:56:15 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-96e469b3-1dfe-4c8a-8bfc-51cfc4554aa8 tempest-VolumesSnapshotTestJSON-1873011056 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-e429f0ec-80ae-461a-8eaf-d82cfc9e6ac6.848dedba-f889-4707-baf3-6898a60a414f" returned: 0 in 0.310s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:56:15 devstack cinder-volume[87116]: DEBUG cinder.quota [None req-3c8bd5ea-1e1a-46ed-a1f0-c51739a30e0e tempest-CreateVolumesFromImageTest-1665643559 None] Created reservations ['637efe96-e65d-4cea-9dda-aee6e42001d7', '95e6533f-a11c-415f-a838-483c1ae608cb', 'a7a72950-7267-4921-a190-1ca25454fbc7', '96543d7e-d902-49e2-b4cb-bdeb5d59ca5d'] {{(pid=87116) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 11:56:15 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-96e469b3-1dfe-4c8a-8bfc-51cfc4554aa8 tempest-VolumesSnapshotTestJSON-1873011056 None] Lock "cinder-quobyte-848dedba-f889-4707-baf3-6898a60a414f" released by "_delete_snapshot" :: held 1.939s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 11:56:15 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-96e469b3-1dfe-4c8a-8bfc-51cfc4554aa8 tempest-VolumesSnapshotTestJSON-1873011056 None] Lock "cinder-quobyte-e429f0ec-80ae-461a-8eaf-d82cfc9e6ac6" released by "delete_snapshot" :: held 1.973s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 11:56:15 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-3c8bd5ea-1e1a-46ed-a1f0-c51739a30e0e tempest-CreateVolumesFromImageTest-1665643559 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 11:56:15 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-3c8bd5ea-1e1a-46ed-a1f0-c51739a30e0e tempest-CreateVolumesFromImageTest-1665643559 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 11:56:15 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-3c8bd5ea-1e1a-46ed-a1f0-c51739a30e0e tempest-CreateVolumesFromImageTest-1665643559 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 11:56:15 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-3c8bd5ea-1e1a-46ed-a1f0-c51739a30e0e tempest-CreateVolumesFromImageTest-1665643559 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 11:56:15 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-3c8bd5ea-1e1a-46ed-a1f0-c51739a30e0e tempest-CreateVolumesFromImageTest-1665643559 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 11:56:15 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-3c8bd5ea-1e1a-46ed-a1f0-c51739a30e0e tempest-CreateVolumesFromImageTest-1665643559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:56:15 devstack sudo[102628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756 Nov 06 11:56:15 devstack sudo[102628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:56:15 devstack cinder-volume[87116]: DEBUG cinder.quota [None req-96e469b3-1dfe-4c8a-8bfc-51cfc4554aa8 tempest-VolumesSnapshotTestJSON-1873011056 None] Created reservations ['9e197389-d34c-4e3b-970c-8999bec9f196', '891a6877-e887-47ff-ba4d-71beb175fb6e', '6e47e3d3-cfbc-4d6f-a928-c7bba1355c2b', '1d2b7548-4fe0-41b4-a84b-48ef53586a56'] {{(pid=87116) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 11:56:15 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-96e469b3-1dfe-4c8a-8bfc-51cfc4554aa8 tempest-VolumesSnapshotTestJSON-1873011056 None] Delete snapshot completed successfully. Nov 06 11:56:15 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-96e469b3-1dfe-4c8a-8bfc-51cfc4554aa8 tempest-VolumesSnapshotTestJSON-1873011056 None] Lock "cinder-848dedba-f889-4707-baf3-6898a60a414f-delete_snapshot" released by "delete_snapshot" :: held 2.302s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 11:56:15 devstack sudo[102625]: pam_unix(sudo:session): session closed for user root Nov 06 11:56:15 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-5e6a5390-9f38-4139-977d-8e8c2ed00fc1 tempest-CreateVolumesFromSnapshotTest-1293587525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-56b47392-5f46-4396-934c-9477ffc90354 -F qcow2 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-56b47392-5f46-4396-934c-9477ffc90354.373327f7-e9f7-43dc-a12e-8d9b63440a62" returned: 0 in 0.473s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:56:15 devstack cinder-volume[87116]: WARNING cinder.volume.drivers.remotefs [None req-5e6a5390-9f38-4139-977d-8e8c2ed00fc1 tempest-CreateVolumesFromSnapshotTest-1293587525 None] /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-56b47392-5f46-4396-934c-9477ffc90354.373327f7-e9f7-43dc-a12e-8d9b63440a62 is being set with open permissions: ugo+rw Nov 06 11:56:15 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-5e6a5390-9f38-4139-977d-8e8c2ed00fc1 tempest-CreateVolumesFromSnapshotTest-1293587525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-56b47392-5f46-4396-934c-9477ffc90354.373327f7-e9f7-43dc-a12e-8d9b63440a62 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:56:15 devstack sudo[102633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-56b47392-5f46-4396-934c-9477ffc90354.373327f7-e9f7-43dc-a12e-8d9b63440a62 Nov 06 11:56:15 devstack sudo[102633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:56:16 devstack sudo[102628]: pam_unix(sudo:session): session closed for user root Nov 06 11:56:16 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-3c8bd5ea-1e1a-46ed-a1f0-c51739a30e0e tempest-CreateVolumesFromImageTest-1665643559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756" returned: 0 in 0.305s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:56:16 devstack cinder-volume[87116]: DEBUG cinder.manager [None req-3c8bd5ea-1e1a-46ed-a1f0-c51739a30e0e tempest-CreateVolumesFromImageTest-1665643559 None] Notifying Schedulers of capabilities ... {{(pid=87116) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 11:56:16 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-3c8bd5ea-1e1a-46ed-a1f0-c51739a30e0e tempest-CreateVolumesFromImageTest-1665643559 None] Deleted volume successfully. Nov 06 11:56:16 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-3c8bd5ea-1e1a-46ed-a1f0-c51739a30e0e tempest-CreateVolumesFromImageTest-1665643559 None] Lock "cinder-5a967410-6f34-4282-acc4-db9b5fe72257-delete_volume" released by "delete_volume" :: held 1.507s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 11:56:16 devstack sudo[102633]: pam_unix(sudo:session): session closed for user root Nov 06 11:56:16 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-5e6a5390-9f38-4139-977d-8e8c2ed00fc1 tempest-CreateVolumesFromSnapshotTest-1293587525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-56b47392-5f46-4396-934c-9477ffc90354.373327f7-e9f7-43dc-a12e-8d9b63440a62" returned: 0 in 0.259s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:56:16 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-5e6a5390-9f38-4139-977d-8e8c2ed00fc1 tempest-CreateVolumesFromSnapshotTest-1293587525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-56b47392-5f46-4396-934c-9477ffc90354.info {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:56:16 devstack sudo[102637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-56b47392-5f46-4396-934c-9477ffc90354.info Nov 06 11:56:16 devstack sudo[102637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:56:16 devstack sudo[102637]: pam_unix(sudo:session): session closed for user root Nov 06 11:56:16 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-5e6a5390-9f38-4139-977d-8e8c2ed00fc1 tempest-CreateVolumesFromSnapshotTest-1293587525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-56b47392-5f46-4396-934c-9477ffc90354.info" returned: 0 in 0.261s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:56:16 devstack cinder-volume[87116]: WARNING cinder.volume.drivers.remotefs [None req-5e6a5390-9f38-4139-977d-8e8c2ed00fc1 tempest-CreateVolumesFromSnapshotTest-1293587525 None] /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-56b47392-5f46-4396-934c-9477ffc90354.info is being set with open permissions: ugo+rw Nov 06 11:56:16 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-5e6a5390-9f38-4139-977d-8e8c2ed00fc1 tempest-CreateVolumesFromSnapshotTest-1293587525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-56b47392-5f46-4396-934c-9477ffc90354.info {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:56:16 devstack sudo[102640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-56b47392-5f46-4396-934c-9477ffc90354.info Nov 06 11:56:16 devstack sudo[102640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:56:16 devstack sudo[102640]: pam_unix(sudo:session): session closed for user root Nov 06 11:56:16 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-5e6a5390-9f38-4139-977d-8e8c2ed00fc1 tempest-CreateVolumesFromSnapshotTest-1293587525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-56b47392-5f46-4396-934c-9477ffc90354.info" returned: 0 in 0.315s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:56:16 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-5e6a5390-9f38-4139-977d-8e8c2ed00fc1 tempest-CreateVolumesFromSnapshotTest-1293587525 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.573s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 11:56:16 devstack cinder-volume[87116]: DEBUG dbcounter [-] [87116] Writing DB stats cinder:SELECT=139,cinder:UPDATE=189,cinder:INSERT=53,cinder:DELETE=13 {{(pid=87116) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 11:56:16 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-5e6a5390-9f38-4139-977d-8e8c2ed00fc1 tempest-CreateVolumesFromSnapshotTest-1293587525 None] Create snapshot completed successfully Nov 06 11:56:16 devstack cinder-volume[87116]: DEBUG dbcounter [-] [87116] Writing DB stats cinder:UPDATE=179,cinder:SELECT=154,cinder:INSERT=54,cinder:DELETE=18 {{(pid=87116) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 11:56:17 devstack cinder-volume[87116]: DEBUG cinder.volume.flows.manager.create_volume [None req-fac62a25-2ac9-450f-aece-ca5f01d22448 tempest-VolumesSnapshotTestJSON-1873011056 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87116) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 11:56:17 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-fac62a25-2ac9-450f-aece-ca5f01d22448 tempest-VolumesSnapshotTestJSON-1873011056 None] Flow 'volume_create_manager' (e4e21ceb-31ae-471b-a21c-cb2a23d1d11e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 11:56:17 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-fac62a25-2ac9-450f-aece-ca5f01d22448 tempest-VolumesSnapshotTestJSON-1873011056 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bc5d2868-5610-4c57-8255-eb1c8485ff71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:56:17 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-fac62a25-2ac9-450f-aece-ca5f01d22448 tempest-VolumesSnapshotTestJSON-1873011056 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bc5d2868-5610-4c57-8255-eb1c8485ff71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T10:56:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-381052476',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4c858247-6332-4d50-8e38-a5b645acb04b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3bf9e5851f734e6098653da76bb11005',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T10:56:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T10:56:17Z,use_quota=True,user_id='2346ada21cbb4d2b9cf86ef1315c49dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(34d3b144-d9b7-480a-a2e3-01e45f3d54c1),volume_type_id=34d3b144-d9b7-480a-a2e3-01e45f3d54c1)' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:56:17 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-fac62a25-2ac9-450f-aece-ca5f01d22448 tempest-VolumesSnapshotTestJSON-1873011056 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (54ebe8dc-fed3-43cb-aa4b-53b872d5c842) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:56:17 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-fac62a25-2ac9-450f-aece-ca5f01d22448 tempest-VolumesSnapshotTestJSON-1873011056 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (54ebe8dc-fed3-43cb-aa4b-53b872d5c842) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:56:17 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-fac62a25-2ac9-450f-aece-ca5f01d22448 tempest-VolumesSnapshotTestJSON-1873011056 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (523f4e2e-ab2a-4bf1-9ae6-c5726b2fe64f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:56:17 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-fac62a25-2ac9-450f-aece-ca5f01d22448 tempest-VolumesSnapshotTestJSON-1873011056 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (523f4e2e-ab2a-4bf1-9ae6-c5726b2fe64f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4c858247-6332-4d50-8e38-a5b645acb04b', 'volume_name': 'volume-4c858247-6332-4d50-8e38-a5b645acb04b', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:56:17 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-fac62a25-2ac9-450f-aece-ca5f01d22448 tempest-VolumesSnapshotTestJSON-1873011056 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e321eee6-c1f3-4e29-a12a-08d529f548c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:56:17 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-fac62a25-2ac9-450f-aece-ca5f01d22448 tempest-VolumesSnapshotTestJSON-1873011056 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e321eee6-c1f3-4e29-a12a-08d529f548c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:56:17 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-fac62a25-2ac9-450f-aece-ca5f01d22448 tempest-VolumesSnapshotTestJSON-1873011056 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (24781c8b-0c08-4613-b9d9-3063292d3517) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:56:17 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-fac62a25-2ac9-450f-aece-ca5f01d22448 tempest-VolumesSnapshotTestJSON-1873011056 None] Volume 4c858247-6332-4d50-8e38-a5b645acb04b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4c858247-6332-4d50-8e38-a5b645acb04b', 'volume_size': 1} Nov 06 11:56:17 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-fac62a25-2ac9-450f-aece-ca5f01d22448 tempest-VolumesSnapshotTestJSON-1873011056 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 11:56:17 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-fac62a25-2ac9-450f-aece-ca5f01d22448 tempest-VolumesSnapshotTestJSON-1873011056 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 11:56:17 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-fac62a25-2ac9-450f-aece-ca5f01d22448 tempest-VolumesSnapshotTestJSON-1873011056 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T10:56:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-381052476',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4c858247-6332-4d50-8e38-a5b645acb04b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3bf9e5851f734e6098653da76bb11005',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T10:56:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T10:56:17Z,use_quota=True,user_id='2346ada21cbb4d2b9cf86ef1315c49dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(34d3b144-d9b7-480a-a2e3-01e45f3d54c1),volume_type_id=34d3b144-d9b7-480a-a2e3-01e45f3d54c1)}" {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 11:56:17 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-fac62a25-2ac9-450f-aece-ca5f01d22448 tempest-VolumesSnapshotTestJSON-1873011056 None] Creating volume 4c858247-6332-4d50-8e38-a5b645acb04b {{(pid=87116) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 11:56:17 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-fac62a25-2ac9-450f-aece-ca5f01d22448 tempest-VolumesSnapshotTestJSON-1873011056 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 11:56:17 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-fac62a25-2ac9-450f-aece-ca5f01d22448 tempest-VolumesSnapshotTestJSON-1873011056 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 11:56:17 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-fac62a25-2ac9-450f-aece-ca5f01d22448 tempest-VolumesSnapshotTestJSON-1873011056 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 11:56:17 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-fac62a25-2ac9-450f-aece-ca5f01d22448 tempest-VolumesSnapshotTestJSON-1873011056 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 11:56:17 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-fac62a25-2ac9-450f-aece-ca5f01d22448 tempest-VolumesSnapshotTestJSON-1873011056 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 11:56:17 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-fac62a25-2ac9-450f-aece-ca5f01d22448 tempest-VolumesSnapshotTestJSON-1873011056 None] Selected osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f as target Quobyte volume. {{(pid=87116) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 11:56:17 devstack cinder-volume[87116]: INFO cinder.volume.drivers.remotefs [None req-fac62a25-2ac9-450f-aece-ca5f01d22448 tempest-VolumesSnapshotTestJSON-1873011056 None] casted to osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f Nov 06 11:56:17 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-fac62a25-2ac9-450f-aece-ca5f01d22448 tempest-VolumesSnapshotTestJSON-1873011056 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-4c858247-6332-4d50-8e38-a5b645acb04b 1073741824 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:56:17 devstack sudo[102643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-4c858247-6332-4d50-8e38-a5b645acb04b 1073741824 Nov 06 11:56:17 devstack sudo[102643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:56:18 devstack cinder-volume[87116]: DEBUG cinder.volume.flows.manager.create_volume [None req-861a0797-dee8-4045-9aa9-a9b4754bf43c tempest-CreateVolumesFromSnapshotTest-1293587525 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87116) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 11:56:18 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-861a0797-dee8-4045-9aa9-a9b4754bf43c tempest-CreateVolumesFromSnapshotTest-1293587525 None] Flow 'volume_create_manager' (34b7e6d5-8778-41e5-85fb-68dfe199bbdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 11:56:18 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-861a0797-dee8-4045-9aa9-a9b4754bf43c tempest-CreateVolumesFromSnapshotTest-1293587525 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (23e357dd-0e90-4071-a46d-346b81f6a0b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:56:18 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-861a0797-dee8-4045-9aa9-a9b4754bf43c tempest-CreateVolumesFromSnapshotTest-1293587525 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (23e357dd-0e90-4071-a46d-346b81f6a0b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T10:56:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-742870267',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cbf5b5dd-8cd9-47c6-84e8-3852bc3ce55c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='df4930ad1b4940eda7fad4b2a8f44c0f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T10:56:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T10:56:18Z,use_quota=True,user_id='9eddd86089bc4e90b3371666f9e7e370',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(34d3b144-d9b7-480a-a2e3-01e45f3d54c1),volume_type_id=34d3b144-d9b7-480a-a2e3-01e45f3d54c1)' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:56:18 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-861a0797-dee8-4045-9aa9-a9b4754bf43c tempest-CreateVolumesFromSnapshotTest-1293587525 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (860c13cd-e095-47fc-bf92-513a09dcced3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:56:18 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-861a0797-dee8-4045-9aa9-a9b4754bf43c tempest-CreateVolumesFromSnapshotTest-1293587525 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (860c13cd-e095-47fc-bf92-513a09dcced3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:56:18 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-861a0797-dee8-4045-9aa9-a9b4754bf43c tempest-CreateVolumesFromSnapshotTest-1293587525 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f7c01d6b-7b77-45d0-a1f2-1a6dd41a257f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:56:18 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-861a0797-dee8-4045-9aa9-a9b4754bf43c tempest-CreateVolumesFromSnapshotTest-1293587525 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f7c01d6b-7b77-45d0-a1f2-1a6dd41a257f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cbf5b5dd-8cd9-47c6-84e8-3852bc3ce55c', 'volume_name': 'volume-cbf5b5dd-8cd9-47c6-84e8-3852bc3ce55c', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:56:18 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-861a0797-dee8-4045-9aa9-a9b4754bf43c tempest-CreateVolumesFromSnapshotTest-1293587525 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (96a447b3-ecda-4aa8-9aaa-4aa5e1b25b47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:56:18 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-861a0797-dee8-4045-9aa9-a9b4754bf43c tempest-CreateVolumesFromSnapshotTest-1293587525 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (96a447b3-ecda-4aa8-9aaa-4aa5e1b25b47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:56:18 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-861a0797-dee8-4045-9aa9-a9b4754bf43c tempest-CreateVolumesFromSnapshotTest-1293587525 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5ff2e550-91ee-4ef2-89f1-fdbc680c6ddc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:56:18 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-861a0797-dee8-4045-9aa9-a9b4754bf43c tempest-CreateVolumesFromSnapshotTest-1293587525 None] Volume cbf5b5dd-8cd9-47c6-84e8-3852bc3ce55c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cbf5b5dd-8cd9-47c6-84e8-3852bc3ce55c', 'volume_size': 1} Nov 06 11:56:18 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-861a0797-dee8-4045-9aa9-a9b4754bf43c tempest-CreateVolumesFromSnapshotTest-1293587525 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 11:56:18 devstack sudo[102643]: pam_unix(sudo:session): session closed for user root Nov 06 11:56:18 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-fac62a25-2ac9-450f-aece-ca5f01d22448 tempest-VolumesSnapshotTestJSON-1873011056 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-4c858247-6332-4d50-8e38-a5b645acb04b 1073741824" returned: 0 in 0.795s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:56:18 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-fac62a25-2ac9-450f-aece-ca5f01d22448 tempest-VolumesSnapshotTestJSON-1873011056 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-4c858247-6332-4d50-8e38-a5b645acb04b {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:56:18 devstack sudo[102650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-4c858247-6332-4d50-8e38-a5b645acb04b Nov 06 11:56:18 devstack sudo[102650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:56:18 devstack sudo[102650]: pam_unix(sudo:session): session closed for user root Nov 06 11:56:18 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-fac62a25-2ac9-450f-aece-ca5f01d22448 tempest-VolumesSnapshotTestJSON-1873011056 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-4c858247-6332-4d50-8e38-a5b645acb04b" returned: 0 in 0.420s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:56:18 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-fac62a25-2ac9-450f-aece-ca5f01d22448 tempest-VolumesSnapshotTestJSON-1873011056 None] <== create_volume: return (1332ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f'} {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 11:56:18 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-fac62a25-2ac9-450f-aece-ca5f01d22448 tempest-VolumesSnapshotTestJSON-1873011056 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.335s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 11:56:18 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-861a0797-dee8-4045-9aa9-a9b4754bf43c tempest-CreateVolumesFromSnapshotTest-1293587525 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.578s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 11:56:18 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-861a0797-dee8-4045-9aa9-a9b4754bf43c tempest-CreateVolumesFromSnapshotTest-1293587525 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T10:56:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-742870267',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cbf5b5dd-8cd9-47c6-84e8-3852bc3ce55c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='df4930ad1b4940eda7fad4b2a8f44c0f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T10:56:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T10:56:18Z,use_quota=True,user_id='9eddd86089bc4e90b3371666f9e7e370',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(34d3b144-d9b7-480a-a2e3-01e45f3d54c1),volume_type_id=34d3b144-d9b7-480a-a2e3-01e45f3d54c1)}" {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 11:56:18 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-861a0797-dee8-4045-9aa9-a9b4754bf43c tempest-CreateVolumesFromSnapshotTest-1293587525 None] Creating volume cbf5b5dd-8cd9-47c6-84e8-3852bc3ce55c {{(pid=87116) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 11:56:18 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-861a0797-dee8-4045-9aa9-a9b4754bf43c tempest-CreateVolumesFromSnapshotTest-1293587525 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 11:56:18 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-861a0797-dee8-4045-9aa9-a9b4754bf43c tempest-CreateVolumesFromSnapshotTest-1293587525 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 11:56:18 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-861a0797-dee8-4045-9aa9-a9b4754bf43c tempest-CreateVolumesFromSnapshotTest-1293587525 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 11:56:18 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-861a0797-dee8-4045-9aa9-a9b4754bf43c tempest-CreateVolumesFromSnapshotTest-1293587525 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 11:56:18 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-861a0797-dee8-4045-9aa9-a9b4754bf43c tempest-CreateVolumesFromSnapshotTest-1293587525 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 11:56:18 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-861a0797-dee8-4045-9aa9-a9b4754bf43c tempest-CreateVolumesFromSnapshotTest-1293587525 None] Selected osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f as target Quobyte volume. {{(pid=87116) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 11:56:18 devstack cinder-volume[87116]: INFO cinder.volume.drivers.remotefs [None req-861a0797-dee8-4045-9aa9-a9b4754bf43c tempest-CreateVolumesFromSnapshotTest-1293587525 None] casted to osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f Nov 06 11:56:18 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-861a0797-dee8-4045-9aa9-a9b4754bf43c tempest-CreateVolumesFromSnapshotTest-1293587525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-cbf5b5dd-8cd9-47c6-84e8-3852bc3ce55c 1073741824 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:56:19 devstack sudo[102654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-cbf5b5dd-8cd9-47c6-84e8-3852bc3ce55c 1073741824 Nov 06 11:56:19 devstack sudo[102654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:56:19 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-fac62a25-2ac9-450f-aece-ca5f01d22448 tempest-VolumesSnapshotTestJSON-1873011056 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (24781c8b-0c08-4613-b9d9-3063292d3517) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4c858247-6332-4d50-8e38-a5b645acb04b', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:56:19 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-fac62a25-2ac9-450f-aece-ca5f01d22448 tempest-VolumesSnapshotTestJSON-1873011056 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c28ea18c-0e34-4604-8983-30bff9be12c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:56:19 devstack cinder-volume[87116]: DEBUG cinder.volume.flows.manager.create_volume [None req-3edfbec7-9ba3-4f82-bd18-6616fa8b7eac tempest-CreateVolumesFromSnapshotTest-1293587525 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87116) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 11:56:19 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-3edfbec7-9ba3-4f82-bd18-6616fa8b7eac tempest-CreateVolumesFromSnapshotTest-1293587525 None] Flow 'volume_create_manager' (7dd5a40d-2caf-4985-9921-4de193be3fd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 11:56:19 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-3edfbec7-9ba3-4f82-bd18-6616fa8b7eac tempest-CreateVolumesFromSnapshotTest-1293587525 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (978af75e-96af-4b1c-a7a4-5e5127506824) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:56:19 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-fac62a25-2ac9-450f-aece-ca5f01d22448 tempest-VolumesSnapshotTestJSON-1873011056 None] Volume volume-4c858247-6332-4d50-8e38-a5b645acb04b (4c858247-6332-4d50-8e38-a5b645acb04b): created successfully Nov 06 11:56:19 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-fac62a25-2ac9-450f-aece-ca5f01d22448 tempest-VolumesSnapshotTestJSON-1873011056 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c28ea18c-0e34-4604-8983-30bff9be12c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:56:19 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-fac62a25-2ac9-450f-aece-ca5f01d22448 tempest-VolumesSnapshotTestJSON-1873011056 None] Flow 'volume_create_manager' (e4e21ceb-31ae-471b-a21c-cb2a23d1d11e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 11:56:19 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-3edfbec7-9ba3-4f82-bd18-6616fa8b7eac tempest-CreateVolumesFromSnapshotTest-1293587525 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (978af75e-96af-4b1c-a7a4-5e5127506824) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T10:56:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-424576798',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f5555b44-1c88-445e-9a70-afee2ade86ca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='df4930ad1b4940eda7fad4b2a8f44c0f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T10:56:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T10:56:19Z,use_quota=True,user_id='9eddd86089bc4e90b3371666f9e7e370',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(34d3b144-d9b7-480a-a2e3-01e45f3d54c1),volume_type_id=34d3b144-d9b7-480a-a2e3-01e45f3d54c1)' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:56:19 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-3edfbec7-9ba3-4f82-bd18-6616fa8b7eac tempest-CreateVolumesFromSnapshotTest-1293587525 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (76a63928-9928-4e71-95b5-01889b8f822a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:56:19 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-3edfbec7-9ba3-4f82-bd18-6616fa8b7eac tempest-CreateVolumesFromSnapshotTest-1293587525 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (76a63928-9928-4e71-95b5-01889b8f822a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:56:19 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-3edfbec7-9ba3-4f82-bd18-6616fa8b7eac tempest-CreateVolumesFromSnapshotTest-1293587525 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (18b4918e-82c6-4c8f-9526-9eadf0a58104) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:56:19 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-3edfbec7-9ba3-4f82-bd18-6616fa8b7eac tempest-CreateVolumesFromSnapshotTest-1293587525 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (18b4918e-82c6-4c8f-9526-9eadf0a58104) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f5555b44-1c88-445e-9a70-afee2ade86ca', 'volume_name': 'volume-f5555b44-1c88-445e-9a70-afee2ade86ca', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:56:19 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-3edfbec7-9ba3-4f82-bd18-6616fa8b7eac tempest-CreateVolumesFromSnapshotTest-1293587525 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6b1cdb5f-58b0-49fe-8463-57ee08f46cb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:56:19 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-3edfbec7-9ba3-4f82-bd18-6616fa8b7eac tempest-CreateVolumesFromSnapshotTest-1293587525 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6b1cdb5f-58b0-49fe-8463-57ee08f46cb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:56:19 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-3edfbec7-9ba3-4f82-bd18-6616fa8b7eac tempest-CreateVolumesFromSnapshotTest-1293587525 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5670b16d-59e5-4f6d-a0fe-80d1942d6955) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:56:19 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-3edfbec7-9ba3-4f82-bd18-6616fa8b7eac tempest-CreateVolumesFromSnapshotTest-1293587525 None] Volume f5555b44-1c88-445e-9a70-afee2ade86ca: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f5555b44-1c88-445e-9a70-afee2ade86ca', 'volume_size': 1} Nov 06 11:56:19 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-3edfbec7-9ba3-4f82-bd18-6616fa8b7eac tempest-CreateVolumesFromSnapshotTest-1293587525 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 11:56:19 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-fac62a25-2ac9-450f-aece-ca5f01d22448 tempest-VolumesSnapshotTestJSON-1873011056 None] Created volume successfully. Nov 06 11:56:19 devstack cinder-volume[87116]: DEBUG cinder.volume.flows.manager.create_volume [None req-95b478a8-9c53-4e5a-a619-7ba69f50bd9e tempest-CreateVolumesFromSnapshotTest-1293587525 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87116) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 11:56:19 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-95b478a8-9c53-4e5a-a619-7ba69f50bd9e tempest-CreateVolumesFromSnapshotTest-1293587525 None] Flow 'volume_create_manager' (54b644f1-e55f-467f-a4ee-2e1719570035) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 11:56:19 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-95b478a8-9c53-4e5a-a619-7ba69f50bd9e tempest-CreateVolumesFromSnapshotTest-1293587525 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e580624-3dbc-4266-ba79-4ae67b636c23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:56:19 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-95b478a8-9c53-4e5a-a619-7ba69f50bd9e tempest-CreateVolumesFromSnapshotTest-1293587525 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e580624-3dbc-4266-ba79-4ae67b636c23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T10:56:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1480093052',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0003bb74-80d0-4a7e-b80a-693c911dbe7f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='df4930ad1b4940eda7fad4b2a8f44c0f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T10:56:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T10:56:19Z,use_quota=True,user_id='9eddd86089bc4e90b3371666f9e7e370',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(34d3b144-d9b7-480a-a2e3-01e45f3d54c1),volume_type_id=34d3b144-d9b7-480a-a2e3-01e45f3d54c1)' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:56:19 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-95b478a8-9c53-4e5a-a619-7ba69f50bd9e tempest-CreateVolumesFromSnapshotTest-1293587525 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d14e9810-1673-4388-aa4e-88564a27a79d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:56:19 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-95b478a8-9c53-4e5a-a619-7ba69f50bd9e tempest-CreateVolumesFromSnapshotTest-1293587525 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d14e9810-1673-4388-aa4e-88564a27a79d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:56:19 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-95b478a8-9c53-4e5a-a619-7ba69f50bd9e tempest-CreateVolumesFromSnapshotTest-1293587525 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6d89614f-a33e-4ee5-9c8f-d37a011db4c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:56:19 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-95b478a8-9c53-4e5a-a619-7ba69f50bd9e tempest-CreateVolumesFromSnapshotTest-1293587525 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6d89614f-a33e-4ee5-9c8f-d37a011db4c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0003bb74-80d0-4a7e-b80a-693c911dbe7f', 'volume_name': 'volume-0003bb74-80d0-4a7e-b80a-693c911dbe7f', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:56:19 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-95b478a8-9c53-4e5a-a619-7ba69f50bd9e tempest-CreateVolumesFromSnapshotTest-1293587525 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1065a021-796b-4090-a989-96f7abb2d575) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:56:19 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-95b478a8-9c53-4e5a-a619-7ba69f50bd9e tempest-CreateVolumesFromSnapshotTest-1293587525 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1065a021-796b-4090-a989-96f7abb2d575) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:56:19 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-95b478a8-9c53-4e5a-a619-7ba69f50bd9e tempest-CreateVolumesFromSnapshotTest-1293587525 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (95855603-f940-42c7-a745-1930e7a62601) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:56:19 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-95b478a8-9c53-4e5a-a619-7ba69f50bd9e tempest-CreateVolumesFromSnapshotTest-1293587525 None] Volume 0003bb74-80d0-4a7e-b80a-693c911dbe7f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0003bb74-80d0-4a7e-b80a-693c911dbe7f', 'volume_size': 1} Nov 06 11:56:19 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-95b478a8-9c53-4e5a-a619-7ba69f50bd9e tempest-CreateVolumesFromSnapshotTest-1293587525 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 11:56:19 devstack sudo[102654]: pam_unix(sudo:session): session closed for user root Nov 06 11:56:19 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-861a0797-dee8-4045-9aa9-a9b4754bf43c tempest-CreateVolumesFromSnapshotTest-1293587525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-cbf5b5dd-8cd9-47c6-84e8-3852bc3ce55c 1073741824" returned: 0 in 0.763s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:56:19 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-861a0797-dee8-4045-9aa9-a9b4754bf43c tempest-CreateVolumesFromSnapshotTest-1293587525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-cbf5b5dd-8cd9-47c6-84e8-3852bc3ce55c {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:56:19 devstack sudo[102660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-cbf5b5dd-8cd9-47c6-84e8-3852bc3ce55c Nov 06 11:56:19 devstack sudo[102660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:56:20 devstack cinder-volume[87116]: DEBUG cinder.volume.flows.manager.create_volume [None req-94ef4352-1490-48c3-b6bb-74680a49a64f tempest-CreateVolumesFromSnapshotTest-1293587525 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87116) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 11:56:20 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-94ef4352-1490-48c3-b6bb-74680a49a64f tempest-CreateVolumesFromSnapshotTest-1293587525 None] Flow 'volume_create_manager' (2a77b6a6-06b0-44b7-8fd4-97ab31b4721e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 11:56:20 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-94ef4352-1490-48c3-b6bb-74680a49a64f tempest-CreateVolumesFromSnapshotTest-1293587525 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (db7479d3-5942-43a8-a879-4158d30c4359) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:56:20 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-94ef4352-1490-48c3-b6bb-74680a49a64f tempest-CreateVolumesFromSnapshotTest-1293587525 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (db7479d3-5942-43a8-a879-4158d30c4359) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T10:56:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2080593070',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=52ce0060-be2d-4c3e-9b61-9b42d1545f30,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='df4930ad1b4940eda7fad4b2a8f44c0f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T10:56:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T10:56:20Z,use_quota=True,user_id='9eddd86089bc4e90b3371666f9e7e370',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(34d3b144-d9b7-480a-a2e3-01e45f3d54c1),volume_type_id=34d3b144-d9b7-480a-a2e3-01e45f3d54c1)' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:56:20 devstack sudo[102660]: pam_unix(sudo:session): session closed for user root Nov 06 11:56:20 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-94ef4352-1490-48c3-b6bb-74680a49a64f tempest-CreateVolumesFromSnapshotTest-1293587525 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (561c3ca8-3244-4feb-a239-6c8a38bc9d32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:56:20 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-94ef4352-1490-48c3-b6bb-74680a49a64f tempest-CreateVolumesFromSnapshotTest-1293587525 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (561c3ca8-3244-4feb-a239-6c8a38bc9d32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:56:20 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-94ef4352-1490-48c3-b6bb-74680a49a64f tempest-CreateVolumesFromSnapshotTest-1293587525 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (387bc149-3c09-4b5f-a896-236be7d5a75b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:56:20 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-94ef4352-1490-48c3-b6bb-74680a49a64f tempest-CreateVolumesFromSnapshotTest-1293587525 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (387bc149-3c09-4b5f-a896-236be7d5a75b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '52ce0060-be2d-4c3e-9b61-9b42d1545f30', 'volume_name': 'volume-52ce0060-be2d-4c3e-9b61-9b42d1545f30', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:56:20 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-94ef4352-1490-48c3-b6bb-74680a49a64f tempest-CreateVolumesFromSnapshotTest-1293587525 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b961fa51-5eea-41d1-9577-909cdd22aea5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:56:20 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-94ef4352-1490-48c3-b6bb-74680a49a64f tempest-CreateVolumesFromSnapshotTest-1293587525 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b961fa51-5eea-41d1-9577-909cdd22aea5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:56:20 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-94ef4352-1490-48c3-b6bb-74680a49a64f tempest-CreateVolumesFromSnapshotTest-1293587525 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6b03a0d2-8414-4e14-8c34-601688d67f6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:56:20 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-94ef4352-1490-48c3-b6bb-74680a49a64f tempest-CreateVolumesFromSnapshotTest-1293587525 None] Volume 52ce0060-be2d-4c3e-9b61-9b42d1545f30: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-52ce0060-be2d-4c3e-9b61-9b42d1545f30', 'volume_size': 1} Nov 06 11:56:20 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-94ef4352-1490-48c3-b6bb-74680a49a64f tempest-CreateVolumesFromSnapshotTest-1293587525 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 11:56:20 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-861a0797-dee8-4045-9aa9-a9b4754bf43c tempest-CreateVolumesFromSnapshotTest-1293587525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-cbf5b5dd-8cd9-47c6-84e8-3852bc3ce55c" returned: 0 in 0.476s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:56:20 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-861a0797-dee8-4045-9aa9-a9b4754bf43c tempest-CreateVolumesFromSnapshotTest-1293587525 None] <== create_volume: return (1294ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f'} {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 11:56:20 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-861a0797-dee8-4045-9aa9-a9b4754bf43c tempest-CreateVolumesFromSnapshotTest-1293587525 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.299s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 11:56:20 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-3edfbec7-9ba3-4f82-bd18-6616fa8b7eac tempest-CreateVolumesFromSnapshotTest-1293587525 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.915s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 11:56:20 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-3edfbec7-9ba3-4f82-bd18-6616fa8b7eac tempest-CreateVolumesFromSnapshotTest-1293587525 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T10:56:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-424576798',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f5555b44-1c88-445e-9a70-afee2ade86ca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='df4930ad1b4940eda7fad4b2a8f44c0f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T10:56:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T10:56:19Z,use_quota=True,user_id='9eddd86089bc4e90b3371666f9e7e370',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(34d3b144-d9b7-480a-a2e3-01e45f3d54c1),volume_type_id=34d3b144-d9b7-480a-a2e3-01e45f3d54c1)}" {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 11:56:20 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-3edfbec7-9ba3-4f82-bd18-6616fa8b7eac tempest-CreateVolumesFromSnapshotTest-1293587525 None] Creating volume f5555b44-1c88-445e-9a70-afee2ade86ca {{(pid=87116) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 11:56:20 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-3edfbec7-9ba3-4f82-bd18-6616fa8b7eac tempest-CreateVolumesFromSnapshotTest-1293587525 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 11:56:20 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-3edfbec7-9ba3-4f82-bd18-6616fa8b7eac tempest-CreateVolumesFromSnapshotTest-1293587525 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 11:56:20 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-3edfbec7-9ba3-4f82-bd18-6616fa8b7eac tempest-CreateVolumesFromSnapshotTest-1293587525 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 11:56:20 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-3edfbec7-9ba3-4f82-bd18-6616fa8b7eac tempest-CreateVolumesFromSnapshotTest-1293587525 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 11:56:20 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-3edfbec7-9ba3-4f82-bd18-6616fa8b7eac tempest-CreateVolumesFromSnapshotTest-1293587525 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 11:56:20 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-3edfbec7-9ba3-4f82-bd18-6616fa8b7eac tempest-CreateVolumesFromSnapshotTest-1293587525 None] Selected osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f as target Quobyte volume. {{(pid=87116) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 11:56:20 devstack cinder-volume[87116]: INFO cinder.volume.drivers.remotefs [None req-3edfbec7-9ba3-4f82-bd18-6616fa8b7eac tempest-CreateVolumesFromSnapshotTest-1293587525 None] casted to osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f Nov 06 11:56:20 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-3edfbec7-9ba3-4f82-bd18-6616fa8b7eac tempest-CreateVolumesFromSnapshotTest-1293587525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-f5555b44-1c88-445e-9a70-afee2ade86ca 1073741824 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:56:20 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-861a0797-dee8-4045-9aa9-a9b4754bf43c tempest-CreateVolumesFromSnapshotTest-1293587525 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5ff2e550-91ee-4ef2-89f1-fdbc680c6ddc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cbf5b5dd-8cd9-47c6-84e8-3852bc3ce55c', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:56:20 devstack sudo[102663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-f5555b44-1c88-445e-9a70-afee2ade86ca 1073741824 Nov 06 11:56:20 devstack sudo[102663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:56:20 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-861a0797-dee8-4045-9aa9-a9b4754bf43c tempest-CreateVolumesFromSnapshotTest-1293587525 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3dcfdadb-75f3-48be-a1a0-31f2ff8edc45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:56:20 devstack cinder-volume[87116]: DEBUG cinder.volume.flows.manager.create_volume [None req-a42a8fb9-dfb6-4c4a-bd14-a80718cf56e0 tempest-VolumeDependencyTests-568082837 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87116) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 11:56:20 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-a42a8fb9-dfb6-4c4a-bd14-a80718cf56e0 tempest-VolumeDependencyTests-568082837 None] Flow 'volume_create_manager' (5b3935a1-fbf9-4b48-94e4-184a1e17bebb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 11:56:20 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-a42a8fb9-dfb6-4c4a-bd14-a80718cf56e0 tempest-VolumeDependencyTests-568082837 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7788e903-51cc-4611-96b0-6a9d75f42be0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:56:20 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-861a0797-dee8-4045-9aa9-a9b4754bf43c tempest-CreateVolumesFromSnapshotTest-1293587525 None] Volume volume-cbf5b5dd-8cd9-47c6-84e8-3852bc3ce55c (cbf5b5dd-8cd9-47c6-84e8-3852bc3ce55c): created successfully Nov 06 11:56:20 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-861a0797-dee8-4045-9aa9-a9b4754bf43c tempest-CreateVolumesFromSnapshotTest-1293587525 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3dcfdadb-75f3-48be-a1a0-31f2ff8edc45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:56:20 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-861a0797-dee8-4045-9aa9-a9b4754bf43c tempest-CreateVolumesFromSnapshotTest-1293587525 None] Flow 'volume_create_manager' (34b7e6d5-8778-41e5-85fb-68dfe199bbdb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 11:56:20 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-634f2ef6-2836-460d-92f9-860dc7feda0b tempest-VolumesSnapshotTestJSON-1873011056 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 11:56:20 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-a42a8fb9-dfb6-4c4a-bd14-a80718cf56e0 tempest-VolumeDependencyTests-568082837 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7788e903-51cc-4611-96b0-6a9d75f42be0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T10:56:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-769268961',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5496bc0e-2d25-4053-afaa-f6fe7bef3bea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='05dc3778d4a14a34bfaf437721a90a8c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T10:56:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T10:56:20Z,use_quota=True,user_id='6557adb4612844f0b015091e3954b981',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(34d3b144-d9b7-480a-a2e3-01e45f3d54c1),volume_type_id=34d3b144-d9b7-480a-a2e3-01e45f3d54c1)' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:56:20 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-a42a8fb9-dfb6-4c4a-bd14-a80718cf56e0 tempest-VolumeDependencyTests-568082837 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b88a6cfd-0ce8-465c-9fd7-edd6c0082b01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:56:20 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-a42a8fb9-dfb6-4c4a-bd14-a80718cf56e0 tempest-VolumeDependencyTests-568082837 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b88a6cfd-0ce8-465c-9fd7-edd6c0082b01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:56:20 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-a42a8fb9-dfb6-4c4a-bd14-a80718cf56e0 tempest-VolumeDependencyTests-568082837 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (806fea9e-7c17-4742-b129-230b2f1e988c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:56:20 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-a42a8fb9-dfb6-4c4a-bd14-a80718cf56e0 tempest-VolumeDependencyTests-568082837 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (806fea9e-7c17-4742-b129-230b2f1e988c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5496bc0e-2d25-4053-afaa-f6fe7bef3bea', 'volume_name': 'volume-5496bc0e-2d25-4053-afaa-f6fe7bef3bea', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:56:20 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-a42a8fb9-dfb6-4c4a-bd14-a80718cf56e0 tempest-VolumeDependencyTests-568082837 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3ca29d59-3c2c-4a59-9fb3-f86723cd5a7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:56:20 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-a42a8fb9-dfb6-4c4a-bd14-a80718cf56e0 tempest-VolumeDependencyTests-568082837 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3ca29d59-3c2c-4a59-9fb3-f86723cd5a7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:56:20 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-a42a8fb9-dfb6-4c4a-bd14-a80718cf56e0 tempest-VolumeDependencyTests-568082837 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a6cfe7a6-71a7-4963-8cf4-6f957c0d8d45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:56:20 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-a42a8fb9-dfb6-4c4a-bd14-a80718cf56e0 tempest-VolumeDependencyTests-568082837 None] Volume 5496bc0e-2d25-4053-afaa-f6fe7bef3bea: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5496bc0e-2d25-4053-afaa-f6fe7bef3bea', 'volume_size': 1} Nov 06 11:56:20 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-a42a8fb9-dfb6-4c4a-bd14-a80718cf56e0 tempest-VolumeDependencyTests-568082837 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 11:56:20 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-861a0797-dee8-4045-9aa9-a9b4754bf43c tempest-CreateVolumesFromSnapshotTest-1293587525 None] Created volume successfully. Nov 06 11:56:20 devstack cinder-volume[87116]: DEBUG cinder.volume.flows.manager.create_volume [None req-1694d69a-ce18-448b-8594-040e151b01a0 tempest-CreateVolumesFromSnapshotTest-1293587525 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87116) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 11:56:20 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-1694d69a-ce18-448b-8594-040e151b01a0 tempest-CreateVolumesFromSnapshotTest-1293587525 None] Flow 'volume_create_manager' (969a7ee3-7af0-4da0-acb5-06055d5d9237) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 11:56:20 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-1694d69a-ce18-448b-8594-040e151b01a0 tempest-CreateVolumesFromSnapshotTest-1293587525 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (67828067-0e2f-47f5-88a6-41881b40386b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:56:20 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-1694d69a-ce18-448b-8594-040e151b01a0 tempest-CreateVolumesFromSnapshotTest-1293587525 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (67828067-0e2f-47f5-88a6-41881b40386b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T10:56:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-103340973',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1b353552-379d-413a-bfbc-a6a758aeb3b4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='df4930ad1b4940eda7fad4b2a8f44c0f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T10:56:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T10:56:20Z,use_quota=True,user_id='9eddd86089bc4e90b3371666f9e7e370',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(34d3b144-d9b7-480a-a2e3-01e45f3d54c1),volume_type_id=34d3b144-d9b7-480a-a2e3-01e45f3d54c1)' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:56:20 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-1694d69a-ce18-448b-8594-040e151b01a0 tempest-CreateVolumesFromSnapshotTest-1293587525 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5db51677-8247-4805-8861-8932b557957a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:56:20 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-1694d69a-ce18-448b-8594-040e151b01a0 tempest-CreateVolumesFromSnapshotTest-1293587525 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5db51677-8247-4805-8861-8932b557957a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:56:20 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-1694d69a-ce18-448b-8594-040e151b01a0 tempest-CreateVolumesFromSnapshotTest-1293587525 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (603f772f-1225-4aae-842e-386a8a8e5fe3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:56:20 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-1694d69a-ce18-448b-8594-040e151b01a0 tempest-CreateVolumesFromSnapshotTest-1293587525 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (603f772f-1225-4aae-842e-386a8a8e5fe3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1b353552-379d-413a-bfbc-a6a758aeb3b4', 'volume_name': 'volume-1b353552-379d-413a-bfbc-a6a758aeb3b4', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:56:20 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-1694d69a-ce18-448b-8594-040e151b01a0 tempest-CreateVolumesFromSnapshotTest-1293587525 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3a1a0f41-1c50-480f-b94d-34cc0b06a707) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:56:20 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-1694d69a-ce18-448b-8594-040e151b01a0 tempest-CreateVolumesFromSnapshotTest-1293587525 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3a1a0f41-1c50-480f-b94d-34cc0b06a707) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:56:20 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-1694d69a-ce18-448b-8594-040e151b01a0 tempest-CreateVolumesFromSnapshotTest-1293587525 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (abcfc889-ce75-4694-bc6f-9c37560d5751) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:56:20 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-1694d69a-ce18-448b-8594-040e151b01a0 tempest-CreateVolumesFromSnapshotTest-1293587525 None] Volume 1b353552-379d-413a-bfbc-a6a758aeb3b4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1b353552-379d-413a-bfbc-a6a758aeb3b4', 'volume_size': 1} Nov 06 11:56:20 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-1694d69a-ce18-448b-8594-040e151b01a0 tempest-CreateVolumesFromSnapshotTest-1293587525 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 11:56:20 devstack sudo[102663]: pam_unix(sudo:session): session closed for user root Nov 06 11:56:20 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-3edfbec7-9ba3-4f82-bd18-6616fa8b7eac tempest-CreateVolumesFromSnapshotTest-1293587525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-f5555b44-1c88-445e-9a70-afee2ade86ca 1073741824" returned: 0 in 0.561s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:56:20 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-3edfbec7-9ba3-4f82-bd18-6616fa8b7eac tempest-CreateVolumesFromSnapshotTest-1293587525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-f5555b44-1c88-445e-9a70-afee2ade86ca {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:56:20 devstack sudo[102670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-f5555b44-1c88-445e-9a70-afee2ade86ca Nov 06 11:56:20 devstack sudo[102670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:56:21 devstack sudo[102670]: pam_unix(sudo:session): session closed for user root Nov 06 11:56:21 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-3edfbec7-9ba3-4f82-bd18-6616fa8b7eac tempest-CreateVolumesFromSnapshotTest-1293587525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-f5555b44-1c88-445e-9a70-afee2ade86ca" returned: 0 in 0.259s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:56:21 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-3edfbec7-9ba3-4f82-bd18-6616fa8b7eac tempest-CreateVolumesFromSnapshotTest-1293587525 None] <== create_volume: return (865ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f'} {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 11:56:21 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-3edfbec7-9ba3-4f82-bd18-6616fa8b7eac tempest-CreateVolumesFromSnapshotTest-1293587525 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.868s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 11:56:21 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-95b478a8-9c53-4e5a-a619-7ba69f50bd9e tempest-CreateVolumesFromSnapshotTest-1293587525 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.611s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 11:56:21 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-95b478a8-9c53-4e5a-a619-7ba69f50bd9e tempest-CreateVolumesFromSnapshotTest-1293587525 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T10:56:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1480093052',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0003bb74-80d0-4a7e-b80a-693c911dbe7f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='df4930ad1b4940eda7fad4b2a8f44c0f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T10:56:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T10:56:19Z,use_quota=True,user_id='9eddd86089bc4e90b3371666f9e7e370',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(34d3b144-d9b7-480a-a2e3-01e45f3d54c1),volume_type_id=34d3b144-d9b7-480a-a2e3-01e45f3d54c1)}" {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 11:56:21 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-95b478a8-9c53-4e5a-a619-7ba69f50bd9e tempest-CreateVolumesFromSnapshotTest-1293587525 None] Creating volume 0003bb74-80d0-4a7e-b80a-693c911dbe7f {{(pid=87116) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 11:56:21 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-95b478a8-9c53-4e5a-a619-7ba69f50bd9e tempest-CreateVolumesFromSnapshotTest-1293587525 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 11:56:21 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-95b478a8-9c53-4e5a-a619-7ba69f50bd9e tempest-CreateVolumesFromSnapshotTest-1293587525 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 11:56:21 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-95b478a8-9c53-4e5a-a619-7ba69f50bd9e tempest-CreateVolumesFromSnapshotTest-1293587525 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 11:56:21 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-95b478a8-9c53-4e5a-a619-7ba69f50bd9e tempest-CreateVolumesFromSnapshotTest-1293587525 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 11:56:21 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-95b478a8-9c53-4e5a-a619-7ba69f50bd9e tempest-CreateVolumesFromSnapshotTest-1293587525 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 11:56:21 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-95b478a8-9c53-4e5a-a619-7ba69f50bd9e tempest-CreateVolumesFromSnapshotTest-1293587525 None] Selected osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f as target Quobyte volume. {{(pid=87116) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 11:56:21 devstack cinder-volume[87116]: INFO cinder.volume.drivers.remotefs [None req-95b478a8-9c53-4e5a-a619-7ba69f50bd9e tempest-CreateVolumesFromSnapshotTest-1293587525 None] casted to osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f Nov 06 11:56:21 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-95b478a8-9c53-4e5a-a619-7ba69f50bd9e tempest-CreateVolumesFromSnapshotTest-1293587525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-0003bb74-80d0-4a7e-b80a-693c911dbe7f 1073741824 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:56:21 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-3edfbec7-9ba3-4f82-bd18-6616fa8b7eac tempest-CreateVolumesFromSnapshotTest-1293587525 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5670b16d-59e5-4f6d-a0fe-80d1942d6955) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f5555b44-1c88-445e-9a70-afee2ade86ca', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:56:21 devstack sudo[102673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-0003bb74-80d0-4a7e-b80a-693c911dbe7f 1073741824 Nov 06 11:56:21 devstack sudo[102673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:56:21 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-3edfbec7-9ba3-4f82-bd18-6616fa8b7eac tempest-CreateVolumesFromSnapshotTest-1293587525 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ad603ea7-8b14-4ef7-943d-a4af9265c9f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:56:21 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-3edfbec7-9ba3-4f82-bd18-6616fa8b7eac tempest-CreateVolumesFromSnapshotTest-1293587525 None] Volume volume-f5555b44-1c88-445e-9a70-afee2ade86ca (f5555b44-1c88-445e-9a70-afee2ade86ca): created successfully Nov 06 11:56:21 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-3edfbec7-9ba3-4f82-bd18-6616fa8b7eac tempest-CreateVolumesFromSnapshotTest-1293587525 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ad603ea7-8b14-4ef7-943d-a4af9265c9f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:56:21 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-3edfbec7-9ba3-4f82-bd18-6616fa8b7eac tempest-CreateVolumesFromSnapshotTest-1293587525 None] Flow 'volume_create_manager' (7dd5a40d-2caf-4985-9921-4de193be3fd6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 11:56:21 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-3edfbec7-9ba3-4f82-bd18-6616fa8b7eac tempest-CreateVolumesFromSnapshotTest-1293587525 None] Created volume successfully. Nov 06 11:56:21 devstack sudo[102673]: pam_unix(sudo:session): session closed for user root Nov 06 11:56:21 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-95b478a8-9c53-4e5a-a619-7ba69f50bd9e tempest-CreateVolumesFromSnapshotTest-1293587525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-0003bb74-80d0-4a7e-b80a-693c911dbe7f 1073741824" returned: 0 in 0.494s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:56:21 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-95b478a8-9c53-4e5a-a619-7ba69f50bd9e tempest-CreateVolumesFromSnapshotTest-1293587525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-0003bb74-80d0-4a7e-b80a-693c911dbe7f {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:56:21 devstack sudo[102681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-0003bb74-80d0-4a7e-b80a-693c911dbe7f Nov 06 11:56:21 devstack sudo[102681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:56:21 devstack sudo[102681]: pam_unix(sudo:session): session closed for user root Nov 06 11:56:21 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-95b478a8-9c53-4e5a-a619-7ba69f50bd9e tempest-CreateVolumesFromSnapshotTest-1293587525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-0003bb74-80d0-4a7e-b80a-693c911dbe7f" returned: 0 in 0.256s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:56:21 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-95b478a8-9c53-4e5a-a619-7ba69f50bd9e tempest-CreateVolumesFromSnapshotTest-1293587525 None] <== create_volume: return (807ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f'} {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 11:56:21 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-95b478a8-9c53-4e5a-a619-7ba69f50bd9e tempest-CreateVolumesFromSnapshotTest-1293587525 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.809s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 11:56:21 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-94ef4352-1490-48c3-b6bb-74680a49a64f tempest-CreateVolumesFromSnapshotTest-1293587525 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.693s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 11:56:21 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-94ef4352-1490-48c3-b6bb-74680a49a64f tempest-CreateVolumesFromSnapshotTest-1293587525 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T10:56:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2080593070',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=52ce0060-be2d-4c3e-9b61-9b42d1545f30,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='df4930ad1b4940eda7fad4b2a8f44c0f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T10:56:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T10:56:20Z,use_quota=True,user_id='9eddd86089bc4e90b3371666f9e7e370',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(34d3b144-d9b7-480a-a2e3-01e45f3d54c1),volume_type_id=34d3b144-d9b7-480a-a2e3-01e45f3d54c1)}" {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 11:56:21 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-94ef4352-1490-48c3-b6bb-74680a49a64f tempest-CreateVolumesFromSnapshotTest-1293587525 None] Creating volume 52ce0060-be2d-4c3e-9b61-9b42d1545f30 {{(pid=87116) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 11:56:21 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-94ef4352-1490-48c3-b6bb-74680a49a64f tempest-CreateVolumesFromSnapshotTest-1293587525 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 11:56:21 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-94ef4352-1490-48c3-b6bb-74680a49a64f tempest-CreateVolumesFromSnapshotTest-1293587525 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 11:56:21 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-94ef4352-1490-48c3-b6bb-74680a49a64f tempest-CreateVolumesFromSnapshotTest-1293587525 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 11:56:21 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-94ef4352-1490-48c3-b6bb-74680a49a64f tempest-CreateVolumesFromSnapshotTest-1293587525 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 11:56:21 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-94ef4352-1490-48c3-b6bb-74680a49a64f tempest-CreateVolumesFromSnapshotTest-1293587525 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 11:56:21 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-94ef4352-1490-48c3-b6bb-74680a49a64f tempest-CreateVolumesFromSnapshotTest-1293587525 None] Selected osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f as target Quobyte volume. {{(pid=87116) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 11:56:21 devstack cinder-volume[87116]: INFO cinder.volume.drivers.remotefs [None req-94ef4352-1490-48c3-b6bb-74680a49a64f tempest-CreateVolumesFromSnapshotTest-1293587525 None] casted to osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f Nov 06 11:56:21 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-94ef4352-1490-48c3-b6bb-74680a49a64f tempest-CreateVolumesFromSnapshotTest-1293587525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-52ce0060-be2d-4c3e-9b61-9b42d1545f30 1073741824 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:56:21 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-95b478a8-9c53-4e5a-a619-7ba69f50bd9e tempest-CreateVolumesFromSnapshotTest-1293587525 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (95855603-f940-42c7-a745-1930e7a62601) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0003bb74-80d0-4a7e-b80a-693c911dbe7f', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:56:21 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-95b478a8-9c53-4e5a-a619-7ba69f50bd9e tempest-CreateVolumesFromSnapshotTest-1293587525 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b43251d0-7127-4a35-83ee-c6c4b125f1b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:56:21 devstack sudo[102684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-52ce0060-be2d-4c3e-9b61-9b42d1545f30 1073741824 Nov 06 11:56:21 devstack sudo[102684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:56:22 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-95b478a8-9c53-4e5a-a619-7ba69f50bd9e tempest-CreateVolumesFromSnapshotTest-1293587525 None] Volume volume-0003bb74-80d0-4a7e-b80a-693c911dbe7f (0003bb74-80d0-4a7e-b80a-693c911dbe7f): created successfully Nov 06 11:56:22 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-95b478a8-9c53-4e5a-a619-7ba69f50bd9e tempest-CreateVolumesFromSnapshotTest-1293587525 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b43251d0-7127-4a35-83ee-c6c4b125f1b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:56:22 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-95b478a8-9c53-4e5a-a619-7ba69f50bd9e tempest-CreateVolumesFromSnapshotTest-1293587525 None] Flow 'volume_create_manager' (54b644f1-e55f-467f-a4ee-2e1719570035) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 11:56:22 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-95b478a8-9c53-4e5a-a619-7ba69f50bd9e tempest-CreateVolumesFromSnapshotTest-1293587525 None] Created volume successfully. Nov 06 11:56:22 devstack sudo[102684]: pam_unix(sudo:session): session closed for user root Nov 06 11:56:22 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-94ef4352-1490-48c3-b6bb-74680a49a64f tempest-CreateVolumesFromSnapshotTest-1293587525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-52ce0060-be2d-4c3e-9b61-9b42d1545f30 1073741824" returned: 0 in 0.402s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:56:22 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-94ef4352-1490-48c3-b6bb-74680a49a64f tempest-CreateVolumesFromSnapshotTest-1293587525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-52ce0060-be2d-4c3e-9b61-9b42d1545f30 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:56:22 devstack sudo[102690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-52ce0060-be2d-4c3e-9b61-9b42d1545f30 Nov 06 11:56:22 devstack sudo[102690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:56:22 devstack sudo[102690]: pam_unix(sudo:session): session closed for user root Nov 06 11:56:22 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-94ef4352-1490-48c3-b6bb-74680a49a64f tempest-CreateVolumesFromSnapshotTest-1293587525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-52ce0060-be2d-4c3e-9b61-9b42d1545f30" returned: 0 in 0.236s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:56:22 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-94ef4352-1490-48c3-b6bb-74680a49a64f tempest-CreateVolumesFromSnapshotTest-1293587525 None] <== create_volume: return (677ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f'} {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 11:56:22 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-94ef4352-1490-48c3-b6bb-74680a49a64f tempest-CreateVolumesFromSnapshotTest-1293587525 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.679s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 11:56:22 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-634f2ef6-2836-460d-92f9-860dc7feda0b tempest-VolumesSnapshotTestJSON-1873011056 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.017s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 11:56:22 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-634f2ef6-2836-460d-92f9-860dc7feda0b tempest-VolumesSnapshotTestJSON-1873011056 None] Creating offline snapshot 8121f4f1-04d0-4124-99b1-e1556bf08dca of volume 4c858247-6332-4d50-8e38-a5b645acb04b {{(pid=87116) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 06 11:56:22 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-94ef4352-1490-48c3-b6bb-74680a49a64f tempest-CreateVolumesFromSnapshotTest-1293587525 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6b03a0d2-8414-4e14-8c34-601688d67f6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-52ce0060-be2d-4c3e-9b61-9b42d1545f30', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:56:22 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-94ef4352-1490-48c3-b6bb-74680a49a64f tempest-CreateVolumesFromSnapshotTest-1293587525 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0c66d4ec-3931-4de1-9086-02e26a7ec791) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:56:22 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-94ef4352-1490-48c3-b6bb-74680a49a64f tempest-CreateVolumesFromSnapshotTest-1293587525 None] Volume volume-52ce0060-be2d-4c3e-9b61-9b42d1545f30 (52ce0060-be2d-4c3e-9b61-9b42d1545f30): created successfully Nov 06 11:56:22 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-94ef4352-1490-48c3-b6bb-74680a49a64f tempest-CreateVolumesFromSnapshotTest-1293587525 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0c66d4ec-3931-4de1-9086-02e26a7ec791) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:56:22 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-94ef4352-1490-48c3-b6bb-74680a49a64f tempest-CreateVolumesFromSnapshotTest-1293587525 None] Flow 'volume_create_manager' (2a77b6a6-06b0-44b7-8fd4-97ab31b4721e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 11:56:22 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[abf49c79-aaef-478f-b800-69a64cc2c11c]: (4, 'qcow2') {{(pid=88420) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 11:56:22 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-634f2ef6-2836-460d-92f9-860dc7feda0b tempest-VolumesSnapshotTestJSON-1873011056 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-4c858247-6332-4d50-8e38-a5b645acb04b {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:56:22 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-94ef4352-1490-48c3-b6bb-74680a49a64f tempest-CreateVolumesFromSnapshotTest-1293587525 None] Created volume successfully. Nov 06 11:56:22 devstack sudo[102694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-4c858247-6332-4d50-8e38-a5b645acb04b Nov 06 11:56:22 devstack sudo[102694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:56:23 devstack sudo[102694]: pam_unix(sudo:session): session closed for user root Nov 06 11:56:23 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-634f2ef6-2836-460d-92f9-860dc7feda0b tempest-VolumesSnapshotTestJSON-1873011056 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-4c858247-6332-4d50-8e38-a5b645acb04b" returned: 0 in 0.370s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:56:23 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-634f2ef6-2836-460d-92f9-860dc7feda0b tempest-VolumesSnapshotTestJSON-1873011056 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-4c858247-6332-4d50-8e38-a5b645acb04b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-4c858247-6332-4d50-8e38-a5b645acb04b.8121f4f1-04d0-4124-99b1-e1556bf08dca 1G {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:56:23 devstack sudo[102699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-4c858247-6332-4d50-8e38-a5b645acb04b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-4c858247-6332-4d50-8e38-a5b645acb04b.8121f4f1-04d0-4124-99b1-e1556bf08dca 1G Nov 06 11:56:23 devstack sudo[102699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:56:23 devstack sudo[102699]: pam_unix(sudo:session): session closed for user root Nov 06 11:56:23 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-634f2ef6-2836-460d-92f9-860dc7feda0b tempest-VolumesSnapshotTestJSON-1873011056 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-4c858247-6332-4d50-8e38-a5b645acb04b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-4c858247-6332-4d50-8e38-a5b645acb04b.8121f4f1-04d0-4124-99b1-e1556bf08dca 1G" returned: 0 in 0.420s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:56:23 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-634f2ef6-2836-460d-92f9-860dc7feda0b tempest-VolumesSnapshotTestJSON-1873011056 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4c858247-6332-4d50-8e38-a5b645acb04b -F qcow2 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-4c858247-6332-4d50-8e38-a5b645acb04b.8121f4f1-04d0-4124-99b1-e1556bf08dca {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:56:23 devstack sudo[102705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4c858247-6332-4d50-8e38-a5b645acb04b -F qcow2 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-4c858247-6332-4d50-8e38-a5b645acb04b.8121f4f1-04d0-4124-99b1-e1556bf08dca Nov 06 11:56:23 devstack sudo[102705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:56:23 devstack sudo[102705]: pam_unix(sudo:session): session closed for user root Nov 06 11:56:23 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-634f2ef6-2836-460d-92f9-860dc7feda0b tempest-VolumesSnapshotTestJSON-1873011056 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4c858247-6332-4d50-8e38-a5b645acb04b -F qcow2 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-4c858247-6332-4d50-8e38-a5b645acb04b.8121f4f1-04d0-4124-99b1-e1556bf08dca" returned: 0 in 0.355s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:56:23 devstack cinder-volume[87116]: WARNING cinder.volume.drivers.remotefs [None req-634f2ef6-2836-460d-92f9-860dc7feda0b tempest-VolumesSnapshotTestJSON-1873011056 None] /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-4c858247-6332-4d50-8e38-a5b645acb04b.8121f4f1-04d0-4124-99b1-e1556bf08dca is being set with open permissions: ugo+rw Nov 06 11:56:23 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-634f2ef6-2836-460d-92f9-860dc7feda0b tempest-VolumesSnapshotTestJSON-1873011056 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-4c858247-6332-4d50-8e38-a5b645acb04b.8121f4f1-04d0-4124-99b1-e1556bf08dca {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:56:23 devstack sudo[102711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-4c858247-6332-4d50-8e38-a5b645acb04b.8121f4f1-04d0-4124-99b1-e1556bf08dca Nov 06 11:56:23 devstack sudo[102711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:56:24 devstack sudo[102711]: pam_unix(sudo:session): session closed for user root Nov 06 11:56:24 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-634f2ef6-2836-460d-92f9-860dc7feda0b tempest-VolumesSnapshotTestJSON-1873011056 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-4c858247-6332-4d50-8e38-a5b645acb04b.8121f4f1-04d0-4124-99b1-e1556bf08dca" returned: 0 in 0.261s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:56:24 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-634f2ef6-2836-460d-92f9-860dc7feda0b tempest-VolumesSnapshotTestJSON-1873011056 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-4c858247-6332-4d50-8e38-a5b645acb04b.info {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:56:24 devstack sudo[102714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-4c858247-6332-4d50-8e38-a5b645acb04b.info Nov 06 11:56:24 devstack sudo[102714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:56:24 devstack sudo[102714]: pam_unix(sudo:session): session closed for user root Nov 06 11:56:24 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-634f2ef6-2836-460d-92f9-860dc7feda0b tempest-VolumesSnapshotTestJSON-1873011056 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-4c858247-6332-4d50-8e38-a5b645acb04b.info" returned: 0 in 0.256s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:56:24 devstack cinder-volume[87116]: WARNING cinder.volume.drivers.remotefs [None req-634f2ef6-2836-460d-92f9-860dc7feda0b tempest-VolumesSnapshotTestJSON-1873011056 None] /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-4c858247-6332-4d50-8e38-a5b645acb04b.info is being set with open permissions: ugo+rw Nov 06 11:56:24 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-634f2ef6-2836-460d-92f9-860dc7feda0b tempest-VolumesSnapshotTestJSON-1873011056 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-4c858247-6332-4d50-8e38-a5b645acb04b.info {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:56:24 devstack sudo[102717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-4c858247-6332-4d50-8e38-a5b645acb04b.info Nov 06 11:56:24 devstack sudo[102717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:56:24 devstack sudo[102717]: pam_unix(sudo:session): session closed for user root Nov 06 11:56:24 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-634f2ef6-2836-460d-92f9-860dc7feda0b tempest-VolumesSnapshotTestJSON-1873011056 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-4c858247-6332-4d50-8e38-a5b645acb04b.info" returned: 0 in 0.250s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:56:24 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-634f2ef6-2836-460d-92f9-860dc7feda0b tempest-VolumesSnapshotTestJSON-1873011056 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.129s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 11:56:24 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-a42a8fb9-dfb6-4c4a-bd14-a80718cf56e0 tempest-VolumeDependencyTests-568082837 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.095s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 11:56:24 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-a42a8fb9-dfb6-4c4a-bd14-a80718cf56e0 tempest-VolumeDependencyTests-568082837 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T10:56:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-769268961',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5496bc0e-2d25-4053-afaa-f6fe7bef3bea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='05dc3778d4a14a34bfaf437721a90a8c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T10:56:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T10:56:20Z,use_quota=True,user_id='6557adb4612844f0b015091e3954b981',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(34d3b144-d9b7-480a-a2e3-01e45f3d54c1),volume_type_id=34d3b144-d9b7-480a-a2e3-01e45f3d54c1)}" {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 11:56:24 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-a42a8fb9-dfb6-4c4a-bd14-a80718cf56e0 tempest-VolumeDependencyTests-568082837 None] Creating volume 5496bc0e-2d25-4053-afaa-f6fe7bef3bea {{(pid=87116) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 11:56:24 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-a42a8fb9-dfb6-4c4a-bd14-a80718cf56e0 tempest-VolumeDependencyTests-568082837 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 11:56:24 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-a42a8fb9-dfb6-4c4a-bd14-a80718cf56e0 tempest-VolumeDependencyTests-568082837 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 11:56:24 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-a42a8fb9-dfb6-4c4a-bd14-a80718cf56e0 tempest-VolumeDependencyTests-568082837 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 11:56:24 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-a42a8fb9-dfb6-4c4a-bd14-a80718cf56e0 tempest-VolumeDependencyTests-568082837 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 11:56:24 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-a42a8fb9-dfb6-4c4a-bd14-a80718cf56e0 tempest-VolumeDependencyTests-568082837 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 11:56:24 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-a42a8fb9-dfb6-4c4a-bd14-a80718cf56e0 tempest-VolumeDependencyTests-568082837 None] Selected osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f as target Quobyte volume. {{(pid=87116) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 11:56:24 devstack cinder-volume[87116]: INFO cinder.volume.drivers.remotefs [None req-a42a8fb9-dfb6-4c4a-bd14-a80718cf56e0 tempest-VolumeDependencyTests-568082837 None] casted to osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f Nov 06 11:56:24 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-a42a8fb9-dfb6-4c4a-bd14-a80718cf56e0 tempest-VolumeDependencyTests-568082837 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-5496bc0e-2d25-4053-afaa-f6fe7bef3bea 1073741824 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:56:24 devstack sudo[102720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-5496bc0e-2d25-4053-afaa-f6fe7bef3bea 1073741824 Nov 06 11:56:24 devstack sudo[102720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:56:24 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-634f2ef6-2836-460d-92f9-860dc7feda0b tempest-VolumesSnapshotTestJSON-1873011056 None] Create snapshot completed successfully Nov 06 11:56:25 devstack sudo[102720]: pam_unix(sudo:session): session closed for user root Nov 06 11:56:25 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-a42a8fb9-dfb6-4c4a-bd14-a80718cf56e0 tempest-VolumeDependencyTests-568082837 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-5496bc0e-2d25-4053-afaa-f6fe7bef3bea 1073741824" returned: 0 in 0.478s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:56:25 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-a42a8fb9-dfb6-4c4a-bd14-a80718cf56e0 tempest-VolumeDependencyTests-568082837 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-5496bc0e-2d25-4053-afaa-f6fe7bef3bea {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:56:25 devstack sudo[102726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-5496bc0e-2d25-4053-afaa-f6fe7bef3bea Nov 06 11:56:25 devstack sudo[102726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:56:25 devstack sudo[102726]: pam_unix(sudo:session): session closed for user root Nov 06 11:56:25 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-a42a8fb9-dfb6-4c4a-bd14-a80718cf56e0 tempest-VolumeDependencyTests-568082837 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-5496bc0e-2d25-4053-afaa-f6fe7bef3bea" returned: 0 in 0.275s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:56:25 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-a42a8fb9-dfb6-4c4a-bd14-a80718cf56e0 tempest-VolumeDependencyTests-568082837 None] <== create_volume: return (792ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f'} {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 11:56:25 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-a42a8fb9-dfb6-4c4a-bd14-a80718cf56e0 tempest-VolumeDependencyTests-568082837 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.797s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 11:56:25 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-1694d69a-ce18-448b-8594-040e151b01a0 tempest-CreateVolumesFromSnapshotTest-1293587525 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.759s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 11:56:25 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-1694d69a-ce18-448b-8594-040e151b01a0 tempest-CreateVolumesFromSnapshotTest-1293587525 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T10:56:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-103340973',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1b353552-379d-413a-bfbc-a6a758aeb3b4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='df4930ad1b4940eda7fad4b2a8f44c0f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T10:56:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T10:56:20Z,use_quota=True,user_id='9eddd86089bc4e90b3371666f9e7e370',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(34d3b144-d9b7-480a-a2e3-01e45f3d54c1),volume_type_id=34d3b144-d9b7-480a-a2e3-01e45f3d54c1)}" {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 11:56:25 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-1694d69a-ce18-448b-8594-040e151b01a0 tempest-CreateVolumesFromSnapshotTest-1293587525 None] Creating volume 1b353552-379d-413a-bfbc-a6a758aeb3b4 {{(pid=87116) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 11:56:25 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-1694d69a-ce18-448b-8594-040e151b01a0 tempest-CreateVolumesFromSnapshotTest-1293587525 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 11:56:25 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-1694d69a-ce18-448b-8594-040e151b01a0 tempest-CreateVolumesFromSnapshotTest-1293587525 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 11:56:25 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-1694d69a-ce18-448b-8594-040e151b01a0 tempest-CreateVolumesFromSnapshotTest-1293587525 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 11:56:25 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-1694d69a-ce18-448b-8594-040e151b01a0 tempest-CreateVolumesFromSnapshotTest-1293587525 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 11:56:25 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-1694d69a-ce18-448b-8594-040e151b01a0 tempest-CreateVolumesFromSnapshotTest-1293587525 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 11:56:25 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-1694d69a-ce18-448b-8594-040e151b01a0 tempest-CreateVolumesFromSnapshotTest-1293587525 None] Selected osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f as target Quobyte volume. {{(pid=87116) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 11:56:25 devstack cinder-volume[87116]: INFO cinder.volume.drivers.remotefs [None req-1694d69a-ce18-448b-8594-040e151b01a0 tempest-CreateVolumesFromSnapshotTest-1293587525 None] casted to osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f Nov 06 11:56:25 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-1694d69a-ce18-448b-8594-040e151b01a0 tempest-CreateVolumesFromSnapshotTest-1293587525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-1b353552-379d-413a-bfbc-a6a758aeb3b4 1073741824 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:56:25 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-a42a8fb9-dfb6-4c4a-bd14-a80718cf56e0 tempest-VolumeDependencyTests-568082837 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a6cfe7a6-71a7-4963-8cf4-6f957c0d8d45) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5496bc0e-2d25-4053-afaa-f6fe7bef3bea', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:56:25 devstack sudo[102729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-1b353552-379d-413a-bfbc-a6a758aeb3b4 1073741824 Nov 06 11:56:25 devstack sudo[102729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:56:25 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-a42a8fb9-dfb6-4c4a-bd14-a80718cf56e0 tempest-VolumeDependencyTests-568082837 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dcadd52f-4e90-45cb-aeb6-be378c5cb8f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:56:25 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-a42a8fb9-dfb6-4c4a-bd14-a80718cf56e0 tempest-VolumeDependencyTests-568082837 None] Volume volume-5496bc0e-2d25-4053-afaa-f6fe7bef3bea (5496bc0e-2d25-4053-afaa-f6fe7bef3bea): created successfully Nov 06 11:56:25 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-a42a8fb9-dfb6-4c4a-bd14-a80718cf56e0 tempest-VolumeDependencyTests-568082837 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dcadd52f-4e90-45cb-aeb6-be378c5cb8f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:56:25 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-a42a8fb9-dfb6-4c4a-bd14-a80718cf56e0 tempest-VolumeDependencyTests-568082837 None] Flow 'volume_create_manager' (5b3935a1-fbf9-4b48-94e4-184a1e17bebb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 11:56:25 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-a42a8fb9-dfb6-4c4a-bd14-a80718cf56e0 tempest-VolumeDependencyTests-568082837 None] Created volume successfully. Nov 06 11:56:26 devstack cinder-volume[87116]: DEBUG cinder.volume.flows.manager.create_volume [None req-4ded65f0-1c8f-465f-a413-e9bd50733e73 tempest-VolumesSnapshotTestJSON-1873011056 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87116) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 11:56:26 devstack sudo[102729]: pam_unix(sudo:session): session closed for user root Nov 06 11:56:26 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-1694d69a-ce18-448b-8594-040e151b01a0 tempest-CreateVolumesFromSnapshotTest-1293587525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-1b353552-379d-413a-bfbc-a6a758aeb3b4 1073741824" returned: 0 in 0.534s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:56:26 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-4ded65f0-1c8f-465f-a413-e9bd50733e73 tempest-VolumesSnapshotTestJSON-1873011056 None] Flow 'volume_create_manager' (c5516a08-13b9-4b1c-a0ed-8bddb4683509) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 11:56:26 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-4ded65f0-1c8f-465f-a413-e9bd50733e73 tempest-VolumesSnapshotTestJSON-1873011056 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4eb53bb9-93e9-4c59-8ae4-d9e245cdae66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:56:26 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-4ded65f0-1c8f-465f-a413-e9bd50733e73 tempest-VolumesSnapshotTestJSON-1873011056 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4eb53bb9-93e9-4c59-8ae4-d9e245cdae66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T10:56:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1657089481',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=006841cb-094c-4572-916d-3fd2a72c3814,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3bf9e5851f734e6098653da76bb11005',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T10:56:26Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=8121f4f1-04d0-4124-99b1-e1556bf08dca,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T10:56:26Z,use_quota=True,user_id='2346ada21cbb4d2b9cf86ef1315c49dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(34d3b144-d9b7-480a-a2e3-01e45f3d54c1),volume_type_id=34d3b144-d9b7-480a-a2e3-01e45f3d54c1)' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:56:26 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-4ded65f0-1c8f-465f-a413-e9bd50733e73 tempest-VolumesSnapshotTestJSON-1873011056 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3fe4113a-ecde-4987-9954-803d558b74ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:56:26 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-4ded65f0-1c8f-465f-a413-e9bd50733e73 tempest-VolumesSnapshotTestJSON-1873011056 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3fe4113a-ecde-4987-9954-803d558b74ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:56:26 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-4ded65f0-1c8f-465f-a413-e9bd50733e73 tempest-VolumesSnapshotTestJSON-1873011056 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (91c7d1d5-faaf-47db-b745-6b120467e2b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:56:26 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-4ded65f0-1c8f-465f-a413-e9bd50733e73 tempest-VolumesSnapshotTestJSON-1873011056 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (91c7d1d5-faaf-47db-b745-6b120467e2b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '006841cb-094c-4572-916d-3fd2a72c3814', 'volume_name': 'volume-006841cb-094c-4572-916d-3fd2a72c3814', 'volume_size': 2, 'snapshot_id': '8121f4f1-04d0-4124-99b1-e1556bf08dca'}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:56:26 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-4ded65f0-1c8f-465f-a413-e9bd50733e73 tempest-VolumesSnapshotTestJSON-1873011056 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5e71f3fb-0efa-4c48-afa1-53a1169cbee0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:56:26 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-4ded65f0-1c8f-465f-a413-e9bd50733e73 tempest-VolumesSnapshotTestJSON-1873011056 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5e71f3fb-0efa-4c48-afa1-53a1169cbee0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:56:26 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-4ded65f0-1c8f-465f-a413-e9bd50733e73 tempest-VolumesSnapshotTestJSON-1873011056 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b64a54ae-ed80-4339-be36-b5173296453f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:56:26 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-4ded65f0-1c8f-465f-a413-e9bd50733e73 tempest-VolumesSnapshotTestJSON-1873011056 None] Volume 006841cb-094c-4572-916d-3fd2a72c3814: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-006841cb-094c-4572-916d-3fd2a72c3814', 'volume_size': 2, 'snapshot_id': '8121f4f1-04d0-4124-99b1-e1556bf08dca'} Nov 06 11:56:26 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-4ded65f0-1c8f-465f-a413-e9bd50733e73 tempest-VolumesSnapshotTestJSON-1873011056 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 11:56:26 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-1694d69a-ce18-448b-8594-040e151b01a0 tempest-CreateVolumesFromSnapshotTest-1293587525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-1b353552-379d-413a-bfbc-a6a758aeb3b4 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:56:26 devstack sudo[102735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-1b353552-379d-413a-bfbc-a6a758aeb3b4 Nov 06 11:56:26 devstack sudo[102735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:56:26 devstack sudo[102735]: pam_unix(sudo:session): session closed for user root Nov 06 11:56:26 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-1694d69a-ce18-448b-8594-040e151b01a0 tempest-CreateVolumesFromSnapshotTest-1293587525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-1b353552-379d-413a-bfbc-a6a758aeb3b4" returned: 0 in 0.308s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:56:26 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-1694d69a-ce18-448b-8594-040e151b01a0 tempest-CreateVolumesFromSnapshotTest-1293587525 None] <== create_volume: return (965ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f'} {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 11:56:26 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-1694d69a-ce18-448b-8594-040e151b01a0 tempest-CreateVolumesFromSnapshotTest-1293587525 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.968s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 11:56:26 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-4ded65f0-1c8f-465f-a413-e9bd50733e73 tempest-VolumesSnapshotTestJSON-1873011056 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.317s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 11:56:26 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-4ded65f0-1c8f-465f-a413-e9bd50733e73 tempest-VolumesSnapshotTestJSON-1873011056 None] Acquiring lock "cinder-quobyte-8121f4f1-04d0-4124-99b1-e1556bf08dca-006841cb-094c-4572-916d-3fd2a72c3814" by "_create_volume_from_snapshot" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 11:56:26 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-cd5c7a76-a04d-4f21-9420-7e2d58f3bc3c tempest-VolumeDependencyTests-568082837 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 11:56:26 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-4ded65f0-1c8f-465f-a413-e9bd50733e73 tempest-VolumesSnapshotTestJSON-1873011056 None] Lock "cinder-quobyte-8121f4f1-04d0-4124-99b1-e1556bf08dca-006841cb-094c-4572-916d-3fd2a72c3814" acquired by "_create_volume_from_snapshot" :: waited 0.018s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 11:56:26 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-4ded65f0-1c8f-465f-a413-e9bd50733e73 tempest-VolumesSnapshotTestJSON-1873011056 None] Creating volume 006841cb-094c-4572-916d-3fd2a72c3814 from snapshot 8121f4f1-04d0-4124-99b1-e1556bf08dca {{(pid=87116) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Nov 06 11:56:26 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-4ded65f0-1c8f-465f-a413-e9bd50733e73 tempest-VolumesSnapshotTestJSON-1873011056 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 11:56:26 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-4ded65f0-1c8f-465f-a413-e9bd50733e73 tempest-VolumesSnapshotTestJSON-1873011056 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 11:56:26 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-4ded65f0-1c8f-465f-a413-e9bd50733e73 tempest-VolumesSnapshotTestJSON-1873011056 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 11:56:26 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-4ded65f0-1c8f-465f-a413-e9bd50733e73 tempest-VolumesSnapshotTestJSON-1873011056 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 11:56:26 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-4ded65f0-1c8f-465f-a413-e9bd50733e73 tempest-VolumesSnapshotTestJSON-1873011056 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 11:56:26 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-4ded65f0-1c8f-465f-a413-e9bd50733e73 tempest-VolumesSnapshotTestJSON-1873011056 None] Selected osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f as target Quobyte volume. {{(pid=87116) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 11:56:26 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-4ded65f0-1c8f-465f-a413-e9bd50733e73 tempest-VolumesSnapshotTestJSON-1873011056 None] Acquiring lock "cinder-quobyte-006841cb-094c-4572-916d-3fd2a72c3814" by "_copy_volume_from_snapshot" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 11:56:26 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-1694d69a-ce18-448b-8594-040e151b01a0 tempest-CreateVolumesFromSnapshotTest-1293587525 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (abcfc889-ce75-4694-bc6f-9c37560d5751) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1b353552-379d-413a-bfbc-a6a758aeb3b4', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:56:26 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-1694d69a-ce18-448b-8594-040e151b01a0 tempest-CreateVolumesFromSnapshotTest-1293587525 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e7c2979d-a426-41a4-aa0f-e00f694ed85a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:56:26 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-1694d69a-ce18-448b-8594-040e151b01a0 tempest-CreateVolumesFromSnapshotTest-1293587525 None] Volume volume-1b353552-379d-413a-bfbc-a6a758aeb3b4 (1b353552-379d-413a-bfbc-a6a758aeb3b4): created successfully Nov 06 11:56:26 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-1694d69a-ce18-448b-8594-040e151b01a0 tempest-CreateVolumesFromSnapshotTest-1293587525 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e7c2979d-a426-41a4-aa0f-e00f694ed85a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:56:26 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-1694d69a-ce18-448b-8594-040e151b01a0 tempest-CreateVolumesFromSnapshotTest-1293587525 None] Flow 'volume_create_manager' (969a7ee3-7af0-4da0-acb5-06055d5d9237) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 11:56:26 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-4ded65f0-1c8f-465f-a413-e9bd50733e73 tempest-VolumesSnapshotTestJSON-1873011056 None] Lock "cinder-quobyte-006841cb-094c-4572-916d-3fd2a72c3814" acquired by "_copy_volume_from_snapshot" :: waited 0.042s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 11:56:26 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-4ded65f0-1c8f-465f-a413-e9bd50733e73 tempest-VolumesSnapshotTestJSON-1873011056 None] snapshot: 8121f4f1-04d0-4124-99b1-e1556bf08dca, volume: 006841cb-094c-4572-916d-3fd2a72c3814, {{(pid=87116) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 06 11:56:26 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-4ded65f0-1c8f-465f-a413-e9bd50733e73 tempest-VolumesSnapshotTestJSON-1873011056 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 11:56:26 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-4ded65f0-1c8f-465f-a413-e9bd50733e73 tempest-VolumesSnapshotTestJSON-1873011056 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 11:56:26 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-4ded65f0-1c8f-465f-a413-e9bd50733e73 tempest-VolumesSnapshotTestJSON-1873011056 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 11:56:26 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-4ded65f0-1c8f-465f-a413-e9bd50733e73 tempest-VolumesSnapshotTestJSON-1873011056 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 11:56:26 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-4ded65f0-1c8f-465f-a413-e9bd50733e73 tempest-VolumesSnapshotTestJSON-1873011056 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 11:56:26 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-1694d69a-ce18-448b-8594-040e151b01a0 tempest-CreateVolumesFromSnapshotTest-1293587525 None] Created volume successfully. Nov 06 11:56:26 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[72e8871f-9305-429e-b784-fddf6fcbceef]: (4, 'qcow2') {{(pid=88420) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 11:56:26 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-4ded65f0-1c8f-465f-a413-e9bd50733e73 tempest-VolumesSnapshotTestJSON-1873011056 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-4c858247-6332-4d50-8e38-a5b645acb04b.8121f4f1-04d0-4124-99b1-e1556bf08dca {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:56:26 devstack sudo[102738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-4c858247-6332-4d50-8e38-a5b645acb04b.8121f4f1-04d0-4124-99b1-e1556bf08dca Nov 06 11:56:26 devstack sudo[102738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:56:27 devstack sudo[102738]: pam_unix(sudo:session): session closed for user root Nov 06 11:56:27 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-4ded65f0-1c8f-465f-a413-e9bd50733e73 tempest-VolumesSnapshotTestJSON-1873011056 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-4c858247-6332-4d50-8e38-a5b645acb04b.8121f4f1-04d0-4124-99b1-e1556bf08dca" returned: 0 in 0.378s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:56:27 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-4ded65f0-1c8f-465f-a413-e9bd50733e73 tempest-VolumesSnapshotTestJSON-1873011056 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4c858247-6332-4d50-8e38-a5b645acb04b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87116) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 11:56:27 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[1dfaa51b-a532-4b08-8726-a88c576b5a15]: (4, 'qcow2') {{(pid=88420) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 11:56:27 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-4ded65f0-1c8f-465f-a413-e9bd50733e73 tempest-VolumesSnapshotTestJSON-1873011056 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-4c858247-6332-4d50-8e38-a5b645acb04b {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:56:27 devstack sudo[102743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-4c858247-6332-4d50-8e38-a5b645acb04b Nov 06 11:56:27 devstack sudo[102743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:56:27 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-7cc827c2-483d-4ae7-a98f-43ba710e9d8e tempest-CreateVolumesFromSnapshotTest-1293587525 None] Acquiring lock "cinder-1b353552-379d-413a-bfbc-a6a758aeb3b4-delete_volume" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 11:56:27 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-7cc827c2-483d-4ae7-a98f-43ba710e9d8e tempest-CreateVolumesFromSnapshotTest-1293587525 None] Lock "cinder-1b353552-379d-413a-bfbc-a6a758aeb3b4-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 11:56:27 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-7cc827c2-483d-4ae7-a98f-43ba710e9d8e tempest-CreateVolumesFromSnapshotTest-1293587525 None] Acquiring lock "cinder-quobyte-1b353552-379d-413a-bfbc-a6a758aeb3b4" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 11:56:27 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-7cc827c2-483d-4ae7-a98f-43ba710e9d8e tempest-CreateVolumesFromSnapshotTest-1293587525 None] Lock "cinder-quobyte-1b353552-379d-413a-bfbc-a6a758aeb3b4" acquired by "delete_volume" :: waited 0.015s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 11:56:27 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[a60eea4c-0cc2-42b9-9d26-9451f65ef468]: (4, 'qcow2') {{(pid=88420) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 11:56:27 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-7cc827c2-483d-4ae7-a98f-43ba710e9d8e tempest-CreateVolumesFromSnapshotTest-1293587525 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-1b353552-379d-413a-bfbc-a6a758aeb3b4 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:56:27 devstack sudo[102745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-1b353552-379d-413a-bfbc-a6a758aeb3b4 Nov 06 11:56:27 devstack sudo[102745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:56:27 devstack sudo[102743]: pam_unix(sudo:session): session closed for user root Nov 06 11:56:27 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-4ded65f0-1c8f-465f-a413-e9bd50733e73 tempest-VolumesSnapshotTestJSON-1873011056 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-4c858247-6332-4d50-8e38-a5b645acb04b" returned: 0 in 0.466s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:56:27 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-4ded65f0-1c8f-465f-a413-e9bd50733e73 tempest-VolumesSnapshotTestJSON-1873011056 None] will copy from snapshot at /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-4c858247-6332-4d50-8e38-a5b645acb04b {{(pid=87116) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 06 11:56:27 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-4ded65f0-1c8f-465f-a413-e9bd50733e73 tempest-VolumesSnapshotTestJSON-1873011056 None] Creating direct copy from snapshot {{(pid=87116) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 06 11:56:27 devstack cinder-volume[87116]: DEBUG cinder.utils [None req-4ded65f0-1c8f-465f-a413-e9bd50733e73 tempest-VolumesSnapshotTestJSON-1873011056 None] Path /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-006841cb-094c-4572-916d-3fd2a72c3814 not found in is_blk_device check {{(pid=87116) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 06 11:56:27 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-4ded65f0-1c8f-465f-a413-e9bd50733e73 tempest-VolumesSnapshotTestJSON-1873011056 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-4c858247-6332-4d50-8e38-a5b645acb04b /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-006841cb-094c-4572-916d-3fd2a72c3814 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:56:27 devstack sudo[102750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-4c858247-6332-4d50-8e38-a5b645acb04b /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-006841cb-094c-4572-916d-3fd2a72c3814 Nov 06 11:56:27 devstack sudo[102750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:56:27 devstack sudo[102745]: pam_unix(sudo:session): session closed for user root Nov 06 11:56:27 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-7cc827c2-483d-4ae7-a98f-43ba710e9d8e tempest-CreateVolumesFromSnapshotTest-1293587525 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-1b353552-379d-413a-bfbc-a6a758aeb3b4" returned: 0 in 0.428s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:56:27 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-7cc827c2-483d-4ae7-a98f-43ba710e9d8e tempest-CreateVolumesFromSnapshotTest-1293587525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-1b353552-379d-413a-bfbc-a6a758aeb3b4 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:56:27 devstack sudo[102755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-1b353552-379d-413a-bfbc-a6a758aeb3b4 Nov 06 11:56:27 devstack sudo[102755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:56:28 devstack sudo[102755]: pam_unix(sudo:session): session closed for user root Nov 06 11:56:28 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-7cc827c2-483d-4ae7-a98f-43ba710e9d8e tempest-CreateVolumesFromSnapshotTest-1293587525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-1b353552-379d-413a-bfbc-a6a758aeb3b4" returned: 0 in 0.258s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:56:28 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-7cc827c2-483d-4ae7-a98f-43ba710e9d8e tempest-CreateVolumesFromSnapshotTest-1293587525 None] Lock "cinder-quobyte-1b353552-379d-413a-bfbc-a6a758aeb3b4" released by "delete_volume" :: held 0.735s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 11:56:28 devstack cinder-volume[87116]: DEBUG cinder.quota [None req-7cc827c2-483d-4ae7-a98f-43ba710e9d8e tempest-CreateVolumesFromSnapshotTest-1293587525 None] Created reservations ['dea57849-4f46-41f8-9fc9-8d015db498a1', '8061ceb6-0fda-424e-b1cd-e18ae58847b3', '2e91573b-f881-4b9b-9f3e-8590df61d1cb', '0229c344-d692-4c00-a7f9-5e21b099df73'] {{(pid=87116) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 11:56:28 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-7cc827c2-483d-4ae7-a98f-43ba710e9d8e tempest-CreateVolumesFromSnapshotTest-1293587525 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 11:56:28 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-7cc827c2-483d-4ae7-a98f-43ba710e9d8e tempest-CreateVolumesFromSnapshotTest-1293587525 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 11:56:28 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-7cc827c2-483d-4ae7-a98f-43ba710e9d8e tempest-CreateVolumesFromSnapshotTest-1293587525 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 11:56:28 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-7cc827c2-483d-4ae7-a98f-43ba710e9d8e tempest-CreateVolumesFromSnapshotTest-1293587525 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 11:56:28 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-7cc827c2-483d-4ae7-a98f-43ba710e9d8e tempest-CreateVolumesFromSnapshotTest-1293587525 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 11:56:28 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-7cc827c2-483d-4ae7-a98f-43ba710e9d8e tempest-CreateVolumesFromSnapshotTest-1293587525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:56:28 devstack sudo[102768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756 Nov 06 11:56:28 devstack sudo[102768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:56:28 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-d1b8c2f7-7b6a-413c-8246-90dabe1bb6da tempest-CreateVolumesFromSnapshotTest-1293587525 None] Acquiring lock "cinder-52ce0060-be2d-4c3e-9b61-9b42d1545f30-delete_volume" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 11:56:28 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-d1b8c2f7-7b6a-413c-8246-90dabe1bb6da tempest-CreateVolumesFromSnapshotTest-1293587525 None] Lock "cinder-52ce0060-be2d-4c3e-9b61-9b42d1545f30-delete_volume" acquired by "delete_volume" :: waited 0.054s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 11:56:28 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-d1b8c2f7-7b6a-413c-8246-90dabe1bb6da tempest-CreateVolumesFromSnapshotTest-1293587525 None] Acquiring lock "cinder-quobyte-52ce0060-be2d-4c3e-9b61-9b42d1545f30" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 11:56:28 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-d1b8c2f7-7b6a-413c-8246-90dabe1bb6da tempest-CreateVolumesFromSnapshotTest-1293587525 None] Lock "cinder-quobyte-52ce0060-be2d-4c3e-9b61-9b42d1545f30" acquired by "delete_volume" :: waited 0.052s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 11:56:28 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[22872aec-6849-4793-87eb-a2b5fb9f4886]: (4, 'qcow2') {{(pid=88420) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 11:56:28 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-d1b8c2f7-7b6a-413c-8246-90dabe1bb6da tempest-CreateVolumesFromSnapshotTest-1293587525 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-52ce0060-be2d-4c3e-9b61-9b42d1545f30 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:56:29 devstack sudo[102768]: pam_unix(sudo:session): session closed for user root Nov 06 11:56:29 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-7cc827c2-483d-4ae7-a98f-43ba710e9d8e tempest-CreateVolumesFromSnapshotTest-1293587525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756" returned: 0 in 0.721s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:56:29 devstack cinder-volume[87116]: DEBUG cinder.manager [None req-7cc827c2-483d-4ae7-a98f-43ba710e9d8e tempest-CreateVolumesFromSnapshotTest-1293587525 None] Notifying Schedulers of capabilities ... {{(pid=87116) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 11:56:29 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-7cc827c2-483d-4ae7-a98f-43ba710e9d8e tempest-CreateVolumesFromSnapshotTest-1293587525 None] Deleted volume successfully. Nov 06 11:56:29 devstack sudo[102770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-52ce0060-be2d-4c3e-9b61-9b42d1545f30 Nov 06 11:56:29 devstack sudo[102770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:56:29 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-7cc827c2-483d-4ae7-a98f-43ba710e9d8e tempest-CreateVolumesFromSnapshotTest-1293587525 None] Lock "cinder-1b353552-379d-413a-bfbc-a6a758aeb3b4-delete_volume" released by "delete_volume" :: held 1.857s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 11:56:29 devstack sudo[102770]: pam_unix(sudo:session): session closed for user root Nov 06 11:56:29 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-d1b8c2f7-7b6a-413c-8246-90dabe1bb6da tempest-CreateVolumesFromSnapshotTest-1293587525 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-52ce0060-be2d-4c3e-9b61-9b42d1545f30" returned: 0 in 0.742s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:56:29 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-d1b8c2f7-7b6a-413c-8246-90dabe1bb6da tempest-CreateVolumesFromSnapshotTest-1293587525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-52ce0060-be2d-4c3e-9b61-9b42d1545f30 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:56:29 devstack sudo[102777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-52ce0060-be2d-4c3e-9b61-9b42d1545f30 Nov 06 11:56:29 devstack sudo[102777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:56:30 devstack sudo[102777]: pam_unix(sudo:session): session closed for user root Nov 06 11:56:30 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-d1b8c2f7-7b6a-413c-8246-90dabe1bb6da tempest-CreateVolumesFromSnapshotTest-1293587525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-52ce0060-be2d-4c3e-9b61-9b42d1545f30" returned: 0 in 0.447s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:56:30 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-d1b8c2f7-7b6a-413c-8246-90dabe1bb6da tempest-CreateVolumesFromSnapshotTest-1293587525 None] Lock "cinder-quobyte-52ce0060-be2d-4c3e-9b61-9b42d1545f30" released by "delete_volume" :: held 1.295s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 11:56:30 devstack cinder-volume[87116]: DEBUG cinder.quota [None req-d1b8c2f7-7b6a-413c-8246-90dabe1bb6da tempest-CreateVolumesFromSnapshotTest-1293587525 None] Created reservations ['f2d8f513-3093-49c2-99f6-2fc1cd0b6a7d', 'db5d6b68-3c01-4682-857a-fbd980fbaa96', '929155e7-4527-411f-abca-f9a34ddf5e4b', 'c0a849b4-ab94-41e6-b19e-bac7fec0fe55'] {{(pid=87116) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 11:56:30 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-d1b8c2f7-7b6a-413c-8246-90dabe1bb6da tempest-CreateVolumesFromSnapshotTest-1293587525 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 11:56:30 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-d1b8c2f7-7b6a-413c-8246-90dabe1bb6da tempest-CreateVolumesFromSnapshotTest-1293587525 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 11:56:30 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-d1b8c2f7-7b6a-413c-8246-90dabe1bb6da tempest-CreateVolumesFromSnapshotTest-1293587525 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 11:56:30 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-d1b8c2f7-7b6a-413c-8246-90dabe1bb6da tempest-CreateVolumesFromSnapshotTest-1293587525 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 11:56:30 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-d1b8c2f7-7b6a-413c-8246-90dabe1bb6da tempest-CreateVolumesFromSnapshotTest-1293587525 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 11:56:30 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-d1b8c2f7-7b6a-413c-8246-90dabe1bb6da tempest-CreateVolumesFromSnapshotTest-1293587525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:56:30 devstack sudo[102780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756 Nov 06 11:56:30 devstack sudo[102780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:56:30 devstack sudo[102780]: pam_unix(sudo:session): session closed for user root Nov 06 11:56:30 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-d1b8c2f7-7b6a-413c-8246-90dabe1bb6da tempest-CreateVolumesFromSnapshotTest-1293587525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756" returned: 0 in 0.344s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:56:30 devstack cinder-volume[87116]: DEBUG cinder.manager [None req-d1b8c2f7-7b6a-413c-8246-90dabe1bb6da tempest-CreateVolumesFromSnapshotTest-1293587525 None] Notifying Schedulers of capabilities ... {{(pid=87116) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 11:56:30 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-d1b8c2f7-7b6a-413c-8246-90dabe1bb6da tempest-CreateVolumesFromSnapshotTest-1293587525 None] Deleted volume successfully. Nov 06 11:56:30 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-d1b8c2f7-7b6a-413c-8246-90dabe1bb6da tempest-CreateVolumesFromSnapshotTest-1293587525 None] Lock "cinder-52ce0060-be2d-4c3e-9b61-9b42d1545f30-delete_volume" released by "delete_volume" :: held 2.126s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 11:56:31 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-a13c941b-cbde-4939-a3e2-d9f30200b7a5 tempest-CreateVolumesFromSnapshotTest-1293587525 None] Acquiring lock "cinder-0003bb74-80d0-4a7e-b80a-693c911dbe7f-delete_volume" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 11:56:31 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-a13c941b-cbde-4939-a3e2-d9f30200b7a5 tempest-CreateVolumesFromSnapshotTest-1293587525 None] Lock "cinder-0003bb74-80d0-4a7e-b80a-693c911dbe7f-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 11:56:31 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-a13c941b-cbde-4939-a3e2-d9f30200b7a5 tempest-CreateVolumesFromSnapshotTest-1293587525 None] Acquiring lock "cinder-quobyte-0003bb74-80d0-4a7e-b80a-693c911dbe7f" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 11:56:31 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-a13c941b-cbde-4939-a3e2-d9f30200b7a5 tempest-CreateVolumesFromSnapshotTest-1293587525 None] Lock "cinder-quobyte-0003bb74-80d0-4a7e-b80a-693c911dbe7f" acquired by "delete_volume" :: waited 0.023s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 11:56:31 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d75d430-39af-4263-aa98-5fb26e5542a6]: (4, 'qcow2') {{(pid=88420) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 11:56:31 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-a13c941b-cbde-4939-a3e2-d9f30200b7a5 tempest-CreateVolumesFromSnapshotTest-1293587525 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-0003bb74-80d0-4a7e-b80a-693c911dbe7f {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:56:31 devstack sudo[102783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-0003bb74-80d0-4a7e-b80a-693c911dbe7f Nov 06 11:56:31 devstack sudo[102783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:56:32 devstack sudo[102783]: pam_unix(sudo:session): session closed for user root Nov 06 11:56:32 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-a13c941b-cbde-4939-a3e2-d9f30200b7a5 tempest-CreateVolumesFromSnapshotTest-1293587525 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-0003bb74-80d0-4a7e-b80a-693c911dbe7f" returned: 0 in 0.731s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:56:32 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-a13c941b-cbde-4939-a3e2-d9f30200b7a5 tempest-CreateVolumesFromSnapshotTest-1293587525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-0003bb74-80d0-4a7e-b80a-693c911dbe7f {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:56:32 devstack sudo[102788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-0003bb74-80d0-4a7e-b80a-693c911dbe7f Nov 06 11:56:32 devstack sudo[102788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:56:32 devstack sudo[102788]: pam_unix(sudo:session): session closed for user root Nov 06 11:56:32 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-a13c941b-cbde-4939-a3e2-d9f30200b7a5 tempest-CreateVolumesFromSnapshotTest-1293587525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-0003bb74-80d0-4a7e-b80a-693c911dbe7f" returned: 0 in 0.403s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:56:32 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-a13c941b-cbde-4939-a3e2-d9f30200b7a5 tempest-CreateVolumesFromSnapshotTest-1293587525 None] Lock "cinder-quobyte-0003bb74-80d0-4a7e-b80a-693c911dbe7f" released by "delete_volume" :: held 1.213s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 11:56:32 devstack cinder-volume[87116]: DEBUG cinder.quota [None req-a13c941b-cbde-4939-a3e2-d9f30200b7a5 tempest-CreateVolumesFromSnapshotTest-1293587525 None] Created reservations ['3b7d80d8-65ce-43fc-9fed-62479494c1ba', 'b0104f03-6dc9-45be-aa0f-aa174cb955ea', '1796e1f9-8788-46fd-851a-ec59bbb90155', 'f525c277-140a-4a02-94a2-4be8d53d62c5'] {{(pid=87116) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 11:56:32 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-a13c941b-cbde-4939-a3e2-d9f30200b7a5 tempest-CreateVolumesFromSnapshotTest-1293587525 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 11:56:32 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-a13c941b-cbde-4939-a3e2-d9f30200b7a5 tempest-CreateVolumesFromSnapshotTest-1293587525 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 11:56:32 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-a13c941b-cbde-4939-a3e2-d9f30200b7a5 tempest-CreateVolumesFromSnapshotTest-1293587525 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 11:56:32 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-a13c941b-cbde-4939-a3e2-d9f30200b7a5 tempest-CreateVolumesFromSnapshotTest-1293587525 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 11:56:32 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-a13c941b-cbde-4939-a3e2-d9f30200b7a5 tempest-CreateVolumesFromSnapshotTest-1293587525 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 11:56:32 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-a13c941b-cbde-4939-a3e2-d9f30200b7a5 tempest-CreateVolumesFromSnapshotTest-1293587525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:56:32 devstack sudo[102793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756 Nov 06 11:56:32 devstack sudo[102793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:56:33 devstack sudo[102793]: pam_unix(sudo:session): session closed for user root Nov 06 11:56:33 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-a13c941b-cbde-4939-a3e2-d9f30200b7a5 tempest-CreateVolumesFromSnapshotTest-1293587525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756" returned: 0 in 0.440s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:56:33 devstack cinder-volume[87116]: DEBUG cinder.manager [None req-a13c941b-cbde-4939-a3e2-d9f30200b7a5 tempest-CreateVolumesFromSnapshotTest-1293587525 None] Notifying Schedulers of capabilities ... {{(pid=87116) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 11:56:33 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-a13c941b-cbde-4939-a3e2-d9f30200b7a5 tempest-CreateVolumesFromSnapshotTest-1293587525 None] Deleted volume successfully. Nov 06 11:56:33 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-a13c941b-cbde-4939-a3e2-d9f30200b7a5 tempest-CreateVolumesFromSnapshotTest-1293587525 None] Lock "cinder-0003bb74-80d0-4a7e-b80a-693c911dbe7f-delete_volume" released by "delete_volume" :: held 2.137s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 11:56:33 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-1a5e287b-0334-452a-a1b5-be47929f1b87 tempest-CreateVolumesFromSnapshotTest-1293587525 None] Acquiring lock "cinder-f5555b44-1c88-445e-9a70-afee2ade86ca-delete_volume" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 11:56:33 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-1a5e287b-0334-452a-a1b5-be47929f1b87 tempest-CreateVolumesFromSnapshotTest-1293587525 None] Lock "cinder-f5555b44-1c88-445e-9a70-afee2ade86ca-delete_volume" acquired by "delete_volume" :: waited 0.061s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 11:56:33 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-1a5e287b-0334-452a-a1b5-be47929f1b87 tempest-CreateVolumesFromSnapshotTest-1293587525 None] Acquiring lock "cinder-quobyte-f5555b44-1c88-445e-9a70-afee2ade86ca" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 11:56:33 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-1a5e287b-0334-452a-a1b5-be47929f1b87 tempest-CreateVolumesFromSnapshotTest-1293587525 None] Lock "cinder-quobyte-f5555b44-1c88-445e-9a70-afee2ade86ca" acquired by "delete_volume" :: waited 0.025s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 11:56:33 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[66cb8107-cfe7-4e36-a50f-3b9b6e2ae9d3]: (4, 'qcow2') {{(pid=88420) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 11:56:33 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-1a5e287b-0334-452a-a1b5-be47929f1b87 tempest-CreateVolumesFromSnapshotTest-1293587525 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-f5555b44-1c88-445e-9a70-afee2ade86ca {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:56:34 devstack sudo[102804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-f5555b44-1c88-445e-9a70-afee2ade86ca Nov 06 11:56:34 devstack sudo[102804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:56:34 devstack sudo[102804]: pam_unix(sudo:session): session closed for user root Nov 06 11:56:34 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-1a5e287b-0334-452a-a1b5-be47929f1b87 tempest-CreateVolumesFromSnapshotTest-1293587525 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-f5555b44-1c88-445e-9a70-afee2ade86ca" returned: 0 in 0.819s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:56:34 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-1a5e287b-0334-452a-a1b5-be47929f1b87 tempest-CreateVolumesFromSnapshotTest-1293587525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-f5555b44-1c88-445e-9a70-afee2ade86ca {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:56:34 devstack sudo[102837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-f5555b44-1c88-445e-9a70-afee2ade86ca Nov 06 11:56:34 devstack sudo[102837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:56:35 devstack sudo[102837]: pam_unix(sudo:session): session closed for user root Nov 06 11:56:35 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-1a5e287b-0334-452a-a1b5-be47929f1b87 tempest-CreateVolumesFromSnapshotTest-1293587525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-f5555b44-1c88-445e-9a70-afee2ade86ca" returned: 0 in 0.678s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:56:35 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-1a5e287b-0334-452a-a1b5-be47929f1b87 tempest-CreateVolumesFromSnapshotTest-1293587525 None] Lock "cinder-quobyte-f5555b44-1c88-445e-9a70-afee2ade86ca" released by "delete_volume" :: held 1.619s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 11:56:35 devstack cinder-volume[87116]: DEBUG cinder.quota [None req-1a5e287b-0334-452a-a1b5-be47929f1b87 tempest-CreateVolumesFromSnapshotTest-1293587525 None] Created reservations ['cd15274b-9789-49ca-a919-a579722dda2d', '6e568283-3d55-4710-b0e6-a6f189fc93a7', 'b22e451a-7d8c-4fd6-9607-63230b233d46', 'ce60af9b-6d48-4b6e-9920-d219ef048393'] {{(pid=87116) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 11:56:35 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-1a5e287b-0334-452a-a1b5-be47929f1b87 tempest-CreateVolumesFromSnapshotTest-1293587525 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 11:56:35 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-1a5e287b-0334-452a-a1b5-be47929f1b87 tempest-CreateVolumesFromSnapshotTest-1293587525 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 11:56:35 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-1a5e287b-0334-452a-a1b5-be47929f1b87 tempest-CreateVolumesFromSnapshotTest-1293587525 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 11:56:35 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-1a5e287b-0334-452a-a1b5-be47929f1b87 tempest-CreateVolumesFromSnapshotTest-1293587525 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 11:56:35 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-1a5e287b-0334-452a-a1b5-be47929f1b87 tempest-CreateVolumesFromSnapshotTest-1293587525 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.029s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 11:56:35 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-1a5e287b-0334-452a-a1b5-be47929f1b87 tempest-CreateVolumesFromSnapshotTest-1293587525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:56:36 devstack sudo[102842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756 Nov 06 11:56:36 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-38e9cb6f-ae9c-4de4-9693-9f7396e2397a tempest-CreateVolumesFromSnapshotTest-1293587525 None] Acquiring lock "cinder-cbf5b5dd-8cd9-47c6-84e8-3852bc3ce55c-delete_volume" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 11:56:36 devstack sudo[102842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:56:36 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-38e9cb6f-ae9c-4de4-9693-9f7396e2397a tempest-CreateVolumesFromSnapshotTest-1293587525 None] Lock "cinder-cbf5b5dd-8cd9-47c6-84e8-3852bc3ce55c-delete_volume" acquired by "delete_volume" :: waited 0.071s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 11:56:36 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-38e9cb6f-ae9c-4de4-9693-9f7396e2397a tempest-CreateVolumesFromSnapshotTest-1293587525 None] Acquiring lock "cinder-quobyte-cbf5b5dd-8cd9-47c6-84e8-3852bc3ce55c" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 11:56:36 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-38e9cb6f-ae9c-4de4-9693-9f7396e2397a tempest-CreateVolumesFromSnapshotTest-1293587525 None] Lock "cinder-quobyte-cbf5b5dd-8cd9-47c6-84e8-3852bc3ce55c" acquired by "delete_volume" :: waited 0.016s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 11:56:36 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[bba26b46-67ca-4c07-95a5-5433b039cace]: (4, 'qcow2') {{(pid=88420) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 11:56:36 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-38e9cb6f-ae9c-4de4-9693-9f7396e2397a tempest-CreateVolumesFromSnapshotTest-1293587525 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-cbf5b5dd-8cd9-47c6-84e8-3852bc3ce55c {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:56:36 devstack sudo[102750]: pam_unix(sudo:session): session closed for user root Nov 06 11:56:36 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-4ded65f0-1c8f-465f-a413-e9bd50733e73 tempest-VolumesSnapshotTestJSON-1873011056 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-4c858247-6332-4d50-8e38-a5b645acb04b /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-006841cb-094c-4572-916d-3fd2a72c3814" returned: 0 in 8.734s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:56:36 devstack cinder-volume[87116]: DEBUG cinder.image.image_utils [None req-4ded65f0-1c8f-465f-a413-e9bd50733e73 tempest-VolumesSnapshotTestJSON-1873011056 None] Image conversion details: src /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-4c858247-6332-4d50-8e38-a5b645acb04b, size 1024.00 MB, duration 8.74 sec, destination /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-006841cb-094c-4572-916d-3fd2a72c3814 {{(pid=87116) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 06 11:56:36 devstack cinder-volume[87116]: INFO cinder.image.image_utils [None req-4ded65f0-1c8f-465f-a413-e9bd50733e73 tempest-VolumesSnapshotTestJSON-1873011056 None] Converted 1024.00 MB image at 117.19 MB/s Nov 06 11:56:36 devstack cinder-volume[87116]: WARNING cinder.volume.drivers.remotefs [None req-4ded65f0-1c8f-465f-a413-e9bd50733e73 tempest-VolumesSnapshotTestJSON-1873011056 None] /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-006841cb-094c-4572-916d-3fd2a72c3814 is being set with open permissions: ugo+rw Nov 06 11:56:36 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-4ded65f0-1c8f-465f-a413-e9bd50733e73 tempest-VolumesSnapshotTestJSON-1873011056 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-006841cb-094c-4572-916d-3fd2a72c3814 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:56:36 devstack sudo[102845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-006841cb-094c-4572-916d-3fd2a72c3814 Nov 06 11:56:36 devstack sudo[102845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:56:36 devstack sudo[102844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-cbf5b5dd-8cd9-47c6-84e8-3852bc3ce55c Nov 06 11:56:36 devstack sudo[102844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:56:36 devstack sudo[102842]: pam_unix(sudo:session): session closed for user root Nov 06 11:56:36 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-1a5e287b-0334-452a-a1b5-be47929f1b87 tempest-CreateVolumesFromSnapshotTest-1293587525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756" returned: 0 in 0.651s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:56:36 devstack cinder-volume[87116]: DEBUG cinder.manager [None req-1a5e287b-0334-452a-a1b5-be47929f1b87 tempest-CreateVolumesFromSnapshotTest-1293587525 None] Notifying Schedulers of capabilities ... {{(pid=87116) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 11:56:36 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-1a5e287b-0334-452a-a1b5-be47929f1b87 tempest-CreateVolumesFromSnapshotTest-1293587525 None] Deleted volume successfully. Nov 06 11:56:36 devstack sudo[102845]: pam_unix(sudo:session): session closed for user root Nov 06 11:56:36 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-4ded65f0-1c8f-465f-a413-e9bd50733e73 tempest-VolumesSnapshotTestJSON-1873011056 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-006841cb-094c-4572-916d-3fd2a72c3814" returned: 0 in 0.389s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:56:36 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-1a5e287b-0334-452a-a1b5-be47929f1b87 tempest-CreateVolumesFromSnapshotTest-1293587525 None] Lock "cinder-f5555b44-1c88-445e-9a70-afee2ade86ca-delete_volume" released by "delete_volume" :: held 3.009s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 11:56:36 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-4ded65f0-1c8f-465f-a413-e9bd50733e73 tempest-VolumesSnapshotTestJSON-1873011056 None] Lock "cinder-quobyte-006841cb-094c-4572-916d-3fd2a72c3814" released by "_copy_volume_from_snapshot" :: held 10.094s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 11:56:36 devstack sudo[102844]: pam_unix(sudo:session): session closed for user root Nov 06 11:56:36 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-38e9cb6f-ae9c-4de4-9693-9f7396e2397a tempest-CreateVolumesFromSnapshotTest-1293587525 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-cbf5b5dd-8cd9-47c6-84e8-3852bc3ce55c" returned: 0 in 0.498s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:56:36 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-38e9cb6f-ae9c-4de4-9693-9f7396e2397a tempest-CreateVolumesFromSnapshotTest-1293587525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-cbf5b5dd-8cd9-47c6-84e8-3852bc3ce55c {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:56:36 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-4ded65f0-1c8f-465f-a413-e9bd50733e73 tempest-VolumesSnapshotTestJSON-1873011056 None] Lock "cinder-quobyte-8121f4f1-04d0-4124-99b1-e1556bf08dca-006841cb-094c-4572-916d-3fd2a72c3814" released by "_create_volume_from_snapshot" :: held 10.223s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 11:56:36 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-4ded65f0-1c8f-465f-a413-e9bd50733e73 tempest-VolumesSnapshotTestJSON-1873011056 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.246s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 11:56:36 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-cd5c7a76-a04d-4f21-9420-7e2d58f3bc3c tempest-VolumeDependencyTests-568082837 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 10.243s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 11:56:36 devstack sudo[102853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-cbf5b5dd-8cd9-47c6-84e8-3852bc3ce55c Nov 06 11:56:36 devstack sudo[102853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:56:36 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-cd5c7a76-a04d-4f21-9420-7e2d58f3bc3c tempest-VolumeDependencyTests-568082837 None] Creating offline snapshot 698750ec-da9d-4373-9c3d-fbcf72c6873e of volume 5496bc0e-2d25-4053-afaa-f6fe7bef3bea {{(pid=87116) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 06 11:56:36 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-4ded65f0-1c8f-465f-a413-e9bd50733e73 tempest-VolumesSnapshotTestJSON-1873011056 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b64a54ae-ed80-4339-be36-b5173296453f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-006841cb-094c-4572-916d-3fd2a72c3814', 'volume_size': 2, 'snapshot_id': '8121f4f1-04d0-4124-99b1-e1556bf08dca'}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:56:36 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-4ded65f0-1c8f-465f-a413-e9bd50733e73 tempest-VolumesSnapshotTestJSON-1873011056 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (821a4e5a-7007-4605-a28d-4b743df8cd9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:56:36 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[9862bc09-11af-4806-8098-855b7aea9022]: (4, 'qcow2') {{(pid=88420) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 11:56:36 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-cd5c7a76-a04d-4f21-9420-7e2d58f3bc3c tempest-VolumeDependencyTests-568082837 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-5496bc0e-2d25-4053-afaa-f6fe7bef3bea {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:56:36 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-4ded65f0-1c8f-465f-a413-e9bd50733e73 tempest-VolumesSnapshotTestJSON-1873011056 None] Volume volume-006841cb-094c-4572-916d-3fd2a72c3814 (006841cb-094c-4572-916d-3fd2a72c3814): created successfully Nov 06 11:56:36 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-4ded65f0-1c8f-465f-a413-e9bd50733e73 tempest-VolumesSnapshotTestJSON-1873011056 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (821a4e5a-7007-4605-a28d-4b743df8cd9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:56:36 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-4ded65f0-1c8f-465f-a413-e9bd50733e73 tempest-VolumesSnapshotTestJSON-1873011056 None] Flow 'volume_create_manager' (c5516a08-13b9-4b1c-a0ed-8bddb4683509) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 11:56:36 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-4ded65f0-1c8f-465f-a413-e9bd50733e73 tempest-VolumesSnapshotTestJSON-1873011056 None] Created volume successfully. Nov 06 11:56:36 devstack sudo[102855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-5496bc0e-2d25-4053-afaa-f6fe7bef3bea Nov 06 11:56:36 devstack sudo[102855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:56:37 devstack sudo[102853]: pam_unix(sudo:session): session closed for user root Nov 06 11:56:37 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-38e9cb6f-ae9c-4de4-9693-9f7396e2397a tempest-CreateVolumesFromSnapshotTest-1293587525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-cbf5b5dd-8cd9-47c6-84e8-3852bc3ce55c" returned: 0 in 0.313s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:56:37 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-38e9cb6f-ae9c-4de4-9693-9f7396e2397a tempest-CreateVolumesFromSnapshotTest-1293587525 None] Lock "cinder-quobyte-cbf5b5dd-8cd9-47c6-84e8-3852bc3ce55c" released by "delete_volume" :: held 0.855s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 11:56:37 devstack cinder-volume[87116]: DEBUG cinder.quota [None req-38e9cb6f-ae9c-4de4-9693-9f7396e2397a tempest-CreateVolumesFromSnapshotTest-1293587525 None] Created reservations ['f0f724e0-99d9-46e1-ba0f-bd9f6a976501', 'e0160118-3d95-49d0-8ee7-cbde95ff9ffe', 'beb514f9-1e14-4c64-94b0-3e89e3bc9344', '1e54c753-fe28-490f-883d-842260379312'] {{(pid=87116) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 11:56:37 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-38e9cb6f-ae9c-4de4-9693-9f7396e2397a tempest-CreateVolumesFromSnapshotTest-1293587525 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 11:56:37 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-38e9cb6f-ae9c-4de4-9693-9f7396e2397a tempest-CreateVolumesFromSnapshotTest-1293587525 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 11:56:37 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-38e9cb6f-ae9c-4de4-9693-9f7396e2397a tempest-CreateVolumesFromSnapshotTest-1293587525 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 11:56:37 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-38e9cb6f-ae9c-4de4-9693-9f7396e2397a tempest-CreateVolumesFromSnapshotTest-1293587525 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 11:56:37 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-38e9cb6f-ae9c-4de4-9693-9f7396e2397a tempest-CreateVolumesFromSnapshotTest-1293587525 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 11:56:37 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-38e9cb6f-ae9c-4de4-9693-9f7396e2397a tempest-CreateVolumesFromSnapshotTest-1293587525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:56:37 devstack sudo[102861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756 Nov 06 11:56:37 devstack sudo[102861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:56:37 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-5ef89a1d-8170-401a-af22-574ef7e43b3a tempest-CreateVolumesFromSnapshotTest-1293587525 None] Acquiring lock "cinder-373327f7-e9f7-43dc-a12e-8d9b63440a62-delete_snapshot" by "delete_snapshot" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 11:56:37 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-e7bf1292-c8a6-4b14-b408-45a2e77d1b68 tempest-VolumesSnapshotTestJSON-1873011056 None] Acquiring lock "cinder-006841cb-094c-4572-916d-3fd2a72c3814-delete_volume" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 11:56:37 devstack sudo[102855]: pam_unix(sudo:session): session closed for user root Nov 06 11:56:37 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-5ef89a1d-8170-401a-af22-574ef7e43b3a tempest-CreateVolumesFromSnapshotTest-1293587525 None] Lock "cinder-373327f7-e9f7-43dc-a12e-8d9b63440a62-delete_snapshot" acquired by "delete_snapshot" :: waited 0.058s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 11:56:37 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-5ef89a1d-8170-401a-af22-574ef7e43b3a tempest-CreateVolumesFromSnapshotTest-1293587525 None] Acquiring lock "cinder-quobyte-56b47392-5f46-4396-934c-9477ffc90354" by "delete_snapshot" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 11:56:37 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-cd5c7a76-a04d-4f21-9420-7e2d58f3bc3c tempest-VolumeDependencyTests-568082837 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-5496bc0e-2d25-4053-afaa-f6fe7bef3bea" returned: 0 in 0.549s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:56:37 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-cd5c7a76-a04d-4f21-9420-7e2d58f3bc3c tempest-VolumeDependencyTests-568082837 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-5496bc0e-2d25-4053-afaa-f6fe7bef3bea,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-5496bc0e-2d25-4053-afaa-f6fe7bef3bea.698750ec-da9d-4373-9c3d-fbcf72c6873e 1G {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:56:37 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-e7bf1292-c8a6-4b14-b408-45a2e77d1b68 tempest-VolumesSnapshotTestJSON-1873011056 None] Lock "cinder-006841cb-094c-4572-916d-3fd2a72c3814-delete_volume" acquired by "delete_volume" :: waited 0.067s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 11:56:37 devstack sudo[102863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-5496bc0e-2d25-4053-afaa-f6fe7bef3bea,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-5496bc0e-2d25-4053-afaa-f6fe7bef3bea.698750ec-da9d-4373-9c3d-fbcf72c6873e 1G Nov 06 11:56:37 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-5ef89a1d-8170-401a-af22-574ef7e43b3a tempest-CreateVolumesFromSnapshotTest-1293587525 None] Lock "cinder-quobyte-56b47392-5f46-4396-934c-9477ffc90354" acquired by "delete_snapshot" :: waited 0.050s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 11:56:37 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-5ef89a1d-8170-401a-af22-574ef7e43b3a tempest-CreateVolumesFromSnapshotTest-1293587525 None] Acquiring lock "cinder-quobyte-373327f7-e9f7-43dc-a12e-8d9b63440a62" by "_delete_snapshot" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 11:56:37 devstack sudo[102863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:56:37 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-5ef89a1d-8170-401a-af22-574ef7e43b3a tempest-CreateVolumesFromSnapshotTest-1293587525 None] Lock "cinder-quobyte-373327f7-e9f7-43dc-a12e-8d9b63440a62" acquired by "_delete_snapshot" :: waited 0.028s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 11:56:37 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-5ef89a1d-8170-401a-af22-574ef7e43b3a tempest-CreateVolumesFromSnapshotTest-1293587525 None] Deleting offline snapshot 373327f7-e9f7-43dc-a12e-8d9b63440a62 of volume 56b47392-5f46-4396-934c-9477ffc90354 {{(pid=87116) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 06 11:56:37 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-5ef89a1d-8170-401a-af22-574ef7e43b3a tempest-CreateVolumesFromSnapshotTest-1293587525 None] snapshot_file for this snap is: volume-56b47392-5f46-4396-934c-9477ffc90354.373327f7-e9f7-43dc-a12e-8d9b63440a62 {{(pid=87116) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 06 11:56:37 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-e7bf1292-c8a6-4b14-b408-45a2e77d1b68 tempest-VolumesSnapshotTestJSON-1873011056 None] Acquiring lock "cinder-quobyte-006841cb-094c-4572-916d-3fd2a72c3814" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 11:56:37 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c77c9e2-c49d-42f1-a16a-f5772e05e23c]: (4, 'qcow2') {{(pid=88420) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 11:56:37 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-5ef89a1d-8170-401a-af22-574ef7e43b3a tempest-CreateVolumesFromSnapshotTest-1293587525 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-56b47392-5f46-4396-934c-9477ffc90354.373327f7-e9f7-43dc-a12e-8d9b63440a62 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:56:37 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-e7bf1292-c8a6-4b14-b408-45a2e77d1b68 tempest-VolumesSnapshotTestJSON-1873011056 None] Lock "cinder-quobyte-006841cb-094c-4572-916d-3fd2a72c3814" acquired by "delete_volume" :: waited 0.037s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 11:56:37 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd3a8f49-b8ba-42fa-b734-9d77d5ba21ff]: (4, 'qcow2') {{(pid=88420) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 11:56:37 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-e7bf1292-c8a6-4b14-b408-45a2e77d1b68 tempest-VolumesSnapshotTestJSON-1873011056 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-006841cb-094c-4572-916d-3fd2a72c3814 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:56:37 devstack sudo[102861]: pam_unix(sudo:session): session closed for user root Nov 06 11:56:37 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-38e9cb6f-ae9c-4de4-9693-9f7396e2397a tempest-CreateVolumesFromSnapshotTest-1293587525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756" returned: 0 in 0.364s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:56:37 devstack cinder-volume[87116]: DEBUG cinder.manager [None req-38e9cb6f-ae9c-4de4-9693-9f7396e2397a tempest-CreateVolumesFromSnapshotTest-1293587525 None] Notifying Schedulers of capabilities ... {{(pid=87116) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 11:56:37 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-38e9cb6f-ae9c-4de4-9693-9f7396e2397a tempest-CreateVolumesFromSnapshotTest-1293587525 None] Deleted volume successfully. Nov 06 11:56:37 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-38e9cb6f-ae9c-4de4-9693-9f7396e2397a tempest-CreateVolumesFromSnapshotTest-1293587525 None] Lock "cinder-cbf5b5dd-8cd9-47c6-84e8-3852bc3ce55c-delete_volume" released by "delete_volume" :: held 1.506s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 11:56:37 devstack sudo[102865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-56b47392-5f46-4396-934c-9477ffc90354.373327f7-e9f7-43dc-a12e-8d9b63440a62 Nov 06 11:56:37 devstack sudo[102865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:56:37 devstack sudo[102867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-006841cb-094c-4572-916d-3fd2a72c3814 Nov 06 11:56:37 devstack sudo[102867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:56:38 devstack sudo[102865]: pam_unix(sudo:session): session closed for user root Nov 06 11:56:38 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-5ef89a1d-8170-401a-af22-574ef7e43b3a tempest-CreateVolumesFromSnapshotTest-1293587525 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-56b47392-5f46-4396-934c-9477ffc90354.373327f7-e9f7-43dc-a12e-8d9b63440a62" returned: 0 in 0.484s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:56:38 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-5ef89a1d-8170-401a-af22-574ef7e43b3a tempest-CreateVolumesFromSnapshotTest-1293587525 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-56b47392-5f46-4396-934c-9477ffc90354(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87116) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 11:56:38 devstack sudo[102863]: pam_unix(sudo:session): session closed for user root Nov 06 11:56:38 devstack sudo[102867]: pam_unix(sudo:session): session closed for user root Nov 06 11:56:38 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-e7bf1292-c8a6-4b14-b408-45a2e77d1b68 tempest-VolumesSnapshotTestJSON-1873011056 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-006841cb-094c-4572-916d-3fd2a72c3814" returned: 0 in 0.450s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:56:38 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-cd5c7a76-a04d-4f21-9420-7e2d58f3bc3c tempest-VolumeDependencyTests-568082837 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-5496bc0e-2d25-4053-afaa-f6fe7bef3bea,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-5496bc0e-2d25-4053-afaa-f6fe7bef3bea.698750ec-da9d-4373-9c3d-fbcf72c6873e 1G" returned: 0 in 0.649s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:56:38 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-e7bf1292-c8a6-4b14-b408-45a2e77d1b68 tempest-VolumesSnapshotTestJSON-1873011056 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-006841cb-094c-4572-916d-3fd2a72c3814 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:56:38 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-cd5c7a76-a04d-4f21-9420-7e2d58f3bc3c tempest-VolumeDependencyTests-568082837 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5496bc0e-2d25-4053-afaa-f6fe7bef3bea -F qcow2 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-5496bc0e-2d25-4053-afaa-f6fe7bef3bea.698750ec-da9d-4373-9c3d-fbcf72c6873e {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:56:38 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[f71020ee-9c87-4191-abc7-295ba82b19ea]: (4, 'qcow2') {{(pid=88420) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 11:56:38 devstack sudo[102886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-006841cb-094c-4572-916d-3fd2a72c3814 Nov 06 11:56:38 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-5ef89a1d-8170-401a-af22-574ef7e43b3a tempest-CreateVolumesFromSnapshotTest-1293587525 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-56b47392-5f46-4396-934c-9477ffc90354 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:56:38 devstack sudo[102886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:56:38 devstack sudo[102887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5496bc0e-2d25-4053-afaa-f6fe7bef3bea -F qcow2 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-5496bc0e-2d25-4053-afaa-f6fe7bef3bea.698750ec-da9d-4373-9c3d-fbcf72c6873e Nov 06 11:56:38 devstack sudo[102887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:56:38 devstack sudo[102889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-56b47392-5f46-4396-934c-9477ffc90354 Nov 06 11:56:38 devstack sudo[102889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:56:38 devstack sudo[102886]: pam_unix(sudo:session): session closed for user root Nov 06 11:56:38 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-e7bf1292-c8a6-4b14-b408-45a2e77d1b68 tempest-VolumesSnapshotTestJSON-1873011056 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-006841cb-094c-4572-916d-3fd2a72c3814" returned: 0 in 0.287s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:56:38 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-e7bf1292-c8a6-4b14-b408-45a2e77d1b68 tempest-VolumesSnapshotTestJSON-1873011056 None] Lock "cinder-quobyte-006841cb-094c-4572-916d-3fd2a72c3814" released by "delete_volume" :: held 0.806s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 11:56:38 devstack cinder-volume[87116]: DEBUG cinder.quota [None req-e7bf1292-c8a6-4b14-b408-45a2e77d1b68 tempest-VolumesSnapshotTestJSON-1873011056 None] Created reservations ['391e8e77-7bf5-44ee-933b-b76416fa0026', '8c52b2d3-d2ac-490f-92ac-ea782de599cc', '6f7ef97e-31a7-4452-88bc-e906691bf0ef', '2a2a608e-46fc-4967-b6bc-b8cbce356bd0'] {{(pid=87116) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 11:56:38 devstack sudo[102887]: pam_unix(sudo:session): session closed for user root Nov 06 11:56:38 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-cd5c7a76-a04d-4f21-9420-7e2d58f3bc3c tempest-VolumeDependencyTests-568082837 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5496bc0e-2d25-4053-afaa-f6fe7bef3bea -F qcow2 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-5496bc0e-2d25-4053-afaa-f6fe7bef3bea.698750ec-da9d-4373-9c3d-fbcf72c6873e" returned: 0 in 0.417s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:56:38 devstack cinder-volume[87116]: WARNING cinder.volume.drivers.remotefs [None req-cd5c7a76-a04d-4f21-9420-7e2d58f3bc3c tempest-VolumeDependencyTests-568082837 None] /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-5496bc0e-2d25-4053-afaa-f6fe7bef3bea.698750ec-da9d-4373-9c3d-fbcf72c6873e is being set with open permissions: ugo+rw Nov 06 11:56:38 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-cd5c7a76-a04d-4f21-9420-7e2d58f3bc3c tempest-VolumeDependencyTests-568082837 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-5496bc0e-2d25-4053-afaa-f6fe7bef3bea.698750ec-da9d-4373-9c3d-fbcf72c6873e {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:56:38 devstack sudo[102899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-5496bc0e-2d25-4053-afaa-f6fe7bef3bea.698750ec-da9d-4373-9c3d-fbcf72c6873e Nov 06 11:56:38 devstack sudo[102899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:56:38 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-e7bf1292-c8a6-4b14-b408-45a2e77d1b68 tempest-VolumesSnapshotTestJSON-1873011056 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 11:56:38 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-e7bf1292-c8a6-4b14-b408-45a2e77d1b68 tempest-VolumesSnapshotTestJSON-1873011056 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 11:56:38 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-e7bf1292-c8a6-4b14-b408-45a2e77d1b68 tempest-VolumesSnapshotTestJSON-1873011056 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 11:56:38 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-e7bf1292-c8a6-4b14-b408-45a2e77d1b68 tempest-VolumesSnapshotTestJSON-1873011056 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 11:56:38 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-e7bf1292-c8a6-4b14-b408-45a2e77d1b68 tempest-VolumesSnapshotTestJSON-1873011056 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 11:56:38 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-e7bf1292-c8a6-4b14-b408-45a2e77d1b68 tempest-VolumesSnapshotTestJSON-1873011056 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:56:38 devstack sudo[102889]: pam_unix(sudo:session): session closed for user root Nov 06 11:56:38 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-5ef89a1d-8170-401a-af22-574ef7e43b3a tempest-CreateVolumesFromSnapshotTest-1293587525 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-56b47392-5f46-4396-934c-9477ffc90354" returned: 0 in 0.508s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:56:38 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-5ef89a1d-8170-401a-af22-574ef7e43b3a tempest-CreateVolumesFromSnapshotTest-1293587525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-56b47392-5f46-4396-934c-9477ffc90354.373327f7-e9f7-43dc-a12e-8d9b63440a62 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:56:38 devstack sudo[102902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756 Nov 06 11:56:38 devstack sudo[102902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:56:38 devstack sudo[102903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-56b47392-5f46-4396-934c-9477ffc90354.373327f7-e9f7-43dc-a12e-8d9b63440a62 Nov 06 11:56:38 devstack sudo[102903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:56:38 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-15f9ae40-2c60-498b-a32f-51b9a9efd845 tempest-VolumesSnapshotTestJSON-1873011056 None] Acquiring lock "cinder-8121f4f1-04d0-4124-99b1-e1556bf08dca-delete_snapshot" by "delete_snapshot" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 11:56:38 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-15f9ae40-2c60-498b-a32f-51b9a9efd845 tempest-VolumesSnapshotTestJSON-1873011056 None] Lock "cinder-8121f4f1-04d0-4124-99b1-e1556bf08dca-delete_snapshot" acquired by "delete_snapshot" :: waited 0.039s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 11:56:38 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-15f9ae40-2c60-498b-a32f-51b9a9efd845 tempest-VolumesSnapshotTestJSON-1873011056 None] Acquiring lock "cinder-quobyte-4c858247-6332-4d50-8e38-a5b645acb04b" by "delete_snapshot" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 11:56:38 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-15f9ae40-2c60-498b-a32f-51b9a9efd845 tempest-VolumesSnapshotTestJSON-1873011056 None] Lock "cinder-quobyte-4c858247-6332-4d50-8e38-a5b645acb04b" acquired by "delete_snapshot" :: waited 0.030s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 11:56:38 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-15f9ae40-2c60-498b-a32f-51b9a9efd845 tempest-VolumesSnapshotTestJSON-1873011056 None] Acquiring lock "cinder-quobyte-8121f4f1-04d0-4124-99b1-e1556bf08dca" by "_delete_snapshot" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 11:56:38 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-15f9ae40-2c60-498b-a32f-51b9a9efd845 tempest-VolumesSnapshotTestJSON-1873011056 None] Lock "cinder-quobyte-8121f4f1-04d0-4124-99b1-e1556bf08dca" acquired by "_delete_snapshot" :: waited 0.029s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 11:56:38 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-15f9ae40-2c60-498b-a32f-51b9a9efd845 tempest-VolumesSnapshotTestJSON-1873011056 None] Deleting offline snapshot 8121f4f1-04d0-4124-99b1-e1556bf08dca of volume 4c858247-6332-4d50-8e38-a5b645acb04b {{(pid=87116) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 06 11:56:38 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-15f9ae40-2c60-498b-a32f-51b9a9efd845 tempest-VolumesSnapshotTestJSON-1873011056 None] snapshot_file for this snap is: volume-4c858247-6332-4d50-8e38-a5b645acb04b.8121f4f1-04d0-4124-99b1-e1556bf08dca {{(pid=87116) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 06 11:56:38 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[12cee581-4d06-431b-99d5-48a08a96bac9]: (4, 'qcow2') {{(pid=88420) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 11:56:38 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-15f9ae40-2c60-498b-a32f-51b9a9efd845 tempest-VolumesSnapshotTestJSON-1873011056 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-4c858247-6332-4d50-8e38-a5b645acb04b.8121f4f1-04d0-4124-99b1-e1556bf08dca {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:56:38 devstack sudo[102899]: pam_unix(sudo:session): session closed for user root Nov 06 11:56:38 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-cd5c7a76-a04d-4f21-9420-7e2d58f3bc3c tempest-VolumeDependencyTests-568082837 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-5496bc0e-2d25-4053-afaa-f6fe7bef3bea.698750ec-da9d-4373-9c3d-fbcf72c6873e" returned: 0 in 0.416s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:56:38 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-cd5c7a76-a04d-4f21-9420-7e2d58f3bc3c tempest-VolumeDependencyTests-568082837 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-5496bc0e-2d25-4053-afaa-f6fe7bef3bea.info {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:56:39 devstack sudo[102911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-5496bc0e-2d25-4053-afaa-f6fe7bef3bea.info Nov 06 11:56:39 devstack sudo[102911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:56:39 devstack sudo[102910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-4c858247-6332-4d50-8e38-a5b645acb04b.8121f4f1-04d0-4124-99b1-e1556bf08dca Nov 06 11:56:39 devstack sudo[102910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:56:39 devstack sudo[102902]: pam_unix(sudo:session): session closed for user root Nov 06 11:56:39 devstack sudo[102903]: pam_unix(sudo:session): session closed for user root Nov 06 11:56:39 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-5ef89a1d-8170-401a-af22-574ef7e43b3a tempest-CreateVolumesFromSnapshotTest-1293587525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-56b47392-5f46-4396-934c-9477ffc90354.373327f7-e9f7-43dc-a12e-8d9b63440a62" returned: 0 in 0.479s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:56:39 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-5ef89a1d-8170-401a-af22-574ef7e43b3a tempest-CreateVolumesFromSnapshotTest-1293587525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-56b47392-5f46-4396-934c-9477ffc90354.373327f7-e9f7-43dc-a12e-8d9b63440a62 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:56:39 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-e7bf1292-c8a6-4b14-b408-45a2e77d1b68 tempest-VolumesSnapshotTestJSON-1873011056 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756" returned: 0 in 0.516s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:56:39 devstack cinder-volume[87116]: DEBUG cinder.manager [None req-e7bf1292-c8a6-4b14-b408-45a2e77d1b68 tempest-VolumesSnapshotTestJSON-1873011056 None] Notifying Schedulers of capabilities ... {{(pid=87116) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 11:56:39 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-e7bf1292-c8a6-4b14-b408-45a2e77d1b68 tempest-VolumesSnapshotTestJSON-1873011056 None] Deleted volume successfully. Nov 06 11:56:39 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-e7bf1292-c8a6-4b14-b408-45a2e77d1b68 tempest-VolumesSnapshotTestJSON-1873011056 None] Lock "cinder-006841cb-094c-4572-916d-3fd2a72c3814-delete_volume" released by "delete_volume" :: held 1.707s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 11:56:39 devstack sudo[102916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-56b47392-5f46-4396-934c-9477ffc90354.373327f7-e9f7-43dc-a12e-8d9b63440a62 Nov 06 11:56:39 devstack sudo[102916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:56:39 devstack sudo[102911]: pam_unix(sudo:session): session closed for user root Nov 06 11:56:39 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-cd5c7a76-a04d-4f21-9420-7e2d58f3bc3c tempest-VolumeDependencyTests-568082837 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-5496bc0e-2d25-4053-afaa-f6fe7bef3bea.info" returned: 0 in 0.353s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:56:39 devstack cinder-volume[87116]: WARNING cinder.volume.drivers.remotefs [None req-cd5c7a76-a04d-4f21-9420-7e2d58f3bc3c tempest-VolumeDependencyTests-568082837 None] /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-5496bc0e-2d25-4053-afaa-f6fe7bef3bea.info is being set with open permissions: ugo+rw Nov 06 11:56:39 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-cd5c7a76-a04d-4f21-9420-7e2d58f3bc3c tempest-VolumeDependencyTests-568082837 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-5496bc0e-2d25-4053-afaa-f6fe7bef3bea.info {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:56:39 devstack sudo[102923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-5496bc0e-2d25-4053-afaa-f6fe7bef3bea.info Nov 06 11:56:39 devstack sudo[102923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:56:39 devstack sudo[102910]: pam_unix(sudo:session): session closed for user root Nov 06 11:56:39 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-15f9ae40-2c60-498b-a32f-51b9a9efd845 tempest-VolumesSnapshotTestJSON-1873011056 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-4c858247-6332-4d50-8e38-a5b645acb04b.8121f4f1-04d0-4124-99b1-e1556bf08dca" returned: 0 in 0.496s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:56:39 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-15f9ae40-2c60-498b-a32f-51b9a9efd845 tempest-VolumesSnapshotTestJSON-1873011056 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4c858247-6332-4d50-8e38-a5b645acb04b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87116) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 11:56:39 devstack sudo[102916]: pam_unix(sudo:session): session closed for user root Nov 06 11:56:39 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-5ef89a1d-8170-401a-af22-574ef7e43b3a tempest-CreateVolumesFromSnapshotTest-1293587525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-56b47392-5f46-4396-934c-9477ffc90354.373327f7-e9f7-43dc-a12e-8d9b63440a62" returned: 0 in 0.377s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:56:39 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea774cdf-5b0b-4e91-9c36-9b1b64df3c09]: (4, 'qcow2') {{(pid=88420) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 11:56:39 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-15f9ae40-2c60-498b-a32f-51b9a9efd845 tempest-VolumesSnapshotTestJSON-1873011056 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-4c858247-6332-4d50-8e38-a5b645acb04b {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:56:39 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-5ef89a1d-8170-401a-af22-574ef7e43b3a tempest-CreateVolumesFromSnapshotTest-1293587525 None] Lock "cinder-quobyte-373327f7-e9f7-43dc-a12e-8d9b63440a62" released by "_delete_snapshot" :: held 2.085s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 11:56:39 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-5ef89a1d-8170-401a-af22-574ef7e43b3a tempest-CreateVolumesFromSnapshotTest-1293587525 None] Lock "cinder-quobyte-56b47392-5f46-4396-934c-9477ffc90354" released by "delete_snapshot" :: held 2.135s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 11:56:39 devstack sudo[102923]: pam_unix(sudo:session): session closed for user root Nov 06 11:56:39 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-cd5c7a76-a04d-4f21-9420-7e2d58f3bc3c tempest-VolumeDependencyTests-568082837 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-5496bc0e-2d25-4053-afaa-f6fe7bef3bea.info" returned: 0 in 0.398s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:56:39 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-cd5c7a76-a04d-4f21-9420-7e2d58f3bc3c tempest-VolumeDependencyTests-568082837 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.938s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 11:56:39 devstack sudo[102926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-4c858247-6332-4d50-8e38-a5b645acb04b Nov 06 11:56:39 devstack sudo[102926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:56:39 devstack cinder-volume[87116]: DEBUG cinder.quota [None req-5ef89a1d-8170-401a-af22-574ef7e43b3a tempest-CreateVolumesFromSnapshotTest-1293587525 None] Created reservations ['2c7fcda6-1ff2-44ad-a5b5-29b360ac8817', '7e3af562-bceb-4c37-82dc-d52698c96064', '5eec7ea1-7d61-4390-8fb6-d4b106eb36b5', 'e7bb632b-1bf2-4915-b183-6044f6022261'] {{(pid=87116) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 11:56:39 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-cd5c7a76-a04d-4f21-9420-7e2d58f3bc3c tempest-VolumeDependencyTests-568082837 None] Create snapshot completed successfully Nov 06 11:56:39 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-5ef89a1d-8170-401a-af22-574ef7e43b3a tempest-CreateVolumesFromSnapshotTest-1293587525 None] Delete snapshot completed successfully. Nov 06 11:56:39 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-5ef89a1d-8170-401a-af22-574ef7e43b3a tempest-CreateVolumesFromSnapshotTest-1293587525 None] Lock "cinder-373327f7-e9f7-43dc-a12e-8d9b63440a62-delete_snapshot" released by "delete_snapshot" :: held 2.448s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 11:56:39 devstack cinder-volume[87116]: DEBUG oslo_service.periodic_task [None req-4fab4816-ec2b-4b19-b2ff-8548f2084354 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87116) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 11:56:39 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-4fab4816-ec2b-4b19-b2ff-8548f2084354 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 11:56:39 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-4fab4816-ec2b-4b19-b2ff-8548f2084354 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 11:56:39 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-4fab4816-ec2b-4b19-b2ff-8548f2084354 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 11:56:39 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-4fab4816-ec2b-4b19-b2ff-8548f2084354 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 11:56:39 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-4fab4816-ec2b-4b19-b2ff-8548f2084354 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 11:56:39 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-4fab4816-ec2b-4b19-b2ff-8548f2084354 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:56:39 devstack sudo[102929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756 Nov 06 11:56:39 devstack sudo[102929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:56:40 devstack sudo[102929]: pam_unix(sudo:session): session closed for user root Nov 06 11:56:40 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-4fab4816-ec2b-4b19-b2ff-8548f2084354 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756" returned: 0 in 0.269s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:56:40 devstack cinder-volume[87116]: DEBUG cinder.manager [None req-4fab4816-ec2b-4b19-b2ff-8548f2084354 None None] Notifying Schedulers of capabilities ... {{(pid=87116) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 11:56:40 devstack cinder-volume[87116]: DEBUG oslo_service.periodic_task [None req-4fab4816-ec2b-4b19-b2ff-8548f2084354 None None] Running periodic task VolumeManager._thread_info {{(pid=87116) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 11:56:40 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-4fab4816-ec2b-4b19-b2ff-8548f2084354 None None] thread count: 28 {{(pid=87116) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 06 11:56:40 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-4fab4816-ec2b-4b19-b2ff-8548f2084354 None None] thread info: [<_MainThread(MainThread, started 131399520669824)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87116) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 06 11:56:40 devstack sudo[102926]: pam_unix(sudo:session): session closed for user root Nov 06 11:56:40 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-15f9ae40-2c60-498b-a32f-51b9a9efd845 tempest-VolumesSnapshotTestJSON-1873011056 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-4c858247-6332-4d50-8e38-a5b645acb04b" returned: 0 in 0.798s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:56:40 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-15f9ae40-2c60-498b-a32f-51b9a9efd845 tempest-VolumesSnapshotTestJSON-1873011056 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-4c858247-6332-4d50-8e38-a5b645acb04b.8121f4f1-04d0-4124-99b1-e1556bf08dca {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:56:40 devstack sudo[102935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-4c858247-6332-4d50-8e38-a5b645acb04b.8121f4f1-04d0-4124-99b1-e1556bf08dca Nov 06 11:56:40 devstack sudo[102935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:56:40 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-13873292-98a8-4757-bafd-b307c765193b tempest-CreateVolumesFromSnapshotTest-1293587525 None] Acquiring lock "cinder-56b47392-5f46-4396-934c-9477ffc90354-delete_volume" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 11:56:40 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-13873292-98a8-4757-bafd-b307c765193b tempest-CreateVolumesFromSnapshotTest-1293587525 None] Lock "cinder-56b47392-5f46-4396-934c-9477ffc90354-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 11:56:40 devstack sudo[102935]: pam_unix(sudo:session): session closed for user root Nov 06 11:56:40 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-15f9ae40-2c60-498b-a32f-51b9a9efd845 tempest-VolumesSnapshotTestJSON-1873011056 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-4c858247-6332-4d50-8e38-a5b645acb04b.8121f4f1-04d0-4124-99b1-e1556bf08dca" returned: 0 in 0.497s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:56:40 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-15f9ae40-2c60-498b-a32f-51b9a9efd845 tempest-VolumesSnapshotTestJSON-1873011056 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-4c858247-6332-4d50-8e38-a5b645acb04b.8121f4f1-04d0-4124-99b1-e1556bf08dca {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:56:40 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-13873292-98a8-4757-bafd-b307c765193b tempest-CreateVolumesFromSnapshotTest-1293587525 None] Acquiring lock "cinder-quobyte-56b47392-5f46-4396-934c-9477ffc90354" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 11:56:40 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-13873292-98a8-4757-bafd-b307c765193b tempest-CreateVolumesFromSnapshotTest-1293587525 None] Lock "cinder-quobyte-56b47392-5f46-4396-934c-9477ffc90354" acquired by "delete_volume" :: waited 0.028s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 11:56:40 devstack sudo[102940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-4c858247-6332-4d50-8e38-a5b645acb04b.8121f4f1-04d0-4124-99b1-e1556bf08dca Nov 06 11:56:40 devstack sudo[102940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:56:40 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[9138aa30-c173-4714-ad47-439b9323945f]: (4, 'qcow2') {{(pid=88420) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 11:56:40 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-13873292-98a8-4757-bafd-b307c765193b tempest-CreateVolumesFromSnapshotTest-1293587525 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-56b47392-5f46-4396-934c-9477ffc90354 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:56:41 devstack sudo[102942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-56b47392-5f46-4396-934c-9477ffc90354 Nov 06 11:56:41 devstack sudo[102942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:56:41 devstack cinder-volume[87116]: DEBUG cinder.volume.flows.manager.create_volume [None req-8ecc634d-ff82-435b-aaf6-80123dca306a tempest-VolumeDependencyTests-568082837 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87116) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 11:56:41 devstack sudo[102940]: pam_unix(sudo:session): session closed for user root Nov 06 11:56:41 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-15f9ae40-2c60-498b-a32f-51b9a9efd845 tempest-VolumesSnapshotTestJSON-1873011056 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-4c858247-6332-4d50-8e38-a5b645acb04b.8121f4f1-04d0-4124-99b1-e1556bf08dca" returned: 0 in 0.413s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:56:41 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-8ecc634d-ff82-435b-aaf6-80123dca306a tempest-VolumeDependencyTests-568082837 None] Flow 'volume_create_manager' (15d7be8f-d3ff-409d-acdc-ba3e1e02d8e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 11:56:41 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-8ecc634d-ff82-435b-aaf6-80123dca306a tempest-VolumeDependencyTests-568082837 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5d941ded-73cb-48b4-af3a-0469ada3d000) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:56:41 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-8ecc634d-ff82-435b-aaf6-80123dca306a tempest-VolumeDependencyTests-568082837 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5d941ded-73cb-48b4-af3a-0469ada3d000) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T10:56:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1165336445',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=43d77c05-f511-4938-9180-d27287b200bb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='05dc3778d4a14a34bfaf437721a90a8c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T10:56:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=698750ec-da9d-4373-9c3d-fbcf72c6873e,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T10:56:41Z,use_quota=True,user_id='6557adb4612844f0b015091e3954b981',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(34d3b144-d9b7-480a-a2e3-01e45f3d54c1),volume_type_id=34d3b144-d9b7-480a-a2e3-01e45f3d54c1)' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:56:41 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-8ecc634d-ff82-435b-aaf6-80123dca306a tempest-VolumeDependencyTests-568082837 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ab513000-34c0-4923-b242-faac12d6b373) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:56:41 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-8ecc634d-ff82-435b-aaf6-80123dca306a tempest-VolumeDependencyTests-568082837 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ab513000-34c0-4923-b242-faac12d6b373) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:56:41 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-8ecc634d-ff82-435b-aaf6-80123dca306a tempest-VolumeDependencyTests-568082837 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e0486ed9-44dd-4b1f-829b-b9226e57cf64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:56:41 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-8ecc634d-ff82-435b-aaf6-80123dca306a tempest-VolumeDependencyTests-568082837 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e0486ed9-44dd-4b1f-829b-b9226e57cf64) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '43d77c05-f511-4938-9180-d27287b200bb', 'volume_name': 'volume-43d77c05-f511-4938-9180-d27287b200bb', 'volume_size': 1, 'snapshot_id': '698750ec-da9d-4373-9c3d-fbcf72c6873e'}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:56:41 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-8ecc634d-ff82-435b-aaf6-80123dca306a tempest-VolumeDependencyTests-568082837 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dfa296e3-e256-4a76-bdea-870b59710714) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:56:41 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-8ecc634d-ff82-435b-aaf6-80123dca306a tempest-VolumeDependencyTests-568082837 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dfa296e3-e256-4a76-bdea-870b59710714) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:56:41 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-8ecc634d-ff82-435b-aaf6-80123dca306a tempest-VolumeDependencyTests-568082837 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d56a9dda-4edf-428e-ab98-8758f182a78e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:56:41 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-8ecc634d-ff82-435b-aaf6-80123dca306a tempest-VolumeDependencyTests-568082837 None] Volume 43d77c05-f511-4938-9180-d27287b200bb: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-43d77c05-f511-4938-9180-d27287b200bb', 'volume_size': 1, 'snapshot_id': '698750ec-da9d-4373-9c3d-fbcf72c6873e'} Nov 06 11:56:41 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-15f9ae40-2c60-498b-a32f-51b9a9efd845 tempest-VolumesSnapshotTestJSON-1873011056 None] Lock "cinder-quobyte-8121f4f1-04d0-4124-99b1-e1556bf08dca" released by "_delete_snapshot" :: held 2.468s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 11:56:41 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-8ecc634d-ff82-435b-aaf6-80123dca306a tempest-VolumeDependencyTests-568082837 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 11:56:41 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-8ecc634d-ff82-435b-aaf6-80123dca306a tempest-VolumeDependencyTests-568082837 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.000s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 11:56:41 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-8ecc634d-ff82-435b-aaf6-80123dca306a tempest-VolumeDependencyTests-568082837 None] Acquiring lock "cinder-quobyte-698750ec-da9d-4373-9c3d-fbcf72c6873e-43d77c05-f511-4938-9180-d27287b200bb" by "_create_volume_from_snapshot" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 11:56:41 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-15f9ae40-2c60-498b-a32f-51b9a9efd845 tempest-VolumesSnapshotTestJSON-1873011056 None] Lock "cinder-quobyte-4c858247-6332-4d50-8e38-a5b645acb04b" released by "delete_snapshot" :: held 2.506s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 11:56:41 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-8ecc634d-ff82-435b-aaf6-80123dca306a tempest-VolumeDependencyTests-568082837 None] Lock "cinder-quobyte-698750ec-da9d-4373-9c3d-fbcf72c6873e-43d77c05-f511-4938-9180-d27287b200bb" acquired by "_create_volume_from_snapshot" :: waited 0.023s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 11:56:41 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-8ecc634d-ff82-435b-aaf6-80123dca306a tempest-VolumeDependencyTests-568082837 None] Creating volume 43d77c05-f511-4938-9180-d27287b200bb from snapshot 698750ec-da9d-4373-9c3d-fbcf72c6873e {{(pid=87116) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Nov 06 11:56:41 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-8ecc634d-ff82-435b-aaf6-80123dca306a tempest-VolumeDependencyTests-568082837 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 11:56:41 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-8ecc634d-ff82-435b-aaf6-80123dca306a tempest-VolumeDependencyTests-568082837 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 11:56:41 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-8ecc634d-ff82-435b-aaf6-80123dca306a tempest-VolumeDependencyTests-568082837 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 11:56:41 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-8ecc634d-ff82-435b-aaf6-80123dca306a tempest-VolumeDependencyTests-568082837 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 11:56:41 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-8ecc634d-ff82-435b-aaf6-80123dca306a tempest-VolumeDependencyTests-568082837 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 11:56:41 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-8ecc634d-ff82-435b-aaf6-80123dca306a tempest-VolumeDependencyTests-568082837 None] Selected osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f as target Quobyte volume. {{(pid=87116) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 11:56:41 devstack sudo[102942]: pam_unix(sudo:session): session closed for user root Nov 06 11:56:41 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-8ecc634d-ff82-435b-aaf6-80123dca306a tempest-VolumeDependencyTests-568082837 None] Acquiring lock "cinder-quobyte-43d77c05-f511-4938-9180-d27287b200bb" by "_copy_volume_from_snapshot" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 11:56:41 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-13873292-98a8-4757-bafd-b307c765193b tempest-CreateVolumesFromSnapshotTest-1293587525 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-56b47392-5f46-4396-934c-9477ffc90354" returned: 0 in 0.461s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:56:41 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-13873292-98a8-4757-bafd-b307c765193b tempest-CreateVolumesFromSnapshotTest-1293587525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-56b47392-5f46-4396-934c-9477ffc90354 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:56:41 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-8ecc634d-ff82-435b-aaf6-80123dca306a tempest-VolumeDependencyTests-568082837 None] Lock "cinder-quobyte-43d77c05-f511-4938-9180-d27287b200bb" acquired by "_copy_volume_from_snapshot" :: waited 0.048s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 11:56:41 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-8ecc634d-ff82-435b-aaf6-80123dca306a tempest-VolumeDependencyTests-568082837 None] snapshot: 698750ec-da9d-4373-9c3d-fbcf72c6873e, volume: 43d77c05-f511-4938-9180-d27287b200bb, {{(pid=87116) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 06 11:56:41 devstack sudo[102948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-56b47392-5f46-4396-934c-9477ffc90354 Nov 06 11:56:41 devstack sudo[102948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:56:41 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-8ecc634d-ff82-435b-aaf6-80123dca306a tempest-VolumeDependencyTests-568082837 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 11:56:41 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-8ecc634d-ff82-435b-aaf6-80123dca306a tempest-VolumeDependencyTests-568082837 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 11:56:41 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-8ecc634d-ff82-435b-aaf6-80123dca306a tempest-VolumeDependencyTests-568082837 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 11:56:41 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-8ecc634d-ff82-435b-aaf6-80123dca306a tempest-VolumeDependencyTests-568082837 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 11:56:41 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-8ecc634d-ff82-435b-aaf6-80123dca306a tempest-VolumeDependencyTests-568082837 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 11:56:41 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[f47bfed9-d907-47fa-9742-b0b1738d2733]: (4, 'qcow2') {{(pid=88420) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 11:56:41 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-8ecc634d-ff82-435b-aaf6-80123dca306a tempest-VolumeDependencyTests-568082837 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-5496bc0e-2d25-4053-afaa-f6fe7bef3bea.698750ec-da9d-4373-9c3d-fbcf72c6873e {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:56:41 devstack cinder-volume[87116]: DEBUG cinder.quota [None req-15f9ae40-2c60-498b-a32f-51b9a9efd845 tempest-VolumesSnapshotTestJSON-1873011056 None] Created reservations ['24970d64-cffe-48bb-9c2e-01beeec3c99f', '54ecab2b-9b52-4d0b-93f5-156cbcd94df9', '971129b2-5395-4290-9f6f-ac0f943616ac', 'b196b2c0-b9c8-47cd-a3b8-2f1960957f4b'] {{(pid=87116) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 11:56:41 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-15f9ae40-2c60-498b-a32f-51b9a9efd845 tempest-VolumesSnapshotTestJSON-1873011056 None] Delete snapshot completed successfully. Nov 06 11:56:41 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-15f9ae40-2c60-498b-a32f-51b9a9efd845 tempest-VolumesSnapshotTestJSON-1873011056 None] Lock "cinder-8121f4f1-04d0-4124-99b1-e1556bf08dca-delete_snapshot" released by "delete_snapshot" :: held 2.907s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 11:56:41 devstack sudo[102948]: pam_unix(sudo:session): session closed for user root Nov 06 11:56:41 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-13873292-98a8-4757-bafd-b307c765193b tempest-CreateVolumesFromSnapshotTest-1293587525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-56b47392-5f46-4396-934c-9477ffc90354" returned: 0 in 0.347s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:56:41 devstack sudo[102950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-5496bc0e-2d25-4053-afaa-f6fe7bef3bea.698750ec-da9d-4373-9c3d-fbcf72c6873e Nov 06 11:56:41 devstack sudo[102950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:56:41 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-13873292-98a8-4757-bafd-b307c765193b tempest-CreateVolumesFromSnapshotTest-1293587525 None] Lock "cinder-quobyte-56b47392-5f46-4396-934c-9477ffc90354" released by "delete_volume" :: held 0.915s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 11:56:41 devstack cinder-volume[87116]: DEBUG cinder.quota [None req-13873292-98a8-4757-bafd-b307c765193b tempest-CreateVolumesFromSnapshotTest-1293587525 None] Created reservations ['a4b17472-6883-4624-92f0-baf5db93533c', '8baf5c58-ae86-4728-a756-12653283d5ad', '236e0b79-5dc8-4728-bce6-3eb9e901f57a', 'e7d36293-5f1c-4313-ad56-5d9398ebafc4'] {{(pid=87116) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 11:56:41 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-13873292-98a8-4757-bafd-b307c765193b tempest-CreateVolumesFromSnapshotTest-1293587525 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 11:56:41 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-13873292-98a8-4757-bafd-b307c765193b tempest-CreateVolumesFromSnapshotTest-1293587525 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 11:56:41 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-13873292-98a8-4757-bafd-b307c765193b tempest-CreateVolumesFromSnapshotTest-1293587525 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 11:56:41 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-13873292-98a8-4757-bafd-b307c765193b tempest-CreateVolumesFromSnapshotTest-1293587525 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 11:56:41 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-13873292-98a8-4757-bafd-b307c765193b tempest-CreateVolumesFromSnapshotTest-1293587525 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 11:56:41 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-13873292-98a8-4757-bafd-b307c765193b tempest-CreateVolumesFromSnapshotTest-1293587525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:56:41 devstack sudo[102955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756 Nov 06 11:56:41 devstack sudo[102955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:56:42 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-f0a36b9d-5c6c-4f9b-83dd-97ef23f057a3 tempest-VolumesSnapshotTestJSON-1873011056 None] Acquiring lock "cinder-4c858247-6332-4d50-8e38-a5b645acb04b-delete_volume" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 11:56:42 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-f0a36b9d-5c6c-4f9b-83dd-97ef23f057a3 tempest-VolumesSnapshotTestJSON-1873011056 None] Lock "cinder-4c858247-6332-4d50-8e38-a5b645acb04b-delete_volume" acquired by "delete_volume" :: waited 0.064s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 11:56:42 devstack sudo[102950]: pam_unix(sudo:session): session closed for user root Nov 06 11:56:42 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-8ecc634d-ff82-435b-aaf6-80123dca306a tempest-VolumeDependencyTests-568082837 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-5496bc0e-2d25-4053-afaa-f6fe7bef3bea.698750ec-da9d-4373-9c3d-fbcf72c6873e" returned: 0 in 0.708s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:56:42 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-8ecc634d-ff82-435b-aaf6-80123dca306a tempest-VolumeDependencyTests-568082837 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5496bc0e-2d25-4053-afaa-f6fe7bef3bea(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87116) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 11:56:42 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[1291d06a-d47a-4bb9-8804-d66621a53ef1]: (4, 'qcow2') {{(pid=88420) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 11:56:42 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-8ecc634d-ff82-435b-aaf6-80123dca306a tempest-VolumeDependencyTests-568082837 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-5496bc0e-2d25-4053-afaa-f6fe7bef3bea {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:56:42 devstack sudo[102955]: pam_unix(sudo:session): session closed for user root Nov 06 11:56:42 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-13873292-98a8-4757-bafd-b307c765193b tempest-CreateVolumesFromSnapshotTest-1293587525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756" returned: 0 in 0.306s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:56:42 devstack cinder-volume[87116]: DEBUG cinder.manager [None req-13873292-98a8-4757-bafd-b307c765193b tempest-CreateVolumesFromSnapshotTest-1293587525 None] Notifying Schedulers of capabilities ... {{(pid=87116) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 11:56:42 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-f0a36b9d-5c6c-4f9b-83dd-97ef23f057a3 tempest-VolumesSnapshotTestJSON-1873011056 None] Acquiring lock "cinder-quobyte-4c858247-6332-4d50-8e38-a5b645acb04b" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 11:56:42 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-13873292-98a8-4757-bafd-b307c765193b tempest-CreateVolumesFromSnapshotTest-1293587525 None] Deleted volume successfully. Nov 06 11:56:42 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-f0a36b9d-5c6c-4f9b-83dd-97ef23f057a3 tempest-VolumesSnapshotTestJSON-1873011056 None] Lock "cinder-quobyte-4c858247-6332-4d50-8e38-a5b645acb04b" acquired by "delete_volume" :: waited 0.037s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 11:56:42 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-13873292-98a8-4757-bafd-b307c765193b tempest-CreateVolumesFromSnapshotTest-1293587525 None] Lock "cinder-56b47392-5f46-4396-934c-9477ffc90354-delete_volume" released by "delete_volume" :: held 1.696s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 11:56:42 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[420d9f56-4c4c-4bbe-9827-cb0ac8be736c]: (4, 'qcow2') {{(pid=88420) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 11:56:42 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-f0a36b9d-5c6c-4f9b-83dd-97ef23f057a3 tempest-VolumesSnapshotTestJSON-1873011056 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-4c858247-6332-4d50-8e38-a5b645acb04b {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:56:42 devstack sudo[102959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-5496bc0e-2d25-4053-afaa-f6fe7bef3bea Nov 06 11:56:42 devstack sudo[102959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:56:42 devstack sudo[102960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-4c858247-6332-4d50-8e38-a5b645acb04b Nov 06 11:56:42 devstack sudo[102960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:56:42 devstack sudo[102959]: pam_unix(sudo:session): session closed for user root Nov 06 11:56:42 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-8ecc634d-ff82-435b-aaf6-80123dca306a tempest-VolumeDependencyTests-568082837 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-5496bc0e-2d25-4053-afaa-f6fe7bef3bea" returned: 0 in 0.628s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:56:42 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-8ecc634d-ff82-435b-aaf6-80123dca306a tempest-VolumeDependencyTests-568082837 None] will copy from snapshot at /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-5496bc0e-2d25-4053-afaa-f6fe7bef3bea {{(pid=87116) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 06 11:56:42 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-8ecc634d-ff82-435b-aaf6-80123dca306a tempest-VolumeDependencyTests-568082837 None] Creating direct copy from snapshot {{(pid=87116) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 06 11:56:42 devstack cinder-volume[87116]: DEBUG cinder.utils [None req-8ecc634d-ff82-435b-aaf6-80123dca306a tempest-VolumeDependencyTests-568082837 None] Path /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-43d77c05-f511-4938-9180-d27287b200bb not found in is_blk_device check {{(pid=87116) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 06 11:56:42 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-8ecc634d-ff82-435b-aaf6-80123dca306a tempest-VolumeDependencyTests-568082837 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-5496bc0e-2d25-4053-afaa-f6fe7bef3bea /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-43d77c05-f511-4938-9180-d27287b200bb {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:56:42 devstack sudo[102967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-5496bc0e-2d25-4053-afaa-f6fe7bef3bea /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-43d77c05-f511-4938-9180-d27287b200bb Nov 06 11:56:42 devstack sudo[102967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:56:43 devstack sudo[102960]: pam_unix(sudo:session): session closed for user root Nov 06 11:56:43 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-f0a36b9d-5c6c-4f9b-83dd-97ef23f057a3 tempest-VolumesSnapshotTestJSON-1873011056 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-4c858247-6332-4d50-8e38-a5b645acb04b" returned: 0 in 0.731s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:56:43 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-f0a36b9d-5c6c-4f9b-83dd-97ef23f057a3 tempest-VolumesSnapshotTestJSON-1873011056 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-4c858247-6332-4d50-8e38-a5b645acb04b {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:56:43 devstack sudo[102972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-4c858247-6332-4d50-8e38-a5b645acb04b Nov 06 11:56:43 devstack sudo[102972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:56:43 devstack sudo[102972]: pam_unix(sudo:session): session closed for user root Nov 06 11:56:43 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-f0a36b9d-5c6c-4f9b-83dd-97ef23f057a3 tempest-VolumesSnapshotTestJSON-1873011056 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-4c858247-6332-4d50-8e38-a5b645acb04b" returned: 0 in 0.329s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:56:43 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-f0a36b9d-5c6c-4f9b-83dd-97ef23f057a3 tempest-VolumesSnapshotTestJSON-1873011056 None] Lock "cinder-quobyte-4c858247-6332-4d50-8e38-a5b645acb04b" released by "delete_volume" :: held 1.195s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 11:56:43 devstack cinder-volume[87116]: DEBUG cinder.quota [None req-f0a36b9d-5c6c-4f9b-83dd-97ef23f057a3 tempest-VolumesSnapshotTestJSON-1873011056 None] Created reservations ['466ae9c7-225e-42a7-b074-98822ece8cfe', '7cabe28e-6481-4649-a896-c2be311e6ec3', '50e11985-b37f-447d-bc4d-cd9f3ebaf426', '45f10fee-93ae-4f7b-bfc3-81387af2be3d'] {{(pid=87116) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 11:56:43 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-f0a36b9d-5c6c-4f9b-83dd-97ef23f057a3 tempest-VolumesSnapshotTestJSON-1873011056 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 11:56:43 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-f0a36b9d-5c6c-4f9b-83dd-97ef23f057a3 tempest-VolumesSnapshotTestJSON-1873011056 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 11:56:43 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-f0a36b9d-5c6c-4f9b-83dd-97ef23f057a3 tempest-VolumesSnapshotTestJSON-1873011056 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 11:56:43 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-f0a36b9d-5c6c-4f9b-83dd-97ef23f057a3 tempest-VolumesSnapshotTestJSON-1873011056 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 11:56:43 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-f0a36b9d-5c6c-4f9b-83dd-97ef23f057a3 tempest-VolumesSnapshotTestJSON-1873011056 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 11:56:43 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-f0a36b9d-5c6c-4f9b-83dd-97ef23f057a3 tempest-VolumesSnapshotTestJSON-1873011056 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:56:43 devstack sudo[102986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756 Nov 06 11:56:43 devstack sudo[102986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:56:44 devstack sudo[102986]: pam_unix(sudo:session): session closed for user root Nov 06 11:56:44 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-f0a36b9d-5c6c-4f9b-83dd-97ef23f057a3 tempest-VolumesSnapshotTestJSON-1873011056 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756" returned: 0 in 0.460s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:56:44 devstack cinder-volume[87116]: DEBUG cinder.manager [None req-f0a36b9d-5c6c-4f9b-83dd-97ef23f057a3 tempest-VolumesSnapshotTestJSON-1873011056 None] Notifying Schedulers of capabilities ... {{(pid=87116) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 11:56:44 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-f0a36b9d-5c6c-4f9b-83dd-97ef23f057a3 tempest-VolumesSnapshotTestJSON-1873011056 None] Deleted volume successfully. Nov 06 11:56:44 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-f0a36b9d-5c6c-4f9b-83dd-97ef23f057a3 tempest-VolumesSnapshotTestJSON-1873011056 None] Lock "cinder-4c858247-6332-4d50-8e38-a5b645acb04b-delete_volume" released by "delete_volume" :: held 2.170s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 11:56:45 devstack cinder-volume[87116]: DEBUG cinder.volume.flows.manager.create_volume [None req-c7e05126-a280-4e26-b796-d1a194dbeb3b tempest-VolumesSnapshotTestJSON-1873011056 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87116) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 11:56:45 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-c7e05126-a280-4e26-b796-d1a194dbeb3b tempest-VolumesSnapshotTestJSON-1873011056 None] Flow 'volume_create_manager' (566b4157-fea3-4c11-9a74-a8cc2ccc64d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 11:56:46 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-c7e05126-a280-4e26-b796-d1a194dbeb3b tempest-VolumesSnapshotTestJSON-1873011056 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c5cf6a47-edcd-40fb-b840-4ff46dfe835e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:56:46 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-c7e05126-a280-4e26-b796-d1a194dbeb3b tempest-VolumesSnapshotTestJSON-1873011056 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c5cf6a47-edcd-40fb-b840-4ff46dfe835e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T10:56:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1699803935',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=637f2fec-842f-4b97-8744-e70167f3da8a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3bf9e5851f734e6098653da76bb11005',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T10:56:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T10:56:46Z,use_quota=True,user_id='2346ada21cbb4d2b9cf86ef1315c49dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(34d3b144-d9b7-480a-a2e3-01e45f3d54c1),volume_type_id=34d3b144-d9b7-480a-a2e3-01e45f3d54c1)' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:56:46 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-c7e05126-a280-4e26-b796-d1a194dbeb3b tempest-VolumesSnapshotTestJSON-1873011056 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e31b1f4e-12e3-4874-8e98-5ede3bdf0b59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:56:46 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-c7e05126-a280-4e26-b796-d1a194dbeb3b tempest-VolumesSnapshotTestJSON-1873011056 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e31b1f4e-12e3-4874-8e98-5ede3bdf0b59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:56:46 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-c7e05126-a280-4e26-b796-d1a194dbeb3b tempest-VolumesSnapshotTestJSON-1873011056 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5fd6ac78-29f9-4986-832e-5e79e018204e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:56:46 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-c7e05126-a280-4e26-b796-d1a194dbeb3b tempest-VolumesSnapshotTestJSON-1873011056 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5fd6ac78-29f9-4986-832e-5e79e018204e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '637f2fec-842f-4b97-8744-e70167f3da8a', 'volume_name': 'volume-637f2fec-842f-4b97-8744-e70167f3da8a', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:56:46 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-c7e05126-a280-4e26-b796-d1a194dbeb3b tempest-VolumesSnapshotTestJSON-1873011056 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1dc7839a-0858-40ee-ade9-abb8e0a35a8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:56:46 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-c7e05126-a280-4e26-b796-d1a194dbeb3b tempest-VolumesSnapshotTestJSON-1873011056 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1dc7839a-0858-40ee-ade9-abb8e0a35a8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:56:46 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-c7e05126-a280-4e26-b796-d1a194dbeb3b tempest-VolumesSnapshotTestJSON-1873011056 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a7bbe901-792b-49c1-abe2-c18d8900570c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:56:46 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-c7e05126-a280-4e26-b796-d1a194dbeb3b tempest-VolumesSnapshotTestJSON-1873011056 None] Volume 637f2fec-842f-4b97-8744-e70167f3da8a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-637f2fec-842f-4b97-8744-e70167f3da8a', 'volume_size': 1} Nov 06 11:56:46 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-c7e05126-a280-4e26-b796-d1a194dbeb3b tempest-VolumesSnapshotTestJSON-1873011056 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 11:56:49 devstack cinder-volume[87116]: DEBUG cinder.volume.flows.manager.create_volume [None req-71ff80e6-b7b8-45f8-aa21-db1443fc3d25 tempest-CreateVolumesFromSourceVolumeTest-627404290 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87116) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 11:56:49 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-71ff80e6-b7b8-45f8-aa21-db1443fc3d25 tempest-CreateVolumesFromSourceVolumeTest-627404290 None] Flow 'volume_create_manager' (68e13c9d-17dc-41ee-a14b-b3c2d7180720) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 11:56:49 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-71ff80e6-b7b8-45f8-aa21-db1443fc3d25 tempest-CreateVolumesFromSourceVolumeTest-627404290 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bdbf85c7-1e5d-45e2-93a2-eedac97a0bb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:56:49 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-71ff80e6-b7b8-45f8-aa21-db1443fc3d25 tempest-CreateVolumesFromSourceVolumeTest-627404290 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bdbf85c7-1e5d-45e2-93a2-eedac97a0bb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T10:56:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1258757821',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2d8ee6d4-b960-4bfc-a460-17181a71c581,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e029558bfb3642e0bca47d6a71f0e56f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T10:56:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T10:56:49Z,use_quota=True,user_id='b25339719cf549ebb1953d05714b30cc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(34d3b144-d9b7-480a-a2e3-01e45f3d54c1),volume_type_id=34d3b144-d9b7-480a-a2e3-01e45f3d54c1)' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:56:49 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-71ff80e6-b7b8-45f8-aa21-db1443fc3d25 tempest-CreateVolumesFromSourceVolumeTest-627404290 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fdf11cf2-3c9c-4c20-9632-b70af1ce4d68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:56:49 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-71ff80e6-b7b8-45f8-aa21-db1443fc3d25 tempest-CreateVolumesFromSourceVolumeTest-627404290 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fdf11cf2-3c9c-4c20-9632-b70af1ce4d68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:56:49 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-71ff80e6-b7b8-45f8-aa21-db1443fc3d25 tempest-CreateVolumesFromSourceVolumeTest-627404290 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b2ed8283-d0bc-4142-94b2-bfe60cfec2fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:56:49 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-71ff80e6-b7b8-45f8-aa21-db1443fc3d25 tempest-CreateVolumesFromSourceVolumeTest-627404290 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b2ed8283-d0bc-4142-94b2-bfe60cfec2fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2d8ee6d4-b960-4bfc-a460-17181a71c581', 'volume_name': 'volume-2d8ee6d4-b960-4bfc-a460-17181a71c581', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:56:49 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-71ff80e6-b7b8-45f8-aa21-db1443fc3d25 tempest-CreateVolumesFromSourceVolumeTest-627404290 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a1cd2fa3-33f1-4b69-b49c-1a2c7672a00c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:56:49 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-71ff80e6-b7b8-45f8-aa21-db1443fc3d25 tempest-CreateVolumesFromSourceVolumeTest-627404290 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a1cd2fa3-33f1-4b69-b49c-1a2c7672a00c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:56:49 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-71ff80e6-b7b8-45f8-aa21-db1443fc3d25 tempest-CreateVolumesFromSourceVolumeTest-627404290 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dd61a032-7847-44d7-b58c-9919e7a36a77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:56:49 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-71ff80e6-b7b8-45f8-aa21-db1443fc3d25 tempest-CreateVolumesFromSourceVolumeTest-627404290 None] Volume 2d8ee6d4-b960-4bfc-a460-17181a71c581: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2d8ee6d4-b960-4bfc-a460-17181a71c581', 'volume_size': 1} Nov 06 11:56:49 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-71ff80e6-b7b8-45f8-aa21-db1443fc3d25 tempest-CreateVolumesFromSourceVolumeTest-627404290 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 11:56:51 devstack sudo[102967]: pam_unix(sudo:session): session closed for user root Nov 06 11:56:51 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-8ecc634d-ff82-435b-aaf6-80123dca306a tempest-VolumeDependencyTests-568082837 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-5496bc0e-2d25-4053-afaa-f6fe7bef3bea /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-43d77c05-f511-4938-9180-d27287b200bb" returned: 0 in 8.892s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:56:51 devstack cinder-volume[87116]: DEBUG cinder.image.image_utils [None req-8ecc634d-ff82-435b-aaf6-80123dca306a tempest-VolumeDependencyTests-568082837 None] Image conversion details: src /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-5496bc0e-2d25-4053-afaa-f6fe7bef3bea, size 1024.00 MB, duration 8.89 sec, destination /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-43d77c05-f511-4938-9180-d27287b200bb {{(pid=87116) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 06 11:56:51 devstack cinder-volume[87116]: INFO cinder.image.image_utils [None req-8ecc634d-ff82-435b-aaf6-80123dca306a tempest-VolumeDependencyTests-568082837 None] Converted 1024.00 MB image at 115.15 MB/s Nov 06 11:56:51 devstack cinder-volume[87116]: WARNING cinder.volume.drivers.remotefs [None req-8ecc634d-ff82-435b-aaf6-80123dca306a tempest-VolumeDependencyTests-568082837 None] /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-43d77c05-f511-4938-9180-d27287b200bb is being set with open permissions: ugo+rw Nov 06 11:56:51 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-8ecc634d-ff82-435b-aaf6-80123dca306a tempest-VolumeDependencyTests-568082837 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-43d77c05-f511-4938-9180-d27287b200bb {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:56:51 devstack sudo[102990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-43d77c05-f511-4938-9180-d27287b200bb Nov 06 11:56:51 devstack sudo[102990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:56:52 devstack sudo[102990]: pam_unix(sudo:session): session closed for user root Nov 06 11:56:52 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-8ecc634d-ff82-435b-aaf6-80123dca306a tempest-VolumeDependencyTests-568082837 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-43d77c05-f511-4938-9180-d27287b200bb" returned: 0 in 0.284s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:56:52 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-8ecc634d-ff82-435b-aaf6-80123dca306a tempest-VolumeDependencyTests-568082837 None] Lock "cinder-quobyte-43d77c05-f511-4938-9180-d27287b200bb" released by "_copy_volume_from_snapshot" :: held 10.639s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 11:56:52 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-8ecc634d-ff82-435b-aaf6-80123dca306a tempest-VolumeDependencyTests-568082837 None] Lock "cinder-quobyte-698750ec-da9d-4373-9c3d-fbcf72c6873e-43d77c05-f511-4938-9180-d27287b200bb" released by "_create_volume_from_snapshot" :: held 10.743s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 11:56:52 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-8ecc634d-ff82-435b-aaf6-80123dca306a tempest-VolumeDependencyTests-568082837 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.767s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 11:56:52 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-c7e05126-a280-4e26-b796-d1a194dbeb3b tempest-VolumesSnapshotTestJSON-1873011056 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.880s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 11:56:52 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-c7e05126-a280-4e26-b796-d1a194dbeb3b tempest-VolumesSnapshotTestJSON-1873011056 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T10:56:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1699803935',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=637f2fec-842f-4b97-8744-e70167f3da8a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3bf9e5851f734e6098653da76bb11005',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T10:56:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T10:56:46Z,use_quota=True,user_id='2346ada21cbb4d2b9cf86ef1315c49dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(34d3b144-d9b7-480a-a2e3-01e45f3d54c1),volume_type_id=34d3b144-d9b7-480a-a2e3-01e45f3d54c1)}" {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 11:56:52 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-c7e05126-a280-4e26-b796-d1a194dbeb3b tempest-VolumesSnapshotTestJSON-1873011056 None] Creating volume 637f2fec-842f-4b97-8744-e70167f3da8a {{(pid=87116) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 11:56:52 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-c7e05126-a280-4e26-b796-d1a194dbeb3b tempest-VolumesSnapshotTestJSON-1873011056 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 11:56:52 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-c7e05126-a280-4e26-b796-d1a194dbeb3b tempest-VolumesSnapshotTestJSON-1873011056 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 11:56:52 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-c7e05126-a280-4e26-b796-d1a194dbeb3b tempest-VolumesSnapshotTestJSON-1873011056 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 11:56:52 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-c7e05126-a280-4e26-b796-d1a194dbeb3b tempest-VolumesSnapshotTestJSON-1873011056 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 11:56:52 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-c7e05126-a280-4e26-b796-d1a194dbeb3b tempest-VolumesSnapshotTestJSON-1873011056 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 11:56:52 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-c7e05126-a280-4e26-b796-d1a194dbeb3b tempest-VolumesSnapshotTestJSON-1873011056 None] Selected osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f as target Quobyte volume. {{(pid=87116) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 11:56:52 devstack cinder-volume[87116]: INFO cinder.volume.drivers.remotefs [None req-c7e05126-a280-4e26-b796-d1a194dbeb3b tempest-VolumesSnapshotTestJSON-1873011056 None] casted to osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f Nov 06 11:56:52 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-c7e05126-a280-4e26-b796-d1a194dbeb3b tempest-VolumesSnapshotTestJSON-1873011056 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-637f2fec-842f-4b97-8744-e70167f3da8a 1073741824 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:56:52 devstack sudo[102993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-637f2fec-842f-4b97-8744-e70167f3da8a 1073741824 Nov 06 11:56:52 devstack sudo[102993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:56:52 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-8ecc634d-ff82-435b-aaf6-80123dca306a tempest-VolumeDependencyTests-568082837 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d56a9dda-4edf-428e-ab98-8758f182a78e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-43d77c05-f511-4938-9180-d27287b200bb', 'volume_size': 1, 'snapshot_id': '698750ec-da9d-4373-9c3d-fbcf72c6873e'}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:56:52 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-8ecc634d-ff82-435b-aaf6-80123dca306a tempest-VolumeDependencyTests-568082837 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa39cb07-34a9-4de5-9d16-348e7e1e3cd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:56:52 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-8ecc634d-ff82-435b-aaf6-80123dca306a tempest-VolumeDependencyTests-568082837 None] Volume volume-43d77c05-f511-4938-9180-d27287b200bb (43d77c05-f511-4938-9180-d27287b200bb): created successfully Nov 06 11:56:52 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-8ecc634d-ff82-435b-aaf6-80123dca306a tempest-VolumeDependencyTests-568082837 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa39cb07-34a9-4de5-9d16-348e7e1e3cd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:56:52 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-8ecc634d-ff82-435b-aaf6-80123dca306a tempest-VolumeDependencyTests-568082837 None] Flow 'volume_create_manager' (15d7be8f-d3ff-409d-acdc-ba3e1e02d8e2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 11:56:52 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-8ecc634d-ff82-435b-aaf6-80123dca306a tempest-VolumeDependencyTests-568082837 None] Created volume successfully. Nov 06 11:56:52 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-3998b45f-920b-4ab3-b417-3a8f8f05e520 tempest-VolumeDependencyTests-568082837 None] Acquiring lock "cinder-698750ec-da9d-4373-9c3d-fbcf72c6873e-delete_snapshot" by "delete_snapshot" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 11:56:52 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-3998b45f-920b-4ab3-b417-3a8f8f05e520 tempest-VolumeDependencyTests-568082837 None] Lock "cinder-698750ec-da9d-4373-9c3d-fbcf72c6873e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 11:56:52 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-3998b45f-920b-4ab3-b417-3a8f8f05e520 tempest-VolumeDependencyTests-568082837 None] Acquiring lock "cinder-quobyte-5496bc0e-2d25-4053-afaa-f6fe7bef3bea" by "delete_snapshot" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 11:56:52 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-3998b45f-920b-4ab3-b417-3a8f8f05e520 tempest-VolumeDependencyTests-568082837 None] Lock "cinder-quobyte-5496bc0e-2d25-4053-afaa-f6fe7bef3bea" acquired by "delete_snapshot" :: waited 0.031s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 11:56:52 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-3998b45f-920b-4ab3-b417-3a8f8f05e520 tempest-VolumeDependencyTests-568082837 None] Acquiring lock "cinder-quobyte-698750ec-da9d-4373-9c3d-fbcf72c6873e" by "_delete_snapshot" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 11:56:52 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-3998b45f-920b-4ab3-b417-3a8f8f05e520 tempest-VolumeDependencyTests-568082837 None] Lock "cinder-quobyte-698750ec-da9d-4373-9c3d-fbcf72c6873e" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 11:56:52 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-3998b45f-920b-4ab3-b417-3a8f8f05e520 tempest-VolumeDependencyTests-568082837 None] Deleting offline snapshot 698750ec-da9d-4373-9c3d-fbcf72c6873e of volume 5496bc0e-2d25-4053-afaa-f6fe7bef3bea {{(pid=87116) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 06 11:56:52 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-3998b45f-920b-4ab3-b417-3a8f8f05e520 tempest-VolumeDependencyTests-568082837 None] snapshot_file for this snap is: volume-5496bc0e-2d25-4053-afaa-f6fe7bef3bea.698750ec-da9d-4373-9c3d-fbcf72c6873e {{(pid=87116) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 06 11:56:52 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4215e67-dc52-4404-8ea8-944bb46a8aa3]: (4, 'qcow2') {{(pid=88420) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 11:56:52 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-3998b45f-920b-4ab3-b417-3a8f8f05e520 tempest-VolumeDependencyTests-568082837 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-5496bc0e-2d25-4053-afaa-f6fe7bef3bea.698750ec-da9d-4373-9c3d-fbcf72c6873e {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:56:52 devstack sudo[102993]: pam_unix(sudo:session): session closed for user root Nov 06 11:56:52 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-c7e05126-a280-4e26-b796-d1a194dbeb3b tempest-VolumesSnapshotTestJSON-1873011056 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-637f2fec-842f-4b97-8744-e70167f3da8a 1073741824" returned: 0 in 0.509s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:56:52 devstack sudo[102999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-5496bc0e-2d25-4053-afaa-f6fe7bef3bea.698750ec-da9d-4373-9c3d-fbcf72c6873e Nov 06 11:56:52 devstack sudo[102999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:56:52 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-c7e05126-a280-4e26-b796-d1a194dbeb3b tempest-VolumesSnapshotTestJSON-1873011056 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-637f2fec-842f-4b97-8744-e70167f3da8a {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:56:52 devstack sudo[103002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-637f2fec-842f-4b97-8744-e70167f3da8a Nov 06 11:56:52 devstack sudo[103002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:56:52 devstack sudo[102999]: pam_unix(sudo:session): session closed for user root Nov 06 11:56:52 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-3998b45f-920b-4ab3-b417-3a8f8f05e520 tempest-VolumeDependencyTests-568082837 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-5496bc0e-2d25-4053-afaa-f6fe7bef3bea.698750ec-da9d-4373-9c3d-fbcf72c6873e" returned: 0 in 0.494s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:56:52 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-3998b45f-920b-4ab3-b417-3a8f8f05e520 tempest-VolumeDependencyTests-568082837 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5496bc0e-2d25-4053-afaa-f6fe7bef3bea(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87116) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 11:56:52 devstack sudo[103002]: pam_unix(sudo:session): session closed for user root Nov 06 11:56:53 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-c7e05126-a280-4e26-b796-d1a194dbeb3b tempest-VolumesSnapshotTestJSON-1873011056 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-637f2fec-842f-4b97-8744-e70167f3da8a" returned: 0 in 0.369s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:56:53 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-c7e05126-a280-4e26-b796-d1a194dbeb3b tempest-VolumesSnapshotTestJSON-1873011056 None] <== create_volume: return (928ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f'} {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 11:56:53 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-c7e05126-a280-4e26-b796-d1a194dbeb3b tempest-VolumesSnapshotTestJSON-1873011056 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.932s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 11:56:53 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-71ff80e6-b7b8-45f8-aa21-db1443fc3d25 tempest-CreateVolumesFromSourceVolumeTest-627404290 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.450s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 11:56:53 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-71ff80e6-b7b8-45f8-aa21-db1443fc3d25 tempest-CreateVolumesFromSourceVolumeTest-627404290 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T10:56:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1258757821',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2d8ee6d4-b960-4bfc-a460-17181a71c581,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e029558bfb3642e0bca47d6a71f0e56f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T10:56:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T10:56:49Z,use_quota=True,user_id='b25339719cf549ebb1953d05714b30cc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(34d3b144-d9b7-480a-a2e3-01e45f3d54c1),volume_type_id=34d3b144-d9b7-480a-a2e3-01e45f3d54c1)}" {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 11:56:53 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-71ff80e6-b7b8-45f8-aa21-db1443fc3d25 tempest-CreateVolumesFromSourceVolumeTest-627404290 None] Creating volume 2d8ee6d4-b960-4bfc-a460-17181a71c581 {{(pid=87116) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 11:56:53 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-71ff80e6-b7b8-45f8-aa21-db1443fc3d25 tempest-CreateVolumesFromSourceVolumeTest-627404290 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 11:56:53 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-71ff80e6-b7b8-45f8-aa21-db1443fc3d25 tempest-CreateVolumesFromSourceVolumeTest-627404290 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 11:56:53 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-71ff80e6-b7b8-45f8-aa21-db1443fc3d25 tempest-CreateVolumesFromSourceVolumeTest-627404290 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 11:56:53 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-71ff80e6-b7b8-45f8-aa21-db1443fc3d25 tempest-CreateVolumesFromSourceVolumeTest-627404290 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 11:56:53 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-71ff80e6-b7b8-45f8-aa21-db1443fc3d25 tempest-CreateVolumesFromSourceVolumeTest-627404290 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 11:56:53 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-71ff80e6-b7b8-45f8-aa21-db1443fc3d25 tempest-CreateVolumesFromSourceVolumeTest-627404290 None] Selected osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f as target Quobyte volume. {{(pid=87116) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 11:56:53 devstack cinder-volume[87116]: INFO cinder.volume.drivers.remotefs [None req-71ff80e6-b7b8-45f8-aa21-db1443fc3d25 tempest-CreateVolumesFromSourceVolumeTest-627404290 None] casted to osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f Nov 06 11:56:53 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-71ff80e6-b7b8-45f8-aa21-db1443fc3d25 tempest-CreateVolumesFromSourceVolumeTest-627404290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-2d8ee6d4-b960-4bfc-a460-17181a71c581 1073741824 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:56:53 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[9999e0a1-6581-4908-95ed-41ecc513e3f6]: (4, 'qcow2') {{(pid=88420) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 11:56:53 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-3998b45f-920b-4ab3-b417-3a8f8f05e520 tempest-VolumeDependencyTests-568082837 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-5496bc0e-2d25-4053-afaa-f6fe7bef3bea {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:56:53 devstack sudo[103008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-2d8ee6d4-b960-4bfc-a460-17181a71c581 1073741824 Nov 06 11:56:53 devstack sudo[103008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:56:53 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-c7e05126-a280-4e26-b796-d1a194dbeb3b tempest-VolumesSnapshotTestJSON-1873011056 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a7bbe901-792b-49c1-abe2-c18d8900570c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-637f2fec-842f-4b97-8744-e70167f3da8a', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:56:53 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-c7e05126-a280-4e26-b796-d1a194dbeb3b tempest-VolumesSnapshotTestJSON-1873011056 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7e7b0462-b6e5-4ff5-9212-955527c9de5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:56:53 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-c7e05126-a280-4e26-b796-d1a194dbeb3b tempest-VolumesSnapshotTestJSON-1873011056 None] Volume volume-637f2fec-842f-4b97-8744-e70167f3da8a (637f2fec-842f-4b97-8744-e70167f3da8a): created successfully Nov 06 11:56:53 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-c7e05126-a280-4e26-b796-d1a194dbeb3b tempest-VolumesSnapshotTestJSON-1873011056 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7e7b0462-b6e5-4ff5-9212-955527c9de5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:56:53 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-c7e05126-a280-4e26-b796-d1a194dbeb3b tempest-VolumesSnapshotTestJSON-1873011056 None] Flow 'volume_create_manager' (566b4157-fea3-4c11-9a74-a8cc2ccc64d5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 11:56:53 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-c7e05126-a280-4e26-b796-d1a194dbeb3b tempest-VolumesSnapshotTestJSON-1873011056 None] Created volume successfully. Nov 06 11:56:53 devstack sudo[103009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-5496bc0e-2d25-4053-afaa-f6fe7bef3bea Nov 06 11:56:53 devstack sudo[103009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:56:53 devstack sudo[103008]: pam_unix(sudo:session): session closed for user root Nov 06 11:56:53 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-71ff80e6-b7b8-45f8-aa21-db1443fc3d25 tempest-CreateVolumesFromSourceVolumeTest-627404290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-2d8ee6d4-b960-4bfc-a460-17181a71c581 1073741824" returned: 0 in 0.664s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:56:53 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-72fd35ee-db21-4aea-9851-b57ea62959fb tempest-VolumesSnapshotTestJSON-1873011056 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 11:56:53 devstack sudo[103009]: pam_unix(sudo:session): session closed for user root Nov 06 11:56:53 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-3998b45f-920b-4ab3-b417-3a8f8f05e520 tempest-VolumeDependencyTests-568082837 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-5496bc0e-2d25-4053-afaa-f6fe7bef3bea" returned: 0 in 0.697s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:56:53 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-3998b45f-920b-4ab3-b417-3a8f8f05e520 tempest-VolumeDependencyTests-568082837 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-5496bc0e-2d25-4053-afaa-f6fe7bef3bea.698750ec-da9d-4373-9c3d-fbcf72c6873e {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:56:53 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-71ff80e6-b7b8-45f8-aa21-db1443fc3d25 tempest-CreateVolumesFromSourceVolumeTest-627404290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-2d8ee6d4-b960-4bfc-a460-17181a71c581 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:56:53 devstack sudo[103018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-5496bc0e-2d25-4053-afaa-f6fe7bef3bea.698750ec-da9d-4373-9c3d-fbcf72c6873e Nov 06 11:56:53 devstack sudo[103018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:56:53 devstack sudo[103019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-2d8ee6d4-b960-4bfc-a460-17181a71c581 Nov 06 11:56:53 devstack sudo[103019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:56:54 devstack sudo[103019]: pam_unix(sudo:session): session closed for user root Nov 06 11:56:54 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-71ff80e6-b7b8-45f8-aa21-db1443fc3d25 tempest-CreateVolumesFromSourceVolumeTest-627404290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-2d8ee6d4-b960-4bfc-a460-17181a71c581" returned: 0 in 0.316s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:56:54 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-71ff80e6-b7b8-45f8-aa21-db1443fc3d25 tempest-CreateVolumesFromSourceVolumeTest-627404290 None] <== create_volume: return (1067ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f'} {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 11:56:54 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-71ff80e6-b7b8-45f8-aa21-db1443fc3d25 tempest-CreateVolumesFromSourceVolumeTest-627404290 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.075s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 11:56:54 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-72fd35ee-db21-4aea-9851-b57ea62959fb tempest-VolumesSnapshotTestJSON-1873011056 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.375s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 11:56:54 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-71ff80e6-b7b8-45f8-aa21-db1443fc3d25 tempest-CreateVolumesFromSourceVolumeTest-627404290 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dd61a032-7847-44d7-b58c-9919e7a36a77) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2d8ee6d4-b960-4bfc-a460-17181a71c581', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:56:54 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-71ff80e6-b7b8-45f8-aa21-db1443fc3d25 tempest-CreateVolumesFromSourceVolumeTest-627404290 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fc7d9583-ad62-48fd-857e-d8fc230a56a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:56:54 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-72fd35ee-db21-4aea-9851-b57ea62959fb tempest-VolumesSnapshotTestJSON-1873011056 None] Creating offline snapshot a0b2cffc-c0e0-4849-9a5d-deb40649f833 of volume 637f2fec-842f-4b97-8744-e70167f3da8a {{(pid=87116) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 06 11:56:54 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-71ff80e6-b7b8-45f8-aa21-db1443fc3d25 tempest-CreateVolumesFromSourceVolumeTest-627404290 None] Volume volume-2d8ee6d4-b960-4bfc-a460-17181a71c581 (2d8ee6d4-b960-4bfc-a460-17181a71c581): created successfully Nov 06 11:56:54 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-71ff80e6-b7b8-45f8-aa21-db1443fc3d25 tempest-CreateVolumesFromSourceVolumeTest-627404290 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fc7d9583-ad62-48fd-857e-d8fc230a56a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:56:54 devstack sudo[103018]: pam_unix(sudo:session): session closed for user root Nov 06 11:56:54 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-71ff80e6-b7b8-45f8-aa21-db1443fc3d25 tempest-CreateVolumesFromSourceVolumeTest-627404290 None] Flow 'volume_create_manager' (68e13c9d-17dc-41ee-a14b-b3c2d7180720) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 11:56:54 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b50b41b-b2f1-44e8-b0dd-953b7aa8216e]: (4, 'qcow2') {{(pid=88420) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 11:56:54 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-72fd35ee-db21-4aea-9851-b57ea62959fb tempest-VolumesSnapshotTestJSON-1873011056 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-637f2fec-842f-4b97-8744-e70167f3da8a {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:56:54 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-3998b45f-920b-4ab3-b417-3a8f8f05e520 tempest-VolumeDependencyTests-568082837 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-5496bc0e-2d25-4053-afaa-f6fe7bef3bea.698750ec-da9d-4373-9c3d-fbcf72c6873e" returned: 0 in 0.454s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:56:54 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-3998b45f-920b-4ab3-b417-3a8f8f05e520 tempest-VolumeDependencyTests-568082837 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-5496bc0e-2d25-4053-afaa-f6fe7bef3bea.698750ec-da9d-4373-9c3d-fbcf72c6873e {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:56:54 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-71ff80e6-b7b8-45f8-aa21-db1443fc3d25 tempest-CreateVolumesFromSourceVolumeTest-627404290 None] Created volume successfully. Nov 06 11:56:54 devstack sudo[103028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-5496bc0e-2d25-4053-afaa-f6fe7bef3bea.698750ec-da9d-4373-9c3d-fbcf72c6873e Nov 06 11:56:54 devstack sudo[103028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:56:54 devstack sudo[103027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-637f2fec-842f-4b97-8744-e70167f3da8a Nov 06 11:56:54 devstack sudo[103027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:56:54 devstack sudo[103028]: pam_unix(sudo:session): session closed for user root Nov 06 11:56:54 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-3998b45f-920b-4ab3-b417-3a8f8f05e520 tempest-VolumeDependencyTests-568082837 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-5496bc0e-2d25-4053-afaa-f6fe7bef3bea.698750ec-da9d-4373-9c3d-fbcf72c6873e" returned: 0 in 0.303s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:56:54 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-3998b45f-920b-4ab3-b417-3a8f8f05e520 tempest-VolumeDependencyTests-568082837 None] Lock "cinder-quobyte-698750ec-da9d-4373-9c3d-fbcf72c6873e" released by "_delete_snapshot" :: held 2.111s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 11:56:54 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-3998b45f-920b-4ab3-b417-3a8f8f05e520 tempest-VolumeDependencyTests-568082837 None] Lock "cinder-quobyte-5496bc0e-2d25-4053-afaa-f6fe7bef3bea" released by "delete_snapshot" :: held 2.138s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 11:56:54 devstack cinder-volume[87116]: DEBUG cinder.quota [None req-3998b45f-920b-4ab3-b417-3a8f8f05e520 tempest-VolumeDependencyTests-568082837 None] Created reservations ['b0633532-945f-4f11-9dde-1bb77ed05c35', 'ee75cbcd-9cf3-41da-bcd4-4eeb2a50b1ac', 'df8fec58-64aa-4856-9969-2a4f6ad213ef', '49746caa-babf-43d8-af06-d3d35ec93e64'] {{(pid=87116) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 11:56:54 devstack sudo[103027]: pam_unix(sudo:session): session closed for user root Nov 06 11:56:54 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-72fd35ee-db21-4aea-9851-b57ea62959fb tempest-VolumesSnapshotTestJSON-1873011056 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-637f2fec-842f-4b97-8744-e70167f3da8a" returned: 0 in 0.564s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:56:54 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-72fd35ee-db21-4aea-9851-b57ea62959fb tempest-VolumesSnapshotTestJSON-1873011056 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-637f2fec-842f-4b97-8744-e70167f3da8a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-637f2fec-842f-4b97-8744-e70167f3da8a.a0b2cffc-c0e0-4849-9a5d-deb40649f833 1G {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:56:54 devstack sudo[103036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-637f2fec-842f-4b97-8744-e70167f3da8a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-637f2fec-842f-4b97-8744-e70167f3da8a.a0b2cffc-c0e0-4849-9a5d-deb40649f833 1G Nov 06 11:56:54 devstack sudo[103036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:56:54 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-3998b45f-920b-4ab3-b417-3a8f8f05e520 tempest-VolumeDependencyTests-568082837 None] Delete snapshot completed successfully. Nov 06 11:56:54 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-3998b45f-920b-4ab3-b417-3a8f8f05e520 tempest-VolumeDependencyTests-568082837 None] Lock "cinder-698750ec-da9d-4373-9c3d-fbcf72c6873e-delete_snapshot" released by "delete_snapshot" :: held 2.470s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 11:56:55 devstack sudo[103036]: pam_unix(sudo:session): session closed for user root Nov 06 11:56:55 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-72fd35ee-db21-4aea-9851-b57ea62959fb tempest-VolumesSnapshotTestJSON-1873011056 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-637f2fec-842f-4b97-8744-e70167f3da8a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-637f2fec-842f-4b97-8744-e70167f3da8a.a0b2cffc-c0e0-4849-9a5d-deb40649f833 1G" returned: 0 in 0.650s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:56:55 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-72fd35ee-db21-4aea-9851-b57ea62959fb tempest-VolumesSnapshotTestJSON-1873011056 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-637f2fec-842f-4b97-8744-e70167f3da8a -F qcow2 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-637f2fec-842f-4b97-8744-e70167f3da8a.a0b2cffc-c0e0-4849-9a5d-deb40649f833 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:56:55 devstack sudo[103042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-637f2fec-842f-4b97-8744-e70167f3da8a -F qcow2 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-637f2fec-842f-4b97-8744-e70167f3da8a.a0b2cffc-c0e0-4849-9a5d-deb40649f833 Nov 06 11:56:55 devstack sudo[103042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:56:55 devstack cinder-volume[87116]: DEBUG cinder.volume.flows.manager.create_volume [None req-08055b1c-0b50-416e-8996-7e16f505304c tempest-CreateVolumesFromSourceVolumeTest-627404290 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87116) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 11:56:55 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-08055b1c-0b50-416e-8996-7e16f505304c tempest-CreateVolumesFromSourceVolumeTest-627404290 None] Flow 'volume_create_manager' (15b366ed-84b3-42ec-9367-06280fba4600) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 11:56:55 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-08055b1c-0b50-416e-8996-7e16f505304c tempest-CreateVolumesFromSourceVolumeTest-627404290 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aad43635-bc57-4286-bf4c-ee5c8cac517c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:56:55 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-08055b1c-0b50-416e-8996-7e16f505304c tempest-CreateVolumesFromSourceVolumeTest-627404290 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aad43635-bc57-4286-bf4c-ee5c8cac517c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T10:56:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1203971339',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c486ab7f-ff2b-430e-8883-d168e695c6d0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e029558bfb3642e0bca47d6a71f0e56f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T10:56:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T10:56:55Z,use_quota=True,user_id='b25339719cf549ebb1953d05714b30cc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(34d3b144-d9b7-480a-a2e3-01e45f3d54c1),volume_type_id=34d3b144-d9b7-480a-a2e3-01e45f3d54c1)' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:56:55 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-08055b1c-0b50-416e-8996-7e16f505304c tempest-CreateVolumesFromSourceVolumeTest-627404290 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4465eef8-81b0-49ee-a3a0-607c47666b60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:56:55 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-08055b1c-0b50-416e-8996-7e16f505304c tempest-CreateVolumesFromSourceVolumeTest-627404290 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4465eef8-81b0-49ee-a3a0-607c47666b60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:56:55 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-08055b1c-0b50-416e-8996-7e16f505304c tempest-CreateVolumesFromSourceVolumeTest-627404290 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (edace5ba-eb5b-45db-b40e-d9d0b8c3240e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:56:55 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-08055b1c-0b50-416e-8996-7e16f505304c tempest-CreateVolumesFromSourceVolumeTest-627404290 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (edace5ba-eb5b-45db-b40e-d9d0b8c3240e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c486ab7f-ff2b-430e-8883-d168e695c6d0', 'volume_name': 'volume-c486ab7f-ff2b-430e-8883-d168e695c6d0', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:56:55 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-08055b1c-0b50-416e-8996-7e16f505304c tempest-CreateVolumesFromSourceVolumeTest-627404290 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7f4a4ed5-1a90-4fc0-a395-c8f12b3d487b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:56:55 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-08055b1c-0b50-416e-8996-7e16f505304c tempest-CreateVolumesFromSourceVolumeTest-627404290 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7f4a4ed5-1a90-4fc0-a395-c8f12b3d487b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:56:55 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-08055b1c-0b50-416e-8996-7e16f505304c tempest-CreateVolumesFromSourceVolumeTest-627404290 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (51abc8b9-0902-4420-8345-8c3a773f4df9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:56:55 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-08055b1c-0b50-416e-8996-7e16f505304c tempest-CreateVolumesFromSourceVolumeTest-627404290 None] Volume c486ab7f-ff2b-430e-8883-d168e695c6d0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c486ab7f-ff2b-430e-8883-d168e695c6d0', 'volume_size': 1} Nov 06 11:56:55 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-08055b1c-0b50-416e-8996-7e16f505304c tempest-CreateVolumesFromSourceVolumeTest-627404290 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 11:56:55 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-a2a6fa5f-4008-4335-9ef6-496913d69046 tempest-VolumeDependencyTests-568082837 None] Acquiring lock "cinder-5496bc0e-2d25-4053-afaa-f6fe7bef3bea-delete_volume" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 11:56:55 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-a2a6fa5f-4008-4335-9ef6-496913d69046 tempest-VolumeDependencyTests-568082837 None] Lock "cinder-5496bc0e-2d25-4053-afaa-f6fe7bef3bea-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 11:56:55 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-a2a6fa5f-4008-4335-9ef6-496913d69046 tempest-VolumeDependencyTests-568082837 None] Acquiring lock "cinder-quobyte-5496bc0e-2d25-4053-afaa-f6fe7bef3bea" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 11:56:55 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-a2a6fa5f-4008-4335-9ef6-496913d69046 tempest-VolumeDependencyTests-568082837 None] Lock "cinder-quobyte-5496bc0e-2d25-4053-afaa-f6fe7bef3bea" acquired by "delete_volume" :: waited 0.036s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 11:56:55 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fd32bce-9bef-4d12-b558-de5bd50d773c]: (4, 'qcow2') {{(pid=88420) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 11:56:55 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-a2a6fa5f-4008-4335-9ef6-496913d69046 tempest-VolumeDependencyTests-568082837 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-5496bc0e-2d25-4053-afaa-f6fe7bef3bea {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:56:55 devstack sudo[103042]: pam_unix(sudo:session): session closed for user root Nov 06 11:56:55 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-72fd35ee-db21-4aea-9851-b57ea62959fb tempest-VolumesSnapshotTestJSON-1873011056 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-637f2fec-842f-4b97-8744-e70167f3da8a -F qcow2 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-637f2fec-842f-4b97-8744-e70167f3da8a.a0b2cffc-c0e0-4849-9a5d-deb40649f833" returned: 0 in 0.599s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:56:56 devstack cinder-volume[87116]: WARNING cinder.volume.drivers.remotefs [None req-72fd35ee-db21-4aea-9851-b57ea62959fb tempest-VolumesSnapshotTestJSON-1873011056 None] /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-637f2fec-842f-4b97-8744-e70167f3da8a.a0b2cffc-c0e0-4849-9a5d-deb40649f833 is being set with open permissions: ugo+rw Nov 06 11:56:56 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-72fd35ee-db21-4aea-9851-b57ea62959fb tempest-VolumesSnapshotTestJSON-1873011056 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-637f2fec-842f-4b97-8744-e70167f3da8a.a0b2cffc-c0e0-4849-9a5d-deb40649f833 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:56:56 devstack sudo[103048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-637f2fec-842f-4b97-8744-e70167f3da8a.a0b2cffc-c0e0-4849-9a5d-deb40649f833 Nov 06 11:56:56 devstack sudo[103048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:56:56 devstack sudo[103047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-5496bc0e-2d25-4053-afaa-f6fe7bef3bea Nov 06 11:56:56 devstack sudo[103047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:56:56 devstack cinder-volume[87116]: DEBUG cinder.volume.flows.manager.create_volume [None req-50d55bd3-4567-452a-90d2-2794abd7a1bf tempest-CreateVolumesFromSourceVolumeTest-627404290 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87116) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 11:56:56 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-50d55bd3-4567-452a-90d2-2794abd7a1bf tempest-CreateVolumesFromSourceVolumeTest-627404290 None] Flow 'volume_create_manager' (bd3303ea-7ddc-4164-b150-cacba2ee5590) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 11:56:56 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-50d55bd3-4567-452a-90d2-2794abd7a1bf tempest-CreateVolumesFromSourceVolumeTest-627404290 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0adb0035-a0d5-44b8-ab02-a440413ac681) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:56:56 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-50d55bd3-4567-452a-90d2-2794abd7a1bf tempest-CreateVolumesFromSourceVolumeTest-627404290 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0adb0035-a0d5-44b8-ab02-a440413ac681) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T10:56:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-808260290',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=92fedce3-a61d-4d62-b138-497b43e8bd79,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e029558bfb3642e0bca47d6a71f0e56f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T10:56:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T10:56:56Z,use_quota=True,user_id='b25339719cf549ebb1953d05714b30cc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(34d3b144-d9b7-480a-a2e3-01e45f3d54c1),volume_type_id=34d3b144-d9b7-480a-a2e3-01e45f3d54c1)' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:56:56 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-50d55bd3-4567-452a-90d2-2794abd7a1bf tempest-CreateVolumesFromSourceVolumeTest-627404290 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eaccb685-1035-40ff-88bd-9b1959b6b5ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:56:56 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-50d55bd3-4567-452a-90d2-2794abd7a1bf tempest-CreateVolumesFromSourceVolumeTest-627404290 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eaccb685-1035-40ff-88bd-9b1959b6b5ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:56:56 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-50d55bd3-4567-452a-90d2-2794abd7a1bf tempest-CreateVolumesFromSourceVolumeTest-627404290 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (488cd2b1-209d-41de-bb1f-4d07b6f8b8b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:56:56 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-50d55bd3-4567-452a-90d2-2794abd7a1bf tempest-CreateVolumesFromSourceVolumeTest-627404290 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (488cd2b1-209d-41de-bb1f-4d07b6f8b8b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '92fedce3-a61d-4d62-b138-497b43e8bd79', 'volume_name': 'volume-92fedce3-a61d-4d62-b138-497b43e8bd79', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:56:56 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-50d55bd3-4567-452a-90d2-2794abd7a1bf tempest-CreateVolumesFromSourceVolumeTest-627404290 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0bea9731-7463-42bd-92af-47f2072f701c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:56:56 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-50d55bd3-4567-452a-90d2-2794abd7a1bf tempest-CreateVolumesFromSourceVolumeTest-627404290 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0bea9731-7463-42bd-92af-47f2072f701c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:56:56 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-50d55bd3-4567-452a-90d2-2794abd7a1bf tempest-CreateVolumesFromSourceVolumeTest-627404290 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ee8106f3-6cff-46e4-a6d1-78b9e9d377eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:56:56 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-50d55bd3-4567-452a-90d2-2794abd7a1bf tempest-CreateVolumesFromSourceVolumeTest-627404290 None] Volume 92fedce3-a61d-4d62-b138-497b43e8bd79: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-92fedce3-a61d-4d62-b138-497b43e8bd79', 'volume_size': 1} Nov 06 11:56:56 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-50d55bd3-4567-452a-90d2-2794abd7a1bf tempest-CreateVolumesFromSourceVolumeTest-627404290 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 11:56:56 devstack sudo[103048]: pam_unix(sudo:session): session closed for user root Nov 06 11:56:56 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-72fd35ee-db21-4aea-9851-b57ea62959fb tempest-VolumesSnapshotTestJSON-1873011056 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-637f2fec-842f-4b97-8744-e70167f3da8a.a0b2cffc-c0e0-4849-9a5d-deb40649f833" returned: 0 in 0.392s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:56:56 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-72fd35ee-db21-4aea-9851-b57ea62959fb tempest-VolumesSnapshotTestJSON-1873011056 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-637f2fec-842f-4b97-8744-e70167f3da8a.info {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:56:56 devstack sudo[103054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-637f2fec-842f-4b97-8744-e70167f3da8a.info Nov 06 11:56:56 devstack sudo[103054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:56:56 devstack sudo[103047]: pam_unix(sudo:session): session closed for user root Nov 06 11:56:56 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-a2a6fa5f-4008-4335-9ef6-496913d69046 tempest-VolumeDependencyTests-568082837 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-5496bc0e-2d25-4053-afaa-f6fe7bef3bea" returned: 0 in 0.651s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:56:56 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-a2a6fa5f-4008-4335-9ef6-496913d69046 tempest-VolumeDependencyTests-568082837 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-5496bc0e-2d25-4053-afaa-f6fe7bef3bea {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:56:56 devstack sudo[103057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-5496bc0e-2d25-4053-afaa-f6fe7bef3bea Nov 06 11:56:56 devstack sudo[103057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:56:56 devstack cinder-volume[87116]: DEBUG cinder.volume.flows.manager.create_volume [None req-2a3fa755-3a5c-49ad-8a06-284399e827a3 tempest-CreateVolumesFromSourceVolumeTest-627404290 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87116) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 11:56:56 devstack sudo[103054]: pam_unix(sudo:session): session closed for user root Nov 06 11:56:56 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-2a3fa755-3a5c-49ad-8a06-284399e827a3 tempest-CreateVolumesFromSourceVolumeTest-627404290 None] Flow 'volume_create_manager' (7ab8371a-8d5e-47e8-bdcf-0a1b146b1557) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 11:56:56 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-2a3fa755-3a5c-49ad-8a06-284399e827a3 tempest-CreateVolumesFromSourceVolumeTest-627404290 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0ad4e885-6609-45e4-8d5e-a621f6bbd73d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:56:56 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-72fd35ee-db21-4aea-9851-b57ea62959fb tempest-VolumesSnapshotTestJSON-1873011056 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-637f2fec-842f-4b97-8744-e70167f3da8a.info" returned: 0 in 0.420s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:56:56 devstack cinder-volume[87116]: WARNING cinder.volume.drivers.remotefs [None req-72fd35ee-db21-4aea-9851-b57ea62959fb tempest-VolumesSnapshotTestJSON-1873011056 None] /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-637f2fec-842f-4b97-8744-e70167f3da8a.info is being set with open permissions: ugo+rw Nov 06 11:56:56 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-72fd35ee-db21-4aea-9851-b57ea62959fb tempest-VolumesSnapshotTestJSON-1873011056 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-637f2fec-842f-4b97-8744-e70167f3da8a.info {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:56:56 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-2a3fa755-3a5c-49ad-8a06-284399e827a3 tempest-CreateVolumesFromSourceVolumeTest-627404290 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0ad4e885-6609-45e4-8d5e-a621f6bbd73d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T10:56:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-893897754',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6ea0b785-ff48-4fbf-8c65-bb7f263d8c51,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e029558bfb3642e0bca47d6a71f0e56f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T10:56:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T10:56:57Z,use_quota=True,user_id='b25339719cf549ebb1953d05714b30cc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(34d3b144-d9b7-480a-a2e3-01e45f3d54c1),volume_type_id=34d3b144-d9b7-480a-a2e3-01e45f3d54c1)' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:56:56 devstack sudo[103060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-637f2fec-842f-4b97-8744-e70167f3da8a.info Nov 06 11:56:56 devstack sudo[103060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:56:56 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-2a3fa755-3a5c-49ad-8a06-284399e827a3 tempest-CreateVolumesFromSourceVolumeTest-627404290 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (267dd7cc-3670-4d6b-a235-156146ecdebb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:56:56 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-2a3fa755-3a5c-49ad-8a06-284399e827a3 tempest-CreateVolumesFromSourceVolumeTest-627404290 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (267dd7cc-3670-4d6b-a235-156146ecdebb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:56:56 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-2a3fa755-3a5c-49ad-8a06-284399e827a3 tempest-CreateVolumesFromSourceVolumeTest-627404290 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cea20894-57d5-4041-9e06-b955db70fdac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:56:57 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-2a3fa755-3a5c-49ad-8a06-284399e827a3 tempest-CreateVolumesFromSourceVolumeTest-627404290 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cea20894-57d5-4041-9e06-b955db70fdac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6ea0b785-ff48-4fbf-8c65-bb7f263d8c51', 'volume_name': 'volume-6ea0b785-ff48-4fbf-8c65-bb7f263d8c51', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:56:57 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-2a3fa755-3a5c-49ad-8a06-284399e827a3 tempest-CreateVolumesFromSourceVolumeTest-627404290 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8fb6901a-59f1-4e70-adc2-8059ec0676e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:56:57 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-2a3fa755-3a5c-49ad-8a06-284399e827a3 tempest-CreateVolumesFromSourceVolumeTest-627404290 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8fb6901a-59f1-4e70-adc2-8059ec0676e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:56:57 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-2a3fa755-3a5c-49ad-8a06-284399e827a3 tempest-CreateVolumesFromSourceVolumeTest-627404290 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (29c874ae-7faf-4105-b0ed-ff13a51bd612) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:56:57 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-2a3fa755-3a5c-49ad-8a06-284399e827a3 tempest-CreateVolumesFromSourceVolumeTest-627404290 None] Volume 6ea0b785-ff48-4fbf-8c65-bb7f263d8c51: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6ea0b785-ff48-4fbf-8c65-bb7f263d8c51', 'volume_size': 1} Nov 06 11:56:57 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-2a3fa755-3a5c-49ad-8a06-284399e827a3 tempest-CreateVolumesFromSourceVolumeTest-627404290 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 11:56:57 devstack sudo[103057]: pam_unix(sudo:session): session closed for user root Nov 06 11:56:57 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-a2a6fa5f-4008-4335-9ef6-496913d69046 tempest-VolumeDependencyTests-568082837 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-5496bc0e-2d25-4053-afaa-f6fe7bef3bea" returned: 0 in 0.521s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:56:57 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-a2a6fa5f-4008-4335-9ef6-496913d69046 tempest-VolumeDependencyTests-568082837 None] Lock "cinder-quobyte-5496bc0e-2d25-4053-afaa-f6fe7bef3bea" released by "delete_volume" :: held 1.285s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 11:56:57 devstack cinder-volume[87116]: DEBUG cinder.quota [None req-a2a6fa5f-4008-4335-9ef6-496913d69046 tempest-VolumeDependencyTests-568082837 None] Created reservations ['d11afb7d-33ff-4b98-8c11-b6b96b9eeb44', 'e64863fb-cfba-4a1f-b1dd-7a1e6d5f719e', 'e4c2b3e3-1c04-4f6f-b8c2-4771ffce6acb', 'b5c30269-34ba-44b0-9e87-35a95d99cfa4'] {{(pid=87116) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 11:56:57 devstack sudo[103060]: pam_unix(sudo:session): session closed for user root Nov 06 11:56:57 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-72fd35ee-db21-4aea-9851-b57ea62959fb tempest-VolumesSnapshotTestJSON-1873011056 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-637f2fec-842f-4b97-8744-e70167f3da8a.info" returned: 0 in 0.492s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:56:57 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-72fd35ee-db21-4aea-9851-b57ea62959fb tempest-VolumesSnapshotTestJSON-1873011056 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.308s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 11:56:57 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-08055b1c-0b50-416e-8996-7e16f505304c tempest-CreateVolumesFromSourceVolumeTest-627404290 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.763s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 11:56:57 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-08055b1c-0b50-416e-8996-7e16f505304c tempest-CreateVolumesFromSourceVolumeTest-627404290 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T10:56:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1203971339',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c486ab7f-ff2b-430e-8883-d168e695c6d0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e029558bfb3642e0bca47d6a71f0e56f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T10:56:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T10:56:55Z,use_quota=True,user_id='b25339719cf549ebb1953d05714b30cc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(34d3b144-d9b7-480a-a2e3-01e45f3d54c1),volume_type_id=34d3b144-d9b7-480a-a2e3-01e45f3d54c1)}" {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 11:56:57 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-08055b1c-0b50-416e-8996-7e16f505304c tempest-CreateVolumesFromSourceVolumeTest-627404290 None] Creating volume c486ab7f-ff2b-430e-8883-d168e695c6d0 {{(pid=87116) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 11:56:57 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-08055b1c-0b50-416e-8996-7e16f505304c tempest-CreateVolumesFromSourceVolumeTest-627404290 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 11:56:57 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-08055b1c-0b50-416e-8996-7e16f505304c tempest-CreateVolumesFromSourceVolumeTest-627404290 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 11:56:57 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-08055b1c-0b50-416e-8996-7e16f505304c tempest-CreateVolumesFromSourceVolumeTest-627404290 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 11:56:57 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-08055b1c-0b50-416e-8996-7e16f505304c tempest-CreateVolumesFromSourceVolumeTest-627404290 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 11:56:57 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-08055b1c-0b50-416e-8996-7e16f505304c tempest-CreateVolumesFromSourceVolumeTest-627404290 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 11:56:57 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-08055b1c-0b50-416e-8996-7e16f505304c tempest-CreateVolumesFromSourceVolumeTest-627404290 None] Selected osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f as target Quobyte volume. {{(pid=87116) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 11:56:57 devstack cinder-volume[87116]: INFO cinder.volume.drivers.remotefs [None req-08055b1c-0b50-416e-8996-7e16f505304c tempest-CreateVolumesFromSourceVolumeTest-627404290 None] casted to osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f Nov 06 11:56:57 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-08055b1c-0b50-416e-8996-7e16f505304c tempest-CreateVolumesFromSourceVolumeTest-627404290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-c486ab7f-ff2b-430e-8883-d168e695c6d0 1073741824 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:56:57 devstack sudo[103064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-c486ab7f-ff2b-430e-8883-d168e695c6d0 1073741824 Nov 06 11:56:57 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-a2a6fa5f-4008-4335-9ef6-496913d69046 tempest-VolumeDependencyTests-568082837 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 11:56:57 devstack sudo[103064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:56:57 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-a2a6fa5f-4008-4335-9ef6-496913d69046 tempest-VolumeDependencyTests-568082837 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 11:56:57 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-a2a6fa5f-4008-4335-9ef6-496913d69046 tempest-VolumeDependencyTests-568082837 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 11:56:57 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-a2a6fa5f-4008-4335-9ef6-496913d69046 tempest-VolumeDependencyTests-568082837 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 11:56:57 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-a2a6fa5f-4008-4335-9ef6-496913d69046 tempest-VolumeDependencyTests-568082837 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 11:56:57 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-a2a6fa5f-4008-4335-9ef6-496913d69046 tempest-VolumeDependencyTests-568082837 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:56:57 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-72fd35ee-db21-4aea-9851-b57ea62959fb tempest-VolumesSnapshotTestJSON-1873011056 None] Create snapshot completed successfully Nov 06 11:56:57 devstack sudo[103066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756 Nov 06 11:56:57 devstack sudo[103066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:56:57 devstack cinder-volume[87116]: DEBUG cinder.volume.flows.manager.create_volume [None req-8660d42e-d522-4ac2-9349-e0b4e9df8eee tempest-CreateVolumesFromSourceVolumeTest-627404290 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87116) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 11:56:57 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-8660d42e-d522-4ac2-9349-e0b4e9df8eee tempest-CreateVolumesFromSourceVolumeTest-627404290 None] Flow 'volume_create_manager' (3d07e9b0-5fac-4ed4-b1b2-06de1e6a7bb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 11:56:57 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-8660d42e-d522-4ac2-9349-e0b4e9df8eee tempest-CreateVolumesFromSourceVolumeTest-627404290 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (51e3d242-af1c-4ca0-a109-02065bd35a8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:56:57 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-8660d42e-d522-4ac2-9349-e0b4e9df8eee tempest-CreateVolumesFromSourceVolumeTest-627404290 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (51e3d242-af1c-4ca0-a109-02065bd35a8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T10:56:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-593022464',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a53721fa-e4a0-415e-bc07-501992c22efe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e029558bfb3642e0bca47d6a71f0e56f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T10:56:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T10:56:58Z,use_quota=True,user_id='b25339719cf549ebb1953d05714b30cc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(34d3b144-d9b7-480a-a2e3-01e45f3d54c1),volume_type_id=34d3b144-d9b7-480a-a2e3-01e45f3d54c1)' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:56:57 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-8660d42e-d522-4ac2-9349-e0b4e9df8eee tempest-CreateVolumesFromSourceVolumeTest-627404290 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b1630ced-cd65-4914-b180-dbf61cd8d331) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:56:57 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-8660d42e-d522-4ac2-9349-e0b4e9df8eee tempest-CreateVolumesFromSourceVolumeTest-627404290 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b1630ced-cd65-4914-b180-dbf61cd8d331) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:56:57 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-8660d42e-d522-4ac2-9349-e0b4e9df8eee tempest-CreateVolumesFromSourceVolumeTest-627404290 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d147064-125e-4987-a688-5b173e0d9e89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:56:57 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-8660d42e-d522-4ac2-9349-e0b4e9df8eee tempest-CreateVolumesFromSourceVolumeTest-627404290 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d147064-125e-4987-a688-5b173e0d9e89) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a53721fa-e4a0-415e-bc07-501992c22efe', 'volume_name': 'volume-a53721fa-e4a0-415e-bc07-501992c22efe', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:56:57 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-8660d42e-d522-4ac2-9349-e0b4e9df8eee tempest-CreateVolumesFromSourceVolumeTest-627404290 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d04f00ae-d984-4311-a83c-32f8a48da311) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:56:57 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-8660d42e-d522-4ac2-9349-e0b4e9df8eee tempest-CreateVolumesFromSourceVolumeTest-627404290 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d04f00ae-d984-4311-a83c-32f8a48da311) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:56:57 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-8660d42e-d522-4ac2-9349-e0b4e9df8eee tempest-CreateVolumesFromSourceVolumeTest-627404290 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (527ee9de-99bb-4fed-8787-a8e2ed7f0734) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:56:57 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-8660d42e-d522-4ac2-9349-e0b4e9df8eee tempest-CreateVolumesFromSourceVolumeTest-627404290 None] Volume a53721fa-e4a0-415e-bc07-501992c22efe: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a53721fa-e4a0-415e-bc07-501992c22efe', 'volume_size': 1} Nov 06 11:56:57 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-8660d42e-d522-4ac2-9349-e0b4e9df8eee tempest-CreateVolumesFromSourceVolumeTest-627404290 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 11:56:58 devstack sudo[103066]: pam_unix(sudo:session): session closed for user root Nov 06 11:56:58 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-a2a6fa5f-4008-4335-9ef6-496913d69046 tempest-VolumeDependencyTests-568082837 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756" returned: 0 in 0.518s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:56:58 devstack cinder-volume[87116]: DEBUG cinder.manager [None req-a2a6fa5f-4008-4335-9ef6-496913d69046 tempest-VolumeDependencyTests-568082837 None] Notifying Schedulers of capabilities ... {{(pid=87116) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 11:56:58 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-a2a6fa5f-4008-4335-9ef6-496913d69046 tempest-VolumeDependencyTests-568082837 None] Deleted volume successfully. Nov 06 11:56:58 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-a2a6fa5f-4008-4335-9ef6-496913d69046 tempest-VolumeDependencyTests-568082837 None] Lock "cinder-5496bc0e-2d25-4053-afaa-f6fe7bef3bea-delete_volume" released by "delete_volume" :: held 2.322s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 11:56:58 devstack cinder-volume[87116]: DEBUG cinder.volume.flows.manager.create_volume [None req-0ef4d4bc-ffc4-42f4-aa05-a9dc7fcd28f2 tempest-CreateVolumesFromSourceVolumeTest-627404290 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87116) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 11:56:58 devstack sudo[103064]: pam_unix(sudo:session): session closed for user root Nov 06 11:56:58 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-0ef4d4bc-ffc4-42f4-aa05-a9dc7fcd28f2 tempest-CreateVolumesFromSourceVolumeTest-627404290 None] Flow 'volume_create_manager' (3c2731b9-d524-4dfc-be83-ec9ca3cc0436) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 11:56:58 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-0ef4d4bc-ffc4-42f4-aa05-a9dc7fcd28f2 tempest-CreateVolumesFromSourceVolumeTest-627404290 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (593c0fd3-9172-49d3-9754-a3d068f1a961) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:56:58 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-b7711f6a-2c40-43cf-bec7-352e9acc114f tempest-VolumeDependencyTests-568082837 None] Acquiring lock "cinder-43d77c05-f511-4938-9180-d27287b200bb-delete_volume" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 11:56:58 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-08055b1c-0b50-416e-8996-7e16f505304c tempest-CreateVolumesFromSourceVolumeTest-627404290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-c486ab7f-ff2b-430e-8883-d168e695c6d0 1073741824" returned: 0 in 0.895s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:56:58 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-0ef4d4bc-ffc4-42f4-aa05-a9dc7fcd28f2 tempest-CreateVolumesFromSourceVolumeTest-627404290 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (593c0fd3-9172-49d3-9754-a3d068f1a961) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T10:56:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1986321895',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b4f5b483-153e-4cf4-95f4-127d58908a2a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e029558bfb3642e0bca47d6a71f0e56f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T10:56:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T10:56:58Z,use_quota=True,user_id='b25339719cf549ebb1953d05714b30cc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(34d3b144-d9b7-480a-a2e3-01e45f3d54c1),volume_type_id=34d3b144-d9b7-480a-a2e3-01e45f3d54c1)' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:56:58 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-0ef4d4bc-ffc4-42f4-aa05-a9dc7fcd28f2 tempest-CreateVolumesFromSourceVolumeTest-627404290 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dfa68918-f09e-45c5-bc65-94e841a223e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:56:58 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-0ef4d4bc-ffc4-42f4-aa05-a9dc7fcd28f2 tempest-CreateVolumesFromSourceVolumeTest-627404290 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dfa68918-f09e-45c5-bc65-94e841a223e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:56:58 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-0ef4d4bc-ffc4-42f4-aa05-a9dc7fcd28f2 tempest-CreateVolumesFromSourceVolumeTest-627404290 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f9120415-d62b-46d5-bcbc-c3b16f856981) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:56:58 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-0ef4d4bc-ffc4-42f4-aa05-a9dc7fcd28f2 tempest-CreateVolumesFromSourceVolumeTest-627404290 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f9120415-d62b-46d5-bcbc-c3b16f856981) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b4f5b483-153e-4cf4-95f4-127d58908a2a', 'volume_name': 'volume-b4f5b483-153e-4cf4-95f4-127d58908a2a', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:56:58 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-0ef4d4bc-ffc4-42f4-aa05-a9dc7fcd28f2 tempest-CreateVolumesFromSourceVolumeTest-627404290 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ad437946-0314-49d4-a786-39213d3d6b96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:56:58 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-0ef4d4bc-ffc4-42f4-aa05-a9dc7fcd28f2 tempest-CreateVolumesFromSourceVolumeTest-627404290 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ad437946-0314-49d4-a786-39213d3d6b96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:56:58 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-0ef4d4bc-ffc4-42f4-aa05-a9dc7fcd28f2 tempest-CreateVolumesFromSourceVolumeTest-627404290 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (18099acd-770b-48ef-a3e7-8f7e0ce2fe8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:56:58 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-0ef4d4bc-ffc4-42f4-aa05-a9dc7fcd28f2 tempest-CreateVolumesFromSourceVolumeTest-627404290 None] Volume b4f5b483-153e-4cf4-95f4-127d58908a2a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b4f5b483-153e-4cf4-95f4-127d58908a2a', 'volume_size': 1} Nov 06 11:56:58 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-0ef4d4bc-ffc4-42f4-aa05-a9dc7fcd28f2 tempest-CreateVolumesFromSourceVolumeTest-627404290 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 11:56:58 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-b7711f6a-2c40-43cf-bec7-352e9acc114f tempest-VolumeDependencyTests-568082837 None] Lock "cinder-43d77c05-f511-4938-9180-d27287b200bb-delete_volume" acquired by "delete_volume" :: waited 0.111s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 11:56:58 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-b7711f6a-2c40-43cf-bec7-352e9acc114f tempest-VolumeDependencyTests-568082837 None] Acquiring lock "cinder-quobyte-43d77c05-f511-4938-9180-d27287b200bb" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 11:56:58 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-08055b1c-0b50-416e-8996-7e16f505304c tempest-CreateVolumesFromSourceVolumeTest-627404290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-c486ab7f-ff2b-430e-8883-d168e695c6d0 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:56:58 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-b7711f6a-2c40-43cf-bec7-352e9acc114f tempest-VolumeDependencyTests-568082837 None] Lock "cinder-quobyte-43d77c05-f511-4938-9180-d27287b200bb" acquired by "delete_volume" :: waited 0.030s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 11:56:58 devstack sudo[103073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-c486ab7f-ff2b-430e-8883-d168e695c6d0 Nov 06 11:56:58 devstack sudo[103073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:56:58 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[74f3a1ca-67c1-439d-be70-877a4d21d23a]: (4, 'qcow2') {{(pid=88420) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 11:56:58 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-b7711f6a-2c40-43cf-bec7-352e9acc114f tempest-VolumeDependencyTests-568082837 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-43d77c05-f511-4938-9180-d27287b200bb {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:56:58 devstack sudo[103075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-43d77c05-f511-4938-9180-d27287b200bb Nov 06 11:56:58 devstack sudo[103075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:56:58 devstack sudo[103073]: pam_unix(sudo:session): session closed for user root Nov 06 11:56:58 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-08055b1c-0b50-416e-8996-7e16f505304c tempest-CreateVolumesFromSourceVolumeTest-627404290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-c486ab7f-ff2b-430e-8883-d168e695c6d0" returned: 0 in 0.343s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:56:58 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-08055b1c-0b50-416e-8996-7e16f505304c tempest-CreateVolumesFromSourceVolumeTest-627404290 None] <== create_volume: return (1437ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f'} {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 11:56:58 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-08055b1c-0b50-416e-8996-7e16f505304c tempest-CreateVolumesFromSourceVolumeTest-627404290 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.444s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 11:56:58 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-50d55bd3-4567-452a-90d2-2794abd7a1bf tempest-CreateVolumesFromSourceVolumeTest-627404290 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.597s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 11:56:58 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-50d55bd3-4567-452a-90d2-2794abd7a1bf tempest-CreateVolumesFromSourceVolumeTest-627404290 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T10:56:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-808260290',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=92fedce3-a61d-4d62-b138-497b43e8bd79,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e029558bfb3642e0bca47d6a71f0e56f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T10:56:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T10:56:56Z,use_quota=True,user_id='b25339719cf549ebb1953d05714b30cc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(34d3b144-d9b7-480a-a2e3-01e45f3d54c1),volume_type_id=34d3b144-d9b7-480a-a2e3-01e45f3d54c1)}" {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 11:56:58 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-50d55bd3-4567-452a-90d2-2794abd7a1bf tempest-CreateVolumesFromSourceVolumeTest-627404290 None] Creating volume 92fedce3-a61d-4d62-b138-497b43e8bd79 {{(pid=87116) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 11:56:58 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-50d55bd3-4567-452a-90d2-2794abd7a1bf tempest-CreateVolumesFromSourceVolumeTest-627404290 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 11:56:58 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-50d55bd3-4567-452a-90d2-2794abd7a1bf tempest-CreateVolumesFromSourceVolumeTest-627404290 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 11:56:58 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-50d55bd3-4567-452a-90d2-2794abd7a1bf tempest-CreateVolumesFromSourceVolumeTest-627404290 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 11:56:58 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-50d55bd3-4567-452a-90d2-2794abd7a1bf tempest-CreateVolumesFromSourceVolumeTest-627404290 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 11:56:58 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-50d55bd3-4567-452a-90d2-2794abd7a1bf tempest-CreateVolumesFromSourceVolumeTest-627404290 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 11:56:58 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-50d55bd3-4567-452a-90d2-2794abd7a1bf tempest-CreateVolumesFromSourceVolumeTest-627404290 None] Selected osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f as target Quobyte volume. {{(pid=87116) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 11:56:58 devstack cinder-volume[87116]: INFO cinder.volume.drivers.remotefs [None req-50d55bd3-4567-452a-90d2-2794abd7a1bf tempest-CreateVolumesFromSourceVolumeTest-627404290 None] casted to osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f Nov 06 11:56:58 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-50d55bd3-4567-452a-90d2-2794abd7a1bf tempest-CreateVolumesFromSourceVolumeTest-627404290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-92fedce3-a61d-4d62-b138-497b43e8bd79 1073741824 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:56:58 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-08055b1c-0b50-416e-8996-7e16f505304c tempest-CreateVolumesFromSourceVolumeTest-627404290 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (51abc8b9-0902-4420-8345-8c3a773f4df9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c486ab7f-ff2b-430e-8883-d168e695c6d0', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:56:58 devstack sudo[103078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-92fedce3-a61d-4d62-b138-497b43e8bd79 1073741824 Nov 06 11:56:58 devstack sudo[103078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:56:58 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-08055b1c-0b50-416e-8996-7e16f505304c tempest-CreateVolumesFromSourceVolumeTest-627404290 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d4d88ec1-b47f-4ba6-995e-dd6ae2bea500) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:56:58 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-08055b1c-0b50-416e-8996-7e16f505304c tempest-CreateVolumesFromSourceVolumeTest-627404290 None] Volume volume-c486ab7f-ff2b-430e-8883-d168e695c6d0 (c486ab7f-ff2b-430e-8883-d168e695c6d0): created successfully Nov 06 11:56:58 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-08055b1c-0b50-416e-8996-7e16f505304c tempest-CreateVolumesFromSourceVolumeTest-627404290 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d4d88ec1-b47f-4ba6-995e-dd6ae2bea500) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:56:59 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-08055b1c-0b50-416e-8996-7e16f505304c tempest-CreateVolumesFromSourceVolumeTest-627404290 None] Flow 'volume_create_manager' (15b366ed-84b3-42ec-9367-06280fba4600) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 11:56:59 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-08055b1c-0b50-416e-8996-7e16f505304c tempest-CreateVolumesFromSourceVolumeTest-627404290 None] Created volume successfully. Nov 06 11:56:59 devstack cinder-volume[87116]: DEBUG cinder.volume.flows.manager.create_volume [None req-0668385c-0124-4c63-a57c-7479a278abcd tempest-VolumesSnapshotTestJSON-1873011056 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87116) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 11:56:59 devstack sudo[103075]: pam_unix(sudo:session): session closed for user root Nov 06 11:56:59 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-0668385c-0124-4c63-a57c-7479a278abcd tempest-VolumesSnapshotTestJSON-1873011056 None] Flow 'volume_create_manager' (61c976a1-33e3-42ae-88cf-26b9ec67530a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 11:56:59 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-0668385c-0124-4c63-a57c-7479a278abcd tempest-VolumesSnapshotTestJSON-1873011056 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0d27aa9a-20d4-4156-9aac-39c0e3910d22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:56:59 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-b7711f6a-2c40-43cf-bec7-352e9acc114f tempest-VolumeDependencyTests-568082837 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-43d77c05-f511-4938-9180-d27287b200bb" returned: 0 in 0.543s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:56:59 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-b7711f6a-2c40-43cf-bec7-352e9acc114f tempest-VolumeDependencyTests-568082837 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-43d77c05-f511-4938-9180-d27287b200bb {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:56:59 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-0668385c-0124-4c63-a57c-7479a278abcd tempest-VolumesSnapshotTestJSON-1873011056 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0d27aa9a-20d4-4156-9aac-39c0e3910d22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T10:56:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1859500466',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6ecc6831-e769-4a50-9caa-7a3c72b7d6f6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3bf9e5851f734e6098653da76bb11005',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T10:56:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=a0b2cffc-c0e0-4849-9a5d-deb40649f833,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T10:56:59Z,use_quota=True,user_id='2346ada21cbb4d2b9cf86ef1315c49dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(34d3b144-d9b7-480a-a2e3-01e45f3d54c1),volume_type_id=34d3b144-d9b7-480a-a2e3-01e45f3d54c1)' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:56:59 devstack sudo[103083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-43d77c05-f511-4938-9180-d27287b200bb Nov 06 11:56:59 devstack sudo[103083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:56:59 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-0668385c-0124-4c63-a57c-7479a278abcd tempest-VolumesSnapshotTestJSON-1873011056 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4d359c78-2d21-425f-b089-5cf52b2f0785) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:56:59 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-0668385c-0124-4c63-a57c-7479a278abcd tempest-VolumesSnapshotTestJSON-1873011056 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4d359c78-2d21-425f-b089-5cf52b2f0785) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:56:59 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-0668385c-0124-4c63-a57c-7479a278abcd tempest-VolumesSnapshotTestJSON-1873011056 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (17411304-47c1-4230-bcbf-7dccd9205014) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:56:59 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-0668385c-0124-4c63-a57c-7479a278abcd tempest-VolumesSnapshotTestJSON-1873011056 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (17411304-47c1-4230-bcbf-7dccd9205014) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '6ecc6831-e769-4a50-9caa-7a3c72b7d6f6', 'volume_name': 'volume-6ecc6831-e769-4a50-9caa-7a3c72b7d6f6', 'volume_size': 1, 'snapshot_id': 'a0b2cffc-c0e0-4849-9a5d-deb40649f833'}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:56:59 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-0668385c-0124-4c63-a57c-7479a278abcd tempest-VolumesSnapshotTestJSON-1873011056 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c6859adc-5129-4c6a-b5f1-2ee39299f434) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:56:59 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-0668385c-0124-4c63-a57c-7479a278abcd tempest-VolumesSnapshotTestJSON-1873011056 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c6859adc-5129-4c6a-b5f1-2ee39299f434) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:56:59 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-0668385c-0124-4c63-a57c-7479a278abcd tempest-VolumesSnapshotTestJSON-1873011056 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f57a001e-dae5-4ddd-bcaf-9feab40c05e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:56:59 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-0668385c-0124-4c63-a57c-7479a278abcd tempest-VolumesSnapshotTestJSON-1873011056 None] Volume 6ecc6831-e769-4a50-9caa-7a3c72b7d6f6: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-6ecc6831-e769-4a50-9caa-7a3c72b7d6f6', 'volume_size': 1, 'snapshot_id': 'a0b2cffc-c0e0-4849-9a5d-deb40649f833'} Nov 06 11:56:59 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-0668385c-0124-4c63-a57c-7479a278abcd tempest-VolumesSnapshotTestJSON-1873011056 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 11:56:59 devstack sudo[103083]: pam_unix(sudo:session): session closed for user root Nov 06 11:56:59 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-b7711f6a-2c40-43cf-bec7-352e9acc114f tempest-VolumeDependencyTests-568082837 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-43d77c05-f511-4938-9180-d27287b200bb" returned: 0 in 0.298s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:56:59 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-b7711f6a-2c40-43cf-bec7-352e9acc114f tempest-VolumeDependencyTests-568082837 None] Lock "cinder-quobyte-43d77c05-f511-4938-9180-d27287b200bb" released by "delete_volume" :: held 0.898s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 11:56:59 devstack sudo[103078]: pam_unix(sudo:session): session closed for user root Nov 06 11:56:59 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-50d55bd3-4567-452a-90d2-2794abd7a1bf tempest-CreateVolumesFromSourceVolumeTest-627404290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-92fedce3-a61d-4d62-b138-497b43e8bd79 1073741824" returned: 0 in 0.599s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:56:59 devstack cinder-volume[87116]: DEBUG cinder.volume.flows.manager.create_volume [None req-a7ce89a6-6dd2-42d7-8589-3e28e6d0fe04 tempest-TestServerVolumeAttachmentScenario-1898122559 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87116) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 11:56:59 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-a7ce89a6-6dd2-42d7-8589-3e28e6d0fe04 tempest-TestServerVolumeAttachmentScenario-1898122559 None] Flow 'volume_create_manager' (ab15bf35-02af-46e2-b339-97d4508c5b68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 11:56:59 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-a7ce89a6-6dd2-42d7-8589-3e28e6d0fe04 tempest-TestServerVolumeAttachmentScenario-1898122559 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9cb4f72a-ef43-41fe-92d0-d91d5b5e7440) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:56:59 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-a7ce89a6-6dd2-42d7-8589-3e28e6d0fe04 tempest-TestServerVolumeAttachmentScenario-1898122559 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9cb4f72a-ef43-41fe-92d0-d91d5b5e7440) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T10:56:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1661948697',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e23cb0d7-5064-4885-91f6-b6dc720fccdd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3f70a1219de74d808b3d8275ab0c3ead',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T10:56:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T10:56:59Z,use_quota=True,user_id='8e439b298e25435f86d09b1c8dbd7cf5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(34d3b144-d9b7-480a-a2e3-01e45f3d54c1),volume_type_id=34d3b144-d9b7-480a-a2e3-01e45f3d54c1)' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:56:59 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-a7ce89a6-6dd2-42d7-8589-3e28e6d0fe04 tempest-TestServerVolumeAttachmentScenario-1898122559 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f8454cbb-1c3d-4411-a1c7-ea85fb9c944f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:56:59 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-a7ce89a6-6dd2-42d7-8589-3e28e6d0fe04 tempest-TestServerVolumeAttachmentScenario-1898122559 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f8454cbb-1c3d-4411-a1c7-ea85fb9c944f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:56:59 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-a7ce89a6-6dd2-42d7-8589-3e28e6d0fe04 tempest-TestServerVolumeAttachmentScenario-1898122559 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cedf295e-e997-48ed-b49a-881eeb702825) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:56:59 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-a7ce89a6-6dd2-42d7-8589-3e28e6d0fe04 tempest-TestServerVolumeAttachmentScenario-1898122559 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cedf295e-e997-48ed-b49a-881eeb702825) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e23cb0d7-5064-4885-91f6-b6dc720fccdd', 'volume_name': 'volume-e23cb0d7-5064-4885-91f6-b6dc720fccdd', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:56:59 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-a7ce89a6-6dd2-42d7-8589-3e28e6d0fe04 tempest-TestServerVolumeAttachmentScenario-1898122559 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (33ded1dd-f622-490d-8959-58d5838a5306) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:56:59 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-a7ce89a6-6dd2-42d7-8589-3e28e6d0fe04 tempest-TestServerVolumeAttachmentScenario-1898122559 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (33ded1dd-f622-490d-8959-58d5838a5306) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:56:59 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-a7ce89a6-6dd2-42d7-8589-3e28e6d0fe04 tempest-TestServerVolumeAttachmentScenario-1898122559 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (72e8433e-3af9-41a5-8c2b-fdfe3d559f53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:56:59 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-a7ce89a6-6dd2-42d7-8589-3e28e6d0fe04 tempest-TestServerVolumeAttachmentScenario-1898122559 None] Volume e23cb0d7-5064-4885-91f6-b6dc720fccdd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e23cb0d7-5064-4885-91f6-b6dc720fccdd', 'volume_size': 1} Nov 06 11:56:59 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-a7ce89a6-6dd2-42d7-8589-3e28e6d0fe04 tempest-TestServerVolumeAttachmentScenario-1898122559 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 11:56:59 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-50d55bd3-4567-452a-90d2-2794abd7a1bf tempest-CreateVolumesFromSourceVolumeTest-627404290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-92fedce3-a61d-4d62-b138-497b43e8bd79 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:56:59 devstack cinder-volume[87116]: DEBUG cinder.quota [None req-b7711f6a-2c40-43cf-bec7-352e9acc114f tempest-VolumeDependencyTests-568082837 None] Created reservations ['01ce93ab-f902-443e-a86b-9a08a220e4f6', '55f7af9d-d4fc-4ea8-88be-e7cddaf779a1', 'e9452468-2d2c-4f23-8bc1-8ccc64607461', '74cf613f-fd03-4dcd-99d5-9a30db3233c2'] {{(pid=87116) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 11:56:59 devstack sudo[103090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-92fedce3-a61d-4d62-b138-497b43e8bd79 Nov 06 11:56:59 devstack sudo[103090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:56:59 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-b7711f6a-2c40-43cf-bec7-352e9acc114f tempest-VolumeDependencyTests-568082837 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 11:56:59 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-b7711f6a-2c40-43cf-bec7-352e9acc114f tempest-VolumeDependencyTests-568082837 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 11:56:59 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-b7711f6a-2c40-43cf-bec7-352e9acc114f tempest-VolumeDependencyTests-568082837 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 11:56:59 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-b7711f6a-2c40-43cf-bec7-352e9acc114f tempest-VolumeDependencyTests-568082837 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 11:56:59 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-b7711f6a-2c40-43cf-bec7-352e9acc114f tempest-VolumeDependencyTests-568082837 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 11:56:59 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-b7711f6a-2c40-43cf-bec7-352e9acc114f tempest-VolumeDependencyTests-568082837 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:56:59 devstack sudo[103092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756 Nov 06 11:56:59 devstack sudo[103092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:56:59 devstack sudo[103090]: pam_unix(sudo:session): session closed for user root Nov 06 11:56:59 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-50d55bd3-4567-452a-90d2-2794abd7a1bf tempest-CreateVolumesFromSourceVolumeTest-627404290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-92fedce3-a61d-4d62-b138-497b43e8bd79" returned: 0 in 0.374s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:56:59 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-50d55bd3-4567-452a-90d2-2794abd7a1bf tempest-CreateVolumesFromSourceVolumeTest-627404290 None] <== create_volume: return (1120ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f'} {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 11:56:59 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-50d55bd3-4567-452a-90d2-2794abd7a1bf tempest-CreateVolumesFromSourceVolumeTest-627404290 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.125s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 11:57:00 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-2a3fa755-3a5c-49ad-8a06-284399e827a3 tempest-CreateVolumesFromSourceVolumeTest-627404290 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.982s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 11:57:00 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-2a3fa755-3a5c-49ad-8a06-284399e827a3 tempest-CreateVolumesFromSourceVolumeTest-627404290 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T10:56:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-893897754',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6ea0b785-ff48-4fbf-8c65-bb7f263d8c51,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e029558bfb3642e0bca47d6a71f0e56f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T10:56:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T10:56:57Z,use_quota=True,user_id='b25339719cf549ebb1953d05714b30cc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(34d3b144-d9b7-480a-a2e3-01e45f3d54c1),volume_type_id=34d3b144-d9b7-480a-a2e3-01e45f3d54c1)}" {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 11:57:00 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-2a3fa755-3a5c-49ad-8a06-284399e827a3 tempest-CreateVolumesFromSourceVolumeTest-627404290 None] Creating volume 6ea0b785-ff48-4fbf-8c65-bb7f263d8c51 {{(pid=87116) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 11:57:00 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-2a3fa755-3a5c-49ad-8a06-284399e827a3 tempest-CreateVolumesFromSourceVolumeTest-627404290 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 11:57:00 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-2a3fa755-3a5c-49ad-8a06-284399e827a3 tempest-CreateVolumesFromSourceVolumeTest-627404290 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 11:57:00 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-2a3fa755-3a5c-49ad-8a06-284399e827a3 tempest-CreateVolumesFromSourceVolumeTest-627404290 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 11:57:00 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-2a3fa755-3a5c-49ad-8a06-284399e827a3 tempest-CreateVolumesFromSourceVolumeTest-627404290 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 11:57:00 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-2a3fa755-3a5c-49ad-8a06-284399e827a3 tempest-CreateVolumesFromSourceVolumeTest-627404290 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 11:57:00 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-2a3fa755-3a5c-49ad-8a06-284399e827a3 tempest-CreateVolumesFromSourceVolumeTest-627404290 None] Selected osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f as target Quobyte volume. {{(pid=87116) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 11:57:00 devstack cinder-volume[87116]: INFO cinder.volume.drivers.remotefs [None req-2a3fa755-3a5c-49ad-8a06-284399e827a3 tempest-CreateVolumesFromSourceVolumeTest-627404290 None] casted to osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f Nov 06 11:57:00 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-2a3fa755-3a5c-49ad-8a06-284399e827a3 tempest-CreateVolumesFromSourceVolumeTest-627404290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-6ea0b785-ff48-4fbf-8c65-bb7f263d8c51 1073741824 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:57:00 devstack sudo[103095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-6ea0b785-ff48-4fbf-8c65-bb7f263d8c51 1073741824 Nov 06 11:57:00 devstack sudo[103095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:57:00 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-50d55bd3-4567-452a-90d2-2794abd7a1bf tempest-CreateVolumesFromSourceVolumeTest-627404290 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ee8106f3-6cff-46e4-a6d1-78b9e9d377eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-92fedce3-a61d-4d62-b138-497b43e8bd79', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:57:00 devstack sudo[103092]: pam_unix(sudo:session): session closed for user root Nov 06 11:57:00 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-50d55bd3-4567-452a-90d2-2794abd7a1bf tempest-CreateVolumesFromSourceVolumeTest-627404290 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (02710244-07c8-472d-b6e6-53595c3bc2a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:57:00 devstack cinder-volume[87116]: DEBUG cinder.volume.flows.manager.create_volume [None req-b305a28a-acdb-4f1a-8fe9-d4a64a1f7fa6 tempest-TestServerVolumeAttachmentScenario-1898122559 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87116) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 11:57:00 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-b305a28a-acdb-4f1a-8fe9-d4a64a1f7fa6 tempest-TestServerVolumeAttachmentScenario-1898122559 None] Flow 'volume_create_manager' (e011b88a-1bdb-400c-afa4-2215f673935b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 11:57:00 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-b305a28a-acdb-4f1a-8fe9-d4a64a1f7fa6 tempest-TestServerVolumeAttachmentScenario-1898122559 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0bba8445-d824-44b6-8aff-12c667456b17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:57:00 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-b7711f6a-2c40-43cf-bec7-352e9acc114f tempest-VolumeDependencyTests-568082837 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756" returned: 0 in 0.408s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:57:00 devstack cinder-volume[87116]: DEBUG cinder.manager [None req-b7711f6a-2c40-43cf-bec7-352e9acc114f tempest-VolumeDependencyTests-568082837 None] Notifying Schedulers of capabilities ... {{(pid=87116) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 11:57:00 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-b7711f6a-2c40-43cf-bec7-352e9acc114f tempest-VolumeDependencyTests-568082837 None] Deleted volume successfully. Nov 06 11:57:00 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-50d55bd3-4567-452a-90d2-2794abd7a1bf tempest-CreateVolumesFromSourceVolumeTest-627404290 None] Volume volume-92fedce3-a61d-4d62-b138-497b43e8bd79 (92fedce3-a61d-4d62-b138-497b43e8bd79): created successfully Nov 06 11:57:00 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-50d55bd3-4567-452a-90d2-2794abd7a1bf tempest-CreateVolumesFromSourceVolumeTest-627404290 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (02710244-07c8-472d-b6e6-53595c3bc2a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:57:00 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-50d55bd3-4567-452a-90d2-2794abd7a1bf tempest-CreateVolumesFromSourceVolumeTest-627404290 None] Flow 'volume_create_manager' (bd3303ea-7ddc-4164-b150-cacba2ee5590) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 11:57:00 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-b305a28a-acdb-4f1a-8fe9-d4a64a1f7fa6 tempest-TestServerVolumeAttachmentScenario-1898122559 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0bba8445-d824-44b6-8aff-12c667456b17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T10:57:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-149940185',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9adf6376-224f-4d46-b887-706ec7d6b79a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3f70a1219de74d808b3d8275ab0c3ead',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T10:57:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T10:57:00Z,use_quota=True,user_id='8e439b298e25435f86d09b1c8dbd7cf5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(34d3b144-d9b7-480a-a2e3-01e45f3d54c1),volume_type_id=34d3b144-d9b7-480a-a2e3-01e45f3d54c1)' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:57:00 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-b305a28a-acdb-4f1a-8fe9-d4a64a1f7fa6 tempest-TestServerVolumeAttachmentScenario-1898122559 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8fd19884-7ce4-4013-8edb-51ace224a742) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:57:00 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-b305a28a-acdb-4f1a-8fe9-d4a64a1f7fa6 tempest-TestServerVolumeAttachmentScenario-1898122559 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8fd19884-7ce4-4013-8edb-51ace224a742) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:57:00 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-b305a28a-acdb-4f1a-8fe9-d4a64a1f7fa6 tempest-TestServerVolumeAttachmentScenario-1898122559 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (71c3dc57-576b-4d68-a3ee-98f6ef781fec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:57:00 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-b305a28a-acdb-4f1a-8fe9-d4a64a1f7fa6 tempest-TestServerVolumeAttachmentScenario-1898122559 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (71c3dc57-576b-4d68-a3ee-98f6ef781fec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9adf6376-224f-4d46-b887-706ec7d6b79a', 'volume_name': 'volume-9adf6376-224f-4d46-b887-706ec7d6b79a', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:57:00 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-b305a28a-acdb-4f1a-8fe9-d4a64a1f7fa6 tempest-TestServerVolumeAttachmentScenario-1898122559 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5024e535-a36c-4454-bb9b-1916b30d574a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:57:00 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-b305a28a-acdb-4f1a-8fe9-d4a64a1f7fa6 tempest-TestServerVolumeAttachmentScenario-1898122559 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5024e535-a36c-4454-bb9b-1916b30d574a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:57:00 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-b305a28a-acdb-4f1a-8fe9-d4a64a1f7fa6 tempest-TestServerVolumeAttachmentScenario-1898122559 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c2179805-3852-4458-89ae-d07ad3e43699) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:57:00 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-b305a28a-acdb-4f1a-8fe9-d4a64a1f7fa6 tempest-TestServerVolumeAttachmentScenario-1898122559 None] Volume 9adf6376-224f-4d46-b887-706ec7d6b79a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9adf6376-224f-4d46-b887-706ec7d6b79a', 'volume_size': 1} Nov 06 11:57:00 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-b305a28a-acdb-4f1a-8fe9-d4a64a1f7fa6 tempest-TestServerVolumeAttachmentScenario-1898122559 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 11:57:00 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-50d55bd3-4567-452a-90d2-2794abd7a1bf tempest-CreateVolumesFromSourceVolumeTest-627404290 None] Created volume successfully. Nov 06 11:57:00 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-b7711f6a-2c40-43cf-bec7-352e9acc114f tempest-VolumeDependencyTests-568082837 None] Lock "cinder-43d77c05-f511-4938-9180-d27287b200bb-delete_volume" released by "delete_volume" :: held 1.817s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 11:57:00 devstack sudo[103095]: pam_unix(sudo:session): session closed for user root Nov 06 11:57:00 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-2a3fa755-3a5c-49ad-8a06-284399e827a3 tempest-CreateVolumesFromSourceVolumeTest-627404290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-6ea0b785-ff48-4fbf-8c65-bb7f263d8c51 1073741824" returned: 0 in 0.520s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:57:00 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-2a3fa755-3a5c-49ad-8a06-284399e827a3 tempest-CreateVolumesFromSourceVolumeTest-627404290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-6ea0b785-ff48-4fbf-8c65-bb7f263d8c51 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:57:00 devstack sudo[103102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-6ea0b785-ff48-4fbf-8c65-bb7f263d8c51 Nov 06 11:57:00 devstack sudo[103102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:57:00 devstack sudo[103102]: pam_unix(sudo:session): session closed for user root Nov 06 11:57:00 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-2a3fa755-3a5c-49ad-8a06-284399e827a3 tempest-CreateVolumesFromSourceVolumeTest-627404290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-6ea0b785-ff48-4fbf-8c65-bb7f263d8c51" returned: 0 in 0.281s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:57:00 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-2a3fa755-3a5c-49ad-8a06-284399e827a3 tempest-CreateVolumesFromSourceVolumeTest-627404290 None] <== create_volume: return (870ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f'} {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 11:57:00 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-2a3fa755-3a5c-49ad-8a06-284399e827a3 tempest-CreateVolumesFromSourceVolumeTest-627404290 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.874s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 11:57:00 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-8660d42e-d522-4ac2-9349-e0b4e9df8eee tempest-CreateVolumesFromSourceVolumeTest-627404290 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.968s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 11:57:00 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-8660d42e-d522-4ac2-9349-e0b4e9df8eee tempest-CreateVolumesFromSourceVolumeTest-627404290 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T10:56:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-593022464',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a53721fa-e4a0-415e-bc07-501992c22efe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e029558bfb3642e0bca47d6a71f0e56f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T10:56:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T10:56:58Z,use_quota=True,user_id='b25339719cf549ebb1953d05714b30cc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(34d3b144-d9b7-480a-a2e3-01e45f3d54c1),volume_type_id=34d3b144-d9b7-480a-a2e3-01e45f3d54c1)}" {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 11:57:00 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-8660d42e-d522-4ac2-9349-e0b4e9df8eee tempest-CreateVolumesFromSourceVolumeTest-627404290 None] Creating volume a53721fa-e4a0-415e-bc07-501992c22efe {{(pid=87116) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 11:57:00 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-8660d42e-d522-4ac2-9349-e0b4e9df8eee tempest-CreateVolumesFromSourceVolumeTest-627404290 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 11:57:00 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-8660d42e-d522-4ac2-9349-e0b4e9df8eee tempest-CreateVolumesFromSourceVolumeTest-627404290 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 11:57:00 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-8660d42e-d522-4ac2-9349-e0b4e9df8eee tempest-CreateVolumesFromSourceVolumeTest-627404290 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 11:57:00 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-8660d42e-d522-4ac2-9349-e0b4e9df8eee tempest-CreateVolumesFromSourceVolumeTest-627404290 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 11:57:00 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-8660d42e-d522-4ac2-9349-e0b4e9df8eee tempest-CreateVolumesFromSourceVolumeTest-627404290 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 11:57:00 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-8660d42e-d522-4ac2-9349-e0b4e9df8eee tempest-CreateVolumesFromSourceVolumeTest-627404290 None] Selected osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f as target Quobyte volume. {{(pid=87116) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 11:57:00 devstack cinder-volume[87116]: INFO cinder.volume.drivers.remotefs [None req-8660d42e-d522-4ac2-9349-e0b4e9df8eee tempest-CreateVolumesFromSourceVolumeTest-627404290 None] casted to osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f Nov 06 11:57:00 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-8660d42e-d522-4ac2-9349-e0b4e9df8eee tempest-CreateVolumesFromSourceVolumeTest-627404290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-a53721fa-e4a0-415e-bc07-501992c22efe 1073741824 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:57:00 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-2a3fa755-3a5c-49ad-8a06-284399e827a3 tempest-CreateVolumesFromSourceVolumeTest-627404290 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (29c874ae-7faf-4105-b0ed-ff13a51bd612) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6ea0b785-ff48-4fbf-8c65-bb7f263d8c51', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:57:00 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-2a3fa755-3a5c-49ad-8a06-284399e827a3 tempest-CreateVolumesFromSourceVolumeTest-627404290 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (69e2a983-1dcc-407a-ab08-763c5f530995) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:57:00 devstack sudo[103105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-a53721fa-e4a0-415e-bc07-501992c22efe 1073741824 Nov 06 11:57:00 devstack sudo[103105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:57:00 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-2a3fa755-3a5c-49ad-8a06-284399e827a3 tempest-CreateVolumesFromSourceVolumeTest-627404290 None] Volume volume-6ea0b785-ff48-4fbf-8c65-bb7f263d8c51 (6ea0b785-ff48-4fbf-8c65-bb7f263d8c51): created successfully Nov 06 11:57:00 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-2a3fa755-3a5c-49ad-8a06-284399e827a3 tempest-CreateVolumesFromSourceVolumeTest-627404290 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (69e2a983-1dcc-407a-ab08-763c5f530995) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:57:00 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-2a3fa755-3a5c-49ad-8a06-284399e827a3 tempest-CreateVolumesFromSourceVolumeTest-627404290 None] Flow 'volume_create_manager' (7ab8371a-8d5e-47e8-bdcf-0a1b146b1557) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 11:57:00 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-2a3fa755-3a5c-49ad-8a06-284399e827a3 tempest-CreateVolumesFromSourceVolumeTest-627404290 None] Created volume successfully. Nov 06 11:57:01 devstack sudo[103105]: pam_unix(sudo:session): session closed for user root Nov 06 11:57:01 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-8660d42e-d522-4ac2-9349-e0b4e9df8eee tempest-CreateVolumesFromSourceVolumeTest-627404290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-a53721fa-e4a0-415e-bc07-501992c22efe 1073741824" returned: 0 in 0.589s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:57:01 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-8660d42e-d522-4ac2-9349-e0b4e9df8eee tempest-CreateVolumesFromSourceVolumeTest-627404290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-a53721fa-e4a0-415e-bc07-501992c22efe {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:57:01 devstack sudo[103111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-a53721fa-e4a0-415e-bc07-501992c22efe Nov 06 11:57:01 devstack sudo[103111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:57:01 devstack sudo[103111]: pam_unix(sudo:session): session closed for user root Nov 06 11:57:01 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-8660d42e-d522-4ac2-9349-e0b4e9df8eee tempest-CreateVolumesFromSourceVolumeTest-627404290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-a53721fa-e4a0-415e-bc07-501992c22efe" returned: 0 in 0.303s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:57:01 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-8660d42e-d522-4ac2-9349-e0b4e9df8eee tempest-CreateVolumesFromSourceVolumeTest-627404290 None] <== create_volume: return (951ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f'} {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 11:57:01 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-8660d42e-d522-4ac2-9349-e0b4e9df8eee tempest-CreateVolumesFromSourceVolumeTest-627404290 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.954s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 11:57:01 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-0ef4d4bc-ffc4-42f4-aa05-a9dc7fcd28f2 tempest-CreateVolumesFromSourceVolumeTest-627404290 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.397s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 11:57:01 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-0ef4d4bc-ffc4-42f4-aa05-a9dc7fcd28f2 tempest-CreateVolumesFromSourceVolumeTest-627404290 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T10:56:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1986321895',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b4f5b483-153e-4cf4-95f4-127d58908a2a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e029558bfb3642e0bca47d6a71f0e56f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T10:56:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T10:56:58Z,use_quota=True,user_id='b25339719cf549ebb1953d05714b30cc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(34d3b144-d9b7-480a-a2e3-01e45f3d54c1),volume_type_id=34d3b144-d9b7-480a-a2e3-01e45f3d54c1)}" {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 11:57:01 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-0ef4d4bc-ffc4-42f4-aa05-a9dc7fcd28f2 tempest-CreateVolumesFromSourceVolumeTest-627404290 None] Creating volume b4f5b483-153e-4cf4-95f4-127d58908a2a {{(pid=87116) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 11:57:01 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-0ef4d4bc-ffc4-42f4-aa05-a9dc7fcd28f2 tempest-CreateVolumesFromSourceVolumeTest-627404290 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 11:57:01 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-0ef4d4bc-ffc4-42f4-aa05-a9dc7fcd28f2 tempest-CreateVolumesFromSourceVolumeTest-627404290 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 11:57:01 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-0ef4d4bc-ffc4-42f4-aa05-a9dc7fcd28f2 tempest-CreateVolumesFromSourceVolumeTest-627404290 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 11:57:01 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-0ef4d4bc-ffc4-42f4-aa05-a9dc7fcd28f2 tempest-CreateVolumesFromSourceVolumeTest-627404290 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 11:57:01 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-0ef4d4bc-ffc4-42f4-aa05-a9dc7fcd28f2 tempest-CreateVolumesFromSourceVolumeTest-627404290 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 11:57:01 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-0ef4d4bc-ffc4-42f4-aa05-a9dc7fcd28f2 tempest-CreateVolumesFromSourceVolumeTest-627404290 None] Selected osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f as target Quobyte volume. {{(pid=87116) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 11:57:01 devstack cinder-volume[87116]: INFO cinder.volume.drivers.remotefs [None req-0ef4d4bc-ffc4-42f4-aa05-a9dc7fcd28f2 tempest-CreateVolumesFromSourceVolumeTest-627404290 None] casted to osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f Nov 06 11:57:01 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-0ef4d4bc-ffc4-42f4-aa05-a9dc7fcd28f2 tempest-CreateVolumesFromSourceVolumeTest-627404290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-b4f5b483-153e-4cf4-95f4-127d58908a2a 1073741824 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:57:01 devstack sudo[103114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-b4f5b483-153e-4cf4-95f4-127d58908a2a 1073741824 Nov 06 11:57:01 devstack sudo[103114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:57:01 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-8660d42e-d522-4ac2-9349-e0b4e9df8eee tempest-CreateVolumesFromSourceVolumeTest-627404290 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (527ee9de-99bb-4fed-8787-a8e2ed7f0734) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a53721fa-e4a0-415e-bc07-501992c22efe', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:57:01 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-8660d42e-d522-4ac2-9349-e0b4e9df8eee tempest-CreateVolumesFromSourceVolumeTest-627404290 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f636b651-c466-4587-9516-2eb8be47603c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:57:01 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-8660d42e-d522-4ac2-9349-e0b4e9df8eee tempest-CreateVolumesFromSourceVolumeTest-627404290 None] Volume volume-a53721fa-e4a0-415e-bc07-501992c22efe (a53721fa-e4a0-415e-bc07-501992c22efe): created successfully Nov 06 11:57:01 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-8660d42e-d522-4ac2-9349-e0b4e9df8eee tempest-CreateVolumesFromSourceVolumeTest-627404290 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f636b651-c466-4587-9516-2eb8be47603c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:57:01 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-8660d42e-d522-4ac2-9349-e0b4e9df8eee tempest-CreateVolumesFromSourceVolumeTest-627404290 None] Flow 'volume_create_manager' (3d07e9b0-5fac-4ed4-b1b2-06de1e6a7bb2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 11:57:01 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-8660d42e-d522-4ac2-9349-e0b4e9df8eee tempest-CreateVolumesFromSourceVolumeTest-627404290 None] Created volume successfully. Nov 06 11:57:02 devstack sudo[103114]: pam_unix(sudo:session): session closed for user root Nov 06 11:57:02 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-0ef4d4bc-ffc4-42f4-aa05-a9dc7fcd28f2 tempest-CreateVolumesFromSourceVolumeTest-627404290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-b4f5b483-153e-4cf4-95f4-127d58908a2a 1073741824" returned: 0 in 0.601s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:57:02 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-0ef4d4bc-ffc4-42f4-aa05-a9dc7fcd28f2 tempest-CreateVolumesFromSourceVolumeTest-627404290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-b4f5b483-153e-4cf4-95f4-127d58908a2a {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:57:02 devstack sudo[103120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-b4f5b483-153e-4cf4-95f4-127d58908a2a Nov 06 11:57:02 devstack sudo[103120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:57:02 devstack sudo[103120]: pam_unix(sudo:session): session closed for user root Nov 06 11:57:02 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-0ef4d4bc-ffc4-42f4-aa05-a9dc7fcd28f2 tempest-CreateVolumesFromSourceVolumeTest-627404290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-b4f5b483-153e-4cf4-95f4-127d58908a2a" returned: 0 in 0.275s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:57:02 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-0ef4d4bc-ffc4-42f4-aa05-a9dc7fcd28f2 tempest-CreateVolumesFromSourceVolumeTest-627404290 None] <== create_volume: return (952ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f'} {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 11:57:02 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-0ef4d4bc-ffc4-42f4-aa05-a9dc7fcd28f2 tempest-CreateVolumesFromSourceVolumeTest-627404290 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.955s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 11:57:02 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-0668385c-0124-4c63-a57c-7479a278abcd tempest-VolumesSnapshotTestJSON-1873011056 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 3.605s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 11:57:02 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-0668385c-0124-4c63-a57c-7479a278abcd tempest-VolumesSnapshotTestJSON-1873011056 None] Acquiring lock "cinder-quobyte-a0b2cffc-c0e0-4849-9a5d-deb40649f833-6ecc6831-e769-4a50-9caa-7a3c72b7d6f6" by "_create_volume_from_snapshot" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 11:57:02 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-0ef4d4bc-ffc4-42f4-aa05-a9dc7fcd28f2 tempest-CreateVolumesFromSourceVolumeTest-627404290 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (18099acd-770b-48ef-a3e7-8f7e0ce2fe8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b4f5b483-153e-4cf4-95f4-127d58908a2a', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:57:02 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-0ef4d4bc-ffc4-42f4-aa05-a9dc7fcd28f2 tempest-CreateVolumesFromSourceVolumeTest-627404290 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ae205cb-b6f4-40c3-a360-f20892e89cd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:57:02 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-0668385c-0124-4c63-a57c-7479a278abcd tempest-VolumesSnapshotTestJSON-1873011056 None] Lock "cinder-quobyte-a0b2cffc-c0e0-4849-9a5d-deb40649f833-6ecc6831-e769-4a50-9caa-7a3c72b7d6f6" acquired by "_create_volume_from_snapshot" :: waited 0.036s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 11:57:02 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-0668385c-0124-4c63-a57c-7479a278abcd tempest-VolumesSnapshotTestJSON-1873011056 None] Creating volume 6ecc6831-e769-4a50-9caa-7a3c72b7d6f6 from snapshot a0b2cffc-c0e0-4849-9a5d-deb40649f833 {{(pid=87116) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Nov 06 11:57:02 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-0668385c-0124-4c63-a57c-7479a278abcd tempest-VolumesSnapshotTestJSON-1873011056 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 11:57:02 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-0668385c-0124-4c63-a57c-7479a278abcd tempest-VolumesSnapshotTestJSON-1873011056 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 11:57:02 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-0668385c-0124-4c63-a57c-7479a278abcd tempest-VolumesSnapshotTestJSON-1873011056 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 11:57:02 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-0668385c-0124-4c63-a57c-7479a278abcd tempest-VolumesSnapshotTestJSON-1873011056 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 11:57:02 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-0668385c-0124-4c63-a57c-7479a278abcd tempest-VolumesSnapshotTestJSON-1873011056 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 11:57:02 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-0668385c-0124-4c63-a57c-7479a278abcd tempest-VolumesSnapshotTestJSON-1873011056 None] Selected osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f as target Quobyte volume. {{(pid=87116) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 11:57:02 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-0668385c-0124-4c63-a57c-7479a278abcd tempest-VolumesSnapshotTestJSON-1873011056 None] Acquiring lock "cinder-quobyte-6ecc6831-e769-4a50-9caa-7a3c72b7d6f6" by "_copy_volume_from_snapshot" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 11:57:02 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-0ef4d4bc-ffc4-42f4-aa05-a9dc7fcd28f2 tempest-CreateVolumesFromSourceVolumeTest-627404290 None] Volume volume-b4f5b483-153e-4cf4-95f4-127d58908a2a (b4f5b483-153e-4cf4-95f4-127d58908a2a): created successfully Nov 06 11:57:02 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-0ef4d4bc-ffc4-42f4-aa05-a9dc7fcd28f2 tempest-CreateVolumesFromSourceVolumeTest-627404290 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ae205cb-b6f4-40c3-a360-f20892e89cd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:57:02 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-0ef4d4bc-ffc4-42f4-aa05-a9dc7fcd28f2 tempest-CreateVolumesFromSourceVolumeTest-627404290 None] Flow 'volume_create_manager' (3c2731b9-d524-4dfc-be83-ec9ca3cc0436) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 11:57:02 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-0668385c-0124-4c63-a57c-7479a278abcd tempest-VolumesSnapshotTestJSON-1873011056 None] Lock "cinder-quobyte-6ecc6831-e769-4a50-9caa-7a3c72b7d6f6" acquired by "_copy_volume_from_snapshot" :: waited 0.033s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 11:57:02 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-0668385c-0124-4c63-a57c-7479a278abcd tempest-VolumesSnapshotTestJSON-1873011056 None] snapshot: a0b2cffc-c0e0-4849-9a5d-deb40649f833, volume: 6ecc6831-e769-4a50-9caa-7a3c72b7d6f6, {{(pid=87116) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 06 11:57:02 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-0668385c-0124-4c63-a57c-7479a278abcd tempest-VolumesSnapshotTestJSON-1873011056 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 11:57:02 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-0668385c-0124-4c63-a57c-7479a278abcd tempest-VolumesSnapshotTestJSON-1873011056 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 11:57:02 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-0668385c-0124-4c63-a57c-7479a278abcd tempest-VolumesSnapshotTestJSON-1873011056 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 11:57:02 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-0668385c-0124-4c63-a57c-7479a278abcd tempest-VolumesSnapshotTestJSON-1873011056 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 11:57:02 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-0668385c-0124-4c63-a57c-7479a278abcd tempest-VolumesSnapshotTestJSON-1873011056 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 11:57:02 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-0ef4d4bc-ffc4-42f4-aa05-a9dc7fcd28f2 tempest-CreateVolumesFromSourceVolumeTest-627404290 None] Created volume successfully. Nov 06 11:57:02 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d8ad4c7-1b3f-4a89-b1fe-95d72099e8c2]: (4, 'qcow2') {{(pid=88420) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 11:57:02 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-0668385c-0124-4c63-a57c-7479a278abcd tempest-VolumesSnapshotTestJSON-1873011056 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-637f2fec-842f-4b97-8744-e70167f3da8a.a0b2cffc-c0e0-4849-9a5d-deb40649f833 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:57:03 devstack sudo[103124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-637f2fec-842f-4b97-8744-e70167f3da8a.a0b2cffc-c0e0-4849-9a5d-deb40649f833 Nov 06 11:57:03 devstack sudo[103124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:57:03 devstack sudo[103124]: pam_unix(sudo:session): session closed for user root Nov 06 11:57:03 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-0668385c-0124-4c63-a57c-7479a278abcd tempest-VolumesSnapshotTestJSON-1873011056 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-637f2fec-842f-4b97-8744-e70167f3da8a.a0b2cffc-c0e0-4849-9a5d-deb40649f833" returned: 0 in 0.460s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:57:03 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-0668385c-0124-4c63-a57c-7479a278abcd tempest-VolumesSnapshotTestJSON-1873011056 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-637f2fec-842f-4b97-8744-e70167f3da8a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87116) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 11:57:03 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[769d730b-6688-4f68-8d3d-246e3661cc44]: (4, 'qcow2') {{(pid=88420) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 11:57:03 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-0668385c-0124-4c63-a57c-7479a278abcd tempest-VolumesSnapshotTestJSON-1873011056 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-637f2fec-842f-4b97-8744-e70167f3da8a {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:57:03 devstack sudo[103133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-637f2fec-842f-4b97-8744-e70167f3da8a Nov 06 11:57:03 devstack sudo[103133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:57:03 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-69d641c5-d339-4091-b03e-452385a303b1 tempest-CreateVolumesFromSourceVolumeTest-627404290 None] Acquiring lock "cinder-b4f5b483-153e-4cf4-95f4-127d58908a2a-delete_volume" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 11:57:03 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-69d641c5-d339-4091-b03e-452385a303b1 tempest-CreateVolumesFromSourceVolumeTest-627404290 None] Lock "cinder-b4f5b483-153e-4cf4-95f4-127d58908a2a-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 11:57:03 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-69d641c5-d339-4091-b03e-452385a303b1 tempest-CreateVolumesFromSourceVolumeTest-627404290 None] Acquiring lock "cinder-quobyte-b4f5b483-153e-4cf4-95f4-127d58908a2a" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 11:57:03 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-69d641c5-d339-4091-b03e-452385a303b1 tempest-CreateVolumesFromSourceVolumeTest-627404290 None] Lock "cinder-quobyte-b4f5b483-153e-4cf4-95f4-127d58908a2a" acquired by "delete_volume" :: waited 0.025s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 11:57:03 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e3935cc-a7ad-44e8-a660-76d00d6916cc]: (4, 'qcow2') {{(pid=88420) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 11:57:03 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-69d641c5-d339-4091-b03e-452385a303b1 tempest-CreateVolumesFromSourceVolumeTest-627404290 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-b4f5b483-153e-4cf4-95f4-127d58908a2a {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:57:03 devstack sudo[103133]: pam_unix(sudo:session): session closed for user root Nov 06 11:57:03 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-0668385c-0124-4c63-a57c-7479a278abcd tempest-VolumesSnapshotTestJSON-1873011056 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-637f2fec-842f-4b97-8744-e70167f3da8a" returned: 0 in 0.490s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:57:03 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-0668385c-0124-4c63-a57c-7479a278abcd tempest-VolumesSnapshotTestJSON-1873011056 None] will copy from snapshot at /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-637f2fec-842f-4b97-8744-e70167f3da8a {{(pid=87116) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 06 11:57:03 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-0668385c-0124-4c63-a57c-7479a278abcd tempest-VolumesSnapshotTestJSON-1873011056 None] Creating direct copy from snapshot {{(pid=87116) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 06 11:57:03 devstack cinder-volume[87116]: DEBUG cinder.utils [None req-0668385c-0124-4c63-a57c-7479a278abcd tempest-VolumesSnapshotTestJSON-1873011056 None] Path /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-6ecc6831-e769-4a50-9caa-7a3c72b7d6f6 not found in is_blk_device check {{(pid=87116) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 06 11:57:03 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-0668385c-0124-4c63-a57c-7479a278abcd tempest-VolumesSnapshotTestJSON-1873011056 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-637f2fec-842f-4b97-8744-e70167f3da8a /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-6ecc6831-e769-4a50-9caa-7a3c72b7d6f6 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:57:03 devstack sudo[103142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-637f2fec-842f-4b97-8744-e70167f3da8a /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-6ecc6831-e769-4a50-9caa-7a3c72b7d6f6 Nov 06 11:57:03 devstack sudo[103142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:57:04 devstack sudo[103141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-b4f5b483-153e-4cf4-95f4-127d58908a2a Nov 06 11:57:04 devstack sudo[103141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:57:04 devstack sudo[103141]: pam_unix(sudo:session): session closed for user root Nov 06 11:57:04 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-69d641c5-d339-4091-b03e-452385a303b1 tempest-CreateVolumesFromSourceVolumeTest-627404290 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-b4f5b483-153e-4cf4-95f4-127d58908a2a" returned: 0 in 0.518s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:57:04 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-69d641c5-d339-4091-b03e-452385a303b1 tempest-CreateVolumesFromSourceVolumeTest-627404290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-b4f5b483-153e-4cf4-95f4-127d58908a2a {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:57:04 devstack sudo[103151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-b4f5b483-153e-4cf4-95f4-127d58908a2a Nov 06 11:57:04 devstack sudo[103151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:57:04 devstack sudo[103151]: pam_unix(sudo:session): session closed for user root Nov 06 11:57:04 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-69d641c5-d339-4091-b03e-452385a303b1 tempest-CreateVolumesFromSourceVolumeTest-627404290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-b4f5b483-153e-4cf4-95f4-127d58908a2a" returned: 0 in 0.551s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:57:05 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-69d641c5-d339-4091-b03e-452385a303b1 tempest-CreateVolumesFromSourceVolumeTest-627404290 None] Lock "cinder-quobyte-b4f5b483-153e-4cf4-95f4-127d58908a2a" released by "delete_volume" :: held 1.156s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 11:57:05 devstack cinder-volume[87116]: DEBUG cinder.quota [None req-69d641c5-d339-4091-b03e-452385a303b1 tempest-CreateVolumesFromSourceVolumeTest-627404290 None] Created reservations ['5ed5d990-5737-4ff2-9552-2da3ae2f4e12', '95cbbfac-b3a5-4f7e-9fb2-0dd351ffdca8', 'ae71674f-68eb-463c-a128-855bfbf854d9', '6d14a2b5-030f-40b7-a6c0-2af1c41bb9ae'] {{(pid=87116) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 11:57:05 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-69d641c5-d339-4091-b03e-452385a303b1 tempest-CreateVolumesFromSourceVolumeTest-627404290 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 11:57:05 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-69d641c5-d339-4091-b03e-452385a303b1 tempest-CreateVolumesFromSourceVolumeTest-627404290 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 11:57:05 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-69d641c5-d339-4091-b03e-452385a303b1 tempest-CreateVolumesFromSourceVolumeTest-627404290 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 11:57:05 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-69d641c5-d339-4091-b03e-452385a303b1 tempest-CreateVolumesFromSourceVolumeTest-627404290 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 11:57:05 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-69d641c5-d339-4091-b03e-452385a303b1 tempest-CreateVolumesFromSourceVolumeTest-627404290 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 11:57:05 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-69d641c5-d339-4091-b03e-452385a303b1 tempest-CreateVolumesFromSourceVolumeTest-627404290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:57:05 devstack sudo[103162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756 Nov 06 11:57:05 devstack sudo[103162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:57:05 devstack sudo[103162]: pam_unix(sudo:session): session closed for user root Nov 06 11:57:05 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-69d641c5-d339-4091-b03e-452385a303b1 tempest-CreateVolumesFromSourceVolumeTest-627404290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756" returned: 0 in 0.349s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:57:05 devstack cinder-volume[87116]: DEBUG cinder.manager [None req-69d641c5-d339-4091-b03e-452385a303b1 tempest-CreateVolumesFromSourceVolumeTest-627404290 None] Notifying Schedulers of capabilities ... {{(pid=87116) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 11:57:05 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-69d641c5-d339-4091-b03e-452385a303b1 tempest-CreateVolumesFromSourceVolumeTest-627404290 None] Deleted volume successfully. Nov 06 11:57:05 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-69d641c5-d339-4091-b03e-452385a303b1 tempest-CreateVolumesFromSourceVolumeTest-627404290 None] Lock "cinder-b4f5b483-153e-4cf4-95f4-127d58908a2a-delete_volume" released by "delete_volume" :: held 2.169s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 11:57:06 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-98933c8d-ce40-4d1f-b789-c2c8271e258e tempest-CreateVolumesFromSourceVolumeTest-627404290 None] Acquiring lock "cinder-a53721fa-e4a0-415e-bc07-501992c22efe-delete_volume" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 11:57:06 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-98933c8d-ce40-4d1f-b789-c2c8271e258e tempest-CreateVolumesFromSourceVolumeTest-627404290 None] Lock "cinder-a53721fa-e4a0-415e-bc07-501992c22efe-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 11:57:06 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-98933c8d-ce40-4d1f-b789-c2c8271e258e tempest-CreateVolumesFromSourceVolumeTest-627404290 None] Acquiring lock "cinder-quobyte-a53721fa-e4a0-415e-bc07-501992c22efe" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 11:57:06 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-98933c8d-ce40-4d1f-b789-c2c8271e258e tempest-CreateVolumesFromSourceVolumeTest-627404290 None] Lock "cinder-quobyte-a53721fa-e4a0-415e-bc07-501992c22efe" acquired by "delete_volume" :: waited 0.040s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 11:57:06 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac9e1124-56bc-4ee4-bf40-ea300ef8da1f]: (4, 'qcow2') {{(pid=88420) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 11:57:06 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-98933c8d-ce40-4d1f-b789-c2c8271e258e tempest-CreateVolumesFromSourceVolumeTest-627404290 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-a53721fa-e4a0-415e-bc07-501992c22efe {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:57:06 devstack sudo[103174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-a53721fa-e4a0-415e-bc07-501992c22efe Nov 06 11:57:06 devstack sudo[103174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:57:07 devstack sudo[103174]: pam_unix(sudo:session): session closed for user root Nov 06 11:57:07 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-98933c8d-ce40-4d1f-b789-c2c8271e258e tempest-CreateVolumesFromSourceVolumeTest-627404290 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-a53721fa-e4a0-415e-bc07-501992c22efe" returned: 0 in 1.026s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:57:07 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-98933c8d-ce40-4d1f-b789-c2c8271e258e tempest-CreateVolumesFromSourceVolumeTest-627404290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-a53721fa-e4a0-415e-bc07-501992c22efe {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:57:07 devstack sudo[103186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-a53721fa-e4a0-415e-bc07-501992c22efe Nov 06 11:57:07 devstack sudo[103186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:57:08 devstack sudo[103186]: pam_unix(sudo:session): session closed for user root Nov 06 11:57:08 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-98933c8d-ce40-4d1f-b789-c2c8271e258e tempest-CreateVolumesFromSourceVolumeTest-627404290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-a53721fa-e4a0-415e-bc07-501992c22efe" returned: 0 in 0.569s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:57:08 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-98933c8d-ce40-4d1f-b789-c2c8271e258e tempest-CreateVolumesFromSourceVolumeTest-627404290 None] Lock "cinder-quobyte-a53721fa-e4a0-415e-bc07-501992c22efe" released by "delete_volume" :: held 1.736s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 11:57:08 devstack cinder-volume[87116]: DEBUG cinder.quota [None req-98933c8d-ce40-4d1f-b789-c2c8271e258e tempest-CreateVolumesFromSourceVolumeTest-627404290 None] Created reservations ['053ef41d-1b9a-4ebc-8a78-6defeb7374db', 'c46a018e-1ab9-4bda-b685-3dddd44a481d', 'f4b030fc-d6b0-48a2-bb76-d465459b8a09', '8f479a68-73e8-4b28-a314-67462e1d39e7'] {{(pid=87116) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 11:57:08 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-98933c8d-ce40-4d1f-b789-c2c8271e258e tempest-CreateVolumesFromSourceVolumeTest-627404290 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 11:57:08 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-98933c8d-ce40-4d1f-b789-c2c8271e258e tempest-CreateVolumesFromSourceVolumeTest-627404290 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 11:57:08 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-98933c8d-ce40-4d1f-b789-c2c8271e258e tempest-CreateVolumesFromSourceVolumeTest-627404290 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 11:57:08 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-98933c8d-ce40-4d1f-b789-c2c8271e258e tempest-CreateVolumesFromSourceVolumeTest-627404290 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 11:57:08 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-98933c8d-ce40-4d1f-b789-c2c8271e258e tempest-CreateVolumesFromSourceVolumeTest-627404290 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 11:57:08 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-98933c8d-ce40-4d1f-b789-c2c8271e258e tempest-CreateVolumesFromSourceVolumeTest-627404290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:57:08 devstack sudo[103190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756 Nov 06 11:57:08 devstack sudo[103190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:57:08 devstack sudo[103190]: pam_unix(sudo:session): session closed for user root Nov 06 11:57:08 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-98933c8d-ce40-4d1f-b789-c2c8271e258e tempest-CreateVolumesFromSourceVolumeTest-627404290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756" returned: 0 in 0.497s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:57:08 devstack cinder-volume[87116]: DEBUG cinder.manager [None req-98933c8d-ce40-4d1f-b789-c2c8271e258e tempest-CreateVolumesFromSourceVolumeTest-627404290 None] Notifying Schedulers of capabilities ... {{(pid=87116) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 11:57:08 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-98933c8d-ce40-4d1f-b789-c2c8271e258e tempest-CreateVolumesFromSourceVolumeTest-627404290 None] Deleted volume successfully. Nov 06 11:57:08 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-98933c8d-ce40-4d1f-b789-c2c8271e258e tempest-CreateVolumesFromSourceVolumeTest-627404290 None] Lock "cinder-a53721fa-e4a0-415e-bc07-501992c22efe-delete_volume" released by "delete_volume" :: held 2.661s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 11:57:09 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-f786dc83-f6ef-473f-86c7-14c4ceb1f0c1 tempest-CreateVolumesFromSourceVolumeTest-627404290 None] Acquiring lock "cinder-6ea0b785-ff48-4fbf-8c65-bb7f263d8c51-delete_volume" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 11:57:09 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-f786dc83-f6ef-473f-86c7-14c4ceb1f0c1 tempest-CreateVolumesFromSourceVolumeTest-627404290 None] Lock "cinder-6ea0b785-ff48-4fbf-8c65-bb7f263d8c51-delete_volume" acquired by "delete_volume" :: waited 0.088s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 11:57:09 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-f786dc83-f6ef-473f-86c7-14c4ceb1f0c1 tempest-CreateVolumesFromSourceVolumeTest-627404290 None] Acquiring lock "cinder-quobyte-6ea0b785-ff48-4fbf-8c65-bb7f263d8c51" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 11:57:09 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-f786dc83-f6ef-473f-86c7-14c4ceb1f0c1 tempest-CreateVolumesFromSourceVolumeTest-627404290 None] Lock "cinder-quobyte-6ea0b785-ff48-4fbf-8c65-bb7f263d8c51" acquired by "delete_volume" :: waited 0.031s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 11:57:09 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[13cff863-fb68-4b50-b1f2-b5165bf070f1]: (4, 'qcow2') {{(pid=88420) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 11:57:09 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-f786dc83-f6ef-473f-86c7-14c4ceb1f0c1 tempest-CreateVolumesFromSourceVolumeTest-627404290 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-6ea0b785-ff48-4fbf-8c65-bb7f263d8c51 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:57:09 devstack sudo[103193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-6ea0b785-ff48-4fbf-8c65-bb7f263d8c51 Nov 06 11:57:09 devstack sudo[103193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:57:10 devstack sudo[103193]: pam_unix(sudo:session): session closed for user root Nov 06 11:57:10 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-f786dc83-f6ef-473f-86c7-14c4ceb1f0c1 tempest-CreateVolumesFromSourceVolumeTest-627404290 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-6ea0b785-ff48-4fbf-8c65-bb7f263d8c51" returned: 0 in 0.974s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:57:10 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-f786dc83-f6ef-473f-86c7-14c4ceb1f0c1 tempest-CreateVolumesFromSourceVolumeTest-627404290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-6ea0b785-ff48-4fbf-8c65-bb7f263d8c51 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:57:10 devstack sudo[103198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-6ea0b785-ff48-4fbf-8c65-bb7f263d8c51 Nov 06 11:57:10 devstack sudo[103198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:57:10 devstack sudo[103198]: pam_unix(sudo:session): session closed for user root Nov 06 11:57:10 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-f786dc83-f6ef-473f-86c7-14c4ceb1f0c1 tempest-CreateVolumesFromSourceVolumeTest-627404290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-6ea0b785-ff48-4fbf-8c65-bb7f263d8c51" returned: 0 in 0.606s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:57:10 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-f786dc83-f6ef-473f-86c7-14c4ceb1f0c1 tempest-CreateVolumesFromSourceVolumeTest-627404290 None] Lock "cinder-quobyte-6ea0b785-ff48-4fbf-8c65-bb7f263d8c51" released by "delete_volume" :: held 1.656s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 11:57:11 devstack cinder-volume[87116]: DEBUG cinder.quota [None req-f786dc83-f6ef-473f-86c7-14c4ceb1f0c1 tempest-CreateVolumesFromSourceVolumeTest-627404290 None] Created reservations ['22330b66-7952-48a4-9561-25c744637272', '6b389abf-1024-4d2e-9b0f-d9a033eafc82', 'c89d8aca-a190-4996-81fe-b6ac8cf52aa3', 'd9fe1c2e-0991-4bc9-9f11-5ac73382b93a'] {{(pid=87116) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 11:57:11 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-f786dc83-f6ef-473f-86c7-14c4ceb1f0c1 tempest-CreateVolumesFromSourceVolumeTest-627404290 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 11:57:11 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-f786dc83-f6ef-473f-86c7-14c4ceb1f0c1 tempest-CreateVolumesFromSourceVolumeTest-627404290 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 11:57:11 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-f786dc83-f6ef-473f-86c7-14c4ceb1f0c1 tempest-CreateVolumesFromSourceVolumeTest-627404290 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 11:57:11 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-f786dc83-f6ef-473f-86c7-14c4ceb1f0c1 tempest-CreateVolumesFromSourceVolumeTest-627404290 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 11:57:11 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-f786dc83-f6ef-473f-86c7-14c4ceb1f0c1 tempest-CreateVolumesFromSourceVolumeTest-627404290 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 11:57:11 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-f786dc83-f6ef-473f-86c7-14c4ceb1f0c1 tempest-CreateVolumesFromSourceVolumeTest-627404290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:57:11 devstack sudo[103202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756 Nov 06 11:57:11 devstack sudo[103202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:57:11 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-b1345e96-dec3-4e87-bfad-69b302e7c865 tempest-CreateVolumesFromSourceVolumeTest-627404290 None] Acquiring lock "cinder-92fedce3-a61d-4d62-b138-497b43e8bd79-delete_volume" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 11:57:11 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-b1345e96-dec3-4e87-bfad-69b302e7c865 tempest-CreateVolumesFromSourceVolumeTest-627404290 None] Lock "cinder-92fedce3-a61d-4d62-b138-497b43e8bd79-delete_volume" acquired by "delete_volume" :: waited 0.061s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 11:57:11 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-b1345e96-dec3-4e87-bfad-69b302e7c865 tempest-CreateVolumesFromSourceVolumeTest-627404290 None] Acquiring lock "cinder-quobyte-92fedce3-a61d-4d62-b138-497b43e8bd79" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 11:57:11 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-b1345e96-dec3-4e87-bfad-69b302e7c865 tempest-CreateVolumesFromSourceVolumeTest-627404290 None] Lock "cinder-quobyte-92fedce3-a61d-4d62-b138-497b43e8bd79" acquired by "delete_volume" :: waited 0.037s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 11:57:11 devstack sudo[103202]: pam_unix(sudo:session): session closed for user root Nov 06 11:57:11 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-f786dc83-f6ef-473f-86c7-14c4ceb1f0c1 tempest-CreateVolumesFromSourceVolumeTest-627404290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756" returned: 0 in 0.651s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:57:12 devstack cinder-volume[87116]: DEBUG cinder.manager [None req-f786dc83-f6ef-473f-86c7-14c4ceb1f0c1 tempest-CreateVolumesFromSourceVolumeTest-627404290 None] Notifying Schedulers of capabilities ... {{(pid=87116) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 11:57:12 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[07b85bf3-a73e-4463-bd8f-f71593201f63]: (4, 'qcow2') {{(pid=88420) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 11:57:12 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-f786dc83-f6ef-473f-86c7-14c4ceb1f0c1 tempest-CreateVolumesFromSourceVolumeTest-627404290 None] Deleted volume successfully. Nov 06 11:57:12 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-b1345e96-dec3-4e87-bfad-69b302e7c865 tempest-CreateVolumesFromSourceVolumeTest-627404290 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-92fedce3-a61d-4d62-b138-497b43e8bd79 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:57:12 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-f786dc83-f6ef-473f-86c7-14c4ceb1f0c1 tempest-CreateVolumesFromSourceVolumeTest-627404290 None] Lock "cinder-6ea0b785-ff48-4fbf-8c65-bb7f263d8c51-delete_volume" released by "delete_volume" :: held 2.961s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 11:57:12 devstack sudo[103217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-92fedce3-a61d-4d62-b138-497b43e8bd79 Nov 06 11:57:12 devstack sudo[103217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:57:13 devstack sudo[103217]: pam_unix(sudo:session): session closed for user root Nov 06 11:57:13 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-b1345e96-dec3-4e87-bfad-69b302e7c865 tempest-CreateVolumesFromSourceVolumeTest-627404290 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-92fedce3-a61d-4d62-b138-497b43e8bd79" returned: 0 in 1.206s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:57:13 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-b1345e96-dec3-4e87-bfad-69b302e7c865 tempest-CreateVolumesFromSourceVolumeTest-627404290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-92fedce3-a61d-4d62-b138-497b43e8bd79 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:57:13 devstack sudo[103268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-92fedce3-a61d-4d62-b138-497b43e8bd79 Nov 06 11:57:13 devstack sudo[103268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:57:13 devstack cinder-volume[87116]: DEBUG cinder.volume.flows.manager.create_volume [None req-9e01d4b1-57e4-43b9-a6c4-d9341b754b1a tempest-VolumeImageDependencyTests-1124435753 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87116) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 11:57:13 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-9e01d4b1-57e4-43b9-a6c4-d9341b754b1a tempest-VolumeImageDependencyTests-1124435753 None] Flow 'volume_create_manager' (b0b7a47f-1d14-4e4a-ba83-c5b00efaef89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 11:57:13 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-9e01d4b1-57e4-43b9-a6c4-d9341b754b1a tempest-VolumeImageDependencyTests-1124435753 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6bec25d2-efd8-47bc-8898-8d9aae79feb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:57:13 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-9e01d4b1-57e4-43b9-a6c4-d9341b754b1a tempest-VolumeImageDependencyTests-1124435753 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6bec25d2-efd8-47bc-8898-8d9aae79feb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T10:57:13Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=68468a20-61bd-41e6-958e-60c157e4ca2b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b7d2871fcb7148e8a312283c07a4fd04',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T10:57:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T10:57:13Z,use_quota=True,user_id='9c5c51168b304374990d0a64ddd4be42',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(34d3b144-d9b7-480a-a2e3-01e45f3d54c1),volume_type_id=34d3b144-d9b7-480a-a2e3-01e45f3d54c1)' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:57:14 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-9e01d4b1-57e4-43b9-a6c4-d9341b754b1a tempest-VolumeImageDependencyTests-1124435753 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6035fe62-0eb1-4782-a75a-a475475fe09e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:57:14 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-9e01d4b1-57e4-43b9-a6c4-d9341b754b1a tempest-VolumeImageDependencyTests-1124435753 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6035fe62-0eb1-4782-a75a-a475475fe09e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:57:14 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-9e01d4b1-57e4-43b9-a6c4-d9341b754b1a tempest-VolumeImageDependencyTests-1124435753 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b75c7d66-11fd-4045-b941-7dd16c31f309) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:57:14 devstack cinder-volume[87116]: DEBUG cinder.image.glance [None req-9e01d4b1-57e4-43b9-a6c4-d9341b754b1a tempest-VolumeImageDependencyTests-1124435753 None] Creating Keystone auth plugin from conf {{(pid=87116) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 06 11:57:14 devstack sudo[103268]: pam_unix(sudo:session): session closed for user root Nov 06 11:57:14 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-b1345e96-dec3-4e87-bfad-69b302e7c865 tempest-CreateVolumesFromSourceVolumeTest-627404290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-92fedce3-a61d-4d62-b138-497b43e8bd79" returned: 0 in 0.893s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:57:14 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-b1345e96-dec3-4e87-bfad-69b302e7c865 tempest-CreateVolumesFromSourceVolumeTest-627404290 None] Lock "cinder-quobyte-92fedce3-a61d-4d62-b138-497b43e8bd79" released by "delete_volume" :: held 2.335s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 11:57:14 devstack cinder-volume[87116]: DEBUG cinder.quota [None req-b1345e96-dec3-4e87-bfad-69b302e7c865 tempest-CreateVolumesFromSourceVolumeTest-627404290 None] Created reservations ['8471a44b-2d38-4f1d-92dc-e0167f8d38f6', '21cbd3cd-8a97-4b46-9c42-488c1b214ab6', '75e06ac5-d6a4-4af7-b29a-626fb2880d03', 'ed02ad58-e3bf-4505-ad32-e2567f8debb5'] {{(pid=87116) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 11:57:14 devstack sudo[103142]: pam_unix(sudo:session): session closed for user root Nov 06 11:57:14 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-0668385c-0124-4c63-a57c-7479a278abcd tempest-VolumesSnapshotTestJSON-1873011056 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-637f2fec-842f-4b97-8744-e70167f3da8a /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-6ecc6831-e769-4a50-9caa-7a3c72b7d6f6" returned: 0 in 10.596s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:57:14 devstack cinder-volume[87116]: DEBUG cinder.image.image_utils [None req-0668385c-0124-4c63-a57c-7479a278abcd tempest-VolumesSnapshotTestJSON-1873011056 None] Image conversion details: src /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-637f2fec-842f-4b97-8744-e70167f3da8a, size 1024.00 MB, duration 10.60 sec, destination /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-6ecc6831-e769-4a50-9caa-7a3c72b7d6f6 {{(pid=87116) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 06 11:57:14 devstack cinder-volume[87116]: INFO cinder.image.image_utils [None req-0668385c-0124-4c63-a57c-7479a278abcd tempest-VolumesSnapshotTestJSON-1873011056 None] Converted 1024.00 MB image at 96.63 MB/s Nov 06 11:57:14 devstack cinder-volume[87116]: WARNING cinder.volume.drivers.remotefs [None req-0668385c-0124-4c63-a57c-7479a278abcd tempest-VolumesSnapshotTestJSON-1873011056 None] /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-6ecc6831-e769-4a50-9caa-7a3c72b7d6f6 is being set with open permissions: ugo+rw Nov 06 11:57:14 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-0668385c-0124-4c63-a57c-7479a278abcd tempest-VolumesSnapshotTestJSON-1873011056 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-6ecc6831-e769-4a50-9caa-7a3c72b7d6f6 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:57:14 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-9e01d4b1-57e4-43b9-a6c4-d9341b754b1a tempest-VolumeImageDependencyTests-1124435753 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b75c7d66-11fd-4045-b941-7dd16c31f309) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '68468a20-61bd-41e6-958e-60c157e4ca2b', 'volume_name': 'volume-68468a20-61bd-41e6-958e-60c157e4ca2b', 'volume_size': 1, 'image_id': '6c3bd3a0-67d8-4df0-9b8f-da117974bc36', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/6c3bd3a0-67d8-4df0-9b8f-da117974bc36', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'a154dd73b7869ecffa40b7f1b33f74b7', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'b7d2871fcb7148e8a312283c07a4fd04', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'f695bcdf9ede07af7ef948471c948186ff4635288446a958efbef98b9629cc09f2108beb9beca941e3a12872b85a5948558cc08de8351d7f6f83e6bc2df47957', 'id': '6c3bd3a0-67d8-4df0-9b8f-da117974bc36', 'created_at': datetime.datetime(2026, 11, 6, 10, 57, 5, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 6, 10, 57, 10, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/6c3bd3a0-67d8-4df0-9b8f-da117974bc36/file', 'properties': {}}, 'image_service': }' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:57:14 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-9e01d4b1-57e4-43b9-a6c4-d9341b754b1a tempest-VolumeImageDependencyTests-1124435753 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (143f2782-2dbd-4fa9-91cf-2157bb7fc058) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:57:14 devstack sudo[103281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-6ecc6831-e769-4a50-9caa-7a3c72b7d6f6 Nov 06 11:57:14 devstack sudo[103281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:57:14 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-9e01d4b1-57e4-43b9-a6c4-d9341b754b1a tempest-VolumeImageDependencyTests-1124435753 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (143f2782-2dbd-4fa9-91cf-2157bb7fc058) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:57:14 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-9e01d4b1-57e4-43b9-a6c4-d9341b754b1a tempest-VolumeImageDependencyTests-1124435753 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e9482d5e-fe98-45cf-9b5d-4d8519640275) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:57:14 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-9e01d4b1-57e4-43b9-a6c4-d9341b754b1a tempest-VolumeImageDependencyTests-1124435753 None] Volume 68468a20-61bd-41e6-958e-60c157e4ca2b: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-68468a20-61bd-41e6-958e-60c157e4ca2b', 'volume_size': 1, 'image_id': '6c3bd3a0-67d8-4df0-9b8f-da117974bc36', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/6c3bd3a0-67d8-4df0-9b8f-da117974bc36', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'a154dd73b7869ecffa40b7f1b33f74b7', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'b7d2871fcb7148e8a312283c07a4fd04', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'f695bcdf9ede07af7ef948471c948186ff4635288446a958efbef98b9629cc09f2108beb9beca941e3a12872b85a5948558cc08de8351d7f6f83e6bc2df47957', 'id': '6c3bd3a0-67d8-4df0-9b8f-da117974bc36', 'created_at': datetime.datetime(2026, 11, 6, 10, 57, 5, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 6, 10, 57, 10, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/6c3bd3a0-67d8-4df0-9b8f-da117974bc36/file', 'properties': {}}, 'image_service': } Nov 06 11:57:14 devstack cinder-volume[87116]: DEBUG cinder.volume.flows.manager.create_volume [None req-9e01d4b1-57e4-43b9-a6c4-d9341b754b1a tempest-VolumeImageDependencyTests-1124435753 None] Trying to clone 68468a20-61bd-41e6-958e-60c157e4ca2b from image 6c3bd3a0-67d8-4df0-9b8f-da117974bc36 at location (None, [{'url': 'file:///opt/stack/data/glance/images/6c3bd3a0-67d8-4df0-9b8f-da117974bc36', 'metadata': {}}]). {{(pid=87116) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Nov 06 11:57:14 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-b1345e96-dec3-4e87-bfad-69b302e7c865 tempest-CreateVolumesFromSourceVolumeTest-627404290 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 11:57:14 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-b1345e96-dec3-4e87-bfad-69b302e7c865 tempest-CreateVolumesFromSourceVolumeTest-627404290 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 11:57:14 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-b1345e96-dec3-4e87-bfad-69b302e7c865 tempest-CreateVolumesFromSourceVolumeTest-627404290 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 11:57:14 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-b1345e96-dec3-4e87-bfad-69b302e7c865 tempest-CreateVolumesFromSourceVolumeTest-627404290 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 11:57:14 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-b1345e96-dec3-4e87-bfad-69b302e7c865 tempest-CreateVolumesFromSourceVolumeTest-627404290 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 11:57:14 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-b1345e96-dec3-4e87-bfad-69b302e7c865 tempest-CreateVolumesFromSourceVolumeTest-627404290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:57:14 devstack sudo[103284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756 Nov 06 11:57:14 devstack sudo[103284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:57:14 devstack cinder-volume[87116]: DEBUG cinder.image.image_utils [None req-9e01d4b1-57e4-43b9-a6c4-d9341b754b1a tempest-VolumeImageDependencyTests-1124435753 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_6c3bd3a0-67d8-4df0-9b8f-da117974bc36_ze6sr9nrdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87116) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Nov 06 11:57:14 devstack cinder-volume[87116]: INFO cinder.image.image_utils [None req-9e01d4b1-57e4-43b9-a6c4-d9341b754b1a tempest-VolumeImageDependencyTests-1124435753 None] Image download 0.00 MB at 0.00 MB/s Nov 06 11:57:14 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8a24e6b-cd8e-4c2a-b53e-e9895c924762]: (4, 'raw') {{(pid=88420) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 11:57:14 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-9e01d4b1-57e4-43b9-a6c4-d9341b754b1a tempest-VolumeImageDependencyTests-1124435753 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_6c3bd3a0-67d8-4df0-9b8f-da117974bc36_ze6sr9nrdevstack@QuobyteHD {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:57:15 devstack sudo[103281]: pam_unix(sudo:session): session closed for user root Nov 06 11:57:15 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-0668385c-0124-4c63-a57c-7479a278abcd tempest-VolumesSnapshotTestJSON-1873011056 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-6ecc6831-e769-4a50-9caa-7a3c72b7d6f6" returned: 0 in 0.499s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:57:15 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-0668385c-0124-4c63-a57c-7479a278abcd tempest-VolumesSnapshotTestJSON-1873011056 None] Lock "cinder-quobyte-6ecc6831-e769-4a50-9caa-7a3c72b7d6f6" released by "_copy_volume_from_snapshot" :: held 12.198s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 11:57:15 devstack sudo[103284]: pam_unix(sudo:session): session closed for user root Nov 06 11:57:15 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-b1345e96-dec3-4e87-bfad-69b302e7c865 tempest-CreateVolumesFromSourceVolumeTest-627404290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756" returned: 0 in 0.396s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:57:15 devstack cinder-volume[87116]: DEBUG cinder.manager [None req-b1345e96-dec3-4e87-bfad-69b302e7c865 tempest-CreateVolumesFromSourceVolumeTest-627404290 None] Notifying Schedulers of capabilities ... {{(pid=87116) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 11:57:15 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-b1345e96-dec3-4e87-bfad-69b302e7c865 tempest-CreateVolumesFromSourceVolumeTest-627404290 None] Deleted volume successfully. Nov 06 11:57:15 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-b1345e96-dec3-4e87-bfad-69b302e7c865 tempest-CreateVolumesFromSourceVolumeTest-627404290 None] Lock "cinder-92fedce3-a61d-4d62-b138-497b43e8bd79-delete_volume" released by "delete_volume" :: held 3.530s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 11:57:15 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-0668385c-0124-4c63-a57c-7479a278abcd tempest-VolumesSnapshotTestJSON-1873011056 None] Lock "cinder-quobyte-a0b2cffc-c0e0-4849-9a5d-deb40649f833-6ecc6831-e769-4a50-9caa-7a3c72b7d6f6" released by "_create_volume_from_snapshot" :: held 12.351s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 11:57:15 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-0668385c-0124-4c63-a57c-7479a278abcd tempest-VolumesSnapshotTestJSON-1873011056 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 12.388s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 11:57:15 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-a7ce89a6-6dd2-42d7-8589-3e28e6d0fe04 tempest-TestServerVolumeAttachmentScenario-1898122559 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 15.586s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 11:57:15 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-a7ce89a6-6dd2-42d7-8589-3e28e6d0fe04 tempest-TestServerVolumeAttachmentScenario-1898122559 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T10:56:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1661948697',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e23cb0d7-5064-4885-91f6-b6dc720fccdd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3f70a1219de74d808b3d8275ab0c3ead',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T10:56:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T10:56:59Z,use_quota=True,user_id='8e439b298e25435f86d09b1c8dbd7cf5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(34d3b144-d9b7-480a-a2e3-01e45f3d54c1),volume_type_id=34d3b144-d9b7-480a-a2e3-01e45f3d54c1)}" {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 11:57:15 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-a7ce89a6-6dd2-42d7-8589-3e28e6d0fe04 tempest-TestServerVolumeAttachmentScenario-1898122559 None] Creating volume e23cb0d7-5064-4885-91f6-b6dc720fccdd {{(pid=87116) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 11:57:15 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-a7ce89a6-6dd2-42d7-8589-3e28e6d0fe04 tempest-TestServerVolumeAttachmentScenario-1898122559 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 11:57:15 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-a7ce89a6-6dd2-42d7-8589-3e28e6d0fe04 tempest-TestServerVolumeAttachmentScenario-1898122559 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 11:57:15 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-a7ce89a6-6dd2-42d7-8589-3e28e6d0fe04 tempest-TestServerVolumeAttachmentScenario-1898122559 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 11:57:15 devstack sudo[103287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_6c3bd3a0-67d8-4df0-9b8f-da117974bc36_ze6sr9nrdevstack@QuobyteHD Nov 06 11:57:15 devstack sudo[103287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:57:15 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-a7ce89a6-6dd2-42d7-8589-3e28e6d0fe04 tempest-TestServerVolumeAttachmentScenario-1898122559 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 11:57:15 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-a7ce89a6-6dd2-42d7-8589-3e28e6d0fe04 tempest-TestServerVolumeAttachmentScenario-1898122559 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 11:57:15 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-a7ce89a6-6dd2-42d7-8589-3e28e6d0fe04 tempest-TestServerVolumeAttachmentScenario-1898122559 None] Selected osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f as target Quobyte volume. {{(pid=87116) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 11:57:15 devstack cinder-volume[87116]: INFO cinder.volume.drivers.remotefs [None req-a7ce89a6-6dd2-42d7-8589-3e28e6d0fe04 tempest-TestServerVolumeAttachmentScenario-1898122559 None] casted to osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f Nov 06 11:57:15 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-a7ce89a6-6dd2-42d7-8589-3e28e6d0fe04 tempest-TestServerVolumeAttachmentScenario-1898122559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-e23cb0d7-5064-4885-91f6-b6dc720fccdd 1073741824 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:57:15 devstack sudo[103290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-e23cb0d7-5064-4885-91f6-b6dc720fccdd 1073741824 Nov 06 11:57:15 devstack sudo[103290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:57:15 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-51169acf-33d4-4786-82a4-23f42a43a246 tempest-CreateVolumesFromSourceVolumeTest-627404290 None] Acquiring lock "cinder-c486ab7f-ff2b-430e-8883-d168e695c6d0-delete_volume" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 11:57:15 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-0668385c-0124-4c63-a57c-7479a278abcd tempest-VolumesSnapshotTestJSON-1873011056 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f57a001e-dae5-4ddd-bcaf-9feab40c05e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6ecc6831-e769-4a50-9caa-7a3c72b7d6f6', 'volume_size': 1, 'snapshot_id': 'a0b2cffc-c0e0-4849-9a5d-deb40649f833'}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:57:15 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-0668385c-0124-4c63-a57c-7479a278abcd tempest-VolumesSnapshotTestJSON-1873011056 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (63927527-7ca2-4e46-85ac-c4c77a409ba8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:57:15 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-51169acf-33d4-4786-82a4-23f42a43a246 tempest-CreateVolumesFromSourceVolumeTest-627404290 None] Lock "cinder-c486ab7f-ff2b-430e-8883-d168e695c6d0-delete_volume" acquired by "delete_volume" :: waited 0.062s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 11:57:15 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-0668385c-0124-4c63-a57c-7479a278abcd tempest-VolumesSnapshotTestJSON-1873011056 None] Volume volume-6ecc6831-e769-4a50-9caa-7a3c72b7d6f6 (6ecc6831-e769-4a50-9caa-7a3c72b7d6f6): created successfully Nov 06 11:57:15 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-0668385c-0124-4c63-a57c-7479a278abcd tempest-VolumesSnapshotTestJSON-1873011056 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (63927527-7ca2-4e46-85ac-c4c77a409ba8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:57:15 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-0668385c-0124-4c63-a57c-7479a278abcd tempest-VolumesSnapshotTestJSON-1873011056 None] Flow 'volume_create_manager' (61c976a1-33e3-42ae-88cf-26b9ec67530a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 11:57:15 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-0668385c-0124-4c63-a57c-7479a278abcd tempest-VolumesSnapshotTestJSON-1873011056 None] Created volume successfully. Nov 06 11:57:15 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-51169acf-33d4-4786-82a4-23f42a43a246 tempest-CreateVolumesFromSourceVolumeTest-627404290 None] Acquiring lock "cinder-quobyte-c486ab7f-ff2b-430e-8883-d168e695c6d0" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 11:57:15 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-51169acf-33d4-4786-82a4-23f42a43a246 tempest-CreateVolumesFromSourceVolumeTest-627404290 None] Lock "cinder-quobyte-c486ab7f-ff2b-430e-8883-d168e695c6d0" acquired by "delete_volume" :: waited 0.038s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 11:57:15 devstack sudo[103287]: pam_unix(sudo:session): session closed for user root Nov 06 11:57:15 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-9e01d4b1-57e4-43b9-a6c4-d9341b754b1a tempest-VolumeImageDependencyTests-1124435753 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_6c3bd3a0-67d8-4df0-9b8f-da117974bc36_ze6sr9nrdevstack@QuobyteHD" returned: 0 in 0.648s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:57:15 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-9e01d4b1-57e4-43b9-a6c4-d9341b754b1a tempest-VolumeImageDependencyTests-1124435753 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6c3bd3a0-67d8-4df0-9b8f-da117974bc36_ze6sr9nrdevstack@QuobyteHD {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:57:15 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[41b0eed4-d2a1-4bd8-b57c-b20dfbe7d034]: (4, 'qcow2') {{(pid=88420) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 11:57:15 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-51169acf-33d4-4786-82a4-23f42a43a246 tempest-CreateVolumesFromSourceVolumeTest-627404290 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-c486ab7f-ff2b-430e-8883-d168e695c6d0 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:57:15 devstack sudo[103294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6c3bd3a0-67d8-4df0-9b8f-da117974bc36_ze6sr9nrdevstack@QuobyteHD Nov 06 11:57:15 devstack sudo[103294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:57:15 devstack sudo[103295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-c486ab7f-ff2b-430e-8883-d168e695c6d0 Nov 06 11:57:15 devstack sudo[103295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:57:16 devstack sudo[103294]: pam_unix(sudo:session): session closed for user root Nov 06 11:57:16 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-9e01d4b1-57e4-43b9-a6c4-d9341b754b1a tempest-VolumeImageDependencyTests-1124435753 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6c3bd3a0-67d8-4df0-9b8f-da117974bc36_ze6sr9nrdevstack@QuobyteHD" returned: 1 in 0.420s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:57:16 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-9e01d4b1-57e4-43b9-a6c4-d9341b754b1a tempest-VolumeImageDependencyTests-1124435753 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6c3bd3a0-67d8-4df0-9b8f-da117974bc36_ze6sr9nrdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 06 11:57:16 devstack cinder-volume[87116]: DEBUG cinder.image.image_utils [None req-9e01d4b1-57e4-43b9-a6c4-d9341b754b1a tempest-VolumeImageDependencyTests-1124435753 None] Temporary image 6c3bd3a0-67d8-4df0-9b8f-da117974bc36 is fetched for user 9c5c51168b304374990d0a64ddd4be42. {{(pid=87116) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Nov 06 11:57:16 devstack sudo[103290]: pam_unix(sudo:session): session closed for user root Nov 06 11:57:16 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-a7ce89a6-6dd2-42d7-8589-3e28e6d0fe04 tempest-TestServerVolumeAttachmentScenario-1898122559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-e23cb0d7-5064-4885-91f6-b6dc720fccdd 1073741824" returned: 0 in 0.977s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:57:16 devstack sudo[103295]: pam_unix(sudo:session): session closed for user root Nov 06 11:57:16 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-51169acf-33d4-4786-82a4-23f42a43a246 tempest-CreateVolumesFromSourceVolumeTest-627404290 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-c486ab7f-ff2b-430e-8883-d168e695c6d0" returned: 0 in 0.590s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:57:16 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-51169acf-33d4-4786-82a4-23f42a43a246 tempest-CreateVolumesFromSourceVolumeTest-627404290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-c486ab7f-ff2b-430e-8883-d168e695c6d0 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:57:16 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fc2daf9-489f-488d-9017-6eb1a0cc6a36]: (4, 'raw') {{(pid=88420) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 11:57:16 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-9e01d4b1-57e4-43b9-a6c4-d9341b754b1a tempest-VolumeImageDependencyTests-1124435753 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_6c3bd3a0-67d8-4df0-9b8f-da117974bc36_ze6sr9nrdevstack@QuobyteHD {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:57:16 devstack sudo[103308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-c486ab7f-ff2b-430e-8883-d168e695c6d0 Nov 06 11:57:16 devstack sudo[103308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:57:16 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-a7ce89a6-6dd2-42d7-8589-3e28e6d0fe04 tempest-TestServerVolumeAttachmentScenario-1898122559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-e23cb0d7-5064-4885-91f6-b6dc720fccdd {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:57:16 devstack sudo[103309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_6c3bd3a0-67d8-4df0-9b8f-da117974bc36_ze6sr9nrdevstack@QuobyteHD Nov 06 11:57:16 devstack sudo[103309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:57:16 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-fe62aec3-56c9-4943-8186-d69dbdb40863 tempest-VolumesSnapshotTestJSON-1873011056 None] Acquiring lock "cinder-6ecc6831-e769-4a50-9caa-7a3c72b7d6f6-delete_volume" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 11:57:16 devstack sudo[103311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-e23cb0d7-5064-4885-91f6-b6dc720fccdd Nov 06 11:57:16 devstack sudo[103311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:57:16 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-fe62aec3-56c9-4943-8186-d69dbdb40863 tempest-VolumesSnapshotTestJSON-1873011056 None] Lock "cinder-6ecc6831-e769-4a50-9caa-7a3c72b7d6f6-delete_volume" acquired by "delete_volume" :: waited 0.080s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 11:57:16 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-fe62aec3-56c9-4943-8186-d69dbdb40863 tempest-VolumesSnapshotTestJSON-1873011056 None] Acquiring lock "cinder-quobyte-6ecc6831-e769-4a50-9caa-7a3c72b7d6f6" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 11:57:16 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-fe62aec3-56c9-4943-8186-d69dbdb40863 tempest-VolumesSnapshotTestJSON-1873011056 None] Lock "cinder-quobyte-6ecc6831-e769-4a50-9caa-7a3c72b7d6f6" acquired by "delete_volume" :: waited 0.035s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 11:57:16 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[535b1afd-b672-4f18-a022-961aaa4050b7]: (4, 'qcow2') {{(pid=88420) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 11:57:16 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-fe62aec3-56c9-4943-8186-d69dbdb40863 tempest-VolumesSnapshotTestJSON-1873011056 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-6ecc6831-e769-4a50-9caa-7a3c72b7d6f6 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:57:16 devstack sudo[103309]: pam_unix(sudo:session): session closed for user root Nov 06 11:57:16 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-9e01d4b1-57e4-43b9-a6c4-d9341b754b1a tempest-VolumeImageDependencyTests-1124435753 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_6c3bd3a0-67d8-4df0-9b8f-da117974bc36_ze6sr9nrdevstack@QuobyteHD" returned: 0 in 0.569s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:57:16 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-9e01d4b1-57e4-43b9-a6c4-d9341b754b1a tempest-VolumeImageDependencyTests-1124435753 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6c3bd3a0-67d8-4df0-9b8f-da117974bc36_ze6sr9nrdevstack@QuobyteHD {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:57:16 devstack sudo[103311]: pam_unix(sudo:session): session closed for user root Nov 06 11:57:16 devstack sudo[103308]: pam_unix(sudo:session): session closed for user root Nov 06 11:57:16 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-51169acf-33d4-4786-82a4-23f42a43a246 tempest-CreateVolumesFromSourceVolumeTest-627404290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-c486ab7f-ff2b-430e-8883-d168e695c6d0" returned: 0 in 0.739s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:57:17 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-a7ce89a6-6dd2-42d7-8589-3e28e6d0fe04 tempest-TestServerVolumeAttachmentScenario-1898122559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-e23cb0d7-5064-4885-91f6-b6dc720fccdd" returned: 0 in 0.655s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:57:17 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-a7ce89a6-6dd2-42d7-8589-3e28e6d0fe04 tempest-TestServerVolumeAttachmentScenario-1898122559 None] <== create_volume: return (1818ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f'} {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 11:57:17 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-a7ce89a6-6dd2-42d7-8589-3e28e6d0fe04 tempest-TestServerVolumeAttachmentScenario-1898122559 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.823s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 11:57:17 devstack sudo[103316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-6ecc6831-e769-4a50-9caa-7a3c72b7d6f6 Nov 06 11:57:17 devstack sudo[103316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:57:17 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-51169acf-33d4-4786-82a4-23f42a43a246 tempest-CreateVolumesFromSourceVolumeTest-627404290 None] Lock "cinder-quobyte-c486ab7f-ff2b-430e-8883-d168e695c6d0" released by "delete_volume" :: held 1.484s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 11:57:17 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-b305a28a-acdb-4f1a-8fe9-d4a64a1f7fa6 tempest-TestServerVolumeAttachmentScenario-1898122559 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 16.823s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 11:57:17 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-b305a28a-acdb-4f1a-8fe9-d4a64a1f7fa6 tempest-TestServerVolumeAttachmentScenario-1898122559 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T10:57:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-149940185',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9adf6376-224f-4d46-b887-706ec7d6b79a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3f70a1219de74d808b3d8275ab0c3ead',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T10:57:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T10:57:00Z,use_quota=True,user_id='8e439b298e25435f86d09b1c8dbd7cf5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(34d3b144-d9b7-480a-a2e3-01e45f3d54c1),volume_type_id=34d3b144-d9b7-480a-a2e3-01e45f3d54c1)}" {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 11:57:17 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-b305a28a-acdb-4f1a-8fe9-d4a64a1f7fa6 tempest-TestServerVolumeAttachmentScenario-1898122559 None] Creating volume 9adf6376-224f-4d46-b887-706ec7d6b79a {{(pid=87116) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 11:57:17 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-b305a28a-acdb-4f1a-8fe9-d4a64a1f7fa6 tempest-TestServerVolumeAttachmentScenario-1898122559 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 11:57:17 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-b305a28a-acdb-4f1a-8fe9-d4a64a1f7fa6 tempest-TestServerVolumeAttachmentScenario-1898122559 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 11:57:17 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-b305a28a-acdb-4f1a-8fe9-d4a64a1f7fa6 tempest-TestServerVolumeAttachmentScenario-1898122559 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 11:57:17 devstack sudo[103317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6c3bd3a0-67d8-4df0-9b8f-da117974bc36_ze6sr9nrdevstack@QuobyteHD Nov 06 11:57:17 devstack sudo[103317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:57:17 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-b305a28a-acdb-4f1a-8fe9-d4a64a1f7fa6 tempest-TestServerVolumeAttachmentScenario-1898122559 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 11:57:17 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-b305a28a-acdb-4f1a-8fe9-d4a64a1f7fa6 tempest-TestServerVolumeAttachmentScenario-1898122559 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 11:57:17 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-b305a28a-acdb-4f1a-8fe9-d4a64a1f7fa6 tempest-TestServerVolumeAttachmentScenario-1898122559 None] Selected osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f as target Quobyte volume. {{(pid=87116) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 11:57:17 devstack cinder-volume[87116]: INFO cinder.volume.drivers.remotefs [None req-b305a28a-acdb-4f1a-8fe9-d4a64a1f7fa6 tempest-TestServerVolumeAttachmentScenario-1898122559 None] casted to osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f Nov 06 11:57:17 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-b305a28a-acdb-4f1a-8fe9-d4a64a1f7fa6 tempest-TestServerVolumeAttachmentScenario-1898122559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-9adf6376-224f-4d46-b887-706ec7d6b79a 1073741824 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:57:17 devstack cinder-volume[87116]: DEBUG dbcounter [-] [87116] Writing DB stats cinder:SELECT=145,cinder:UPDATE=188,cinder:DELETE=19,cinder:INSERT=57 {{(pid=87116) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 11:57:17 devstack cinder-volume[87116]: DEBUG dbcounter [-] [87116] Writing DB stats cinder:UPDATE=188,cinder:SELECT=141,cinder:INSERT=33,cinder:DELETE=15 {{(pid=87116) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 11:57:17 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-a7ce89a6-6dd2-42d7-8589-3e28e6d0fe04 tempest-TestServerVolumeAttachmentScenario-1898122559 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (72e8433e-3af9-41a5-8c2b-fdfe3d559f53) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e23cb0d7-5064-4885-91f6-b6dc720fccdd', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:57:17 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-a7ce89a6-6dd2-42d7-8589-3e28e6d0fe04 tempest-TestServerVolumeAttachmentScenario-1898122559 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (397c2467-8c46-4257-9894-911776c6b4bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:57:17 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-a7ce89a6-6dd2-42d7-8589-3e28e6d0fe04 tempest-TestServerVolumeAttachmentScenario-1898122559 None] Volume volume-e23cb0d7-5064-4885-91f6-b6dc720fccdd (e23cb0d7-5064-4885-91f6-b6dc720fccdd): created successfully Nov 06 11:57:17 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-a7ce89a6-6dd2-42d7-8589-3e28e6d0fe04 tempest-TestServerVolumeAttachmentScenario-1898122559 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (397c2467-8c46-4257-9894-911776c6b4bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:57:17 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-a7ce89a6-6dd2-42d7-8589-3e28e6d0fe04 tempest-TestServerVolumeAttachmentScenario-1898122559 None] Flow 'volume_create_manager' (ab15bf35-02af-46e2-b339-97d4508c5b68) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 11:57:17 devstack sudo[103322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-9adf6376-224f-4d46-b887-706ec7d6b79a 1073741824 Nov 06 11:57:17 devstack sudo[103322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:57:17 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-a7ce89a6-6dd2-42d7-8589-3e28e6d0fe04 tempest-TestServerVolumeAttachmentScenario-1898122559 None] Created volume successfully. Nov 06 11:57:17 devstack cinder-volume[87116]: DEBUG cinder.quota [None req-51169acf-33d4-4786-82a4-23f42a43a246 tempest-CreateVolumesFromSourceVolumeTest-627404290 None] Created reservations ['32d9d2e0-d3c5-4060-b5e7-fa19602e3b2e', '9e472f6b-03c7-4f01-9b5c-868eeb594d4e', '36b94a22-e00e-4f47-99b7-6b80e73799d4', 'cb9dda49-6dbe-4ff9-828a-1d9b8d25627b'] {{(pid=87116) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 11:57:17 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-51169acf-33d4-4786-82a4-23f42a43a246 tempest-CreateVolumesFromSourceVolumeTest-627404290 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 11:57:17 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-51169acf-33d4-4786-82a4-23f42a43a246 tempest-CreateVolumesFromSourceVolumeTest-627404290 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 11:57:17 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-51169acf-33d4-4786-82a4-23f42a43a246 tempest-CreateVolumesFromSourceVolumeTest-627404290 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 11:57:17 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-51169acf-33d4-4786-82a4-23f42a43a246 tempest-CreateVolumesFromSourceVolumeTest-627404290 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 11:57:17 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-51169acf-33d4-4786-82a4-23f42a43a246 tempest-CreateVolumesFromSourceVolumeTest-627404290 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 11:57:17 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-51169acf-33d4-4786-82a4-23f42a43a246 tempest-CreateVolumesFromSourceVolumeTest-627404290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:57:17 devstack sudo[103316]: pam_unix(sudo:session): session closed for user root Nov 06 11:57:17 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-fe62aec3-56c9-4943-8186-d69dbdb40863 tempest-VolumesSnapshotTestJSON-1873011056 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-6ecc6831-e769-4a50-9caa-7a3c72b7d6f6" returned: 0 in 0.748s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:57:17 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-fe62aec3-56c9-4943-8186-d69dbdb40863 tempest-VolumesSnapshotTestJSON-1873011056 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-6ecc6831-e769-4a50-9caa-7a3c72b7d6f6 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:57:17 devstack sudo[103317]: pam_unix(sudo:session): session closed for user root Nov 06 11:57:17 devstack sudo[103329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756 Nov 06 11:57:17 devstack sudo[103329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:57:17 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-9e01d4b1-57e4-43b9-a6c4-d9341b754b1a tempest-VolumeImageDependencyTests-1124435753 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6c3bd3a0-67d8-4df0-9b8f-da117974bc36_ze6sr9nrdevstack@QuobyteHD" returned: 1 in 0.718s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:57:17 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-9e01d4b1-57e4-43b9-a6c4-d9341b754b1a tempest-VolumeImageDependencyTests-1124435753 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6c3bd3a0-67d8-4df0-9b8f-da117974bc36_ze6sr9nrdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 06 11:57:17 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-9e01d4b1-57e4-43b9-a6c4-d9341b754b1a tempest-VolumeImageDependencyTests-1124435753 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 11:57:17 devstack sudo[103332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-6ecc6831-e769-4a50-9caa-7a3c72b7d6f6 Nov 06 11:57:17 devstack sudo[103332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:57:17 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-0e3070fd-6b6c-4dc8-8fec-c2ee3a284bb5 tempest-CreateVolumesFromSourceVolumeTest-627404290 None] Acquiring lock "cinder-2d8ee6d4-b960-4bfc-a460-17181a71c581-delete_volume" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 11:57:17 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-0e3070fd-6b6c-4dc8-8fec-c2ee3a284bb5 tempest-CreateVolumesFromSourceVolumeTest-627404290 None] Lock "cinder-2d8ee6d4-b960-4bfc-a460-17181a71c581-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 11:57:17 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-0e3070fd-6b6c-4dc8-8fec-c2ee3a284bb5 tempest-CreateVolumesFromSourceVolumeTest-627404290 None] Acquiring lock "cinder-quobyte-2d8ee6d4-b960-4bfc-a460-17181a71c581" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 11:57:17 devstack sudo[103329]: pam_unix(sudo:session): session closed for user root Nov 06 11:57:18 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-51169acf-33d4-4786-82a4-23f42a43a246 tempest-CreateVolumesFromSourceVolumeTest-627404290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756" returned: 0 in 0.527s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:57:18 devstack cinder-volume[87116]: DEBUG cinder.manager [None req-51169acf-33d4-4786-82a4-23f42a43a246 tempest-CreateVolumesFromSourceVolumeTest-627404290 None] Notifying Schedulers of capabilities ... {{(pid=87116) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 11:57:18 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-51169acf-33d4-4786-82a4-23f42a43a246 tempest-CreateVolumesFromSourceVolumeTest-627404290 None] Deleted volume successfully. Nov 06 11:57:18 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-0e3070fd-6b6c-4dc8-8fec-c2ee3a284bb5 tempest-CreateVolumesFromSourceVolumeTest-627404290 None] Lock "cinder-quobyte-2d8ee6d4-b960-4bfc-a460-17181a71c581" acquired by "delete_volume" :: waited 0.052s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 11:57:18 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-51169acf-33d4-4786-82a4-23f42a43a246 tempest-CreateVolumesFromSourceVolumeTest-627404290 None] Lock "cinder-c486ab7f-ff2b-430e-8883-d168e695c6d0-delete_volume" released by "delete_volume" :: held 2.693s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 11:57:18 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[2baf4061-3d48-4c80-a8be-d9e71d2ec082]: (4, 'qcow2') {{(pid=88420) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 11:57:18 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-0e3070fd-6b6c-4dc8-8fec-c2ee3a284bb5 tempest-CreateVolumesFromSourceVolumeTest-627404290 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-2d8ee6d4-b960-4bfc-a460-17181a71c581 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:57:18 devstack sudo[103322]: pam_unix(sudo:session): session closed for user root Nov 06 11:57:18 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-b305a28a-acdb-4f1a-8fe9-d4a64a1f7fa6 tempest-TestServerVolumeAttachmentScenario-1898122559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-9adf6376-224f-4d46-b887-706ec7d6b79a 1073741824" returned: 0 in 1.046s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:57:18 devstack sudo[103332]: pam_unix(sudo:session): session closed for user root Nov 06 11:57:18 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-fe62aec3-56c9-4943-8186-d69dbdb40863 tempest-VolumesSnapshotTestJSON-1873011056 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-6ecc6831-e769-4a50-9caa-7a3c72b7d6f6" returned: 0 in 0.608s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:57:18 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-fe62aec3-56c9-4943-8186-d69dbdb40863 tempest-VolumesSnapshotTestJSON-1873011056 None] Lock "cinder-quobyte-6ecc6831-e769-4a50-9caa-7a3c72b7d6f6" released by "delete_volume" :: held 1.508s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 11:57:18 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-b305a28a-acdb-4f1a-8fe9-d4a64a1f7fa6 tempest-TestServerVolumeAttachmentScenario-1898122559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-9adf6376-224f-4d46-b887-706ec7d6b79a {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:57:18 devstack sudo[103343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-9adf6376-224f-4d46-b887-706ec7d6b79a Nov 06 11:57:18 devstack sudo[103343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:57:18 devstack cinder-volume[87116]: DEBUG cinder.quota [None req-fe62aec3-56c9-4943-8186-d69dbdb40863 tempest-VolumesSnapshotTestJSON-1873011056 None] Created reservations ['c021c491-b66c-4592-a119-96a654f6cda7', 'c5432c92-871b-4ca0-9df5-310e92ecd418', 'f55d41fb-2251-4a1b-b286-1964e0fbb0b7', 'e8e2ce83-5a95-4747-9d0d-38bedfaa0650'] {{(pid=87116) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 11:57:18 devstack sudo[103342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-2d8ee6d4-b960-4bfc-a460-17181a71c581 Nov 06 11:57:18 devstack sudo[103342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:57:18 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-fe62aec3-56c9-4943-8186-d69dbdb40863 tempest-VolumesSnapshotTestJSON-1873011056 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 11:57:18 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-fe62aec3-56c9-4943-8186-d69dbdb40863 tempest-VolumesSnapshotTestJSON-1873011056 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 11:57:18 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-fe62aec3-56c9-4943-8186-d69dbdb40863 tempest-VolumesSnapshotTestJSON-1873011056 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 11:57:18 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-fe62aec3-56c9-4943-8186-d69dbdb40863 tempest-VolumesSnapshotTestJSON-1873011056 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 11:57:18 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-fe62aec3-56c9-4943-8186-d69dbdb40863 tempest-VolumesSnapshotTestJSON-1873011056 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 11:57:18 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-fe62aec3-56c9-4943-8186-d69dbdb40863 tempest-VolumesSnapshotTestJSON-1873011056 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:57:18 devstack sudo[103346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756 Nov 06 11:57:18 devstack sudo[103346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:57:18 devstack sudo[103343]: pam_unix(sudo:session): session closed for user root Nov 06 11:57:18 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-b305a28a-acdb-4f1a-8fe9-d4a64a1f7fa6 tempest-TestServerVolumeAttachmentScenario-1898122559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-9adf6376-224f-4d46-b887-706ec7d6b79a" returned: 0 in 0.339s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:57:18 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-b305a28a-acdb-4f1a-8fe9-d4a64a1f7fa6 tempest-TestServerVolumeAttachmentScenario-1898122559 None] <== create_volume: return (1481ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f'} {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 11:57:18 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-b305a28a-acdb-4f1a-8fe9-d4a64a1f7fa6 tempest-TestServerVolumeAttachmentScenario-1898122559 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.489s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 11:57:18 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-9e01d4b1-57e4-43b9-a6c4-d9341b754b1a tempest-VolumeImageDependencyTests-1124435753 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.989s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 11:57:18 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-9e01d4b1-57e4-43b9-a6c4-d9341b754b1a tempest-VolumeImageDependencyTests-1124435753 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T10:57:13Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=68468a20-61bd-41e6-958e-60c157e4ca2b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b7d2871fcb7148e8a312283c07a4fd04',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T10:57:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T10:57:13Z,use_quota=True,user_id='9c5c51168b304374990d0a64ddd4be42',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(34d3b144-d9b7-480a-a2e3-01e45f3d54c1),volume_type_id=34d3b144-d9b7-480a-a2e3-01e45f3d54c1)}" {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 11:57:18 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-9e01d4b1-57e4-43b9-a6c4-d9341b754b1a tempest-VolumeImageDependencyTests-1124435753 None] Creating volume 68468a20-61bd-41e6-958e-60c157e4ca2b {{(pid=87116) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 11:57:18 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-9e01d4b1-57e4-43b9-a6c4-d9341b754b1a tempest-VolumeImageDependencyTests-1124435753 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 11:57:18 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-9e01d4b1-57e4-43b9-a6c4-d9341b754b1a tempest-VolumeImageDependencyTests-1124435753 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 11:57:18 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-9e01d4b1-57e4-43b9-a6c4-d9341b754b1a tempest-VolumeImageDependencyTests-1124435753 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 11:57:18 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-9e01d4b1-57e4-43b9-a6c4-d9341b754b1a tempest-VolumeImageDependencyTests-1124435753 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 11:57:18 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-9e01d4b1-57e4-43b9-a6c4-d9341b754b1a tempest-VolumeImageDependencyTests-1124435753 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 11:57:18 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-9e01d4b1-57e4-43b9-a6c4-d9341b754b1a tempest-VolumeImageDependencyTests-1124435753 None] Selected osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f as target Quobyte volume. {{(pid=87116) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 11:57:18 devstack cinder-volume[87116]: INFO cinder.volume.drivers.remotefs [None req-9e01d4b1-57e4-43b9-a6c4-d9341b754b1a tempest-VolumeImageDependencyTests-1124435753 None] casted to osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f Nov 06 11:57:18 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-9e01d4b1-57e4-43b9-a6c4-d9341b754b1a tempest-VolumeImageDependencyTests-1124435753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-68468a20-61bd-41e6-958e-60c157e4ca2b 1073741824 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:57:18 devstack sudo[103349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-68468a20-61bd-41e6-958e-60c157e4ca2b 1073741824 Nov 06 11:57:18 devstack sudo[103349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:57:18 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-b305a28a-acdb-4f1a-8fe9-d4a64a1f7fa6 tempest-TestServerVolumeAttachmentScenario-1898122559 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c2179805-3852-4458-89ae-d07ad3e43699) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9adf6376-224f-4d46-b887-706ec7d6b79a', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:57:18 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-b305a28a-acdb-4f1a-8fe9-d4a64a1f7fa6 tempest-TestServerVolumeAttachmentScenario-1898122559 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0d18e484-c6c5-495a-98b3-5920c76c70d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:57:18 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-b305a28a-acdb-4f1a-8fe9-d4a64a1f7fa6 tempest-TestServerVolumeAttachmentScenario-1898122559 None] Volume volume-9adf6376-224f-4d46-b887-706ec7d6b79a (9adf6376-224f-4d46-b887-706ec7d6b79a): created successfully Nov 06 11:57:18 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-b305a28a-acdb-4f1a-8fe9-d4a64a1f7fa6 tempest-TestServerVolumeAttachmentScenario-1898122559 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0d18e484-c6c5-495a-98b3-5920c76c70d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:57:18 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-b305a28a-acdb-4f1a-8fe9-d4a64a1f7fa6 tempest-TestServerVolumeAttachmentScenario-1898122559 None] Flow 'volume_create_manager' (e011b88a-1bdb-400c-afa4-2215f673935b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 11:57:18 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-b305a28a-acdb-4f1a-8fe9-d4a64a1f7fa6 tempest-TestServerVolumeAttachmentScenario-1898122559 None] Created volume successfully. Nov 06 11:57:18 devstack sudo[103342]: pam_unix(sudo:session): session closed for user root Nov 06 11:57:18 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-0e3070fd-6b6c-4dc8-8fec-c2ee3a284bb5 tempest-CreateVolumesFromSourceVolumeTest-627404290 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-2d8ee6d4-b960-4bfc-a460-17181a71c581" returned: 0 in 0.786s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:57:18 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-0e3070fd-6b6c-4dc8-8fec-c2ee3a284bb5 tempest-CreateVolumesFromSourceVolumeTest-627404290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-2d8ee6d4-b960-4bfc-a460-17181a71c581 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:57:18 devstack sudo[103346]: pam_unix(sudo:session): session closed for user root Nov 06 11:57:18 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-90553648-5690-4b3b-b299-424930533f10 tempest-VolumesSnapshotTestJSON-1873011056 None] Acquiring lock "cinder-a0b2cffc-c0e0-4849-9a5d-deb40649f833-delete_snapshot" by "delete_snapshot" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 11:57:18 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-fe62aec3-56c9-4943-8186-d69dbdb40863 tempest-VolumesSnapshotTestJSON-1873011056 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756" returned: 0 in 0.514s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:57:18 devstack sudo[103355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-2d8ee6d4-b960-4bfc-a460-17181a71c581 Nov 06 11:57:18 devstack sudo[103355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:57:18 devstack cinder-volume[87116]: DEBUG cinder.manager [None req-fe62aec3-56c9-4943-8186-d69dbdb40863 tempest-VolumesSnapshotTestJSON-1873011056 None] Notifying Schedulers of capabilities ... {{(pid=87116) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 11:57:18 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-fe62aec3-56c9-4943-8186-d69dbdb40863 tempest-VolumesSnapshotTestJSON-1873011056 None] Deleted volume successfully. Nov 06 11:57:19 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-90553648-5690-4b3b-b299-424930533f10 tempest-VolumesSnapshotTestJSON-1873011056 None] Lock "cinder-a0b2cffc-c0e0-4849-9a5d-deb40649f833-delete_snapshot" acquired by "delete_snapshot" :: waited 0.065s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 11:57:19 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-90553648-5690-4b3b-b299-424930533f10 tempest-VolumesSnapshotTestJSON-1873011056 None] Acquiring lock "cinder-quobyte-637f2fec-842f-4b97-8744-e70167f3da8a" by "delete_snapshot" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 11:57:19 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-fe62aec3-56c9-4943-8186-d69dbdb40863 tempest-VolumesSnapshotTestJSON-1873011056 None] Lock "cinder-6ecc6831-e769-4a50-9caa-7a3c72b7d6f6-delete_volume" released by "delete_volume" :: held 2.554s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 11:57:19 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-90553648-5690-4b3b-b299-424930533f10 tempest-VolumesSnapshotTestJSON-1873011056 None] Lock "cinder-quobyte-637f2fec-842f-4b97-8744-e70167f3da8a" acquired by "delete_snapshot" :: waited 0.055s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 11:57:19 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-90553648-5690-4b3b-b299-424930533f10 tempest-VolumesSnapshotTestJSON-1873011056 None] Acquiring lock "cinder-quobyte-a0b2cffc-c0e0-4849-9a5d-deb40649f833" by "_delete_snapshot" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 11:57:19 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-90553648-5690-4b3b-b299-424930533f10 tempest-VolumesSnapshotTestJSON-1873011056 None] Lock "cinder-quobyte-a0b2cffc-c0e0-4849-9a5d-deb40649f833" acquired by "_delete_snapshot" :: waited 0.054s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 11:57:19 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-90553648-5690-4b3b-b299-424930533f10 tempest-VolumesSnapshotTestJSON-1873011056 None] Deleting offline snapshot a0b2cffc-c0e0-4849-9a5d-deb40649f833 of volume 637f2fec-842f-4b97-8744-e70167f3da8a {{(pid=87116) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 06 11:57:19 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-90553648-5690-4b3b-b299-424930533f10 tempest-VolumesSnapshotTestJSON-1873011056 None] snapshot_file for this snap is: volume-637f2fec-842f-4b97-8744-e70167f3da8a.a0b2cffc-c0e0-4849-9a5d-deb40649f833 {{(pid=87116) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 06 11:57:19 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[71c70e6f-9c24-43cf-a91f-c63bc0957744]: (4, 'qcow2') {{(pid=88420) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 11:57:19 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-90553648-5690-4b3b-b299-424930533f10 tempest-VolumesSnapshotTestJSON-1873011056 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-637f2fec-842f-4b97-8744-e70167f3da8a.a0b2cffc-c0e0-4849-9a5d-deb40649f833 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:57:19 devstack sudo[103355]: pam_unix(sudo:session): session closed for user root Nov 06 11:57:19 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-0e3070fd-6b6c-4dc8-8fec-c2ee3a284bb5 tempest-CreateVolumesFromSourceVolumeTest-627404290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-2d8ee6d4-b960-4bfc-a460-17181a71c581" returned: 0 in 0.416s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:57:19 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-0e3070fd-6b6c-4dc8-8fec-c2ee3a284bb5 tempest-CreateVolumesFromSourceVolumeTest-627404290 None] Lock "cinder-quobyte-2d8ee6d4-b960-4bfc-a460-17181a71c581" released by "delete_volume" :: held 1.279s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 11:57:19 devstack sudo[103349]: pam_unix(sudo:session): session closed for user root Nov 06 11:57:19 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-9e01d4b1-57e4-43b9-a6c4-d9341b754b1a tempest-VolumeImageDependencyTests-1124435753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-68468a20-61bd-41e6-958e-60c157e4ca2b 1073741824" returned: 0 in 0.756s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:57:19 devstack sudo[103361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-637f2fec-842f-4b97-8744-e70167f3da8a.a0b2cffc-c0e0-4849-9a5d-deb40649f833 Nov 06 11:57:19 devstack sudo[103361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:57:19 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-9e01d4b1-57e4-43b9-a6c4-d9341b754b1a tempest-VolumeImageDependencyTests-1124435753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-68468a20-61bd-41e6-958e-60c157e4ca2b {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:57:19 devstack sudo[103365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-68468a20-61bd-41e6-958e-60c157e4ca2b Nov 06 11:57:19 devstack sudo[103365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:57:19 devstack cinder-volume[87116]: DEBUG cinder.quota [None req-0e3070fd-6b6c-4dc8-8fec-c2ee3a284bb5 tempest-CreateVolumesFromSourceVolumeTest-627404290 None] Created reservations ['ebf293ca-f11a-4920-b5a7-03d61cfa5faf', '9d1f7c93-4c13-4c30-9d63-376abfd73321', '6985d0c6-e1ea-412c-89ad-38e9c6857cff', '40d87956-141e-47d0-bd82-3581555953db'] {{(pid=87116) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 11:57:19 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-0e3070fd-6b6c-4dc8-8fec-c2ee3a284bb5 tempest-CreateVolumesFromSourceVolumeTest-627404290 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 11:57:19 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-0e3070fd-6b6c-4dc8-8fec-c2ee3a284bb5 tempest-CreateVolumesFromSourceVolumeTest-627404290 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 11:57:19 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-0e3070fd-6b6c-4dc8-8fec-c2ee3a284bb5 tempest-CreateVolumesFromSourceVolumeTest-627404290 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 11:57:19 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-0e3070fd-6b6c-4dc8-8fec-c2ee3a284bb5 tempest-CreateVolumesFromSourceVolumeTest-627404290 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 11:57:19 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-0e3070fd-6b6c-4dc8-8fec-c2ee3a284bb5 tempest-CreateVolumesFromSourceVolumeTest-627404290 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 11:57:19 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-0e3070fd-6b6c-4dc8-8fec-c2ee3a284bb5 tempest-CreateVolumesFromSourceVolumeTest-627404290 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:57:19 devstack sudo[103369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756 Nov 06 11:57:19 devstack sudo[103369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:57:19 devstack sudo[103365]: pam_unix(sudo:session): session closed for user root Nov 06 11:57:19 devstack sudo[103361]: pam_unix(sudo:session): session closed for user root Nov 06 11:57:19 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-9e01d4b1-57e4-43b9-a6c4-d9341b754b1a tempest-VolumeImageDependencyTests-1124435753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-68468a20-61bd-41e6-958e-60c157e4ca2b" returned: 0 in 0.278s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:57:19 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-9e01d4b1-57e4-43b9-a6c4-d9341b754b1a tempest-VolumeImageDependencyTests-1124435753 None] <== create_volume: return (1095ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f'} {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 11:57:19 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-9e01d4b1-57e4-43b9-a6c4-d9341b754b1a tempest-VolumeImageDependencyTests-1124435753 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.099s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 11:57:19 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-90553648-5690-4b3b-b299-424930533f10 tempest-VolumesSnapshotTestJSON-1873011056 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-637f2fec-842f-4b97-8744-e70167f3da8a.a0b2cffc-c0e0-4849-9a5d-deb40649f833" returned: 0 in 0.476s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:57:19 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-90553648-5690-4b3b-b299-424930533f10 tempest-VolumesSnapshotTestJSON-1873011056 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-637f2fec-842f-4b97-8744-e70167f3da8a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87116) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 11:57:19 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2207ea5-5034-437c-8320-d73d674aade3]: (4, 'qcow2') {{(pid=88420) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 11:57:19 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-90553648-5690-4b3b-b299-424930533f10 tempest-VolumesSnapshotTestJSON-1873011056 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-637f2fec-842f-4b97-8744-e70167f3da8a {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:57:19 devstack cinder-volume[87116]: DEBUG cinder.volume.volume_utils [None req-9e01d4b1-57e4-43b9-a6c4-d9341b754b1a tempest-VolumeImageDependencyTests-1124435753 None] Attempting download of 6c3bd3a0-67d8-4df0-9b8f-da117974bc36 ((None, [{'url': 'file:///opt/stack/data/glance/images/6c3bd3a0-67d8-4df0-9b8f-da117974bc36', 'metadata': {}}])) to volume 68468a20-61bd-41e6-958e-60c157e4ca2b. {{(pid=87116) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Nov 06 11:57:19 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[6986e995-3791-4629-8e4a-de76d610c715]: (4, 'raw') {{(pid=88420) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 11:57:19 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-9e01d4b1-57e4-43b9-a6c4-d9341b754b1a tempest-VolumeImageDependencyTests-1124435753 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_6c3bd3a0-67d8-4df0-9b8f-da117974bc36_bd5v9_ar {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:57:19 devstack sudo[103369]: pam_unix(sudo:session): session closed for user root Nov 06 11:57:19 devstack sudo[103373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-637f2fec-842f-4b97-8744-e70167f3da8a Nov 06 11:57:19 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-0e3070fd-6b6c-4dc8-8fec-c2ee3a284bb5 tempest-CreateVolumesFromSourceVolumeTest-627404290 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756" returned: 0 in 0.310s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:57:19 devstack cinder-volume[87116]: DEBUG cinder.manager [None req-0e3070fd-6b6c-4dc8-8fec-c2ee3a284bb5 tempest-CreateVolumesFromSourceVolumeTest-627404290 None] Notifying Schedulers of capabilities ... {{(pid=87116) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 11:57:19 devstack sudo[103373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:57:19 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-0e3070fd-6b6c-4dc8-8fec-c2ee3a284bb5 tempest-CreateVolumesFromSourceVolumeTest-627404290 None] Deleted volume successfully. Nov 06 11:57:19 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-0e3070fd-6b6c-4dc8-8fec-c2ee3a284bb5 tempest-CreateVolumesFromSourceVolumeTest-627404290 None] Lock "cinder-2d8ee6d4-b960-4bfc-a460-17181a71c581-delete_volume" released by "delete_volume" :: held 2.039s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 11:57:19 devstack sudo[103374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_6c3bd3a0-67d8-4df0-9b8f-da117974bc36_bd5v9_ar Nov 06 11:57:19 devstack sudo[103374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:57:20 devstack sudo[103374]: pam_unix(sudo:session): session closed for user root Nov 06 11:57:20 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-9e01d4b1-57e4-43b9-a6c4-d9341b754b1a tempest-VolumeImageDependencyTests-1124435753 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_6c3bd3a0-67d8-4df0-9b8f-da117974bc36_bd5v9_ar" returned: 0 in 0.423s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:57:20 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-9e01d4b1-57e4-43b9-a6c4-d9341b754b1a tempest-VolumeImageDependencyTests-1124435753 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6c3bd3a0-67d8-4df0-9b8f-da117974bc36_bd5v9_ar {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:57:20 devstack sudo[103382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6c3bd3a0-67d8-4df0-9b8f-da117974bc36_bd5v9_ar Nov 06 11:57:20 devstack sudo[103382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:57:20 devstack sudo[103373]: pam_unix(sudo:session): session closed for user root Nov 06 11:57:20 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-90553648-5690-4b3b-b299-424930533f10 tempest-VolumesSnapshotTestJSON-1873011056 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-637f2fec-842f-4b97-8744-e70167f3da8a" returned: 0 in 0.662s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:57:20 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-90553648-5690-4b3b-b299-424930533f10 tempest-VolumesSnapshotTestJSON-1873011056 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-637f2fec-842f-4b97-8744-e70167f3da8a.a0b2cffc-c0e0-4849-9a5d-deb40649f833 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:57:20 devstack sudo[103386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-637f2fec-842f-4b97-8744-e70167f3da8a.a0b2cffc-c0e0-4849-9a5d-deb40649f833 Nov 06 11:57:20 devstack sudo[103386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:57:20 devstack sudo[103382]: pam_unix(sudo:session): session closed for user root Nov 06 11:57:20 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-9e01d4b1-57e4-43b9-a6c4-d9341b754b1a tempest-VolumeImageDependencyTests-1124435753 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6c3bd3a0-67d8-4df0-9b8f-da117974bc36_bd5v9_ar" returned: 1 in 0.417s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:57:20 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-9e01d4b1-57e4-43b9-a6c4-d9341b754b1a tempest-VolumeImageDependencyTests-1124435753 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6c3bd3a0-67d8-4df0-9b8f-da117974bc36_bd5v9_ar' failed. Not Retrying. {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 06 11:57:20 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[a80bfc1e-1d3b-4176-8a89-1f22884fa438]: (4, 'raw') {{(pid=88420) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 11:57:20 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-9e01d4b1-57e4-43b9-a6c4-d9341b754b1a tempest-VolumeImageDependencyTests-1124435753 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_6c3bd3a0-67d8-4df0-9b8f-da117974bc36_ze6sr9nrdevstack@QuobyteHD {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:57:20 devstack sudo[103390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_6c3bd3a0-67d8-4df0-9b8f-da117974bc36_ze6sr9nrdevstack@QuobyteHD Nov 06 11:57:20 devstack sudo[103390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:57:20 devstack sudo[103386]: pam_unix(sudo:session): session closed for user root Nov 06 11:57:20 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-90553648-5690-4b3b-b299-424930533f10 tempest-VolumesSnapshotTestJSON-1873011056 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-637f2fec-842f-4b97-8744-e70167f3da8a.a0b2cffc-c0e0-4849-9a5d-deb40649f833" returned: 0 in 0.525s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:57:20 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-90553648-5690-4b3b-b299-424930533f10 tempest-VolumesSnapshotTestJSON-1873011056 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-637f2fec-842f-4b97-8744-e70167f3da8a.a0b2cffc-c0e0-4849-9a5d-deb40649f833 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:57:20 devstack sudo[103395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-637f2fec-842f-4b97-8744-e70167f3da8a.a0b2cffc-c0e0-4849-9a5d-deb40649f833 Nov 06 11:57:20 devstack sudo[103395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:57:21 devstack sudo[103390]: pam_unix(sudo:session): session closed for user root Nov 06 11:57:21 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-9e01d4b1-57e4-43b9-a6c4-d9341b754b1a tempest-VolumeImageDependencyTests-1124435753 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_6c3bd3a0-67d8-4df0-9b8f-da117974bc36_ze6sr9nrdevstack@QuobyteHD" returned: 0 in 0.466s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:57:21 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-9e01d4b1-57e4-43b9-a6c4-d9341b754b1a tempest-VolumeImageDependencyTests-1124435753 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6c3bd3a0-67d8-4df0-9b8f-da117974bc36_ze6sr9nrdevstack@QuobyteHD {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:57:21 devstack sudo[103399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6c3bd3a0-67d8-4df0-9b8f-da117974bc36_ze6sr9nrdevstack@QuobyteHD Nov 06 11:57:21 devstack sudo[103399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:57:21 devstack sudo[103395]: pam_unix(sudo:session): session closed for user root Nov 06 11:57:21 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-90553648-5690-4b3b-b299-424930533f10 tempest-VolumesSnapshotTestJSON-1873011056 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-637f2fec-842f-4b97-8744-e70167f3da8a.a0b2cffc-c0e0-4849-9a5d-deb40649f833" returned: 0 in 0.436s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:57:21 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-90553648-5690-4b3b-b299-424930533f10 tempest-VolumesSnapshotTestJSON-1873011056 None] Lock "cinder-quobyte-a0b2cffc-c0e0-4849-9a5d-deb40649f833" released by "_delete_snapshot" :: held 2.266s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 11:57:21 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-90553648-5690-4b3b-b299-424930533f10 tempest-VolumesSnapshotTestJSON-1873011056 None] Lock "cinder-quobyte-637f2fec-842f-4b97-8744-e70167f3da8a" released by "delete_snapshot" :: held 2.335s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 11:57:21 devstack cinder-volume[87116]: DEBUG cinder.quota [None req-90553648-5690-4b3b-b299-424930533f10 tempest-VolumesSnapshotTestJSON-1873011056 None] Created reservations ['ae8674fe-4595-4350-8dc2-90e5ead634a9', 'fc66c3e5-b774-42c8-af54-266496a92289', '551a6c45-f648-4f49-86fb-d48ce88f30d0', 'bd15f88a-e7dc-47b8-bf04-433ca43dfbdb'] {{(pid=87116) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 11:57:21 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-90553648-5690-4b3b-b299-424930533f10 tempest-VolumesSnapshotTestJSON-1873011056 None] Delete snapshot completed successfully. Nov 06 11:57:21 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-90553648-5690-4b3b-b299-424930533f10 tempest-VolumesSnapshotTestJSON-1873011056 None] Lock "cinder-a0b2cffc-c0e0-4849-9a5d-deb40649f833-delete_snapshot" released by "delete_snapshot" :: held 2.549s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 11:57:21 devstack sudo[103399]: pam_unix(sudo:session): session closed for user root Nov 06 11:57:21 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-9e01d4b1-57e4-43b9-a6c4-d9341b754b1a tempest-VolumeImageDependencyTests-1124435753 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6c3bd3a0-67d8-4df0-9b8f-da117974bc36_ze6sr9nrdevstack@QuobyteHD" returned: 1 in 0.502s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:57:21 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-9e01d4b1-57e4-43b9-a6c4-d9341b754b1a tempest-VolumeImageDependencyTests-1124435753 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6c3bd3a0-67d8-4df0-9b8f-da117974bc36_ze6sr9nrdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 06 11:57:21 devstack cinder-volume[87116]: DEBUG cinder.image.image_utils [None req-9e01d4b1-57e4-43b9-a6c4-d9341b754b1a tempest-VolumeImageDependencyTests-1124435753 None] 6c3bd3a0-67d8-4df0-9b8f-da117974bc36 was raw, converting to qcow2 {{(pid=87116) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Nov 06 11:57:21 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-9e01d4b1-57e4-43b9-a6c4-d9341b754b1a tempest-VolumeImageDependencyTests-1124435753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_6c3bd3a0-67d8-4df0-9b8f-da117974bc36_ze6sr9nrdevstack@QuobyteHD /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-68468a20-61bd-41e6-958e-60c157e4ca2b {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:57:21 devstack sudo[103407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_6c3bd3a0-67d8-4df0-9b8f-da117974bc36_ze6sr9nrdevstack@QuobyteHD /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-68468a20-61bd-41e6-958e-60c157e4ca2b Nov 06 11:57:21 devstack sudo[103407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:57:22 devstack sudo[103407]: pam_unix(sudo:session): session closed for user root Nov 06 11:57:22 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-9e01d4b1-57e4-43b9-a6c4-d9341b754b1a tempest-VolumeImageDependencyTests-1124435753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_6c3bd3a0-67d8-4df0-9b8f-da117974bc36_ze6sr9nrdevstack@QuobyteHD /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-68468a20-61bd-41e6-958e-60c157e4ca2b" returned: 0 in 0.624s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:57:22 devstack cinder-volume[87116]: DEBUG cinder.image.image_utils [None req-9e01d4b1-57e4-43b9-a6c4-d9341b754b1a tempest-VolumeImageDependencyTests-1124435753 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_6c3bd3a0-67d8-4df0-9b8f-da117974bc36_ze6sr9nrdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-68468a20-61bd-41e6-958e-60c157e4ca2b {{(pid=87116) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 06 11:57:22 devstack cinder-volume[87116]: INFO cinder.image.image_utils [None req-9e01d4b1-57e4-43b9-a6c4-d9341b754b1a tempest-VolumeImageDependencyTests-1124435753 None] Converted 0.00 MB image at 0.00 MB/s Nov 06 11:57:22 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-9e01d4b1-57e4-43b9-a6c4-d9341b754b1a tempest-VolumeImageDependencyTests-1124435753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-68468a20-61bd-41e6-958e-60c157e4ca2b 1G {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:57:22 devstack sudo[103413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-68468a20-61bd-41e6-958e-60c157e4ca2b 1G Nov 06 11:57:22 devstack sudo[103413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:57:22 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-b5e57178-cbf7-4b3b-8072-e8a2c3bd1959 tempest-VolumesSnapshotTestJSON-1873011056 None] Acquiring lock "cinder-637f2fec-842f-4b97-8744-e70167f3da8a-delete_volume" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 11:57:22 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-b5e57178-cbf7-4b3b-8072-e8a2c3bd1959 tempest-VolumesSnapshotTestJSON-1873011056 None] Lock "cinder-637f2fec-842f-4b97-8744-e70167f3da8a-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 11:57:22 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-b5e57178-cbf7-4b3b-8072-e8a2c3bd1959 tempest-VolumesSnapshotTestJSON-1873011056 None] Acquiring lock "cinder-quobyte-637f2fec-842f-4b97-8744-e70167f3da8a" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 11:57:22 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-b5e57178-cbf7-4b3b-8072-e8a2c3bd1959 tempest-VolumesSnapshotTestJSON-1873011056 None] Lock "cinder-quobyte-637f2fec-842f-4b97-8744-e70167f3da8a" acquired by "delete_volume" :: waited 0.024s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 11:57:22 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea11eeb6-e0d3-4c0b-8e60-83f8099657b5]: (4, 'qcow2') {{(pid=88420) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 11:57:22 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-b5e57178-cbf7-4b3b-8072-e8a2c3bd1959 tempest-VolumesSnapshotTestJSON-1873011056 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-637f2fec-842f-4b97-8744-e70167f3da8a {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:57:22 devstack sudo[103415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-637f2fec-842f-4b97-8744-e70167f3da8a Nov 06 11:57:22 devstack sudo[103415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:57:22 devstack sudo[103413]: pam_unix(sudo:session): session closed for user root Nov 06 11:57:22 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-9e01d4b1-57e4-43b9-a6c4-d9341b754b1a tempest-VolumeImageDependencyTests-1124435753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-68468a20-61bd-41e6-958e-60c157e4ca2b 1G" returned: 0 in 0.555s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:57:22 devstack cinder-volume[87116]: DEBUG cinder.volume.volume_utils [None req-9e01d4b1-57e4-43b9-a6c4-d9341b754b1a tempest-VolumeImageDependencyTests-1124435753 None] Downloaded image 6c3bd3a0-67d8-4df0-9b8f-da117974bc36 ((None, [{'url': 'file:///opt/stack/data/glance/images/6c3bd3a0-67d8-4df0-9b8f-da117974bc36', 'metadata': {}}])) to volume 68468a20-61bd-41e6-958e-60c157e4ca2b successfully. {{(pid=87116) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Nov 06 11:57:22 devstack cinder-volume[87116]: DEBUG cinder.image.image_utils [None req-9e01d4b1-57e4-43b9-a6c4-d9341b754b1a tempest-VolumeImageDependencyTests-1124435753 None] Temporary image 6c3bd3a0-67d8-4df0-9b8f-da117974bc36 for user 9c5c51168b304374990d0a64ddd4be42 is deleted. {{(pid=87116) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Nov 06 11:57:22 devstack cinder-volume[87116]: DEBUG cinder.volume.volume_utils [None req-9e01d4b1-57e4-43b9-a6c4-d9341b754b1a tempest-VolumeImageDependencyTests-1124435753 None] Marking volume 68468a20-61bd-41e6-958e-60c157e4ca2b as bootable. {{(pid=87116) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Nov 06 11:57:22 devstack cinder-volume[87116]: DEBUG cinder.volume.flows.manager.create_volume [None req-9e01d4b1-57e4-43b9-a6c4-d9341b754b1a tempest-VolumeImageDependencyTests-1124435753 None] Copying metadata from image 6c3bd3a0-67d8-4df0-9b8f-da117974bc36 to 68468a20-61bd-41e6-958e-60c157e4ca2b. {{(pid=87116) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Nov 06 11:57:22 devstack cinder-volume[87116]: DEBUG cinder.volume.flows.manager.create_volume [None req-9e01d4b1-57e4-43b9-a6c4-d9341b754b1a tempest-VolumeImageDependencyTests-1124435753 None] Creating volume glance metadata for volume 68468a20-61bd-41e6-958e-60c157e4ca2b backed by image 6c3bd3a0-67d8-4df0-9b8f-da117974bc36 with: {'image_id': '6c3bd3a0-67d8-4df0-9b8f-da117974bc36', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': 'a154dd73b7869ecffa40b7f1b33f74b7', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87116) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Nov 06 11:57:22 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-9e01d4b1-57e4-43b9-a6c4-d9341b754b1a tempest-VolumeImageDependencyTests-1124435753 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e9482d5e-fe98-45cf-9b5d-4d8519640275) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-68468a20-61bd-41e6-958e-60c157e4ca2b', 'volume_size': 1, 'image_id': '6c3bd3a0-67d8-4df0-9b8f-da117974bc36', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/6c3bd3a0-67d8-4df0-9b8f-da117974bc36', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'a154dd73b7869ecffa40b7f1b33f74b7', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'b7d2871fcb7148e8a312283c07a4fd04', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'f695bcdf9ede07af7ef948471c948186ff4635288446a958efbef98b9629cc09f2108beb9beca941e3a12872b85a5948558cc08de8351d7f6f83e6bc2df47957', 'id': '6c3bd3a0-67d8-4df0-9b8f-da117974bc36', 'created_at': datetime.datetime(2026, 11, 6, 10, 57, 5, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 6, 10, 57, 10, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/6c3bd3a0-67d8-4df0-9b8f-da117974bc36/file', 'properties': {}}, 'image_service': }' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:57:22 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-9e01d4b1-57e4-43b9-a6c4-d9341b754b1a tempest-VolumeImageDependencyTests-1124435753 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2435539f-6e14-4b08-a5e5-e0b57fd04edb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:57:22 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-9e01d4b1-57e4-43b9-a6c4-d9341b754b1a tempest-VolumeImageDependencyTests-1124435753 None] Volume volume-68468a20-61bd-41e6-958e-60c157e4ca2b (68468a20-61bd-41e6-958e-60c157e4ca2b): created successfully Nov 06 11:57:22 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-9e01d4b1-57e4-43b9-a6c4-d9341b754b1a tempest-VolumeImageDependencyTests-1124435753 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2435539f-6e14-4b08-a5e5-e0b57fd04edb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:57:22 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-9e01d4b1-57e4-43b9-a6c4-d9341b754b1a tempest-VolumeImageDependencyTests-1124435753 None] Flow 'volume_create_manager' (b0b7a47f-1d14-4e4a-ba83-c5b00efaef89) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 11:57:22 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-9e01d4b1-57e4-43b9-a6c4-d9341b754b1a tempest-VolumeImageDependencyTests-1124435753 None] Created volume successfully. Nov 06 11:57:23 devstack sudo[103415]: pam_unix(sudo:session): session closed for user root Nov 06 11:57:23 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-b5e57178-cbf7-4b3b-8072-e8a2c3bd1959 tempest-VolumesSnapshotTestJSON-1873011056 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-637f2fec-842f-4b97-8744-e70167f3da8a" returned: 0 in 0.498s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:57:23 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-b5e57178-cbf7-4b3b-8072-e8a2c3bd1959 tempest-VolumesSnapshotTestJSON-1873011056 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-637f2fec-842f-4b97-8744-e70167f3da8a {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:57:23 devstack sudo[103425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-637f2fec-842f-4b97-8744-e70167f3da8a Nov 06 11:57:23 devstack sudo[103425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:57:23 devstack sudo[103425]: pam_unix(sudo:session): session closed for user root Nov 06 11:57:23 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-b5e57178-cbf7-4b3b-8072-e8a2c3bd1959 tempest-VolumesSnapshotTestJSON-1873011056 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-637f2fec-842f-4b97-8744-e70167f3da8a" returned: 0 in 0.283s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:57:23 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-b5e57178-cbf7-4b3b-8072-e8a2c3bd1959 tempest-VolumesSnapshotTestJSON-1873011056 None] Lock "cinder-quobyte-637f2fec-842f-4b97-8744-e70167f3da8a" released by "delete_volume" :: held 0.869s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 11:57:23 devstack cinder-volume[87116]: DEBUG cinder.quota [None req-b5e57178-cbf7-4b3b-8072-e8a2c3bd1959 tempest-VolumesSnapshotTestJSON-1873011056 None] Created reservations ['0f983e97-83db-4cc3-97bd-b56a11ef8020', '3eb311d6-117d-42d7-b8c9-e12279d5437f', 'b170538e-5896-4bba-9910-533ab8fb4791', '95863e16-3adf-4f4c-b1f2-38a810553f39'] {{(pid=87116) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 11:57:23 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-b5e57178-cbf7-4b3b-8072-e8a2c3bd1959 tempest-VolumesSnapshotTestJSON-1873011056 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 11:57:23 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-b5e57178-cbf7-4b3b-8072-e8a2c3bd1959 tempest-VolumesSnapshotTestJSON-1873011056 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 11:57:23 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-b5e57178-cbf7-4b3b-8072-e8a2c3bd1959 tempest-VolumesSnapshotTestJSON-1873011056 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 11:57:23 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-b5e57178-cbf7-4b3b-8072-e8a2c3bd1959 tempest-VolumesSnapshotTestJSON-1873011056 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 11:57:23 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-b5e57178-cbf7-4b3b-8072-e8a2c3bd1959 tempest-VolumesSnapshotTestJSON-1873011056 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 11:57:23 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-b5e57178-cbf7-4b3b-8072-e8a2c3bd1959 tempest-VolumesSnapshotTestJSON-1873011056 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:57:23 devstack sudo[103428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756 Nov 06 11:57:23 devstack sudo[103428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:57:23 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-6f5feaa6-ce84-4270-875d-22d05429f44d tempest-VolumeImageDependencyTests-1124435753 None] Acquiring lock "cinder-68468a20-61bd-41e6-958e-60c157e4ca2b-delete_volume" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 11:57:23 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-6f5feaa6-ce84-4270-875d-22d05429f44d tempest-VolumeImageDependencyTests-1124435753 None] Lock "cinder-68468a20-61bd-41e6-958e-60c157e4ca2b-delete_volume" acquired by "delete_volume" :: waited 0.166s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 11:57:23 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-cb76a979-7952-4c7f-b85b-978035a675d0 tempest-VolumesSnapshotTestJSON-1873011056 None] Acquiring lock "cinder-e429f0ec-80ae-461a-8eaf-d82cfc9e6ac6-delete_volume" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 11:57:23 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-6f5feaa6-ce84-4270-875d-22d05429f44d tempest-VolumeImageDependencyTests-1124435753 None] Acquiring lock "cinder-quobyte-68468a20-61bd-41e6-958e-60c157e4ca2b" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 11:57:23 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-cb76a979-7952-4c7f-b85b-978035a675d0 tempest-VolumesSnapshotTestJSON-1873011056 None] Lock "cinder-e429f0ec-80ae-461a-8eaf-d82cfc9e6ac6-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 11:57:23 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-6f5feaa6-ce84-4270-875d-22d05429f44d tempest-VolumeImageDependencyTests-1124435753 None] Lock "cinder-quobyte-68468a20-61bd-41e6-958e-60c157e4ca2b" acquired by "delete_volume" :: waited 0.056s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 11:57:24 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[21f0b4c2-5b8a-41a6-8a9c-4208304e132b]: (4, 'qcow2') {{(pid=88420) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 11:57:24 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-6f5feaa6-ce84-4270-875d-22d05429f44d tempest-VolumeImageDependencyTests-1124435753 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-68468a20-61bd-41e6-958e-60c157e4ca2b {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:57:24 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-cb76a979-7952-4c7f-b85b-978035a675d0 tempest-VolumesSnapshotTestJSON-1873011056 None] Acquiring lock "cinder-quobyte-e429f0ec-80ae-461a-8eaf-d82cfc9e6ac6" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 11:57:24 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-cb76a979-7952-4c7f-b85b-978035a675d0 tempest-VolumesSnapshotTestJSON-1873011056 None] Lock "cinder-quobyte-e429f0ec-80ae-461a-8eaf-d82cfc9e6ac6" acquired by "delete_volume" :: waited 0.025s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 11:57:24 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[52d34321-a25f-4863-8e56-2258aaa7d794]: (4, 'qcow2') {{(pid=88420) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 11:57:24 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-cb76a979-7952-4c7f-b85b-978035a675d0 tempest-VolumesSnapshotTestJSON-1873011056 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-e429f0ec-80ae-461a-8eaf-d82cfc9e6ac6 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:57:24 devstack sudo[103428]: pam_unix(sudo:session): session closed for user root Nov 06 11:57:24 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-b5e57178-cbf7-4b3b-8072-e8a2c3bd1959 tempest-VolumesSnapshotTestJSON-1873011056 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756" returned: 0 in 0.621s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:57:24 devstack cinder-volume[87116]: DEBUG cinder.manager [None req-b5e57178-cbf7-4b3b-8072-e8a2c3bd1959 tempest-VolumesSnapshotTestJSON-1873011056 None] Notifying Schedulers of capabilities ... {{(pid=87116) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 11:57:24 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-b5e57178-cbf7-4b3b-8072-e8a2c3bd1959 tempest-VolumesSnapshotTestJSON-1873011056 None] Deleted volume successfully. Nov 06 11:57:24 devstack sudo[103430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-68468a20-61bd-41e6-958e-60c157e4ca2b Nov 06 11:57:24 devstack sudo[103430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:57:24 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-b5e57178-cbf7-4b3b-8072-e8a2c3bd1959 tempest-VolumesSnapshotTestJSON-1873011056 None] Lock "cinder-637f2fec-842f-4b97-8744-e70167f3da8a-delete_volume" released by "delete_volume" :: held 1.875s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 11:57:24 devstack sudo[103432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-e429f0ec-80ae-461a-8eaf-d82cfc9e6ac6 Nov 06 11:57:24 devstack sudo[103432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:57:24 devstack sudo[103430]: pam_unix(sudo:session): session closed for user root Nov 06 11:57:24 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-6f5feaa6-ce84-4270-875d-22d05429f44d tempest-VolumeImageDependencyTests-1124435753 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-68468a20-61bd-41e6-958e-60c157e4ca2b" returned: 0 in 0.655s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:57:24 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-6f5feaa6-ce84-4270-875d-22d05429f44d tempest-VolumeImageDependencyTests-1124435753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-68468a20-61bd-41e6-958e-60c157e4ca2b {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:57:24 devstack sudo[103442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-68468a20-61bd-41e6-958e-60c157e4ca2b Nov 06 11:57:24 devstack sudo[103442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:57:24 devstack sudo[103432]: pam_unix(sudo:session): session closed for user root Nov 06 11:57:24 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-cb76a979-7952-4c7f-b85b-978035a675d0 tempest-VolumesSnapshotTestJSON-1873011056 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-e429f0ec-80ae-461a-8eaf-d82cfc9e6ac6" returned: 0 in 0.568s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:57:24 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-cb76a979-7952-4c7f-b85b-978035a675d0 tempest-VolumesSnapshotTestJSON-1873011056 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-e429f0ec-80ae-461a-8eaf-d82cfc9e6ac6 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:57:24 devstack sudo[103444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-e429f0ec-80ae-461a-8eaf-d82cfc9e6ac6 Nov 06 11:57:24 devstack sudo[103444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:57:25 devstack sudo[103442]: pam_unix(sudo:session): session closed for user root Nov 06 11:57:25 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-6f5feaa6-ce84-4270-875d-22d05429f44d tempest-VolumeImageDependencyTests-1124435753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-68468a20-61bd-41e6-958e-60c157e4ca2b" returned: 0 in 0.329s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:57:25 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-6f5feaa6-ce84-4270-875d-22d05429f44d tempest-VolumeImageDependencyTests-1124435753 None] Lock "cinder-quobyte-68468a20-61bd-41e6-958e-60c157e4ca2b" released by "delete_volume" :: held 1.079s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 11:57:25 devstack cinder-volume[87116]: DEBUG cinder.quota [None req-6f5feaa6-ce84-4270-875d-22d05429f44d tempest-VolumeImageDependencyTests-1124435753 None] Created reservations ['16e82cde-cff8-4551-b38d-1de1c42065d2', '0827d378-4948-4800-8bc7-f289aa334658', 'c8f078da-65ce-4f92-95e8-9f695093367a', 'c40b6a1d-4be5-4346-aeaa-c46eb9636f26'] {{(pid=87116) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 11:57:25 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-6f5feaa6-ce84-4270-875d-22d05429f44d tempest-VolumeImageDependencyTests-1124435753 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 11:57:25 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-6f5feaa6-ce84-4270-875d-22d05429f44d tempest-VolumeImageDependencyTests-1124435753 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 11:57:25 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-6f5feaa6-ce84-4270-875d-22d05429f44d tempest-VolumeImageDependencyTests-1124435753 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 11:57:25 devstack sudo[103444]: pam_unix(sudo:session): session closed for user root Nov 06 11:57:25 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-6f5feaa6-ce84-4270-875d-22d05429f44d tempest-VolumeImageDependencyTests-1124435753 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 11:57:25 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-6f5feaa6-ce84-4270-875d-22d05429f44d tempest-VolumeImageDependencyTests-1124435753 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 11:57:25 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-6f5feaa6-ce84-4270-875d-22d05429f44d tempest-VolumeImageDependencyTests-1124435753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:57:25 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-cb76a979-7952-4c7f-b85b-978035a675d0 tempest-VolumesSnapshotTestJSON-1873011056 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-e429f0ec-80ae-461a-8eaf-d82cfc9e6ac6" returned: 0 in 0.477s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:57:25 devstack sudo[103448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756 Nov 06 11:57:25 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-cb76a979-7952-4c7f-b85b-978035a675d0 tempest-VolumesSnapshotTestJSON-1873011056 None] Lock "cinder-quobyte-e429f0ec-80ae-461a-8eaf-d82cfc9e6ac6" released by "delete_volume" :: held 1.175s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 11:57:25 devstack sudo[103448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:57:25 devstack cinder-volume[87116]: DEBUG cinder.quota [None req-cb76a979-7952-4c7f-b85b-978035a675d0 tempest-VolumesSnapshotTestJSON-1873011056 None] Created reservations ['bd9b7358-dae4-4858-bd31-bbd9a03311f1', 'e7f44897-76f3-4fea-afb9-dbbb36de39e7', '0ce48b26-f0dd-4814-84aa-ce7d51d6d7c5', '9c48e077-2f87-4759-bb39-b64b4663ec7d'] {{(pid=87116) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 11:57:25 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-cb76a979-7952-4c7f-b85b-978035a675d0 tempest-VolumesSnapshotTestJSON-1873011056 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 11:57:25 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-cb76a979-7952-4c7f-b85b-978035a675d0 tempest-VolumesSnapshotTestJSON-1873011056 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 11:57:25 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-cb76a979-7952-4c7f-b85b-978035a675d0 tempest-VolumesSnapshotTestJSON-1873011056 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 11:57:25 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-cb76a979-7952-4c7f-b85b-978035a675d0 tempest-VolumesSnapshotTestJSON-1873011056 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 11:57:25 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-cb76a979-7952-4c7f-b85b-978035a675d0 tempest-VolumesSnapshotTestJSON-1873011056 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 11:57:25 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-cb76a979-7952-4c7f-b85b-978035a675d0 tempest-VolumesSnapshotTestJSON-1873011056 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:57:25 devstack sudo[103450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756 Nov 06 11:57:25 devstack sudo[103450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:57:25 devstack sudo[103448]: pam_unix(sudo:session): session closed for user root Nov 06 11:57:25 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-6f5feaa6-ce84-4270-875d-22d05429f44d tempest-VolumeImageDependencyTests-1124435753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756" returned: 0 in 0.417s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:57:25 devstack cinder-volume[87116]: DEBUG cinder.manager [None req-6f5feaa6-ce84-4270-875d-22d05429f44d tempest-VolumeImageDependencyTests-1124435753 None] Notifying Schedulers of capabilities ... {{(pid=87116) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 11:57:25 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-6f5feaa6-ce84-4270-875d-22d05429f44d tempest-VolumeImageDependencyTests-1124435753 None] Deleted volume successfully. Nov 06 11:57:25 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-6f5feaa6-ce84-4270-875d-22d05429f44d tempest-VolumeImageDependencyTests-1124435753 None] Lock "cinder-68468a20-61bd-41e6-958e-60c157e4ca2b-delete_volume" released by "delete_volume" :: held 1.867s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 11:57:25 devstack sudo[103450]: pam_unix(sudo:session): session closed for user root Nov 06 11:57:25 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-cb76a979-7952-4c7f-b85b-978035a675d0 tempest-VolumesSnapshotTestJSON-1873011056 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756" returned: 0 in 0.341s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:57:25 devstack cinder-volume[87116]: DEBUG cinder.manager [None req-cb76a979-7952-4c7f-b85b-978035a675d0 tempest-VolumesSnapshotTestJSON-1873011056 None] Notifying Schedulers of capabilities ... {{(pid=87116) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 11:57:25 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-cb76a979-7952-4c7f-b85b-978035a675d0 tempest-VolumesSnapshotTestJSON-1873011056 None] Deleted volume successfully. Nov 06 11:57:25 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-cb76a979-7952-4c7f-b85b-978035a675d0 tempest-VolumesSnapshotTestJSON-1873011056 None] Lock "cinder-e429f0ec-80ae-461a-8eaf-d82cfc9e6ac6-delete_volume" released by "delete_volume" :: held 1.869s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 11:57:31 devstack cinder-volume[87116]: DEBUG cinder.volume.flows.manager.create_volume [None req-62948cd4-41b7-428b-811a-cffcda9779d9 tempest-CinderUnicodeTest-1042787105 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87116) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 11:57:31 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-62948cd4-41b7-428b-811a-cffcda9779d9 tempest-CinderUnicodeTest-1042787105 None] Flow 'volume_create_manager' (6a776082-9ed8-4341-b22d-e8d8d8852197) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 11:57:31 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-62948cd4-41b7-428b-811a-cffcda9779d9 tempest-CinderUnicodeTest-1042787105 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (99e7618f-8949-4c93-886b-0f76cdf32a8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:57:31 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-62948cd4-41b7-428b-811a-cffcda9779d9 tempest-CinderUnicodeTest-1042787105 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (99e7618f-8949-4c93-886b-0f76cdf32a8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T10:57:31Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a64bf327-bc87-47b1-9566-cd992fc46f88,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f47e751b29e14e7a9216217c1fab18df',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T10:57:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T10:57:31Z,use_quota=True,user_id='90cb83fdf5364efbb1c3c01fe6a9e810',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(34d3b144-d9b7-480a-a2e3-01e45f3d54c1),volume_type_id=34d3b144-d9b7-480a-a2e3-01e45f3d54c1)' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:57:31 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-62948cd4-41b7-428b-811a-cffcda9779d9 tempest-CinderUnicodeTest-1042787105 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec174a20-2072-4cb8-b4ed-d919d2ec54e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:57:31 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-62948cd4-41b7-428b-811a-cffcda9779d9 tempest-CinderUnicodeTest-1042787105 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec174a20-2072-4cb8-b4ed-d919d2ec54e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:57:31 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-62948cd4-41b7-428b-811a-cffcda9779d9 tempest-CinderUnicodeTest-1042787105 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e3c81162-3eca-4936-8c3a-974e0cbbc93f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:57:31 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-62948cd4-41b7-428b-811a-cffcda9779d9 tempest-CinderUnicodeTest-1042787105 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e3c81162-3eca-4936-8c3a-974e0cbbc93f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a64bf327-bc87-47b1-9566-cd992fc46f88', 'volume_name': 'volume-a64bf327-bc87-47b1-9566-cd992fc46f88', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:57:31 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-62948cd4-41b7-428b-811a-cffcda9779d9 tempest-CinderUnicodeTest-1042787105 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4174e092-086c-4b64-8386-d736954a5fe6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:57:31 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-62948cd4-41b7-428b-811a-cffcda9779d9 tempest-CinderUnicodeTest-1042787105 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4174e092-086c-4b64-8386-d736954a5fe6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:57:31 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-62948cd4-41b7-428b-811a-cffcda9779d9 tempest-CinderUnicodeTest-1042787105 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3848150a-5505-4bc2-9d9a-6b7b7d1418ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:57:31 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-62948cd4-41b7-428b-811a-cffcda9779d9 tempest-CinderUnicodeTest-1042787105 None] Volume a64bf327-bc87-47b1-9566-cd992fc46f88: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a64bf327-bc87-47b1-9566-cd992fc46f88', 'volume_size': 1} Nov 06 11:57:31 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-62948cd4-41b7-428b-811a-cffcda9779d9 tempest-CinderUnicodeTest-1042787105 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 11:57:31 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-62948cd4-41b7-428b-811a-cffcda9779d9 tempest-CinderUnicodeTest-1042787105 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 11:57:31 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-62948cd4-41b7-428b-811a-cffcda9779d9 tempest-CinderUnicodeTest-1042787105 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T10:57:31Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a64bf327-bc87-47b1-9566-cd992fc46f88,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f47e751b29e14e7a9216217c1fab18df',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T10:57:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T10:57:31Z,use_quota=True,user_id='90cb83fdf5364efbb1c3c01fe6a9e810',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(34d3b144-d9b7-480a-a2e3-01e45f3d54c1),volume_type_id=34d3b144-d9b7-480a-a2e3-01e45f3d54c1)}" {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 11:57:31 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-62948cd4-41b7-428b-811a-cffcda9779d9 tempest-CinderUnicodeTest-1042787105 None] Creating volume a64bf327-bc87-47b1-9566-cd992fc46f88 {{(pid=87116) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 11:57:31 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-62948cd4-41b7-428b-811a-cffcda9779d9 tempest-CinderUnicodeTest-1042787105 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 11:57:31 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-62948cd4-41b7-428b-811a-cffcda9779d9 tempest-CinderUnicodeTest-1042787105 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 11:57:31 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-62948cd4-41b7-428b-811a-cffcda9779d9 tempest-CinderUnicodeTest-1042787105 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 11:57:31 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-62948cd4-41b7-428b-811a-cffcda9779d9 tempest-CinderUnicodeTest-1042787105 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 11:57:31 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-62948cd4-41b7-428b-811a-cffcda9779d9 tempest-CinderUnicodeTest-1042787105 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 11:57:31 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-62948cd4-41b7-428b-811a-cffcda9779d9 tempest-CinderUnicodeTest-1042787105 None] Selected osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f as target Quobyte volume. {{(pid=87116) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 11:57:31 devstack cinder-volume[87116]: INFO cinder.volume.drivers.remotefs [None req-62948cd4-41b7-428b-811a-cffcda9779d9 tempest-CinderUnicodeTest-1042787105 None] casted to osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f Nov 06 11:57:31 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-62948cd4-41b7-428b-811a-cffcda9779d9 tempest-CinderUnicodeTest-1042787105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-a64bf327-bc87-47b1-9566-cd992fc46f88 1073741824 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:57:31 devstack sudo[103491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-a64bf327-bc87-47b1-9566-cd992fc46f88 1073741824 Nov 06 11:57:31 devstack sudo[103491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:57:31 devstack cinder-volume[87116]: DEBUG cinder.volume.flows.manager.create_volume [None req-045a0a35-3acd-4378-a687-ae649c5645a8 tempest-ProjectReaderTests-1213314159 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87116) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 11:57:31 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-045a0a35-3acd-4378-a687-ae649c5645a8 tempest-ProjectReaderTests-1213314159 None] Flow 'volume_create_manager' (6038184f-fb12-461c-b8f0-f792d7b4f3d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 11:57:31 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-045a0a35-3acd-4378-a687-ae649c5645a8 tempest-ProjectReaderTests-1213314159 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dd72aa59-1598-46ad-b644-c62b226ecca5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:57:31 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-045a0a35-3acd-4378-a687-ae649c5645a8 tempest-ProjectReaderTests-1213314159 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dd72aa59-1598-46ad-b644-c62b226ecca5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T10:57:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1980962319',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=60485655-95e6-4591-bcdc-ccd36326a995,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dad66e9c5e0f4b4d9b2cadfd48e6f4a0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T10:57:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T10:57:31Z,use_quota=True,user_id='9fd41617bad94a1893cda6310db71f37',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(34d3b144-d9b7-480a-a2e3-01e45f3d54c1),volume_type_id=34d3b144-d9b7-480a-a2e3-01e45f3d54c1)' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:57:31 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-045a0a35-3acd-4378-a687-ae649c5645a8 tempest-ProjectReaderTests-1213314159 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (57e2585e-2dd2-48a9-a37d-d63b23f72c61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:57:31 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-045a0a35-3acd-4378-a687-ae649c5645a8 tempest-ProjectReaderTests-1213314159 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (57e2585e-2dd2-48a9-a37d-d63b23f72c61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:57:31 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-045a0a35-3acd-4378-a687-ae649c5645a8 tempest-ProjectReaderTests-1213314159 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dbb79015-3deb-4ae4-99ee-7460a5f74507) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:57:31 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-045a0a35-3acd-4378-a687-ae649c5645a8 tempest-ProjectReaderTests-1213314159 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dbb79015-3deb-4ae4-99ee-7460a5f74507) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '60485655-95e6-4591-bcdc-ccd36326a995', 'volume_name': 'volume-60485655-95e6-4591-bcdc-ccd36326a995', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:57:31 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-045a0a35-3acd-4378-a687-ae649c5645a8 tempest-ProjectReaderTests-1213314159 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eb0b72c6-f276-4d1f-8125-a53a41b889b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:57:31 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-045a0a35-3acd-4378-a687-ae649c5645a8 tempest-ProjectReaderTests-1213314159 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eb0b72c6-f276-4d1f-8125-a53a41b889b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:57:31 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-045a0a35-3acd-4378-a687-ae649c5645a8 tempest-ProjectReaderTests-1213314159 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1b8625d0-51e5-455f-ab96-5d126f4b8cad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:57:31 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-045a0a35-3acd-4378-a687-ae649c5645a8 tempest-ProjectReaderTests-1213314159 None] Volume 60485655-95e6-4591-bcdc-ccd36326a995: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-60485655-95e6-4591-bcdc-ccd36326a995', 'volume_size': 1} Nov 06 11:57:31 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-045a0a35-3acd-4378-a687-ae649c5645a8 tempest-ProjectReaderTests-1213314159 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 11:57:31 devstack sudo[103491]: pam_unix(sudo:session): session closed for user root Nov 06 11:57:31 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-62948cd4-41b7-428b-811a-cffcda9779d9 tempest-CinderUnicodeTest-1042787105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-a64bf327-bc87-47b1-9566-cd992fc46f88 1073741824" returned: 0 in 0.541s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:57:31 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-62948cd4-41b7-428b-811a-cffcda9779d9 tempest-CinderUnicodeTest-1042787105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-a64bf327-bc87-47b1-9566-cd992fc46f88 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:57:31 devstack sudo[103498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-a64bf327-bc87-47b1-9566-cd992fc46f88 Nov 06 11:57:31 devstack sudo[103498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:57:32 devstack sudo[103498]: pam_unix(sudo:session): session closed for user root Nov 06 11:57:32 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-62948cd4-41b7-428b-811a-cffcda9779d9 tempest-CinderUnicodeTest-1042787105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-a64bf327-bc87-47b1-9566-cd992fc46f88" returned: 0 in 0.277s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:57:32 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-62948cd4-41b7-428b-811a-cffcda9779d9 tempest-CinderUnicodeTest-1042787105 None] <== create_volume: return (881ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f'} {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 11:57:32 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-62948cd4-41b7-428b-811a-cffcda9779d9 tempest-CinderUnicodeTest-1042787105 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.884s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 11:57:32 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-045a0a35-3acd-4378-a687-ae649c5645a8 tempest-ProjectReaderTests-1213314159 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.606s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 11:57:32 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-045a0a35-3acd-4378-a687-ae649c5645a8 tempest-ProjectReaderTests-1213314159 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T10:57:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1980962319',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=60485655-95e6-4591-bcdc-ccd36326a995,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dad66e9c5e0f4b4d9b2cadfd48e6f4a0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T10:57:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T10:57:31Z,use_quota=True,user_id='9fd41617bad94a1893cda6310db71f37',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(34d3b144-d9b7-480a-a2e3-01e45f3d54c1),volume_type_id=34d3b144-d9b7-480a-a2e3-01e45f3d54c1)}" {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 11:57:32 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-045a0a35-3acd-4378-a687-ae649c5645a8 tempest-ProjectReaderTests-1213314159 None] Creating volume 60485655-95e6-4591-bcdc-ccd36326a995 {{(pid=87116) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 11:57:32 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-045a0a35-3acd-4378-a687-ae649c5645a8 tempest-ProjectReaderTests-1213314159 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 11:57:32 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-045a0a35-3acd-4378-a687-ae649c5645a8 tempest-ProjectReaderTests-1213314159 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 11:57:32 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-045a0a35-3acd-4378-a687-ae649c5645a8 tempest-ProjectReaderTests-1213314159 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 11:57:32 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-045a0a35-3acd-4378-a687-ae649c5645a8 tempest-ProjectReaderTests-1213314159 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 11:57:32 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-045a0a35-3acd-4378-a687-ae649c5645a8 tempest-ProjectReaderTests-1213314159 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 11:57:32 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-045a0a35-3acd-4378-a687-ae649c5645a8 tempest-ProjectReaderTests-1213314159 None] Selected osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f as target Quobyte volume. {{(pid=87116) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 11:57:32 devstack cinder-volume[87116]: INFO cinder.volume.drivers.remotefs [None req-045a0a35-3acd-4378-a687-ae649c5645a8 tempest-ProjectReaderTests-1213314159 None] casted to osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f Nov 06 11:57:32 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-045a0a35-3acd-4378-a687-ae649c5645a8 tempest-ProjectReaderTests-1213314159 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-60485655-95e6-4591-bcdc-ccd36326a995 1073741824 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:57:32 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-62948cd4-41b7-428b-811a-cffcda9779d9 tempest-CinderUnicodeTest-1042787105 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3848150a-5505-4bc2-9d9a-6b7b7d1418ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a64bf327-bc87-47b1-9566-cd992fc46f88', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:57:32 devstack sudo[103501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-60485655-95e6-4591-bcdc-ccd36326a995 1073741824 Nov 06 11:57:32 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-62948cd4-41b7-428b-811a-cffcda9779d9 tempest-CinderUnicodeTest-1042787105 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (80059497-a7d5-4404-b119-aad945acdf0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:57:32 devstack sudo[103501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:57:32 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-62948cd4-41b7-428b-811a-cffcda9779d9 tempest-CinderUnicodeTest-1042787105 None] Volume volume-a64bf327-bc87-47b1-9566-cd992fc46f88 (a64bf327-bc87-47b1-9566-cd992fc46f88): created successfully Nov 06 11:57:32 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-62948cd4-41b7-428b-811a-cffcda9779d9 tempest-CinderUnicodeTest-1042787105 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (80059497-a7d5-4404-b119-aad945acdf0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:57:32 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-62948cd4-41b7-428b-811a-cffcda9779d9 tempest-CinderUnicodeTest-1042787105 None] Flow 'volume_create_manager' (6a776082-9ed8-4341-b22d-e8d8d8852197) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 11:57:32 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-62948cd4-41b7-428b-811a-cffcda9779d9 tempest-CinderUnicodeTest-1042787105 None] Created volume successfully. Nov 06 11:57:32 devstack sudo[103501]: pam_unix(sudo:session): session closed for user root Nov 06 11:57:32 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-045a0a35-3acd-4378-a687-ae649c5645a8 tempest-ProjectReaderTests-1213314159 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-60485655-95e6-4591-bcdc-ccd36326a995 1073741824" returned: 0 in 0.525s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:57:32 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-045a0a35-3acd-4378-a687-ae649c5645a8 tempest-ProjectReaderTests-1213314159 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-60485655-95e6-4591-bcdc-ccd36326a995 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:57:32 devstack sudo[103507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-60485655-95e6-4591-bcdc-ccd36326a995 Nov 06 11:57:32 devstack sudo[103507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:57:32 devstack sudo[103507]: pam_unix(sudo:session): session closed for user root Nov 06 11:57:32 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-045a0a35-3acd-4378-a687-ae649c5645a8 tempest-ProjectReaderTests-1213314159 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-60485655-95e6-4591-bcdc-ccd36326a995" returned: 0 in 0.278s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:57:32 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-045a0a35-3acd-4378-a687-ae649c5645a8 tempest-ProjectReaderTests-1213314159 None] <== create_volume: return (863ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f'} {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 11:57:32 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-045a0a35-3acd-4378-a687-ae649c5645a8 tempest-ProjectReaderTests-1213314159 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.866s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 11:57:32 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-045a0a35-3acd-4378-a687-ae649c5645a8 tempest-ProjectReaderTests-1213314159 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1b8625d0-51e5-455f-ab96-5d126f4b8cad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-60485655-95e6-4591-bcdc-ccd36326a995', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:57:32 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-045a0a35-3acd-4378-a687-ae649c5645a8 tempest-ProjectReaderTests-1213314159 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e4c2aecd-7bfb-45cf-afeb-314a8f049c51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:57:32 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-045a0a35-3acd-4378-a687-ae649c5645a8 tempest-ProjectReaderTests-1213314159 None] Volume volume-60485655-95e6-4591-bcdc-ccd36326a995 (60485655-95e6-4591-bcdc-ccd36326a995): created successfully Nov 06 11:57:32 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-045a0a35-3acd-4378-a687-ae649c5645a8 tempest-ProjectReaderTests-1213314159 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e4c2aecd-7bfb-45cf-afeb-314a8f049c51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:57:32 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-045a0a35-3acd-4378-a687-ae649c5645a8 tempest-ProjectReaderTests-1213314159 None] Flow 'volume_create_manager' (6038184f-fb12-461c-b8f0-f792d7b4f3d5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 11:57:32 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-045a0a35-3acd-4378-a687-ae649c5645a8 tempest-ProjectReaderTests-1213314159 None] Created volume successfully. Nov 06 11:57:33 devstack cinder-volume[87116]: DEBUG cinder.volume.flows.manager.create_volume [None req-35b69a09-c90e-4c6a-a402-64c70065533d tempest-CinderUnicodeTest-1042787105 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87116) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 11:57:33 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-35b69a09-c90e-4c6a-a402-64c70065533d tempest-CinderUnicodeTest-1042787105 None] Flow 'volume_create_manager' (41821729-5ea0-4a76-9013-f12d21165cd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 11:57:33 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-35b69a09-c90e-4c6a-a402-64c70065533d tempest-CinderUnicodeTest-1042787105 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (481bb02a-309f-4eb0-9af0-b5e3ed3c69ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:57:33 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-35b69a09-c90e-4c6a-a402-64c70065533d tempest-CinderUnicodeTest-1042787105 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (481bb02a-309f-4eb0-9af0-b5e3ed3c69ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T10:57:33Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1636251355',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a6a25b2f-9e5f-450b-b34c-d51cb28451b4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f47e751b29e14e7a9216217c1fab18df',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T10:57:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T10:57:34Z,use_quota=True,user_id='90cb83fdf5364efbb1c3c01fe6a9e810',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(34d3b144-d9b7-480a-a2e3-01e45f3d54c1),volume_type_id=34d3b144-d9b7-480a-a2e3-01e45f3d54c1)' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:57:33 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-35b69a09-c90e-4c6a-a402-64c70065533d tempest-CinderUnicodeTest-1042787105 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (453b7369-b6a6-44d1-a394-87da62355c92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:57:33 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-35b69a09-c90e-4c6a-a402-64c70065533d tempest-CinderUnicodeTest-1042787105 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (453b7369-b6a6-44d1-a394-87da62355c92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:57:33 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-35b69a09-c90e-4c6a-a402-64c70065533d tempest-CinderUnicodeTest-1042787105 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4180059e-0ab2-4d68-b019-b62993ae1d92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:57:33 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-35b69a09-c90e-4c6a-a402-64c70065533d tempest-CinderUnicodeTest-1042787105 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4180059e-0ab2-4d68-b019-b62993ae1d92) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a6a25b2f-9e5f-450b-b34c-d51cb28451b4', 'volume_name': 'volume-a6a25b2f-9e5f-450b-b34c-d51cb28451b4', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:57:33 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-35b69a09-c90e-4c6a-a402-64c70065533d tempest-CinderUnicodeTest-1042787105 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (69443b92-703f-4d08-afbc-8f4f06127e89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:57:33 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-35b69a09-c90e-4c6a-a402-64c70065533d tempest-CinderUnicodeTest-1042787105 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (69443b92-703f-4d08-afbc-8f4f06127e89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:57:33 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-35b69a09-c90e-4c6a-a402-64c70065533d tempest-CinderUnicodeTest-1042787105 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9618bb2e-ad58-4b8d-9d23-31e8e6b70de8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:57:33 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-35b69a09-c90e-4c6a-a402-64c70065533d tempest-CinderUnicodeTest-1042787105 None] Volume a6a25b2f-9e5f-450b-b34c-d51cb28451b4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a6a25b2f-9e5f-450b-b34c-d51cb28451b4', 'volume_size': 1} Nov 06 11:57:33 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-35b69a09-c90e-4c6a-a402-64c70065533d tempest-CinderUnicodeTest-1042787105 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 11:57:33 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-35b69a09-c90e-4c6a-a402-64c70065533d tempest-CinderUnicodeTest-1042787105 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 11:57:33 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-35b69a09-c90e-4c6a-a402-64c70065533d tempest-CinderUnicodeTest-1042787105 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T10:57:33Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1636251355',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a6a25b2f-9e5f-450b-b34c-d51cb28451b4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f47e751b29e14e7a9216217c1fab18df',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T10:57:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T10:57:34Z,use_quota=True,user_id='90cb83fdf5364efbb1c3c01fe6a9e810',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(34d3b144-d9b7-480a-a2e3-01e45f3d54c1),volume_type_id=34d3b144-d9b7-480a-a2e3-01e45f3d54c1)}" {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 11:57:33 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-35b69a09-c90e-4c6a-a402-64c70065533d tempest-CinderUnicodeTest-1042787105 None] Creating volume a6a25b2f-9e5f-450b-b34c-d51cb28451b4 {{(pid=87116) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 11:57:33 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-35b69a09-c90e-4c6a-a402-64c70065533d tempest-CinderUnicodeTest-1042787105 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 11:57:33 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-35b69a09-c90e-4c6a-a402-64c70065533d tempest-CinderUnicodeTest-1042787105 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 11:57:33 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-35b69a09-c90e-4c6a-a402-64c70065533d tempest-CinderUnicodeTest-1042787105 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 11:57:33 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-35b69a09-c90e-4c6a-a402-64c70065533d tempest-CinderUnicodeTest-1042787105 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 11:57:33 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-35b69a09-c90e-4c6a-a402-64c70065533d tempest-CinderUnicodeTest-1042787105 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 11:57:33 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-35b69a09-c90e-4c6a-a402-64c70065533d tempest-CinderUnicodeTest-1042787105 None] Selected osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f as target Quobyte volume. {{(pid=87116) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 11:57:33 devstack cinder-volume[87116]: INFO cinder.volume.drivers.remotefs [None req-35b69a09-c90e-4c6a-a402-64c70065533d tempest-CinderUnicodeTest-1042787105 None] casted to osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f Nov 06 11:57:33 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-35b69a09-c90e-4c6a-a402-64c70065533d tempest-CinderUnicodeTest-1042787105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-a6a25b2f-9e5f-450b-b34c-d51cb28451b4 1073741824 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:57:33 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-7b1e3e76-07ea-4e40-b442-b4af9ba68145 tempest-ProjectReaderTests-1213314159 None] Acquiring lock "cinder-60485655-95e6-4591-bcdc-ccd36326a995-delete_volume" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 11:57:33 devstack sudo[103511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-a6a25b2f-9e5f-450b-b34c-d51cb28451b4 1073741824 Nov 06 11:57:33 devstack sudo[103511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:57:33 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-7b1e3e76-07ea-4e40-b442-b4af9ba68145 tempest-ProjectReaderTests-1213314159 None] Lock "cinder-60485655-95e6-4591-bcdc-ccd36326a995-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 11:57:33 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-7b1e3e76-07ea-4e40-b442-b4af9ba68145 tempest-ProjectReaderTests-1213314159 None] Acquiring lock "cinder-quobyte-60485655-95e6-4591-bcdc-ccd36326a995" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 11:57:33 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-7b1e3e76-07ea-4e40-b442-b4af9ba68145 tempest-ProjectReaderTests-1213314159 None] Lock "cinder-quobyte-60485655-95e6-4591-bcdc-ccd36326a995" acquired by "delete_volume" :: waited 0.021s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 11:57:34 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8e8f3b0-1496-49fa-89fc-4238c16b6b67]: (4, 'qcow2') {{(pid=88420) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 11:57:34 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-7b1e3e76-07ea-4e40-b442-b4af9ba68145 tempest-ProjectReaderTests-1213314159 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-60485655-95e6-4591-bcdc-ccd36326a995 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:57:34 devstack sudo[103513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-60485655-95e6-4591-bcdc-ccd36326a995 Nov 06 11:57:34 devstack sudo[103513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:57:34 devstack sudo[103511]: pam_unix(sudo:session): session closed for user root Nov 06 11:57:34 devstack sudo[103513]: pam_unix(sudo:session): session closed for user root Nov 06 11:57:34 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-35b69a09-c90e-4c6a-a402-64c70065533d tempest-CinderUnicodeTest-1042787105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-a6a25b2f-9e5f-450b-b34c-d51cb28451b4 1073741824" returned: 0 in 0.656s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:57:34 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-7b1e3e76-07ea-4e40-b442-b4af9ba68145 tempest-ProjectReaderTests-1213314159 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-60485655-95e6-4591-bcdc-ccd36326a995" returned: 0 in 0.495s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:57:34 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-7b1e3e76-07ea-4e40-b442-b4af9ba68145 tempest-ProjectReaderTests-1213314159 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-60485655-95e6-4591-bcdc-ccd36326a995 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:57:34 devstack sudo[103522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-60485655-95e6-4591-bcdc-ccd36326a995 Nov 06 11:57:34 devstack sudo[103522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:57:34 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-35b69a09-c90e-4c6a-a402-64c70065533d tempest-CinderUnicodeTest-1042787105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-a6a25b2f-9e5f-450b-b34c-d51cb28451b4 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:57:34 devstack sudo[103524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-a6a25b2f-9e5f-450b-b34c-d51cb28451b4 Nov 06 11:57:34 devstack sudo[103524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:57:34 devstack sudo[103522]: pam_unix(sudo:session): session closed for user root Nov 06 11:57:34 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-7b1e3e76-07ea-4e40-b442-b4af9ba68145 tempest-ProjectReaderTests-1213314159 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-60485655-95e6-4591-bcdc-ccd36326a995" returned: 0 in 0.385s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:57:34 devstack sudo[103524]: pam_unix(sudo:session): session closed for user root Nov 06 11:57:34 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-35b69a09-c90e-4c6a-a402-64c70065533d tempest-CinderUnicodeTest-1042787105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-a6a25b2f-9e5f-450b-b34c-d51cb28451b4" returned: 0 in 0.314s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:57:34 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-35b69a09-c90e-4c6a-a402-64c70065533d tempest-CinderUnicodeTest-1042787105 None] <== create_volume: return (1091ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f'} {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 11:57:34 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-35b69a09-c90e-4c6a-a402-64c70065533d tempest-CinderUnicodeTest-1042787105 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.095s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 11:57:34 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-7b1e3e76-07ea-4e40-b442-b4af9ba68145 tempest-ProjectReaderTests-1213314159 None] Lock "cinder-quobyte-60485655-95e6-4591-bcdc-ccd36326a995" released by "delete_volume" :: held 0.957s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 11:57:34 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-35b69a09-c90e-4c6a-a402-64c70065533d tempest-CinderUnicodeTest-1042787105 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9618bb2e-ad58-4b8d-9d23-31e8e6b70de8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a6a25b2f-9e5f-450b-b34c-d51cb28451b4', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:57:34 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-35b69a09-c90e-4c6a-a402-64c70065533d tempest-CinderUnicodeTest-1042787105 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8152869e-bc6e-4340-8872-e6a1c04f3c01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:57:34 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-35b69a09-c90e-4c6a-a402-64c70065533d tempest-CinderUnicodeTest-1042787105 None] Volume volume-a6a25b2f-9e5f-450b-b34c-d51cb28451b4 (a6a25b2f-9e5f-450b-b34c-d51cb28451b4): created successfully Nov 06 11:57:34 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-35b69a09-c90e-4c6a-a402-64c70065533d tempest-CinderUnicodeTest-1042787105 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8152869e-bc6e-4340-8872-e6a1c04f3c01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:57:34 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-35b69a09-c90e-4c6a-a402-64c70065533d tempest-CinderUnicodeTest-1042787105 None] Flow 'volume_create_manager' (41821729-5ea0-4a76-9013-f12d21165cd6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 11:57:35 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-35b69a09-c90e-4c6a-a402-64c70065533d tempest-CinderUnicodeTest-1042787105 None] Created volume successfully. Nov 06 11:57:35 devstack cinder-volume[87116]: DEBUG cinder.quota [None req-7b1e3e76-07ea-4e40-b442-b4af9ba68145 tempest-ProjectReaderTests-1213314159 None] Created reservations ['23f52e9d-3ecd-45a2-a175-148a106c19b0', 'db33a08d-9a5e-4dd5-a9d7-5d9941aebb80', '6b402c92-dd28-4d7f-b5d1-254d4ea69aa0', '491eb7f5-6ae2-4c60-a9ca-b9eb741d93c2'] {{(pid=87116) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 11:57:35 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-7b1e3e76-07ea-4e40-b442-b4af9ba68145 tempest-ProjectReaderTests-1213314159 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 11:57:35 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-7b1e3e76-07ea-4e40-b442-b4af9ba68145 tempest-ProjectReaderTests-1213314159 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 11:57:35 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-7b1e3e76-07ea-4e40-b442-b4af9ba68145 tempest-ProjectReaderTests-1213314159 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 11:57:35 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-7b1e3e76-07ea-4e40-b442-b4af9ba68145 tempest-ProjectReaderTests-1213314159 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 11:57:35 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-7b1e3e76-07ea-4e40-b442-b4af9ba68145 tempest-ProjectReaderTests-1213314159 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 11:57:35 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-7b1e3e76-07ea-4e40-b442-b4af9ba68145 tempest-ProjectReaderTests-1213314159 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:57:35 devstack sudo[103528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756 Nov 06 11:57:35 devstack sudo[103528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:57:35 devstack sudo[103528]: pam_unix(sudo:session): session closed for user root Nov 06 11:57:35 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-7b1e3e76-07ea-4e40-b442-b4af9ba68145 tempest-ProjectReaderTests-1213314159 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756" returned: 0 in 0.381s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:57:35 devstack cinder-volume[87116]: DEBUG cinder.manager [None req-7b1e3e76-07ea-4e40-b442-b4af9ba68145 tempest-ProjectReaderTests-1213314159 None] Notifying Schedulers of capabilities ... {{(pid=87116) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 11:57:35 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-7b1e3e76-07ea-4e40-b442-b4af9ba68145 tempest-ProjectReaderTests-1213314159 None] Deleted volume successfully. Nov 06 11:57:35 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-7b1e3e76-07ea-4e40-b442-b4af9ba68145 tempest-ProjectReaderTests-1213314159 None] Lock "cinder-60485655-95e6-4591-bcdc-ccd36326a995-delete_volume" released by "delete_volume" :: held 1.625s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 11:57:36 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-ad9671a8-fe0e-4d38-a992-9591006b54ba tempest-CinderUnicodeTest-1042787105 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 11:57:36 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-ad9671a8-fe0e-4d38-a992-9591006b54ba tempest-CinderUnicodeTest-1042787105 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 11:57:36 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-ad9671a8-fe0e-4d38-a992-9591006b54ba tempest-CinderUnicodeTest-1042787105 None] Creating offline snapshot d14b40f7-da04-4f66-bc32-ef3f1348f2e1 of volume a6a25b2f-9e5f-450b-b34c-d51cb28451b4 {{(pid=87116) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 06 11:57:36 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f99033f-9745-4b9c-8c89-30470dba2768]: (4, 'qcow2') {{(pid=88420) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 11:57:36 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-ad9671a8-fe0e-4d38-a992-9591006b54ba tempest-CinderUnicodeTest-1042787105 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-a6a25b2f-9e5f-450b-b34c-d51cb28451b4 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:57:36 devstack sudo[103573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-a6a25b2f-9e5f-450b-b34c-d51cb28451b4 Nov 06 11:57:36 devstack sudo[103573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:57:36 devstack cinder-volume[87116]: DEBUG cinder.volume.flows.manager.create_volume [None req-d0e2bb37-75d0-4689-b73b-4b9706c830e6 tempest-ProjectReaderTests-1213314159 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87116) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 11:57:36 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-d0e2bb37-75d0-4689-b73b-4b9706c830e6 tempest-ProjectReaderTests-1213314159 None] Flow 'volume_create_manager' (96ac3d6c-0fec-46bc-b6f4-006b6df8d8d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 11:57:36 devstack sudo[103573]: pam_unix(sudo:session): session closed for user root Nov 06 11:57:36 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-d0e2bb37-75d0-4689-b73b-4b9706c830e6 tempest-ProjectReaderTests-1213314159 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (23952bb3-2600-491a-96d4-882bc4fac48b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:57:36 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-ad9671a8-fe0e-4d38-a992-9591006b54ba tempest-CinderUnicodeTest-1042787105 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-a6a25b2f-9e5f-450b-b34c-d51cb28451b4" returned: 0 in 0.525s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:57:36 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-ad9671a8-fe0e-4d38-a992-9591006b54ba tempest-CinderUnicodeTest-1042787105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-a6a25b2f-9e5f-450b-b34c-d51cb28451b4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-a6a25b2f-9e5f-450b-b34c-d51cb28451b4.d14b40f7-da04-4f66-bc32-ef3f1348f2e1 1G {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:57:36 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-d0e2bb37-75d0-4689-b73b-4b9706c830e6 tempest-ProjectReaderTests-1213314159 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (23952bb3-2600-491a-96d4-882bc4fac48b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T10:57:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1701728915',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=677efbb6-746f-426f-9010-b50047e593aa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dad66e9c5e0f4b4d9b2cadfd48e6f4a0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T10:57:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T10:57:37Z,use_quota=True,user_id='9fd41617bad94a1893cda6310db71f37',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(34d3b144-d9b7-480a-a2e3-01e45f3d54c1),volume_type_id=34d3b144-d9b7-480a-a2e3-01e45f3d54c1)' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:57:36 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-d0e2bb37-75d0-4689-b73b-4b9706c830e6 tempest-ProjectReaderTests-1213314159 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (afe0b0d3-982d-435f-b0ae-e250e9ec6ea9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:57:36 devstack sudo[103580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-a6a25b2f-9e5f-450b-b34c-d51cb28451b4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-a6a25b2f-9e5f-450b-b34c-d51cb28451b4.d14b40f7-da04-4f66-bc32-ef3f1348f2e1 1G Nov 06 11:57:36 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-d0e2bb37-75d0-4689-b73b-4b9706c830e6 tempest-ProjectReaderTests-1213314159 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (afe0b0d3-982d-435f-b0ae-e250e9ec6ea9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:57:36 devstack sudo[103580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:57:36 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-d0e2bb37-75d0-4689-b73b-4b9706c830e6 tempest-ProjectReaderTests-1213314159 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (095af16e-8aeb-4753-be28-9643b10aca24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:57:36 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-d0e2bb37-75d0-4689-b73b-4b9706c830e6 tempest-ProjectReaderTests-1213314159 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (095af16e-8aeb-4753-be28-9643b10aca24) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '677efbb6-746f-426f-9010-b50047e593aa', 'volume_name': 'volume-677efbb6-746f-426f-9010-b50047e593aa', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:57:36 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-d0e2bb37-75d0-4689-b73b-4b9706c830e6 tempest-ProjectReaderTests-1213314159 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4138f7d8-240a-4214-9516-39c1ab93ebe4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:57:36 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-d0e2bb37-75d0-4689-b73b-4b9706c830e6 tempest-ProjectReaderTests-1213314159 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4138f7d8-240a-4214-9516-39c1ab93ebe4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:57:36 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-d0e2bb37-75d0-4689-b73b-4b9706c830e6 tempest-ProjectReaderTests-1213314159 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (88c957c7-71cc-4c86-a60f-465de4323fbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:57:36 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-d0e2bb37-75d0-4689-b73b-4b9706c830e6 tempest-ProjectReaderTests-1213314159 None] Volume 677efbb6-746f-426f-9010-b50047e593aa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-677efbb6-746f-426f-9010-b50047e593aa', 'volume_size': 1} Nov 06 11:57:36 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-d0e2bb37-75d0-4689-b73b-4b9706c830e6 tempest-ProjectReaderTests-1213314159 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 11:57:37 devstack sudo[103580]: pam_unix(sudo:session): session closed for user root Nov 06 11:57:37 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-ad9671a8-fe0e-4d38-a992-9591006b54ba tempest-CinderUnicodeTest-1042787105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-a6a25b2f-9e5f-450b-b34c-d51cb28451b4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-a6a25b2f-9e5f-450b-b34c-d51cb28451b4.d14b40f7-da04-4f66-bc32-ef3f1348f2e1 1G" returned: 0 in 0.457s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:57:37 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-ad9671a8-fe0e-4d38-a992-9591006b54ba tempest-CinderUnicodeTest-1042787105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a6a25b2f-9e5f-450b-b34c-d51cb28451b4 -F qcow2 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-a6a25b2f-9e5f-450b-b34c-d51cb28451b4.d14b40f7-da04-4f66-bc32-ef3f1348f2e1 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:57:37 devstack sudo[103586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a6a25b2f-9e5f-450b-b34c-d51cb28451b4 -F qcow2 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-a6a25b2f-9e5f-450b-b34c-d51cb28451b4.d14b40f7-da04-4f66-bc32-ef3f1348f2e1 Nov 06 11:57:37 devstack sudo[103586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:57:37 devstack sudo[103586]: pam_unix(sudo:session): session closed for user root Nov 06 11:57:37 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-ad9671a8-fe0e-4d38-a992-9591006b54ba tempest-CinderUnicodeTest-1042787105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a6a25b2f-9e5f-450b-b34c-d51cb28451b4 -F qcow2 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-a6a25b2f-9e5f-450b-b34c-d51cb28451b4.d14b40f7-da04-4f66-bc32-ef3f1348f2e1" returned: 0 in 0.323s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:57:37 devstack cinder-volume[87116]: WARNING cinder.volume.drivers.remotefs [None req-ad9671a8-fe0e-4d38-a992-9591006b54ba tempest-CinderUnicodeTest-1042787105 None] /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-a6a25b2f-9e5f-450b-b34c-d51cb28451b4.d14b40f7-da04-4f66-bc32-ef3f1348f2e1 is being set with open permissions: ugo+rw Nov 06 11:57:37 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-ad9671a8-fe0e-4d38-a992-9591006b54ba tempest-CinderUnicodeTest-1042787105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-a6a25b2f-9e5f-450b-b34c-d51cb28451b4.d14b40f7-da04-4f66-bc32-ef3f1348f2e1 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:57:37 devstack sudo[103593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-a6a25b2f-9e5f-450b-b34c-d51cb28451b4.d14b40f7-da04-4f66-bc32-ef3f1348f2e1 Nov 06 11:57:37 devstack sudo[103593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:57:37 devstack sudo[103593]: pam_unix(sudo:session): session closed for user root Nov 06 11:57:37 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-ad9671a8-fe0e-4d38-a992-9591006b54ba tempest-CinderUnicodeTest-1042787105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-a6a25b2f-9e5f-450b-b34c-d51cb28451b4.d14b40f7-da04-4f66-bc32-ef3f1348f2e1" returned: 0 in 0.262s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:57:37 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-ad9671a8-fe0e-4d38-a992-9591006b54ba tempest-CinderUnicodeTest-1042787105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-a6a25b2f-9e5f-450b-b34c-d51cb28451b4.info {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:57:37 devstack sudo[103599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-a6a25b2f-9e5f-450b-b34c-d51cb28451b4.info Nov 06 11:57:37 devstack sudo[103599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:57:38 devstack sudo[103599]: pam_unix(sudo:session): session closed for user root Nov 06 11:57:38 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-ad9671a8-fe0e-4d38-a992-9591006b54ba tempest-CinderUnicodeTest-1042787105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-a6a25b2f-9e5f-450b-b34c-d51cb28451b4.info" returned: 0 in 0.256s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:57:38 devstack cinder-volume[87116]: WARNING cinder.volume.drivers.remotefs [None req-ad9671a8-fe0e-4d38-a992-9591006b54ba tempest-CinderUnicodeTest-1042787105 None] /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-a6a25b2f-9e5f-450b-b34c-d51cb28451b4.info is being set with open permissions: ugo+rw Nov 06 11:57:38 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-ad9671a8-fe0e-4d38-a992-9591006b54ba tempest-CinderUnicodeTest-1042787105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-a6a25b2f-9e5f-450b-b34c-d51cb28451b4.info {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:57:38 devstack sudo[103605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-a6a25b2f-9e5f-450b-b34c-d51cb28451b4.info Nov 06 11:57:38 devstack sudo[103605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:57:38 devstack sudo[103605]: pam_unix(sudo:session): session closed for user root Nov 06 11:57:38 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-ad9671a8-fe0e-4d38-a992-9591006b54ba tempest-CinderUnicodeTest-1042787105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-a6a25b2f-9e5f-450b-b34c-d51cb28451b4.info" returned: 0 in 0.280s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:57:38 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-ad9671a8-fe0e-4d38-a992-9591006b54ba tempest-CinderUnicodeTest-1042787105 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.253s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 11:57:38 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-d0e2bb37-75d0-4689-b73b-4b9706c830e6 tempest-ProjectReaderTests-1213314159 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.598s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 11:57:38 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-d0e2bb37-75d0-4689-b73b-4b9706c830e6 tempest-ProjectReaderTests-1213314159 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T10:57:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1701728915',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=677efbb6-746f-426f-9010-b50047e593aa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dad66e9c5e0f4b4d9b2cadfd48e6f4a0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T10:57:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T10:57:37Z,use_quota=True,user_id='9fd41617bad94a1893cda6310db71f37',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(34d3b144-d9b7-480a-a2e3-01e45f3d54c1),volume_type_id=34d3b144-d9b7-480a-a2e3-01e45f3d54c1)}" {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 11:57:38 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-d0e2bb37-75d0-4689-b73b-4b9706c830e6 tempest-ProjectReaderTests-1213314159 None] Creating volume 677efbb6-746f-426f-9010-b50047e593aa {{(pid=87116) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 11:57:38 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-d0e2bb37-75d0-4689-b73b-4b9706c830e6 tempest-ProjectReaderTests-1213314159 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 11:57:38 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-d0e2bb37-75d0-4689-b73b-4b9706c830e6 tempest-ProjectReaderTests-1213314159 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 11:57:38 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-d0e2bb37-75d0-4689-b73b-4b9706c830e6 tempest-ProjectReaderTests-1213314159 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 11:57:38 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-d0e2bb37-75d0-4689-b73b-4b9706c830e6 tempest-ProjectReaderTests-1213314159 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 11:57:38 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-d0e2bb37-75d0-4689-b73b-4b9706c830e6 tempest-ProjectReaderTests-1213314159 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 11:57:38 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-d0e2bb37-75d0-4689-b73b-4b9706c830e6 tempest-ProjectReaderTests-1213314159 None] Selected osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f as target Quobyte volume. {{(pid=87116) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 11:57:38 devstack cinder-volume[87116]: INFO cinder.volume.drivers.remotefs [None req-d0e2bb37-75d0-4689-b73b-4b9706c830e6 tempest-ProjectReaderTests-1213314159 None] casted to osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f Nov 06 11:57:38 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-d0e2bb37-75d0-4689-b73b-4b9706c830e6 tempest-ProjectReaderTests-1213314159 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-677efbb6-746f-426f-9010-b50047e593aa 1073741824 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:57:38 devstack sudo[103611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-677efbb6-746f-426f-9010-b50047e593aa 1073741824 Nov 06 11:57:38 devstack sudo[103611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:57:38 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-ad9671a8-fe0e-4d38-a992-9591006b54ba tempest-CinderUnicodeTest-1042787105 None] Create snapshot completed successfully Nov 06 11:57:38 devstack sudo[103611]: pam_unix(sudo:session): session closed for user root Nov 06 11:57:38 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-d0e2bb37-75d0-4689-b73b-4b9706c830e6 tempest-ProjectReaderTests-1213314159 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-677efbb6-746f-426f-9010-b50047e593aa 1073741824" returned: 0 in 0.517s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:57:39 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-d0e2bb37-75d0-4689-b73b-4b9706c830e6 tempest-ProjectReaderTests-1213314159 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-677efbb6-746f-426f-9010-b50047e593aa {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:57:39 devstack sudo[103625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-677efbb6-746f-426f-9010-b50047e593aa Nov 06 11:57:39 devstack sudo[103625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:57:39 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [req-0e9fa210-e22f-4cc5-ab56-313877a2d87f req-56ff3a8c-905f-4162-811b-52d3ec7cabaf tempest-TestServerVolumeAttachmentScenario-1898122559 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 11:57:39 devstack sudo[103625]: pam_unix(sudo:session): session closed for user root Nov 06 11:57:39 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-d0e2bb37-75d0-4689-b73b-4b9706c830e6 tempest-ProjectReaderTests-1213314159 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-677efbb6-746f-426f-9010-b50047e593aa" returned: 0 in 0.288s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:57:39 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-d0e2bb37-75d0-4689-b73b-4b9706c830e6 tempest-ProjectReaderTests-1213314159 None] <== create_volume: return (863ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f'} {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 11:57:39 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-d0e2bb37-75d0-4689-b73b-4b9706c830e6 tempest-ProjectReaderTests-1213314159 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.866s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 11:57:39 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [req-0e9fa210-e22f-4cc5-ab56-313877a2d87f req-56ff3a8c-905f-4162-811b-52d3ec7cabaf tempest-TestServerVolumeAttachmentScenario-1898122559 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.236s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 11:57:39 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-d0e2bb37-75d0-4689-b73b-4b9706c830e6 tempest-ProjectReaderTests-1213314159 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (88c957c7-71cc-4c86-a60f-465de4323fbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-677efbb6-746f-426f-9010-b50047e593aa', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:57:39 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-d0e2bb37-75d0-4689-b73b-4b9706c830e6 tempest-ProjectReaderTests-1213314159 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (122fb940-e80f-4e92-bf69-7852400674db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:57:39 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-794aacb2-6b62-47f4-90c2-dc870bdde305 tempest-CinderUnicodeTest-1042787105 None] Acquiring lock "cinder-d14b40f7-da04-4f66-bc32-ef3f1348f2e1-delete_snapshot" by "delete_snapshot" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 11:57:39 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [req-0e9fa210-e22f-4cc5-ab56-313877a2d87f req-56ff3a8c-905f-4162-811b-52d3ec7cabaf tempest-TestServerVolumeAttachmentScenario-1898122559 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.046s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 11:57:39 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-d0e2bb37-75d0-4689-b73b-4b9706c830e6 tempest-ProjectReaderTests-1213314159 None] Volume volume-677efbb6-746f-426f-9010-b50047e593aa (677efbb6-746f-426f-9010-b50047e593aa): created successfully Nov 06 11:57:39 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-d0e2bb37-75d0-4689-b73b-4b9706c830e6 tempest-ProjectReaderTests-1213314159 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (122fb940-e80f-4e92-bf69-7852400674db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:57:39 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-d0e2bb37-75d0-4689-b73b-4b9706c830e6 tempest-ProjectReaderTests-1213314159 None] Flow 'volume_create_manager' (96ac3d6c-0fec-46bc-b6f4-006b6df8d8d7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 11:57:39 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-794aacb2-6b62-47f4-90c2-dc870bdde305 tempest-CinderUnicodeTest-1042787105 None] Lock "cinder-d14b40f7-da04-4f66-bc32-ef3f1348f2e1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.054s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 11:57:39 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-794aacb2-6b62-47f4-90c2-dc870bdde305 tempest-CinderUnicodeTest-1042787105 None] Acquiring lock "cinder-quobyte-a6a25b2f-9e5f-450b-b34c-d51cb28451b4" by "delete_snapshot" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 11:57:39 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-d0e2bb37-75d0-4689-b73b-4b9706c830e6 tempest-ProjectReaderTests-1213314159 None] Created volume successfully. Nov 06 11:57:39 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-794aacb2-6b62-47f4-90c2-dc870bdde305 tempest-CinderUnicodeTest-1042787105 None] Lock "cinder-quobyte-a6a25b2f-9e5f-450b-b34c-d51cb28451b4" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 11:57:39 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-794aacb2-6b62-47f4-90c2-dc870bdde305 tempest-CinderUnicodeTest-1042787105 None] Acquiring lock "cinder-quobyte-d14b40f7-da04-4f66-bc32-ef3f1348f2e1" by "_delete_snapshot" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 11:57:39 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [req-0e9fa210-e22f-4cc5-ab56-313877a2d87f req-56ff3a8c-905f-4162-811b-52d3ec7cabaf tempest-TestServerVolumeAttachmentScenario-1898122559 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f', 'name': 'volume-e23cb0d7-5064-4885-91f6-b6dc720fccdd', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '6966b40b-7b24-40a3-a65e-34b9feaa2d5d', 'enforce_multipath': True} {{(pid=87116) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 06 11:57:39 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-794aacb2-6b62-47f4-90c2-dc870bdde305 tempest-CinderUnicodeTest-1042787105 None] Lock "cinder-quobyte-d14b40f7-da04-4f66-bc32-ef3f1348f2e1" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 11:57:39 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-794aacb2-6b62-47f4-90c2-dc870bdde305 tempest-CinderUnicodeTest-1042787105 None] Deleting offline snapshot d14b40f7-da04-4f66-bc32-ef3f1348f2e1 of volume a6a25b2f-9e5f-450b-b34c-d51cb28451b4 {{(pid=87116) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 06 11:57:39 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-794aacb2-6b62-47f4-90c2-dc870bdde305 tempest-CinderUnicodeTest-1042787105 None] snapshot_file for this snap is: volume-a6a25b2f-9e5f-450b-b34c-d51cb28451b4.d14b40f7-da04-4f66-bc32-ef3f1348f2e1 {{(pid=87116) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 06 11:57:39 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[3640fbda-9473-424a-bfbb-cf87b66208fe]: (4, 'qcow2') {{(pid=88420) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 11:57:39 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-794aacb2-6b62-47f4-90c2-dc870bdde305 tempest-CinderUnicodeTest-1042787105 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-a6a25b2f-9e5f-450b-b34c-d51cb28451b4.d14b40f7-da04-4f66-bc32-ef3f1348f2e1 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:57:39 devstack cinder-volume[87116]: INFO cinder.volume.manager [req-0e9fa210-e22f-4cc5-ab56-313877a2d87f req-56ff3a8c-905f-4162-811b-52d3ec7cabaf tempest-TestServerVolumeAttachmentScenario-1898122559 None] attachment_update completed successfully. Nov 06 11:57:39 devstack sudo[103628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-a6a25b2f-9e5f-450b-b34c-d51cb28451b4.d14b40f7-da04-4f66-bc32-ef3f1348f2e1 Nov 06 11:57:39 devstack sudo[103628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:57:39 devstack cinder-volume[87116]: DEBUG oslo_service.periodic_task [None req-4fab4816-ec2b-4b19-b2ff-8548f2084354 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87116) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 11:57:39 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-4fab4816-ec2b-4b19-b2ff-8548f2084354 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 11:57:39 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-4fab4816-ec2b-4b19-b2ff-8548f2084354 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 11:57:39 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-4fab4816-ec2b-4b19-b2ff-8548f2084354 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 11:57:39 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-4fab4816-ec2b-4b19-b2ff-8548f2084354 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 11:57:39 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-4fab4816-ec2b-4b19-b2ff-8548f2084354 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 11:57:39 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-4fab4816-ec2b-4b19-b2ff-8548f2084354 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:57:39 devstack sudo[103728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756 Nov 06 11:57:39 devstack sudo[103728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:57:40 devstack sudo[103628]: pam_unix(sudo:session): session closed for user root Nov 06 11:57:40 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-794aacb2-6b62-47f4-90c2-dc870bdde305 tempest-CinderUnicodeTest-1042787105 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-a6a25b2f-9e5f-450b-b34c-d51cb28451b4.d14b40f7-da04-4f66-bc32-ef3f1348f2e1" returned: 0 in 0.576s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:57:40 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-794aacb2-6b62-47f4-90c2-dc870bdde305 tempest-CinderUnicodeTest-1042787105 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a6a25b2f-9e5f-450b-b34c-d51cb28451b4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87116) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 11:57:40 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-cba4111b-f40d-4ae6-9474-deb90c668f84 tempest-ProjectReaderTests-1213314159 None] Acquiring lock "cinder-677efbb6-746f-426f-9010-b50047e593aa-delete_volume" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 11:57:40 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f3c351c-36f4-45e0-89ed-01ebf16c2902]: (4, 'qcow2') {{(pid=88420) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 11:57:40 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-794aacb2-6b62-47f4-90c2-dc870bdde305 tempest-CinderUnicodeTest-1042787105 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-a6a25b2f-9e5f-450b-b34c-d51cb28451b4 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:57:40 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-cba4111b-f40d-4ae6-9474-deb90c668f84 tempest-ProjectReaderTests-1213314159 None] Lock "cinder-677efbb6-746f-426f-9010-b50047e593aa-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 11:57:40 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-cba4111b-f40d-4ae6-9474-deb90c668f84 tempest-ProjectReaderTests-1213314159 None] Acquiring lock "cinder-quobyte-677efbb6-746f-426f-9010-b50047e593aa" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 11:57:40 devstack sudo[103728]: pam_unix(sudo:session): session closed for user root Nov 06 11:57:40 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-4fab4816-ec2b-4b19-b2ff-8548f2084354 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756" returned: 0 in 0.358s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:57:40 devstack cinder-volume[87116]: DEBUG cinder.manager [None req-4fab4816-ec2b-4b19-b2ff-8548f2084354 None None] Notifying Schedulers of capabilities ... {{(pid=87116) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 11:57:40 devstack cinder-volume[87116]: DEBUG oslo_service.periodic_task [None req-4fab4816-ec2b-4b19-b2ff-8548f2084354 None None] Running periodic task VolumeManager._thread_info {{(pid=87116) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 11:57:40 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-4fab4816-ec2b-4b19-b2ff-8548f2084354 None None] thread count: 28 {{(pid=87116) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 06 11:57:40 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-4fab4816-ec2b-4b19-b2ff-8548f2084354 None None] thread info: [<_MainThread(MainThread, started 131399520669824)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87116) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 06 11:57:40 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-cba4111b-f40d-4ae6-9474-deb90c668f84 tempest-ProjectReaderTests-1213314159 None] Lock "cinder-quobyte-677efbb6-746f-426f-9010-b50047e593aa" acquired by "delete_volume" :: waited 0.020s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 11:57:40 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1e4c6bf-606f-4921-bc65-90880bc80567]: (4, 'qcow2') {{(pid=88420) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 11:57:40 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-cba4111b-f40d-4ae6-9474-deb90c668f84 tempest-ProjectReaderTests-1213314159 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-677efbb6-746f-426f-9010-b50047e593aa {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:57:40 devstack sudo[104052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-a6a25b2f-9e5f-450b-b34c-d51cb28451b4 Nov 06 11:57:40 devstack sudo[104052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:57:40 devstack sudo[104053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-677efbb6-746f-426f-9010-b50047e593aa Nov 06 11:57:40 devstack sudo[104053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:57:40 devstack sudo[104052]: pam_unix(sudo:session): session closed for user root Nov 06 11:57:40 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-794aacb2-6b62-47f4-90c2-dc870bdde305 tempest-CinderUnicodeTest-1042787105 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-a6a25b2f-9e5f-450b-b34c-d51cb28451b4" returned: 0 in 0.631s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:57:40 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-794aacb2-6b62-47f4-90c2-dc870bdde305 tempest-CinderUnicodeTest-1042787105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-a6a25b2f-9e5f-450b-b34c-d51cb28451b4.d14b40f7-da04-4f66-bc32-ef3f1348f2e1 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:57:40 devstack sudo[104062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-a6a25b2f-9e5f-450b-b34c-d51cb28451b4.d14b40f7-da04-4f66-bc32-ef3f1348f2e1 Nov 06 11:57:40 devstack sudo[104062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:57:40 devstack sudo[104053]: pam_unix(sudo:session): session closed for user root Nov 06 11:57:40 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-cba4111b-f40d-4ae6-9474-deb90c668f84 tempest-ProjectReaderTests-1213314159 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-677efbb6-746f-426f-9010-b50047e593aa" returned: 0 in 0.551s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:57:40 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-cba4111b-f40d-4ae6-9474-deb90c668f84 tempest-ProjectReaderTests-1213314159 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-677efbb6-746f-426f-9010-b50047e593aa {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:57:40 devstack sudo[104064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-677efbb6-746f-426f-9010-b50047e593aa Nov 06 11:57:40 devstack sudo[104064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:57:41 devstack sudo[104064]: pam_unix(sudo:session): session closed for user root Nov 06 11:57:41 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-cba4111b-f40d-4ae6-9474-deb90c668f84 tempest-ProjectReaderTests-1213314159 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-677efbb6-746f-426f-9010-b50047e593aa" returned: 0 in 0.318s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:57:41 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-cba4111b-f40d-4ae6-9474-deb90c668f84 tempest-ProjectReaderTests-1213314159 None] Lock "cinder-quobyte-677efbb6-746f-426f-9010-b50047e593aa" released by "delete_volume" :: held 0.947s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 11:57:41 devstack sudo[104062]: pam_unix(sudo:session): session closed for user root Nov 06 11:57:41 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-794aacb2-6b62-47f4-90c2-dc870bdde305 tempest-CinderUnicodeTest-1042787105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-a6a25b2f-9e5f-450b-b34c-d51cb28451b4.d14b40f7-da04-4f66-bc32-ef3f1348f2e1" returned: 0 in 0.491s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:57:41 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-794aacb2-6b62-47f4-90c2-dc870bdde305 tempest-CinderUnicodeTest-1042787105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-a6a25b2f-9e5f-450b-b34c-d51cb28451b4.d14b40f7-da04-4f66-bc32-ef3f1348f2e1 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:57:41 devstack cinder-volume[87116]: DEBUG cinder.quota [None req-cba4111b-f40d-4ae6-9474-deb90c668f84 tempest-ProjectReaderTests-1213314159 None] Created reservations ['5f25934a-cd56-4758-941f-fe9d2d0385eb', '5664b582-ac67-49b9-8171-e9149d9fe6f0', 'c1f9571f-28f0-4655-a67a-f17fc89e89cf', '9a619ffa-c77d-4b77-97fa-c76a976c8d89'] {{(pid=87116) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 11:57:41 devstack sudo[104071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-a6a25b2f-9e5f-450b-b34c-d51cb28451b4.d14b40f7-da04-4f66-bc32-ef3f1348f2e1 Nov 06 11:57:41 devstack sudo[104071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:57:41 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-cba4111b-f40d-4ae6-9474-deb90c668f84 tempest-ProjectReaderTests-1213314159 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 11:57:41 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-cba4111b-f40d-4ae6-9474-deb90c668f84 tempest-ProjectReaderTests-1213314159 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 11:57:41 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-cba4111b-f40d-4ae6-9474-deb90c668f84 tempest-ProjectReaderTests-1213314159 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 11:57:41 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-cba4111b-f40d-4ae6-9474-deb90c668f84 tempest-ProjectReaderTests-1213314159 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 11:57:41 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-cba4111b-f40d-4ae6-9474-deb90c668f84 tempest-ProjectReaderTests-1213314159 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 11:57:41 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-cba4111b-f40d-4ae6-9474-deb90c668f84 tempest-ProjectReaderTests-1213314159 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:57:41 devstack sudo[104073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756 Nov 06 11:57:41 devstack sudo[104073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:57:41 devstack sudo[104073]: pam_unix(sudo:session): session closed for user root Nov 06 11:57:41 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-cba4111b-f40d-4ae6-9474-deb90c668f84 tempest-ProjectReaderTests-1213314159 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756" returned: 0 in 0.334s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:57:41 devstack cinder-volume[87116]: DEBUG cinder.manager [None req-cba4111b-f40d-4ae6-9474-deb90c668f84 tempest-ProjectReaderTests-1213314159 None] Notifying Schedulers of capabilities ... {{(pid=87116) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 11:57:41 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-cba4111b-f40d-4ae6-9474-deb90c668f84 tempest-ProjectReaderTests-1213314159 None] Deleted volume successfully. Nov 06 11:57:41 devstack sudo[104071]: pam_unix(sudo:session): session closed for user root Nov 06 11:57:41 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-794aacb2-6b62-47f4-90c2-dc870bdde305 tempest-CinderUnicodeTest-1042787105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-a6a25b2f-9e5f-450b-b34c-d51cb28451b4.d14b40f7-da04-4f66-bc32-ef3f1348f2e1" returned: 0 in 0.462s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:57:41 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-794aacb2-6b62-47f4-90c2-dc870bdde305 tempest-CinderUnicodeTest-1042787105 None] Lock "cinder-quobyte-d14b40f7-da04-4f66-bc32-ef3f1348f2e1" released by "_delete_snapshot" :: held 2.342s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 11:57:41 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-cba4111b-f40d-4ae6-9474-deb90c668f84 tempest-ProjectReaderTests-1213314159 None] Lock "cinder-677efbb6-746f-426f-9010-b50047e593aa-delete_volume" released by "delete_volume" :: held 1.646s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 11:57:41 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-794aacb2-6b62-47f4-90c2-dc870bdde305 tempest-CinderUnicodeTest-1042787105 None] Lock "cinder-quobyte-a6a25b2f-9e5f-450b-b34c-d51cb28451b4" released by "delete_snapshot" :: held 2.378s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 11:57:41 devstack cinder-volume[87116]: DEBUG cinder.quota [None req-794aacb2-6b62-47f4-90c2-dc870bdde305 tempest-CinderUnicodeTest-1042787105 None] Created reservations ['3b1775f0-83b8-4cc2-b0ec-fea8160ec29b', '9bce38d4-7e84-4bc4-93f1-aa7ea3f9bfe7', 'afc5a59e-706f-4ba8-992d-5333f95d64ee', '60bdcc89-e08c-4e64-8bc6-9aeb0e563353'] {{(pid=87116) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 11:57:41 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-794aacb2-6b62-47f4-90c2-dc870bdde305 tempest-CinderUnicodeTest-1042787105 None] Delete snapshot completed successfully. Nov 06 11:57:41 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-794aacb2-6b62-47f4-90c2-dc870bdde305 tempest-CinderUnicodeTest-1042787105 None] Lock "cinder-d14b40f7-da04-4f66-bc32-ef3f1348f2e1-delete_snapshot" released by "delete_snapshot" :: held 2.562s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 11:57:42 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-dbb7b995-32ae-4c28-8698-bc3280934458 tempest-CinderUnicodeTest-1042787105 None] Acquiring lock "cinder-a6a25b2f-9e5f-450b-b34c-d51cb28451b4-delete_volume" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 11:57:43 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-dbb7b995-32ae-4c28-8698-bc3280934458 tempest-CinderUnicodeTest-1042787105 None] Lock "cinder-a6a25b2f-9e5f-450b-b34c-d51cb28451b4-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 11:57:43 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-dbb7b995-32ae-4c28-8698-bc3280934458 tempest-CinderUnicodeTest-1042787105 None] Acquiring lock "cinder-quobyte-a6a25b2f-9e5f-450b-b34c-d51cb28451b4" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 11:57:43 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-dbb7b995-32ae-4c28-8698-bc3280934458 tempest-CinderUnicodeTest-1042787105 None] Lock "cinder-quobyte-a6a25b2f-9e5f-450b-b34c-d51cb28451b4" acquired by "delete_volume" :: waited 0.021s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 11:57:43 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[03ad2c0d-228a-41fb-baed-f7f6f0f8ca4c]: (4, 'qcow2') {{(pid=88420) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 11:57:43 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-dbb7b995-32ae-4c28-8698-bc3280934458 tempest-CinderUnicodeTest-1042787105 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-a6a25b2f-9e5f-450b-b34c-d51cb28451b4 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:57:43 devstack cinder-volume[87116]: DEBUG cinder.volume.flows.manager.create_volume [None req-8a0b659e-0a63-4d7c-aa6d-923def39db13 tempest-ProjectReaderTests-1213314159 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87116) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 11:57:43 devstack sudo[104078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-a6a25b2f-9e5f-450b-b34c-d51cb28451b4 Nov 06 11:57:43 devstack sudo[104078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:57:43 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-8a0b659e-0a63-4d7c-aa6d-923def39db13 tempest-ProjectReaderTests-1213314159 None] Flow 'volume_create_manager' (9ea3d80e-5afd-4fc6-93f5-305b5d49269f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 11:57:43 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-8a0b659e-0a63-4d7c-aa6d-923def39db13 tempest-ProjectReaderTests-1213314159 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a926a70-8a08-4344-a6de-300a126d8e9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:57:43 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-8a0b659e-0a63-4d7c-aa6d-923def39db13 tempest-ProjectReaderTests-1213314159 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a926a70-8a08-4344-a6de-300a126d8e9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T10:57:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1730927233',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bb678686-cb0a-4334-9f4c-e758fcc8d9e8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dad66e9c5e0f4b4d9b2cadfd48e6f4a0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T10:57:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T10:57:43Z,use_quota=True,user_id='9fd41617bad94a1893cda6310db71f37',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(34d3b144-d9b7-480a-a2e3-01e45f3d54c1),volume_type_id=34d3b144-d9b7-480a-a2e3-01e45f3d54c1)' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:57:43 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-8a0b659e-0a63-4d7c-aa6d-923def39db13 tempest-ProjectReaderTests-1213314159 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0ad12b6d-4f4f-41ec-8b9c-335d9061b825) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:57:43 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-8a0b659e-0a63-4d7c-aa6d-923def39db13 tempest-ProjectReaderTests-1213314159 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0ad12b6d-4f4f-41ec-8b9c-335d9061b825) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:57:43 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-8a0b659e-0a63-4d7c-aa6d-923def39db13 tempest-ProjectReaderTests-1213314159 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b00e799b-af84-4a7e-a2d0-3c63f618281f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:57:43 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-8a0b659e-0a63-4d7c-aa6d-923def39db13 tempest-ProjectReaderTests-1213314159 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b00e799b-af84-4a7e-a2d0-3c63f618281f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bb678686-cb0a-4334-9f4c-e758fcc8d9e8', 'volume_name': 'volume-bb678686-cb0a-4334-9f4c-e758fcc8d9e8', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:57:43 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-8a0b659e-0a63-4d7c-aa6d-923def39db13 tempest-ProjectReaderTests-1213314159 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7d8a22d3-d9d0-416e-a806-022c362697fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:57:43 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-8a0b659e-0a63-4d7c-aa6d-923def39db13 tempest-ProjectReaderTests-1213314159 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7d8a22d3-d9d0-416e-a806-022c362697fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:57:43 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-8a0b659e-0a63-4d7c-aa6d-923def39db13 tempest-ProjectReaderTests-1213314159 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9785d4cc-1999-4d46-b1e9-6dda6a8e4a5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:57:43 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-8a0b659e-0a63-4d7c-aa6d-923def39db13 tempest-ProjectReaderTests-1213314159 None] Volume bb678686-cb0a-4334-9f4c-e758fcc8d9e8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bb678686-cb0a-4334-9f4c-e758fcc8d9e8', 'volume_size': 1} Nov 06 11:57:43 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-8a0b659e-0a63-4d7c-aa6d-923def39db13 tempest-ProjectReaderTests-1213314159 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 11:57:43 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-8a0b659e-0a63-4d7c-aa6d-923def39db13 tempest-ProjectReaderTests-1213314159 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 11:57:43 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-8a0b659e-0a63-4d7c-aa6d-923def39db13 tempest-ProjectReaderTests-1213314159 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T10:57:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1730927233',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bb678686-cb0a-4334-9f4c-e758fcc8d9e8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dad66e9c5e0f4b4d9b2cadfd48e6f4a0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T10:57:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T10:57:43Z,use_quota=True,user_id='9fd41617bad94a1893cda6310db71f37',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(34d3b144-d9b7-480a-a2e3-01e45f3d54c1),volume_type_id=34d3b144-d9b7-480a-a2e3-01e45f3d54c1)}" {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 11:57:43 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-8a0b659e-0a63-4d7c-aa6d-923def39db13 tempest-ProjectReaderTests-1213314159 None] Creating volume bb678686-cb0a-4334-9f4c-e758fcc8d9e8 {{(pid=87116) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 11:57:43 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-8a0b659e-0a63-4d7c-aa6d-923def39db13 tempest-ProjectReaderTests-1213314159 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 11:57:43 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-8a0b659e-0a63-4d7c-aa6d-923def39db13 tempest-ProjectReaderTests-1213314159 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 11:57:43 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-8a0b659e-0a63-4d7c-aa6d-923def39db13 tempest-ProjectReaderTests-1213314159 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 11:57:43 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-8a0b659e-0a63-4d7c-aa6d-923def39db13 tempest-ProjectReaderTests-1213314159 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 11:57:43 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-8a0b659e-0a63-4d7c-aa6d-923def39db13 tempest-ProjectReaderTests-1213314159 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 11:57:43 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-8a0b659e-0a63-4d7c-aa6d-923def39db13 tempest-ProjectReaderTests-1213314159 None] Selected osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f as target Quobyte volume. {{(pid=87116) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 11:57:43 devstack cinder-volume[87116]: INFO cinder.volume.drivers.remotefs [None req-8a0b659e-0a63-4d7c-aa6d-923def39db13 tempest-ProjectReaderTests-1213314159 None] casted to osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f Nov 06 11:57:43 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-8a0b659e-0a63-4d7c-aa6d-923def39db13 tempest-ProjectReaderTests-1213314159 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-bb678686-cb0a-4334-9f4c-e758fcc8d9e8 1073741824 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:57:43 devstack sudo[104080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-bb678686-cb0a-4334-9f4c-e758fcc8d9e8 1073741824 Nov 06 11:57:43 devstack sudo[104080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:57:43 devstack sudo[104078]: pam_unix(sudo:session): session closed for user root Nov 06 11:57:43 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-dbb7b995-32ae-4c28-8698-bc3280934458 tempest-CinderUnicodeTest-1042787105 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-a6a25b2f-9e5f-450b-b34c-d51cb28451b4" returned: 0 in 0.532s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:57:43 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-dbb7b995-32ae-4c28-8698-bc3280934458 tempest-CinderUnicodeTest-1042787105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-a6a25b2f-9e5f-450b-b34c-d51cb28451b4 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:57:43 devstack sudo[104089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-a6a25b2f-9e5f-450b-b34c-d51cb28451b4 Nov 06 11:57:43 devstack sudo[104089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:57:44 devstack sudo[104080]: pam_unix(sudo:session): session closed for user root Nov 06 11:57:44 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-8a0b659e-0a63-4d7c-aa6d-923def39db13 tempest-ProjectReaderTests-1213314159 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-bb678686-cb0a-4334-9f4c-e758fcc8d9e8 1073741824" returned: 0 in 0.616s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:57:44 devstack sudo[104089]: pam_unix(sudo:session): session closed for user root Nov 06 11:57:44 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-dbb7b995-32ae-4c28-8698-bc3280934458 tempest-CinderUnicodeTest-1042787105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-a6a25b2f-9e5f-450b-b34c-d51cb28451b4" returned: 0 in 0.346s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:57:44 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-dbb7b995-32ae-4c28-8698-bc3280934458 tempest-CinderUnicodeTest-1042787105 None] Lock "cinder-quobyte-a6a25b2f-9e5f-450b-b34c-d51cb28451b4" released by "delete_volume" :: held 1.020s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 11:57:44 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-8a0b659e-0a63-4d7c-aa6d-923def39db13 tempest-ProjectReaderTests-1213314159 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-bb678686-cb0a-4334-9f4c-e758fcc8d9e8 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:57:44 devstack sudo[104096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-bb678686-cb0a-4334-9f4c-e758fcc8d9e8 Nov 06 11:57:44 devstack sudo[104096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:57:44 devstack cinder-volume[87116]: DEBUG cinder.quota [None req-dbb7b995-32ae-4c28-8698-bc3280934458 tempest-CinderUnicodeTest-1042787105 None] Created reservations ['ef530a2f-4f03-4347-9ab1-d1ccb5c4902c', '3d07c52d-0981-4312-8f97-c54cebfafb6b', '6115e0b8-783b-41d2-b423-26110303e08b', 'c2055fbe-f32c-444d-8abe-2edbc1113e2f'] {{(pid=87116) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 11:57:44 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-dbb7b995-32ae-4c28-8698-bc3280934458 tempest-CinderUnicodeTest-1042787105 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 11:57:44 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-dbb7b995-32ae-4c28-8698-bc3280934458 tempest-CinderUnicodeTest-1042787105 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 11:57:44 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-dbb7b995-32ae-4c28-8698-bc3280934458 tempest-CinderUnicodeTest-1042787105 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 11:57:44 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-dbb7b995-32ae-4c28-8698-bc3280934458 tempest-CinderUnicodeTest-1042787105 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 11:57:44 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-dbb7b995-32ae-4c28-8698-bc3280934458 tempest-CinderUnicodeTest-1042787105 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 11:57:44 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-dbb7b995-32ae-4c28-8698-bc3280934458 tempest-CinderUnicodeTest-1042787105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:57:44 devstack sudo[104098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756 Nov 06 11:57:44 devstack sudo[104098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:57:44 devstack sudo[104096]: pam_unix(sudo:session): session closed for user root Nov 06 11:57:44 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-8a0b659e-0a63-4d7c-aa6d-923def39db13 tempest-ProjectReaderTests-1213314159 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-bb678686-cb0a-4334-9f4c-e758fcc8d9e8" returned: 0 in 0.418s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:57:44 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-8a0b659e-0a63-4d7c-aa6d-923def39db13 tempest-ProjectReaderTests-1213314159 None] <== create_volume: return (1151ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f'} {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 11:57:44 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-8a0b659e-0a63-4d7c-aa6d-923def39db13 tempest-ProjectReaderTests-1213314159 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.155s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 11:57:44 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-8a0b659e-0a63-4d7c-aa6d-923def39db13 tempest-ProjectReaderTests-1213314159 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9785d4cc-1999-4d46-b1e9-6dda6a8e4a5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bb678686-cb0a-4334-9f4c-e758fcc8d9e8', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:57:44 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-8a0b659e-0a63-4d7c-aa6d-923def39db13 tempest-ProjectReaderTests-1213314159 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (34f397dd-535b-4e0a-bbb1-b6a0244a94aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:57:44 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-8a0b659e-0a63-4d7c-aa6d-923def39db13 tempest-ProjectReaderTests-1213314159 None] Volume volume-bb678686-cb0a-4334-9f4c-e758fcc8d9e8 (bb678686-cb0a-4334-9f4c-e758fcc8d9e8): created successfully Nov 06 11:57:44 devstack sudo[104098]: pam_unix(sudo:session): session closed for user root Nov 06 11:57:44 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-8a0b659e-0a63-4d7c-aa6d-923def39db13 tempest-ProjectReaderTests-1213314159 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (34f397dd-535b-4e0a-bbb1-b6a0244a94aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:57:44 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-8a0b659e-0a63-4d7c-aa6d-923def39db13 tempest-ProjectReaderTests-1213314159 None] Flow 'volume_create_manager' (9ea3d80e-5afd-4fc6-93f5-305b5d49269f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 11:57:44 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-dbb7b995-32ae-4c28-8698-bc3280934458 tempest-CinderUnicodeTest-1042787105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756" returned: 0 in 0.308s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:57:44 devstack cinder-volume[87116]: DEBUG cinder.manager [None req-dbb7b995-32ae-4c28-8698-bc3280934458 tempest-CinderUnicodeTest-1042787105 None] Notifying Schedulers of capabilities ... {{(pid=87116) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 11:57:44 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-dbb7b995-32ae-4c28-8698-bc3280934458 tempest-CinderUnicodeTest-1042787105 None] Deleted volume successfully. Nov 06 11:57:44 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-8a0b659e-0a63-4d7c-aa6d-923def39db13 tempest-ProjectReaderTests-1213314159 None] Created volume successfully. Nov 06 11:57:44 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-dbb7b995-32ae-4c28-8698-bc3280934458 tempest-CinderUnicodeTest-1042787105 None] Lock "cinder-a6a25b2f-9e5f-450b-b34c-d51cb28451b4-delete_volume" released by "delete_volume" :: held 1.681s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 11:57:45 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [req-2a37fca0-e7eb-46a0-995e-c418369f30e0 req-ef627686-3f84-45d4-bdfe-496e98cf3759 tempest-TestServerVolumeAttachmentScenario-1898122559 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 11:57:45 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [req-2a37fca0-e7eb-46a0-995e-c418369f30e0 req-ef627686-3f84-45d4-bdfe-496e98cf3759 tempest-TestServerVolumeAttachmentScenario-1898122559 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 11:57:45 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [req-2a37fca0-e7eb-46a0-995e-c418369f30e0 req-ef627686-3f84-45d4-bdfe-496e98cf3759 tempest-TestServerVolumeAttachmentScenario-1898122559 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.017s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 11:57:45 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [req-2a37fca0-e7eb-46a0-995e-c418369f30e0 req-ef627686-3f84-45d4-bdfe-496e98cf3759 tempest-TestServerVolumeAttachmentScenario-1898122559 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f', 'name': 'volume-9adf6376-224f-4d46-b887-706ec7d6b79a', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '9234a4a4-afa6-490b-b907-428563c4e231', 'enforce_multipath': True} {{(pid=87116) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 06 11:57:45 devstack cinder-volume[87116]: INFO cinder.volume.manager [req-2a37fca0-e7eb-46a0-995e-c418369f30e0 req-ef627686-3f84-45d4-bdfe-496e98cf3759 tempest-TestServerVolumeAttachmentScenario-1898122559 None] attachment_update completed successfully. Nov 06 11:57:45 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-50832f21-f11e-4e86-8482-a41bc994f593 tempest-ProjectReaderTests-1213314159 None] Acquiring lock "cinder-bb678686-cb0a-4334-9f4c-e758fcc8d9e8-delete_volume" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 11:57:45 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-50832f21-f11e-4e86-8482-a41bc994f593 tempest-ProjectReaderTests-1213314159 None] Lock "cinder-bb678686-cb0a-4334-9f4c-e758fcc8d9e8-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 11:57:45 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-50832f21-f11e-4e86-8482-a41bc994f593 tempest-ProjectReaderTests-1213314159 None] Acquiring lock "cinder-quobyte-bb678686-cb0a-4334-9f4c-e758fcc8d9e8" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 11:57:45 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-50832f21-f11e-4e86-8482-a41bc994f593 tempest-ProjectReaderTests-1213314159 None] Lock "cinder-quobyte-bb678686-cb0a-4334-9f4c-e758fcc8d9e8" acquired by "delete_volume" :: waited 0.037s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 11:57:45 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-0767874c-c58d-42d2-8bea-c58fe487cb07 tempest-CinderUnicodeTest-1042787105 None] Acquiring lock "cinder-a64bf327-bc87-47b1-9566-cd992fc46f88-delete_volume" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 11:57:45 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e69c81e-1d05-4de1-af6c-4b618493c360]: (4, 'qcow2') {{(pid=88420) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 11:57:45 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-50832f21-f11e-4e86-8482-a41bc994f593 tempest-ProjectReaderTests-1213314159 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-bb678686-cb0a-4334-9f4c-e758fcc8d9e8 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:57:45 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-0767874c-c58d-42d2-8bea-c58fe487cb07 tempest-CinderUnicodeTest-1042787105 None] Lock "cinder-a64bf327-bc87-47b1-9566-cd992fc46f88-delete_volume" acquired by "delete_volume" :: waited 0.062s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 11:57:45 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-0767874c-c58d-42d2-8bea-c58fe487cb07 tempest-CinderUnicodeTest-1042787105 None] Acquiring lock "cinder-quobyte-a64bf327-bc87-47b1-9566-cd992fc46f88" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 11:57:45 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-0767874c-c58d-42d2-8bea-c58fe487cb07 tempest-CinderUnicodeTest-1042787105 None] Lock "cinder-quobyte-a64bf327-bc87-47b1-9566-cd992fc46f88" acquired by "delete_volume" :: waited 0.035s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 11:57:45 devstack sudo[104112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-bb678686-cb0a-4334-9f4c-e758fcc8d9e8 Nov 06 11:57:45 devstack sudo[104112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:57:45 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[77ff9866-4f39-4c48-ba78-b9d7dbc891b1]: (4, 'qcow2') {{(pid=88420) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 11:57:45 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-0767874c-c58d-42d2-8bea-c58fe487cb07 tempest-CinderUnicodeTest-1042787105 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-a64bf327-bc87-47b1-9566-cd992fc46f88 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:57:46 devstack sudo[104114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-a64bf327-bc87-47b1-9566-cd992fc46f88 Nov 06 11:57:46 devstack sudo[104114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:57:46 devstack sudo[104112]: pam_unix(sudo:session): session closed for user root Nov 06 11:57:46 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-50832f21-f11e-4e86-8482-a41bc994f593 tempest-ProjectReaderTests-1213314159 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-bb678686-cb0a-4334-9f4c-e758fcc8d9e8" returned: 0 in 0.771s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:57:46 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-50832f21-f11e-4e86-8482-a41bc994f593 tempest-ProjectReaderTests-1213314159 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-bb678686-cb0a-4334-9f4c-e758fcc8d9e8 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:57:46 devstack sudo[104122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-bb678686-cb0a-4334-9f4c-e758fcc8d9e8 Nov 06 11:57:46 devstack sudo[104122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:57:46 devstack sudo[104114]: pam_unix(sudo:session): session closed for user root Nov 06 11:57:46 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-0767874c-c58d-42d2-8bea-c58fe487cb07 tempest-CinderUnicodeTest-1042787105 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-a64bf327-bc87-47b1-9566-cd992fc46f88" returned: 0 in 0.534s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:57:46 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-0767874c-c58d-42d2-8bea-c58fe487cb07 tempest-CinderUnicodeTest-1042787105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-a64bf327-bc87-47b1-9566-cd992fc46f88 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:57:46 devstack sudo[104125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-a64bf327-bc87-47b1-9566-cd992fc46f88 Nov 06 11:57:46 devstack sudo[104125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:57:46 devstack sudo[104122]: pam_unix(sudo:session): session closed for user root Nov 06 11:57:46 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-50832f21-f11e-4e86-8482-a41bc994f593 tempest-ProjectReaderTests-1213314159 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-bb678686-cb0a-4334-9f4c-e758fcc8d9e8" returned: 0 in 0.339s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:57:46 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-50832f21-f11e-4e86-8482-a41bc994f593 tempest-ProjectReaderTests-1213314159 None] Lock "cinder-quobyte-bb678686-cb0a-4334-9f4c-e758fcc8d9e8" released by "delete_volume" :: held 1.200s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 11:57:46 devstack sudo[104125]: pam_unix(sudo:session): session closed for user root Nov 06 11:57:46 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-0767874c-c58d-42d2-8bea-c58fe487cb07 tempest-CinderUnicodeTest-1042787105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-a64bf327-bc87-47b1-9566-cd992fc46f88" returned: 0 in 0.289s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:57:46 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-0767874c-c58d-42d2-8bea-c58fe487cb07 tempest-CinderUnicodeTest-1042787105 None] Lock "cinder-quobyte-a64bf327-bc87-47b1-9566-cd992fc46f88" released by "delete_volume" :: held 0.928s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 11:57:46 devstack cinder-volume[87116]: DEBUG cinder.quota [None req-50832f21-f11e-4e86-8482-a41bc994f593 tempest-ProjectReaderTests-1213314159 None] Created reservations ['47b1a777-e454-436d-9dd6-54fea0d51a02', '98c6a88a-b051-4475-9588-41c5c5553bff', 'd74bd748-736b-4194-9dbe-a6ad9acc9d52', '8b3caf56-4792-4932-88c4-5639171a4309'] {{(pid=87116) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 11:57:47 devstack cinder-volume[87116]: DEBUG cinder.quota [None req-0767874c-c58d-42d2-8bea-c58fe487cb07 tempest-CinderUnicodeTest-1042787105 None] Created reservations ['baf33b47-8929-4b3b-b133-d9a97238cd54', '8b18fe98-d7b8-4ae2-9b1a-b0af34df3fcf', 'b2a0ca95-4f0a-4005-b523-b9103e165566', '7f805849-ef22-416e-8f5f-379b119cc064'] {{(pid=87116) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 11:57:47 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-50832f21-f11e-4e86-8482-a41bc994f593 tempest-ProjectReaderTests-1213314159 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 11:57:47 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-50832f21-f11e-4e86-8482-a41bc994f593 tempest-ProjectReaderTests-1213314159 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 11:57:47 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-50832f21-f11e-4e86-8482-a41bc994f593 tempest-ProjectReaderTests-1213314159 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 11:57:47 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-50832f21-f11e-4e86-8482-a41bc994f593 tempest-ProjectReaderTests-1213314159 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 11:57:47 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-50832f21-f11e-4e86-8482-a41bc994f593 tempest-ProjectReaderTests-1213314159 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 11:57:47 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-50832f21-f11e-4e86-8482-a41bc994f593 tempest-ProjectReaderTests-1213314159 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:57:47 devstack sudo[104129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756 Nov 06 11:57:47 devstack sudo[104129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:57:47 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-0767874c-c58d-42d2-8bea-c58fe487cb07 tempest-CinderUnicodeTest-1042787105 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 11:57:47 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-0767874c-c58d-42d2-8bea-c58fe487cb07 tempest-CinderUnicodeTest-1042787105 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 11:57:47 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-0767874c-c58d-42d2-8bea-c58fe487cb07 tempest-CinderUnicodeTest-1042787105 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 11:57:47 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-0767874c-c58d-42d2-8bea-c58fe487cb07 tempest-CinderUnicodeTest-1042787105 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 11:57:47 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-0767874c-c58d-42d2-8bea-c58fe487cb07 tempest-CinderUnicodeTest-1042787105 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 11:57:47 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-0767874c-c58d-42d2-8bea-c58fe487cb07 tempest-CinderUnicodeTest-1042787105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:57:47 devstack sudo[104131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756 Nov 06 11:57:47 devstack sudo[104131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:57:47 devstack sudo[104129]: pam_unix(sudo:session): session closed for user root Nov 06 11:57:47 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-50832f21-f11e-4e86-8482-a41bc994f593 tempest-ProjectReaderTests-1213314159 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756" returned: 0 in 0.362s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:57:47 devstack cinder-volume[87116]: DEBUG cinder.manager [None req-50832f21-f11e-4e86-8482-a41bc994f593 tempest-ProjectReaderTests-1213314159 None] Notifying Schedulers of capabilities ... {{(pid=87116) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 11:57:47 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-50832f21-f11e-4e86-8482-a41bc994f593 tempest-ProjectReaderTests-1213314159 None] Deleted volume successfully. Nov 06 11:57:47 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-50832f21-f11e-4e86-8482-a41bc994f593 tempest-ProjectReaderTests-1213314159 None] Lock "cinder-bb678686-cb0a-4334-9f4c-e758fcc8d9e8-delete_volume" released by "delete_volume" :: held 2.156s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 11:57:47 devstack sudo[104131]: pam_unix(sudo:session): session closed for user root Nov 06 11:57:47 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-0767874c-c58d-42d2-8bea-c58fe487cb07 tempest-CinderUnicodeTest-1042787105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756" returned: 0 in 0.388s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:57:47 devstack cinder-volume[87116]: DEBUG cinder.manager [None req-0767874c-c58d-42d2-8bea-c58fe487cb07 tempest-CinderUnicodeTest-1042787105 None] Notifying Schedulers of capabilities ... {{(pid=87116) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 11:57:47 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-0767874c-c58d-42d2-8bea-c58fe487cb07 tempest-CinderUnicodeTest-1042787105 None] Deleted volume successfully. Nov 06 11:57:47 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-0767874c-c58d-42d2-8bea-c58fe487cb07 tempest-CinderUnicodeTest-1042787105 None] Lock "cinder-a64bf327-bc87-47b1-9566-cd992fc46f88-delete_volume" released by "delete_volume" :: held 2.005s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 11:57:47 devstack cinder-volume[87116]: INFO cinder.volume.manager [req-8dda0a94-e94a-4b7d-bb46-a01059df427e req-a8e875e8-b491-496b-a1a0-acc1629873e6 tempest-TestServerVolumeAttachmentScenario-1898122559 None] Terminate volume connection completed successfully. Nov 06 11:57:47 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [req-8dda0a94-e94a-4b7d-bb46-a01059df427e req-a8e875e8-b491-496b-a1a0-acc1629873e6 tempest-TestServerVolumeAttachmentScenario-1898122559 None] Deleting attachment 9234a4a4-afa6-490b-b907-428563c4e231. {{(pid=87116) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 06 11:57:48 devstack cinder-volume[87116]: DEBUG cinder.volume.flows.manager.create_volume [None req-d940bab6-d62f-4be8-8100-0edf0368394c tempest-ProjectReaderTests-1213314159 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87116) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 11:57:48 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-d940bab6-d62f-4be8-8100-0edf0368394c tempest-ProjectReaderTests-1213314159 None] Flow 'volume_create_manager' (7d253bba-7194-4802-b544-0a58f9a74d36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 11:57:48 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-d940bab6-d62f-4be8-8100-0edf0368394c tempest-ProjectReaderTests-1213314159 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c916dbd6-d5b8-4400-9562-1b4efb258745) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:57:48 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-d940bab6-d62f-4be8-8100-0edf0368394c tempest-ProjectReaderTests-1213314159 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c916dbd6-d5b8-4400-9562-1b4efb258745) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T10:57:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1288119787',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aa682740-e1e0-4637-ba6d-26a67b852f3c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dad66e9c5e0f4b4d9b2cadfd48e6f4a0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T10:57:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T10:57:48Z,use_quota=True,user_id='9fd41617bad94a1893cda6310db71f37',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(34d3b144-d9b7-480a-a2e3-01e45f3d54c1),volume_type_id=34d3b144-d9b7-480a-a2e3-01e45f3d54c1)' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:57:48 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-d940bab6-d62f-4be8-8100-0edf0368394c tempest-ProjectReaderTests-1213314159 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0921cb04-d967-4b6d-a84d-dcdf5c8f7d57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:57:48 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-d940bab6-d62f-4be8-8100-0edf0368394c tempest-ProjectReaderTests-1213314159 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0921cb04-d967-4b6d-a84d-dcdf5c8f7d57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:57:48 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-d940bab6-d62f-4be8-8100-0edf0368394c tempest-ProjectReaderTests-1213314159 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ba0829a2-d8f9-460a-9d8f-728709e7bb20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:57:48 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-d940bab6-d62f-4be8-8100-0edf0368394c tempest-ProjectReaderTests-1213314159 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ba0829a2-d8f9-460a-9d8f-728709e7bb20) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'aa682740-e1e0-4637-ba6d-26a67b852f3c', 'volume_name': 'volume-aa682740-e1e0-4637-ba6d-26a67b852f3c', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:57:48 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-d940bab6-d62f-4be8-8100-0edf0368394c tempest-ProjectReaderTests-1213314159 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (695fc8de-69d9-45b2-89f6-ab3203bf3aab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:57:48 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-d940bab6-d62f-4be8-8100-0edf0368394c tempest-ProjectReaderTests-1213314159 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (695fc8de-69d9-45b2-89f6-ab3203bf3aab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:57:48 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-d940bab6-d62f-4be8-8100-0edf0368394c tempest-ProjectReaderTests-1213314159 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3560d8f1-6ce0-4d17-b14e-912442c48983) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:57:48 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-d940bab6-d62f-4be8-8100-0edf0368394c tempest-ProjectReaderTests-1213314159 None] Volume aa682740-e1e0-4637-ba6d-26a67b852f3c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-aa682740-e1e0-4637-ba6d-26a67b852f3c', 'volume_size': 1} Nov 06 11:57:48 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-d940bab6-d62f-4be8-8100-0edf0368394c tempest-ProjectReaderTests-1213314159 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 11:57:48 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-d940bab6-d62f-4be8-8100-0edf0368394c tempest-ProjectReaderTests-1213314159 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 11:57:48 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-d940bab6-d62f-4be8-8100-0edf0368394c tempest-ProjectReaderTests-1213314159 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T10:57:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1288119787',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aa682740-e1e0-4637-ba6d-26a67b852f3c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dad66e9c5e0f4b4d9b2cadfd48e6f4a0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T10:57:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T10:57:48Z,use_quota=True,user_id='9fd41617bad94a1893cda6310db71f37',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(34d3b144-d9b7-480a-a2e3-01e45f3d54c1),volume_type_id=34d3b144-d9b7-480a-a2e3-01e45f3d54c1)}" {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 11:57:48 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-d940bab6-d62f-4be8-8100-0edf0368394c tempest-ProjectReaderTests-1213314159 None] Creating volume aa682740-e1e0-4637-ba6d-26a67b852f3c {{(pid=87116) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 11:57:48 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-d940bab6-d62f-4be8-8100-0edf0368394c tempest-ProjectReaderTests-1213314159 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 11:57:48 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-d940bab6-d62f-4be8-8100-0edf0368394c tempest-ProjectReaderTests-1213314159 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 11:57:48 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-d940bab6-d62f-4be8-8100-0edf0368394c tempest-ProjectReaderTests-1213314159 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 11:57:48 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-d940bab6-d62f-4be8-8100-0edf0368394c tempest-ProjectReaderTests-1213314159 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 11:57:48 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-d940bab6-d62f-4be8-8100-0edf0368394c tempest-ProjectReaderTests-1213314159 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 11:57:48 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-d940bab6-d62f-4be8-8100-0edf0368394c tempest-ProjectReaderTests-1213314159 None] Selected osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f as target Quobyte volume. {{(pid=87116) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 11:57:48 devstack cinder-volume[87116]: INFO cinder.volume.drivers.remotefs [None req-d940bab6-d62f-4be8-8100-0edf0368394c tempest-ProjectReaderTests-1213314159 None] casted to osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f Nov 06 11:57:48 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-d940bab6-d62f-4be8-8100-0edf0368394c tempest-ProjectReaderTests-1213314159 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-aa682740-e1e0-4637-ba6d-26a67b852f3c 1073741824 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:57:48 devstack sudo[104137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-aa682740-e1e0-4637-ba6d-26a67b852f3c 1073741824 Nov 06 11:57:48 devstack sudo[104137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:57:49 devstack sudo[104137]: pam_unix(sudo:session): session closed for user root Nov 06 11:57:49 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-d940bab6-d62f-4be8-8100-0edf0368394c tempest-ProjectReaderTests-1213314159 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-aa682740-e1e0-4637-ba6d-26a67b852f3c 1073741824" returned: 0 in 0.668s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:57:49 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-d940bab6-d62f-4be8-8100-0edf0368394c tempest-ProjectReaderTests-1213314159 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-aa682740-e1e0-4637-ba6d-26a67b852f3c {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:57:49 devstack sudo[104143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-aa682740-e1e0-4637-ba6d-26a67b852f3c Nov 06 11:57:49 devstack sudo[104143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:57:49 devstack sudo[104143]: pam_unix(sudo:session): session closed for user root Nov 06 11:57:49 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-d940bab6-d62f-4be8-8100-0edf0368394c tempest-ProjectReaderTests-1213314159 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-aa682740-e1e0-4637-ba6d-26a67b852f3c" returned: 0 in 0.383s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:57:49 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-d940bab6-d62f-4be8-8100-0edf0368394c tempest-ProjectReaderTests-1213314159 None] <== create_volume: return (1112ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f'} {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 11:57:49 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-d940bab6-d62f-4be8-8100-0edf0368394c tempest-ProjectReaderTests-1213314159 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.115s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 11:57:49 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-d940bab6-d62f-4be8-8100-0edf0368394c tempest-ProjectReaderTests-1213314159 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3560d8f1-6ce0-4d17-b14e-912442c48983) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aa682740-e1e0-4637-ba6d-26a67b852f3c', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:57:49 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-d940bab6-d62f-4be8-8100-0edf0368394c tempest-ProjectReaderTests-1213314159 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7c51840e-6c3f-477d-9ba0-a95194ea507a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:57:49 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-d940bab6-d62f-4be8-8100-0edf0368394c tempest-ProjectReaderTests-1213314159 None] Volume volume-aa682740-e1e0-4637-ba6d-26a67b852f3c (aa682740-e1e0-4637-ba6d-26a67b852f3c): created successfully Nov 06 11:57:49 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-d940bab6-d62f-4be8-8100-0edf0368394c tempest-ProjectReaderTests-1213314159 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7c51840e-6c3f-477d-9ba0-a95194ea507a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:57:49 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-d940bab6-d62f-4be8-8100-0edf0368394c tempest-ProjectReaderTests-1213314159 None] Flow 'volume_create_manager' (7d253bba-7194-4802-b544-0a58f9a74d36) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 11:57:49 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-d940bab6-d62f-4be8-8100-0edf0368394c tempest-ProjectReaderTests-1213314159 None] Created volume successfully. Nov 06 11:57:49 devstack cinder-volume[87116]: INFO cinder.volume.manager [req-2a238c69-fce6-4b47-8d83-82d47e055e74 req-89a0b110-3d76-440e-aa5e-ab2e3746593e tempest-TestServerVolumeAttachmentScenario-1898122559 None] Terminate volume connection completed successfully. Nov 06 11:57:49 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [req-2a238c69-fce6-4b47-8d83-82d47e055e74 req-89a0b110-3d76-440e-aa5e-ab2e3746593e tempest-TestServerVolumeAttachmentScenario-1898122559 None] Deleting attachment 6966b40b-7b24-40a3-a65e-34b9feaa2d5d. {{(pid=87116) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 06 11:57:50 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-e67a2bc8-34d6-4d05-829a-4d2ae22f9c7b tempest-ProjectReaderTests-1213314159 None] Acquiring lock "cinder-aa682740-e1e0-4637-ba6d-26a67b852f3c-delete_volume" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 11:57:50 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-e67a2bc8-34d6-4d05-829a-4d2ae22f9c7b tempest-ProjectReaderTests-1213314159 None] Lock "cinder-aa682740-e1e0-4637-ba6d-26a67b852f3c-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 11:57:50 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-e67a2bc8-34d6-4d05-829a-4d2ae22f9c7b tempest-ProjectReaderTests-1213314159 None] Acquiring lock "cinder-quobyte-aa682740-e1e0-4637-ba6d-26a67b852f3c" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 11:57:50 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-e67a2bc8-34d6-4d05-829a-4d2ae22f9c7b tempest-ProjectReaderTests-1213314159 None] Lock "cinder-quobyte-aa682740-e1e0-4637-ba6d-26a67b852f3c" acquired by "delete_volume" :: waited 0.018s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 11:57:50 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[d62b991f-4027-44b1-bf69-f3187fc3545c]: (4, 'qcow2') {{(pid=88420) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 11:57:50 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-e67a2bc8-34d6-4d05-829a-4d2ae22f9c7b tempest-ProjectReaderTests-1213314159 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-aa682740-e1e0-4637-ba6d-26a67b852f3c {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:57:50 devstack sudo[104175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-aa682740-e1e0-4637-ba6d-26a67b852f3c Nov 06 11:57:50 devstack sudo[104175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:57:50 devstack sudo[104175]: pam_unix(sudo:session): session closed for user root Nov 06 11:57:50 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-e67a2bc8-34d6-4d05-829a-4d2ae22f9c7b tempest-ProjectReaderTests-1213314159 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-aa682740-e1e0-4637-ba6d-26a67b852f3c" returned: 0 in 0.497s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:57:50 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-e67a2bc8-34d6-4d05-829a-4d2ae22f9c7b tempest-ProjectReaderTests-1213314159 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-aa682740-e1e0-4637-ba6d-26a67b852f3c {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:57:50 devstack sudo[104180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-aa682740-e1e0-4637-ba6d-26a67b852f3c Nov 06 11:57:50 devstack sudo[104180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:57:51 devstack sudo[104180]: pam_unix(sudo:session): session closed for user root Nov 06 11:57:51 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-e67a2bc8-34d6-4d05-829a-4d2ae22f9c7b tempest-ProjectReaderTests-1213314159 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-aa682740-e1e0-4637-ba6d-26a67b852f3c" returned: 0 in 0.386s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:57:51 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-e67a2bc8-34d6-4d05-829a-4d2ae22f9c7b tempest-ProjectReaderTests-1213314159 None] Lock "cinder-quobyte-aa682740-e1e0-4637-ba6d-26a67b852f3c" released by "delete_volume" :: held 0.939s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 11:57:51 devstack cinder-volume[87116]: DEBUG cinder.quota [None req-e67a2bc8-34d6-4d05-829a-4d2ae22f9c7b tempest-ProjectReaderTests-1213314159 None] Created reservations ['b4944bd6-9ce8-491c-841e-6d2943408f5b', 'a8217521-5720-4e0d-a6aa-61c5cf651575', '4694fde6-5535-4977-837b-56f07ce9e629', '58d721bd-28ee-4b2b-9cce-37e6c04abb15'] {{(pid=87116) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 11:57:51 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-e67a2bc8-34d6-4d05-829a-4d2ae22f9c7b tempest-ProjectReaderTests-1213314159 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 11:57:51 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-e67a2bc8-34d6-4d05-829a-4d2ae22f9c7b tempest-ProjectReaderTests-1213314159 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 11:57:51 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-e67a2bc8-34d6-4d05-829a-4d2ae22f9c7b tempest-ProjectReaderTests-1213314159 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 11:57:51 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-e67a2bc8-34d6-4d05-829a-4d2ae22f9c7b tempest-ProjectReaderTests-1213314159 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 11:57:51 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-e67a2bc8-34d6-4d05-829a-4d2ae22f9c7b tempest-ProjectReaderTests-1213314159 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 11:57:51 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-e67a2bc8-34d6-4d05-829a-4d2ae22f9c7b tempest-ProjectReaderTests-1213314159 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:57:51 devstack sudo[104202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756 Nov 06 11:57:51 devstack sudo[104202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:57:51 devstack sudo[104202]: pam_unix(sudo:session): session closed for user root Nov 06 11:57:51 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-e67a2bc8-34d6-4d05-829a-4d2ae22f9c7b tempest-ProjectReaderTests-1213314159 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756" returned: 0 in 0.334s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:57:51 devstack cinder-volume[87116]: DEBUG cinder.manager [None req-e67a2bc8-34d6-4d05-829a-4d2ae22f9c7b tempest-ProjectReaderTests-1213314159 None] Notifying Schedulers of capabilities ... {{(pid=87116) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 11:57:51 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-e67a2bc8-34d6-4d05-829a-4d2ae22f9c7b tempest-ProjectReaderTests-1213314159 None] Deleted volume successfully. Nov 06 11:57:51 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-e67a2bc8-34d6-4d05-829a-4d2ae22f9c7b tempest-ProjectReaderTests-1213314159 None] Lock "cinder-aa682740-e1e0-4637-ba6d-26a67b852f3c-delete_volume" released by "delete_volume" :: held 1.542s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 11:57:55 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-1f3189c7-3808-46d5-a07d-36bab8ba5c27 tempest-TestServerVolumeAttachmentScenario-1898122559 None] Acquiring lock "cinder-9adf6376-224f-4d46-b887-706ec7d6b79a-delete_volume" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 11:57:55 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-1f3189c7-3808-46d5-a07d-36bab8ba5c27 tempest-TestServerVolumeAttachmentScenario-1898122559 None] Lock "cinder-9adf6376-224f-4d46-b887-706ec7d6b79a-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 11:57:55 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-1f3189c7-3808-46d5-a07d-36bab8ba5c27 tempest-TestServerVolumeAttachmentScenario-1898122559 None] Acquiring lock "cinder-quobyte-9adf6376-224f-4d46-b887-706ec7d6b79a" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 11:57:55 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-1f3189c7-3808-46d5-a07d-36bab8ba5c27 tempest-TestServerVolumeAttachmentScenario-1898122559 None] Lock "cinder-quobyte-9adf6376-224f-4d46-b887-706ec7d6b79a" acquired by "delete_volume" :: waited 0.016s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 11:57:55 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e9f0ba1-9a00-46e9-99fd-d4b95ab35090]: (4, 'qcow2') {{(pid=88420) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 11:57:55 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-1f3189c7-3808-46d5-a07d-36bab8ba5c27 tempest-TestServerVolumeAttachmentScenario-1898122559 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-9adf6376-224f-4d46-b887-706ec7d6b79a {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:57:55 devstack sudo[104211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-9adf6376-224f-4d46-b887-706ec7d6b79a Nov 06 11:57:55 devstack sudo[104211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:57:56 devstack sudo[104211]: pam_unix(sudo:session): session closed for user root Nov 06 11:57:56 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-1f3189c7-3808-46d5-a07d-36bab8ba5c27 tempest-TestServerVolumeAttachmentScenario-1898122559 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-9adf6376-224f-4d46-b887-706ec7d6b79a" returned: 0 in 0.382s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:57:56 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-1f3189c7-3808-46d5-a07d-36bab8ba5c27 tempest-TestServerVolumeAttachmentScenario-1898122559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-9adf6376-224f-4d46-b887-706ec7d6b79a {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:57:56 devstack sudo[104217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-9adf6376-224f-4d46-b887-706ec7d6b79a Nov 06 11:57:56 devstack sudo[104217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:57:56 devstack sudo[104217]: pam_unix(sudo:session): session closed for user root Nov 06 11:57:56 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-1f3189c7-3808-46d5-a07d-36bab8ba5c27 tempest-TestServerVolumeAttachmentScenario-1898122559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-9adf6376-224f-4d46-b887-706ec7d6b79a" returned: 0 in 0.254s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:57:56 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-1f3189c7-3808-46d5-a07d-36bab8ba5c27 tempest-TestServerVolumeAttachmentScenario-1898122559 None] Lock "cinder-quobyte-9adf6376-224f-4d46-b887-706ec7d6b79a" released by "delete_volume" :: held 0.689s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 11:57:56 devstack cinder-volume[87116]: DEBUG cinder.quota [None req-1f3189c7-3808-46d5-a07d-36bab8ba5c27 tempest-TestServerVolumeAttachmentScenario-1898122559 None] Created reservations ['26cb7a43-0e8c-4297-8dcd-2f624bdd6395', '64320d1b-c6ba-4b38-8783-f79f3058d8a2', '80fe852d-7748-44ae-ac19-b96623973e96', '833c66b6-6884-4fe6-a15b-ffac3c9e947f'] {{(pid=87116) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 11:57:56 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-1f3189c7-3808-46d5-a07d-36bab8ba5c27 tempest-TestServerVolumeAttachmentScenario-1898122559 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 11:57:56 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-1f3189c7-3808-46d5-a07d-36bab8ba5c27 tempest-TestServerVolumeAttachmentScenario-1898122559 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 11:57:56 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-1f3189c7-3808-46d5-a07d-36bab8ba5c27 tempest-TestServerVolumeAttachmentScenario-1898122559 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 11:57:56 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-1f3189c7-3808-46d5-a07d-36bab8ba5c27 tempest-TestServerVolumeAttachmentScenario-1898122559 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 11:57:56 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-1f3189c7-3808-46d5-a07d-36bab8ba5c27 tempest-TestServerVolumeAttachmentScenario-1898122559 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 11:57:56 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-1f3189c7-3808-46d5-a07d-36bab8ba5c27 tempest-TestServerVolumeAttachmentScenario-1898122559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:57:56 devstack sudo[104220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756 Nov 06 11:57:56 devstack sudo[104220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:57:56 devstack sudo[104220]: pam_unix(sudo:session): session closed for user root Nov 06 11:57:56 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-1f3189c7-3808-46d5-a07d-36bab8ba5c27 tempest-TestServerVolumeAttachmentScenario-1898122559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756" returned: 0 in 0.301s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:57:56 devstack cinder-volume[87116]: DEBUG cinder.manager [None req-1f3189c7-3808-46d5-a07d-36bab8ba5c27 tempest-TestServerVolumeAttachmentScenario-1898122559 None] Notifying Schedulers of capabilities ... {{(pid=87116) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 11:57:56 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-7f62593c-069b-46ce-83ae-bc32b1ebb424 tempest-TestServerVolumeAttachmentScenario-1898122559 None] Acquiring lock "cinder-e23cb0d7-5064-4885-91f6-b6dc720fccdd-delete_volume" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 11:57:56 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-1f3189c7-3808-46d5-a07d-36bab8ba5c27 tempest-TestServerVolumeAttachmentScenario-1898122559 None] Deleted volume successfully. Nov 06 11:57:56 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-7f62593c-069b-46ce-83ae-bc32b1ebb424 tempest-TestServerVolumeAttachmentScenario-1898122559 None] Lock "cinder-e23cb0d7-5064-4885-91f6-b6dc720fccdd-delete_volume" acquired by "delete_volume" :: waited 0.054s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 11:57:56 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-1f3189c7-3808-46d5-a07d-36bab8ba5c27 tempest-TestServerVolumeAttachmentScenario-1898122559 None] Lock "cinder-9adf6376-224f-4d46-b887-706ec7d6b79a-delete_volume" released by "delete_volume" :: held 1.310s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 11:57:56 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-7f62593c-069b-46ce-83ae-bc32b1ebb424 tempest-TestServerVolumeAttachmentScenario-1898122559 None] Acquiring lock "cinder-quobyte-e23cb0d7-5064-4885-91f6-b6dc720fccdd" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 11:57:56 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-7f62593c-069b-46ce-83ae-bc32b1ebb424 tempest-TestServerVolumeAttachmentScenario-1898122559 None] Lock "cinder-quobyte-e23cb0d7-5064-4885-91f6-b6dc720fccdd" acquired by "delete_volume" :: waited 0.016s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 11:57:57 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[c19f1eb9-74f5-48e0-9456-681cb1a75cdb]: (4, 'qcow2') {{(pid=88420) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 11:57:57 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-7f62593c-069b-46ce-83ae-bc32b1ebb424 tempest-TestServerVolumeAttachmentScenario-1898122559 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-e23cb0d7-5064-4885-91f6-b6dc720fccdd {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:57:57 devstack sudo[104223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-e23cb0d7-5064-4885-91f6-b6dc720fccdd Nov 06 11:57:57 devstack sudo[104223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:57:57 devstack sudo[104223]: pam_unix(sudo:session): session closed for user root Nov 06 11:57:57 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-7f62593c-069b-46ce-83ae-bc32b1ebb424 tempest-TestServerVolumeAttachmentScenario-1898122559 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-e23cb0d7-5064-4885-91f6-b6dc720fccdd" returned: 0 in 0.367s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:57:57 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-7f62593c-069b-46ce-83ae-bc32b1ebb424 tempest-TestServerVolumeAttachmentScenario-1898122559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-e23cb0d7-5064-4885-91f6-b6dc720fccdd {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:57:57 devstack sudo[104229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-e23cb0d7-5064-4885-91f6-b6dc720fccdd Nov 06 11:57:57 devstack sudo[104229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:57:57 devstack sudo[104229]: pam_unix(sudo:session): session closed for user root Nov 06 11:57:57 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-7f62593c-069b-46ce-83ae-bc32b1ebb424 tempest-TestServerVolumeAttachmentScenario-1898122559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-e23cb0d7-5064-4885-91f6-b6dc720fccdd" returned: 0 in 0.250s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:57:57 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-7f62593c-069b-46ce-83ae-bc32b1ebb424 tempest-TestServerVolumeAttachmentScenario-1898122559 None] Lock "cinder-quobyte-e23cb0d7-5064-4885-91f6-b6dc720fccdd" released by "delete_volume" :: held 0.664s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 11:57:57 devstack cinder-volume[87116]: DEBUG cinder.quota [None req-7f62593c-069b-46ce-83ae-bc32b1ebb424 tempest-TestServerVolumeAttachmentScenario-1898122559 None] Created reservations ['68cebd04-5868-47f0-93ca-a84a9ef994c3', '8bf5a061-4728-4eb7-95c5-42dd28efdc32', '29b416f6-b3b4-4725-9aba-568c9a9388e7', 'c0c4263e-b298-45a9-996f-8099ecc0e5ee'] {{(pid=87116) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 11:57:57 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-7f62593c-069b-46ce-83ae-bc32b1ebb424 tempest-TestServerVolumeAttachmentScenario-1898122559 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 11:57:57 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-7f62593c-069b-46ce-83ae-bc32b1ebb424 tempest-TestServerVolumeAttachmentScenario-1898122559 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 11:57:57 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-7f62593c-069b-46ce-83ae-bc32b1ebb424 tempest-TestServerVolumeAttachmentScenario-1898122559 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 11:57:57 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-7f62593c-069b-46ce-83ae-bc32b1ebb424 tempest-TestServerVolumeAttachmentScenario-1898122559 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 11:57:57 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-7f62593c-069b-46ce-83ae-bc32b1ebb424 tempest-TestServerVolumeAttachmentScenario-1898122559 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 11:57:57 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-7f62593c-069b-46ce-83ae-bc32b1ebb424 tempest-TestServerVolumeAttachmentScenario-1898122559 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:57:57 devstack sudo[104232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756 Nov 06 11:57:57 devstack sudo[104232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:57:58 devstack sudo[104232]: pam_unix(sudo:session): session closed for user root Nov 06 11:57:58 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-7f62593c-069b-46ce-83ae-bc32b1ebb424 tempest-TestServerVolumeAttachmentScenario-1898122559 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756" returned: 0 in 0.268s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:57:58 devstack cinder-volume[87116]: DEBUG cinder.manager [None req-7f62593c-069b-46ce-83ae-bc32b1ebb424 tempest-TestServerVolumeAttachmentScenario-1898122559 None] Notifying Schedulers of capabilities ... {{(pid=87116) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 11:57:58 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-7f62593c-069b-46ce-83ae-bc32b1ebb424 tempest-TestServerVolumeAttachmentScenario-1898122559 None] Deleted volume successfully. Nov 06 11:57:58 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-7f62593c-069b-46ce-83ae-bc32b1ebb424 tempest-TestServerVolumeAttachmentScenario-1898122559 None] Lock "cinder-e23cb0d7-5064-4885-91f6-b6dc720fccdd-delete_volume" released by "delete_volume" :: held 1.184s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 11:58:03 devstack cinder-volume[87116]: DEBUG cinder.volume.flows.manager.create_volume [None req-3f6e9697-72f0-4398-8081-23d59ea91c70 tempest-TestStampPattern-949619326 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87116) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 11:58:03 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-3f6e9697-72f0-4398-8081-23d59ea91c70 tempest-TestStampPattern-949619326 None] Flow 'volume_create_manager' (736cc545-656d-4e90-a276-3062f22e1793) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 11:58:03 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-3f6e9697-72f0-4398-8081-23d59ea91c70 tempest-TestStampPattern-949619326 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9d1303db-a5a1-4b12-ba47-361901d15fe1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:58:03 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-3f6e9697-72f0-4398-8081-23d59ea91c70 tempest-TestStampPattern-949619326 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9d1303db-a5a1-4b12-ba47-361901d15fe1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T10:58:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-103607538',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4b9d12f5-bc74-4263-acb9-1d7180eccfa2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da923cf98fce43ca95251edc67ad6245',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T10:58:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T10:58:04Z,use_quota=True,user_id='32e6decf0db5486c9827a4cb36276515',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(34d3b144-d9b7-480a-a2e3-01e45f3d54c1),volume_type_id=34d3b144-d9b7-480a-a2e3-01e45f3d54c1)' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:58:03 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-3f6e9697-72f0-4398-8081-23d59ea91c70 tempest-TestStampPattern-949619326 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f8e2d83d-77ac-4395-893f-d3a12380d1d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:58:03 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-3f6e9697-72f0-4398-8081-23d59ea91c70 tempest-TestStampPattern-949619326 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f8e2d83d-77ac-4395-893f-d3a12380d1d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:58:03 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-3f6e9697-72f0-4398-8081-23d59ea91c70 tempest-TestStampPattern-949619326 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (40fec0da-0e13-492d-bd77-06f087b1d7af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:58:04 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-3f6e9697-72f0-4398-8081-23d59ea91c70 tempest-TestStampPattern-949619326 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (40fec0da-0e13-492d-bd77-06f087b1d7af) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4b9d12f5-bc74-4263-acb9-1d7180eccfa2', 'volume_name': 'volume-4b9d12f5-bc74-4263-acb9-1d7180eccfa2', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:58:04 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-3f6e9697-72f0-4398-8081-23d59ea91c70 tempest-TestStampPattern-949619326 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b2243124-6d8c-4136-9aa4-a894dcf747e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:58:04 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-3f6e9697-72f0-4398-8081-23d59ea91c70 tempest-TestStampPattern-949619326 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b2243124-6d8c-4136-9aa4-a894dcf747e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:58:04 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-3f6e9697-72f0-4398-8081-23d59ea91c70 tempest-TestStampPattern-949619326 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (76193ed3-3b28-4efd-9ed2-10f04b62139b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:58:04 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-3f6e9697-72f0-4398-8081-23d59ea91c70 tempest-TestStampPattern-949619326 None] Volume 4b9d12f5-bc74-4263-acb9-1d7180eccfa2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4b9d12f5-bc74-4263-acb9-1d7180eccfa2', 'volume_size': 1} Nov 06 11:58:04 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-3f6e9697-72f0-4398-8081-23d59ea91c70 tempest-TestStampPattern-949619326 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 11:58:04 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-3f6e9697-72f0-4398-8081-23d59ea91c70 tempest-TestStampPattern-949619326 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 11:58:04 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-3f6e9697-72f0-4398-8081-23d59ea91c70 tempest-TestStampPattern-949619326 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T10:58:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-103607538',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4b9d12f5-bc74-4263-acb9-1d7180eccfa2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da923cf98fce43ca95251edc67ad6245',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T10:58:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T10:58:04Z,use_quota=True,user_id='32e6decf0db5486c9827a4cb36276515',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(34d3b144-d9b7-480a-a2e3-01e45f3d54c1),volume_type_id=34d3b144-d9b7-480a-a2e3-01e45f3d54c1)}" {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 11:58:04 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-3f6e9697-72f0-4398-8081-23d59ea91c70 tempest-TestStampPattern-949619326 None] Creating volume 4b9d12f5-bc74-4263-acb9-1d7180eccfa2 {{(pid=87116) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 11:58:04 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-3f6e9697-72f0-4398-8081-23d59ea91c70 tempest-TestStampPattern-949619326 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 11:58:04 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-3f6e9697-72f0-4398-8081-23d59ea91c70 tempest-TestStampPattern-949619326 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 11:58:04 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-3f6e9697-72f0-4398-8081-23d59ea91c70 tempest-TestStampPattern-949619326 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 11:58:04 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-3f6e9697-72f0-4398-8081-23d59ea91c70 tempest-TestStampPattern-949619326 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 11:58:04 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-3f6e9697-72f0-4398-8081-23d59ea91c70 tempest-TestStampPattern-949619326 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 11:58:04 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-3f6e9697-72f0-4398-8081-23d59ea91c70 tempest-TestStampPattern-949619326 None] Selected osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f as target Quobyte volume. {{(pid=87116) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 11:58:04 devstack cinder-volume[87116]: INFO cinder.volume.drivers.remotefs [None req-3f6e9697-72f0-4398-8081-23d59ea91c70 tempest-TestStampPattern-949619326 None] casted to osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f Nov 06 11:58:04 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-3f6e9697-72f0-4398-8081-23d59ea91c70 tempest-TestStampPattern-949619326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-4b9d12f5-bc74-4263-acb9-1d7180eccfa2 1073741824 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:58:04 devstack sudo[104238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-4b9d12f5-bc74-4263-acb9-1d7180eccfa2 1073741824 Nov 06 11:58:04 devstack sudo[104238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:58:04 devstack sudo[104238]: pam_unix(sudo:session): session closed for user root Nov 06 11:58:04 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-3f6e9697-72f0-4398-8081-23d59ea91c70 tempest-TestStampPattern-949619326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-4b9d12f5-bc74-4263-acb9-1d7180eccfa2 1073741824" returned: 0 in 0.537s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:58:04 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-3f6e9697-72f0-4398-8081-23d59ea91c70 tempest-TestStampPattern-949619326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-4b9d12f5-bc74-4263-acb9-1d7180eccfa2 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:58:04 devstack sudo[104246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-4b9d12f5-bc74-4263-acb9-1d7180eccfa2 Nov 06 11:58:04 devstack sudo[104246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:58:04 devstack sudo[104246]: pam_unix(sudo:session): session closed for user root Nov 06 11:58:04 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-3f6e9697-72f0-4398-8081-23d59ea91c70 tempest-TestStampPattern-949619326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-4b9d12f5-bc74-4263-acb9-1d7180eccfa2" returned: 0 in 0.328s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:58:04 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-3f6e9697-72f0-4398-8081-23d59ea91c70 tempest-TestStampPattern-949619326 None] <== create_volume: return (921ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f'} {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 11:58:04 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-3f6e9697-72f0-4398-8081-23d59ea91c70 tempest-TestStampPattern-949619326 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.927s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 11:58:04 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-3f6e9697-72f0-4398-8081-23d59ea91c70 tempest-TestStampPattern-949619326 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (76193ed3-3b28-4efd-9ed2-10f04b62139b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4b9d12f5-bc74-4263-acb9-1d7180eccfa2', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:58:04 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-3f6e9697-72f0-4398-8081-23d59ea91c70 tempest-TestStampPattern-949619326 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a59ba15c-dec9-41d1-842f-8b609998b6db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:58:04 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-3f6e9697-72f0-4398-8081-23d59ea91c70 tempest-TestStampPattern-949619326 None] Volume volume-4b9d12f5-bc74-4263-acb9-1d7180eccfa2 (4b9d12f5-bc74-4263-acb9-1d7180eccfa2): created successfully Nov 06 11:58:05 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-3f6e9697-72f0-4398-8081-23d59ea91c70 tempest-TestStampPattern-949619326 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a59ba15c-dec9-41d1-842f-8b609998b6db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:58:05 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-3f6e9697-72f0-4398-8081-23d59ea91c70 tempest-TestStampPattern-949619326 None] Flow 'volume_create_manager' (736cc545-656d-4e90-a276-3062f22e1793) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 11:58:05 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-3f6e9697-72f0-4398-8081-23d59ea91c70 tempest-TestStampPattern-949619326 None] Created volume successfully. Nov 06 11:58:15 devstack cinder-volume[87116]: DEBUG dbcounter [-] [87116] Writing DB stats cinder:INSERT=39,cinder:UPDATE=169,cinder:SELECT=119,cinder:DELETE=12 {{(pid=87116) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 11:58:15 devstack cinder-volume[87116]: DEBUG dbcounter [-] [87116] Writing DB stats cinder:SELECT=117,cinder:UPDATE=142,cinder:INSERT=43,cinder:DELETE=13 {{(pid=87116) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 11:58:30 devstack cinder-volume[87116]: DEBUG cinder.volume.flows.manager.create_volume [None req-3f433f26-d167-4457-95c1-04eb49ceef65 tempest-TestImageHashVerification-520081510 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87116) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 11:58:30 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-3f433f26-d167-4457-95c1-04eb49ceef65 tempest-TestImageHashVerification-520081510 None] Flow 'volume_create_manager' (6a5eb3d4-7f13-4c56-994d-6de8df6537c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 11:58:30 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-3f433f26-d167-4457-95c1-04eb49ceef65 tempest-TestImageHashVerification-520081510 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (92d29060-3113-4772-803d-99134233a6f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:58:30 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-3f433f26-d167-4457-95c1-04eb49ceef65 tempest-TestImageHashVerification-520081510 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (92d29060-3113-4772-803d-99134233a6f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T10:58:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-1963743821',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aaed265d-a9dd-45cd-8377-6036c5adc311,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d09be69fe8394908973f3e1fa3774f92',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T10:58:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T10:58:30Z,use_quota=True,user_id='3f3bee1785414c04b64c17339ec6a158',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(34d3b144-d9b7-480a-a2e3-01e45f3d54c1),volume_type_id=34d3b144-d9b7-480a-a2e3-01e45f3d54c1)' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:58:30 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-3f433f26-d167-4457-95c1-04eb49ceef65 tempest-TestImageHashVerification-520081510 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (effc18c1-978e-40ba-85f6-bc3de695d190) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:58:30 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-3f433f26-d167-4457-95c1-04eb49ceef65 tempest-TestImageHashVerification-520081510 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (effc18c1-978e-40ba-85f6-bc3de695d190) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:58:30 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-3f433f26-d167-4457-95c1-04eb49ceef65 tempest-TestImageHashVerification-520081510 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c14d8f91-d51e-49cc-bc50-e4373d8a2d3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:58:30 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-3f433f26-d167-4457-95c1-04eb49ceef65 tempest-TestImageHashVerification-520081510 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c14d8f91-d51e-49cc-bc50-e4373d8a2d3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'aaed265d-a9dd-45cd-8377-6036c5adc311', 'volume_name': 'volume-aaed265d-a9dd-45cd-8377-6036c5adc311', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:58:30 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-3f433f26-d167-4457-95c1-04eb49ceef65 tempest-TestImageHashVerification-520081510 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1fc87414-2eef-474e-8e59-4244c79a20fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:58:30 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-3f433f26-d167-4457-95c1-04eb49ceef65 tempest-TestImageHashVerification-520081510 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1fc87414-2eef-474e-8e59-4244c79a20fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:58:30 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-3f433f26-d167-4457-95c1-04eb49ceef65 tempest-TestImageHashVerification-520081510 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f1b1b681-b386-4c02-b50f-de0ab20f199f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:58:30 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-3f433f26-d167-4457-95c1-04eb49ceef65 tempest-TestImageHashVerification-520081510 None] Volume aaed265d-a9dd-45cd-8377-6036c5adc311: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-aaed265d-a9dd-45cd-8377-6036c5adc311', 'volume_size': 1} Nov 06 11:58:30 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-3f433f26-d167-4457-95c1-04eb49ceef65 tempest-TestImageHashVerification-520081510 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 11:58:30 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-3f433f26-d167-4457-95c1-04eb49ceef65 tempest-TestImageHashVerification-520081510 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 11:58:30 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-3f433f26-d167-4457-95c1-04eb49ceef65 tempest-TestImageHashVerification-520081510 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T10:58:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-1963743821',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aaed265d-a9dd-45cd-8377-6036c5adc311,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d09be69fe8394908973f3e1fa3774f92',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T10:58:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T10:58:30Z,use_quota=True,user_id='3f3bee1785414c04b64c17339ec6a158',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(34d3b144-d9b7-480a-a2e3-01e45f3d54c1),volume_type_id=34d3b144-d9b7-480a-a2e3-01e45f3d54c1)}" {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 11:58:30 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-3f433f26-d167-4457-95c1-04eb49ceef65 tempest-TestImageHashVerification-520081510 None] Creating volume aaed265d-a9dd-45cd-8377-6036c5adc311 {{(pid=87116) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 11:58:30 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-3f433f26-d167-4457-95c1-04eb49ceef65 tempest-TestImageHashVerification-520081510 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 11:58:30 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-3f433f26-d167-4457-95c1-04eb49ceef65 tempest-TestImageHashVerification-520081510 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 11:58:30 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-3f433f26-d167-4457-95c1-04eb49ceef65 tempest-TestImageHashVerification-520081510 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 11:58:30 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-3f433f26-d167-4457-95c1-04eb49ceef65 tempest-TestImageHashVerification-520081510 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 11:58:30 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-3f433f26-d167-4457-95c1-04eb49ceef65 tempest-TestImageHashVerification-520081510 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 11:58:30 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-3f433f26-d167-4457-95c1-04eb49ceef65 tempest-TestImageHashVerification-520081510 None] Selected osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f as target Quobyte volume. {{(pid=87116) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 11:58:30 devstack cinder-volume[87116]: INFO cinder.volume.drivers.remotefs [None req-3f433f26-d167-4457-95c1-04eb49ceef65 tempest-TestImageHashVerification-520081510 None] casted to osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f Nov 06 11:58:30 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-3f433f26-d167-4457-95c1-04eb49ceef65 tempest-TestImageHashVerification-520081510 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-aaed265d-a9dd-45cd-8377-6036c5adc311 1073741824 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:58:30 devstack sudo[104364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-aaed265d-a9dd-45cd-8377-6036c5adc311 1073741824 Nov 06 11:58:30 devstack sudo[104364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:58:30 devstack sudo[104364]: pam_unix(sudo:session): session closed for user root Nov 06 11:58:30 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-3f433f26-d167-4457-95c1-04eb49ceef65 tempest-TestImageHashVerification-520081510 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-aaed265d-a9dd-45cd-8377-6036c5adc311 1073741824" returned: 0 in 0.425s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:58:30 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-3f433f26-d167-4457-95c1-04eb49ceef65 tempest-TestImageHashVerification-520081510 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-aaed265d-a9dd-45cd-8377-6036c5adc311 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:58:30 devstack sudo[104369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-aaed265d-a9dd-45cd-8377-6036c5adc311 Nov 06 11:58:30 devstack sudo[104369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:58:31 devstack sudo[104369]: pam_unix(sudo:session): session closed for user root Nov 06 11:58:31 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-3f433f26-d167-4457-95c1-04eb49ceef65 tempest-TestImageHashVerification-520081510 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-aaed265d-a9dd-45cd-8377-6036c5adc311" returned: 0 in 0.235s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:58:31 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-3f433f26-d167-4457-95c1-04eb49ceef65 tempest-TestImageHashVerification-520081510 None] <== create_volume: return (702ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f'} {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 11:58:31 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-3f433f26-d167-4457-95c1-04eb49ceef65 tempest-TestImageHashVerification-520081510 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.705s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 11:58:31 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-3f433f26-d167-4457-95c1-04eb49ceef65 tempest-TestImageHashVerification-520081510 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f1b1b681-b386-4c02-b50f-de0ab20f199f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aaed265d-a9dd-45cd-8377-6036c5adc311', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:58:31 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-3f433f26-d167-4457-95c1-04eb49ceef65 tempest-TestImageHashVerification-520081510 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e1176f10-2c5d-4961-afe9-4d4ccd140a78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:58:31 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-3f433f26-d167-4457-95c1-04eb49ceef65 tempest-TestImageHashVerification-520081510 None] Volume volume-aaed265d-a9dd-45cd-8377-6036c5adc311 (aaed265d-a9dd-45cd-8377-6036c5adc311): created successfully Nov 06 11:58:31 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-3f433f26-d167-4457-95c1-04eb49ceef65 tempest-TestImageHashVerification-520081510 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e1176f10-2c5d-4961-afe9-4d4ccd140a78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:58:31 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-3f433f26-d167-4457-95c1-04eb49ceef65 tempest-TestImageHashVerification-520081510 None] Flow 'volume_create_manager' (6a5eb3d4-7f13-4c56-994d-6de8df6537c5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 11:58:31 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-3f433f26-d167-4457-95c1-04eb49ceef65 tempest-TestImageHashVerification-520081510 None] Created volume successfully. Nov 06 11:58:32 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-bcf7b1e7-1c3c-413f-ad33-e197214ab873 tempest-TestImageHashVerification-520081510 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 11:58:32 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-bcf7b1e7-1c3c-413f-ad33-e197214ab873 tempest-TestImageHashVerification-520081510 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 11:58:32 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8efbfc7-cc78-4030-8b3d-da54f39569c8]: (4, 'qcow2') {{(pid=88420) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 11:58:32 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-bcf7b1e7-1c3c-413f-ad33-e197214ab873 tempest-TestImageHashVerification-520081510 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-aaed265d-a9dd-45cd-8377-6036c5adc311 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:58:32 devstack sudo[104372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-aaed265d-a9dd-45cd-8377-6036c5adc311 Nov 06 11:58:32 devstack sudo[104372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:58:32 devstack sudo[104372]: pam_unix(sudo:session): session closed for user root Nov 06 11:58:32 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-bcf7b1e7-1c3c-413f-ad33-e197214ab873 tempest-TestImageHashVerification-520081510 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-aaed265d-a9dd-45cd-8377-6036c5adc311" returned: 0 in 0.346s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:58:32 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2b3a75f-c493-4ad2-8df1-e2fd339b2313]: (4, 'qcow2') {{(pid=88420) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 11:58:32 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-bcf7b1e7-1c3c-413f-ad33-e197214ab873 tempest-TestImageHashVerification-520081510 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-aaed265d-a9dd-45cd-8377-6036c5adc311 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:58:32 devstack sudo[104377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-aaed265d-a9dd-45cd-8377-6036c5adc311 Nov 06 11:58:32 devstack sudo[104377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:58:32 devstack sudo[104377]: pam_unix(sudo:session): session closed for user root Nov 06 11:58:32 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-bcf7b1e7-1c3c-413f-ad33-e197214ab873 tempest-TestImageHashVerification-520081510 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-aaed265d-a9dd-45cd-8377-6036c5adc311" returned: 0 in 0.343s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:58:32 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-bcf7b1e7-1c3c-413f-ad33-e197214ab873 tempest-TestImageHashVerification-520081510 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-aaed265d-a9dd-45cd-8377-6036c5adc311 /opt/stack/data/cinder/conversion/aaed265d-a9dd-45cd-8377-6036c5adc311.temp_image.0a3f19f3-dcf5-4f4d-a88b-6520a3a83cfavt71j0me.img {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:58:32 devstack sudo[104383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-aaed265d-a9dd-45cd-8377-6036c5adc311 /opt/stack/data/cinder/conversion/aaed265d-a9dd-45cd-8377-6036c5adc311.temp_image.0a3f19f3-dcf5-4f4d-a88b-6520a3a83cfavt71j0me.img Nov 06 11:58:32 devstack sudo[104383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:58:36 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [req-b6cc186f-2172-48d9-a4aa-89db93111ffd req-e7c77ed8-c902-4475-8bba-1ff92734f22c tempest-TestStampPattern-949619326 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 11:58:39 devstack sudo[104383]: pam_unix(sudo:session): session closed for user root Nov 06 11:58:39 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-bcf7b1e7-1c3c-413f-ad33-e197214ab873 tempest-TestImageHashVerification-520081510 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-aaed265d-a9dd-45cd-8377-6036c5adc311 /opt/stack/data/cinder/conversion/aaed265d-a9dd-45cd-8377-6036c5adc311.temp_image.0a3f19f3-dcf5-4f4d-a88b-6520a3a83cfavt71j0me.img" returned: 0 in 6.182s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:58:39 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[601066d1-243d-4943-9267-d47c24b21db4]: (4, 'qcow2') {{(pid=88420) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 11:58:39 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-bcf7b1e7-1c3c-413f-ad33-e197214ab873 tempest-TestImageHashVerification-520081510 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-aaed265d-a9dd-45cd-8377-6036c5adc311 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:58:39 devstack sudo[104462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-aaed265d-a9dd-45cd-8377-6036c5adc311 Nov 06 11:58:39 devstack sudo[104462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:58:39 devstack sudo[104462]: pam_unix(sudo:session): session closed for user root Nov 06 11:58:39 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-bcf7b1e7-1c3c-413f-ad33-e197214ab873 tempest-TestImageHashVerification-520081510 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-aaed265d-a9dd-45cd-8377-6036c5adc311" returned: 0 in 0.518s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:58:39 devstack cinder-volume[87116]: DEBUG cinder.image.image_utils [None req-bcf7b1e7-1c3c-413f-ad33-e197214ab873 tempest-TestImageHashVerification-520081510 None] Image conversion details: src /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-aaed265d-a9dd-45cd-8377-6036c5adc311, size 1024.00 MB, duration 6.18 sec, destination /opt/stack/data/cinder/conversion/aaed265d-a9dd-45cd-8377-6036c5adc311.temp_image.0a3f19f3-dcf5-4f4d-a88b-6520a3a83cfavt71j0me.img {{(pid=87116) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 06 11:58:39 devstack cinder-volume[87116]: INFO cinder.image.image_utils [None req-bcf7b1e7-1c3c-413f-ad33-e197214ab873 tempest-TestImageHashVerification-520081510 None] Converted 1024.00 MB image at 165.61 MB/s Nov 06 11:58:39 devstack cinder-volume[87116]: DEBUG cinder.image.image_utils [None req-bcf7b1e7-1c3c-413f-ad33-e197214ab873 tempest-TestImageHashVerification-520081510 None] 0a3f19f3-dcf5-4f4d-a88b-6520a3a83cfa was raw, no need to convert to raw {{(pid=87116) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1186}} Nov 06 11:58:39 devstack cinder-volume[87116]: DEBUG oslo_service.periodic_task [None req-4fab4816-ec2b-4b19-b2ff-8548f2084354 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87116) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 11:58:39 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-4fab4816-ec2b-4b19-b2ff-8548f2084354 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 11:58:39 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-4fab4816-ec2b-4b19-b2ff-8548f2084354 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 11:58:39 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-4fab4816-ec2b-4b19-b2ff-8548f2084354 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 11:58:39 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-4fab4816-ec2b-4b19-b2ff-8548f2084354 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 11:58:39 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-4fab4816-ec2b-4b19-b2ff-8548f2084354 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 11:58:39 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-4fab4816-ec2b-4b19-b2ff-8548f2084354 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:58:39 devstack sudo[104467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756 Nov 06 11:58:39 devstack sudo[104467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:58:40 devstack sudo[104467]: pam_unix(sudo:session): session closed for user root Nov 06 11:58:40 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-4fab4816-ec2b-4b19-b2ff-8548f2084354 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756" returned: 0 in 0.261s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:58:40 devstack cinder-volume[87116]: DEBUG cinder.manager [None req-4fab4816-ec2b-4b19-b2ff-8548f2084354 None None] Notifying Schedulers of capabilities ... {{(pid=87116) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 11:58:40 devstack cinder-volume[87116]: DEBUG oslo_service.periodic_task [None req-4fab4816-ec2b-4b19-b2ff-8548f2084354 None None] Running periodic task VolumeManager._thread_info {{(pid=87116) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 11:58:40 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-4fab4816-ec2b-4b19-b2ff-8548f2084354 None None] thread count: 28 {{(pid=87116) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 06 11:58:40 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-4fab4816-ec2b-4b19-b2ff-8548f2084354 None None] thread info: [<_MainThread(MainThread, started 131399520669824)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87116) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 06 11:58:49 devstack cinder-volume[87116]: DEBUG dbcounter [-] [87116] Writing DB stats cinder:UPDATE=4,cinder:SELECT=3,cinder:DELETE=1 {{(pid=87116) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 11:58:49 devstack cinder-volume[87116]: DEBUG dbcounter [-] [87116] Writing DB stats cinder:SELECT=6,cinder:UPDATE=2,cinder:INSERT=1 {{(pid=87116) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 11:58:57 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-bcf7b1e7-1c3c-413f-ad33-e197214ab873 tempest-TestImageHashVerification-520081510 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 25.414s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 11:58:57 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-bcf7b1e7-1c3c-413f-ad33-e197214ab873 tempest-TestImageHashVerification-520081510 None] Uploaded volume to glance image-id: 0a3f19f3-dcf5-4f4d-a88b-6520a3a83cfa. {{(pid=87116) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Nov 06 11:58:57 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [req-b6cc186f-2172-48d9-a4aa-89db93111ffd req-e7c77ed8-c902-4475-8bba-1ff92734f22c tempest-TestStampPattern-949619326 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 21.482s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 11:58:57 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [req-b6cc186f-2172-48d9-a4aa-89db93111ffd req-e7c77ed8-c902-4475-8bba-1ff92734f22c tempest-TestStampPattern-949619326 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.017s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 11:58:57 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-bcf7b1e7-1c3c-413f-ad33-e197214ab873 tempest-TestImageHashVerification-520081510 None] Copy volume to image completed successfully. Nov 06 11:58:57 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [req-b6cc186f-2172-48d9-a4aa-89db93111ffd req-e7c77ed8-c902-4475-8bba-1ff92734f22c tempest-TestStampPattern-949619326 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f', 'name': 'volume-4b9d12f5-bc74-4263-acb9-1d7180eccfa2', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '4a1a5902-c401-4598-b63f-10fd77359524', 'enforce_multipath': True} {{(pid=87116) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 06 11:58:57 devstack cinder-volume[87116]: INFO cinder.volume.manager [req-b6cc186f-2172-48d9-a4aa-89db93111ffd req-e7c77ed8-c902-4475-8bba-1ff92734f22c tempest-TestStampPattern-949619326 None] attachment_update completed successfully. Nov 06 11:58:58 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-214eef13-e0cc-4add-9c22-8a1a5f54c75a tempest-TestImageHashVerification-520081510 None] Acquiring lock "cinder-aaed265d-a9dd-45cd-8377-6036c5adc311-delete_volume" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 11:58:58 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-214eef13-e0cc-4add-9c22-8a1a5f54c75a tempest-TestImageHashVerification-520081510 None] Lock "cinder-aaed265d-a9dd-45cd-8377-6036c5adc311-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 11:58:58 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-214eef13-e0cc-4add-9c22-8a1a5f54c75a tempest-TestImageHashVerification-520081510 None] Acquiring lock "cinder-quobyte-aaed265d-a9dd-45cd-8377-6036c5adc311" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 11:58:58 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-214eef13-e0cc-4add-9c22-8a1a5f54c75a tempest-TestImageHashVerification-520081510 None] Lock "cinder-quobyte-aaed265d-a9dd-45cd-8377-6036c5adc311" acquired by "delete_volume" :: waited 0.018s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 11:58:58 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[c909ff7f-2662-43f1-92d8-25ff671e1fbe]: (4, 'qcow2') {{(pid=88420) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 11:58:58 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-214eef13-e0cc-4add-9c22-8a1a5f54c75a tempest-TestImageHashVerification-520081510 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-aaed265d-a9dd-45cd-8377-6036c5adc311 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:58:58 devstack sudo[104888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-aaed265d-a9dd-45cd-8377-6036c5adc311 Nov 06 11:58:58 devstack sudo[104888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:58:59 devstack sudo[104888]: pam_unix(sudo:session): session closed for user root Nov 06 11:58:59 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-214eef13-e0cc-4add-9c22-8a1a5f54c75a tempest-TestImageHashVerification-520081510 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-aaed265d-a9dd-45cd-8377-6036c5adc311" returned: 0 in 0.343s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:58:59 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-214eef13-e0cc-4add-9c22-8a1a5f54c75a tempest-TestImageHashVerification-520081510 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-aaed265d-a9dd-45cd-8377-6036c5adc311 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:58:59 devstack sudo[104893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-aaed265d-a9dd-45cd-8377-6036c5adc311 Nov 06 11:58:59 devstack sudo[104893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:58:59 devstack sudo[104893]: pam_unix(sudo:session): session closed for user root Nov 06 11:58:59 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-214eef13-e0cc-4add-9c22-8a1a5f54c75a tempest-TestImageHashVerification-520081510 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-aaed265d-a9dd-45cd-8377-6036c5adc311" returned: 0 in 0.231s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:58:59 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-214eef13-e0cc-4add-9c22-8a1a5f54c75a tempest-TestImageHashVerification-520081510 None] Lock "cinder-quobyte-aaed265d-a9dd-45cd-8377-6036c5adc311" released by "delete_volume" :: held 0.608s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 11:58:59 devstack cinder-volume[87116]: DEBUG cinder.quota [None req-214eef13-e0cc-4add-9c22-8a1a5f54c75a tempest-TestImageHashVerification-520081510 None] Created reservations ['35837059-dfe2-4ac2-9e55-7c8c79586328', '54e0a73a-739c-4b48-87b0-925cc0a32dff', '68962a7f-f128-43bc-b214-5bd4265a2b8a', 'c5b78422-64a6-4716-8295-c51cb2380a1e'] {{(pid=87116) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 11:58:59 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-214eef13-e0cc-4add-9c22-8a1a5f54c75a tempest-TestImageHashVerification-520081510 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 11:58:59 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-214eef13-e0cc-4add-9c22-8a1a5f54c75a tempest-TestImageHashVerification-520081510 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 11:58:59 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-214eef13-e0cc-4add-9c22-8a1a5f54c75a tempest-TestImageHashVerification-520081510 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 11:58:59 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-214eef13-e0cc-4add-9c22-8a1a5f54c75a tempest-TestImageHashVerification-520081510 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 11:58:59 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-214eef13-e0cc-4add-9c22-8a1a5f54c75a tempest-TestImageHashVerification-520081510 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 11:58:59 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-214eef13-e0cc-4add-9c22-8a1a5f54c75a tempest-TestImageHashVerification-520081510 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:58:59 devstack sudo[104896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756 Nov 06 11:58:59 devstack sudo[104896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:58:59 devstack sudo[104896]: pam_unix(sudo:session): session closed for user root Nov 06 11:58:59 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-214eef13-e0cc-4add-9c22-8a1a5f54c75a tempest-TestImageHashVerification-520081510 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756" returned: 0 in 0.241s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:58:59 devstack cinder-volume[87116]: DEBUG cinder.manager [None req-214eef13-e0cc-4add-9c22-8a1a5f54c75a tempest-TestImageHashVerification-520081510 None] Notifying Schedulers of capabilities ... {{(pid=87116) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 11:58:59 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-214eef13-e0cc-4add-9c22-8a1a5f54c75a tempest-TestImageHashVerification-520081510 None] Deleted volume successfully. Nov 06 11:58:59 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-214eef13-e0cc-4add-9c22-8a1a5f54c75a tempest-TestImageHashVerification-520081510 None] Lock "cinder-aaed265d-a9dd-45cd-8377-6036c5adc311-delete_volume" released by "delete_volume" :: held 1.042s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 11:59:03 devstack cinder-volume[87116]: INFO cinder.volume.manager [req-8cd8f0c2-9011-4e9a-afea-475f45d6eba1 req-7de451bc-5852-4d4f-af5e-332e80d1039c tempest-TestStampPattern-949619326 None] Terminate volume connection completed successfully. Nov 06 11:59:03 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [req-8cd8f0c2-9011-4e9a-afea-475f45d6eba1 req-7de451bc-5852-4d4f-af5e-332e80d1039c tempest-TestStampPattern-949619326 None] Deleting attachment 4a1a5902-c401-4598-b63f-10fd77359524. {{(pid=87116) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 06 11:59:04 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-ad94c98c-1fd9-43f8-ae5e-4aac415297c5 tempest-TestStampPattern-949619326 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 11:59:04 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-ad94c98c-1fd9-43f8-ae5e-4aac415297c5 tempest-TestStampPattern-949619326 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 11:59:04 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-ad94c98c-1fd9-43f8-ae5e-4aac415297c5 tempest-TestStampPattern-949619326 None] Creating offline snapshot f577480f-c459-4849-b588-11787d70e7c4 of volume 4b9d12f5-bc74-4263-acb9-1d7180eccfa2 {{(pid=87116) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 06 11:59:04 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[408fcc01-f9bc-4b25-a8d8-062bb5704331]: (4, 'qcow2') {{(pid=88420) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 11:59:04 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-ad94c98c-1fd9-43f8-ae5e-4aac415297c5 tempest-TestStampPattern-949619326 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-4b9d12f5-bc74-4263-acb9-1d7180eccfa2 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:59:04 devstack sudo[104951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-4b9d12f5-bc74-4263-acb9-1d7180eccfa2 Nov 06 11:59:04 devstack sudo[104951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:59:04 devstack sudo[104951]: pam_unix(sudo:session): session closed for user root Nov 06 11:59:04 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-ad94c98c-1fd9-43f8-ae5e-4aac415297c5 tempest-TestStampPattern-949619326 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-4b9d12f5-bc74-4263-acb9-1d7180eccfa2" returned: 0 in 0.358s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:59:04 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-ad94c98c-1fd9-43f8-ae5e-4aac415297c5 tempest-TestStampPattern-949619326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-4b9d12f5-bc74-4263-acb9-1d7180eccfa2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-4b9d12f5-bc74-4263-acb9-1d7180eccfa2.f577480f-c459-4849-b588-11787d70e7c4 1G {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:59:04 devstack sudo[104957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-4b9d12f5-bc74-4263-acb9-1d7180eccfa2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-4b9d12f5-bc74-4263-acb9-1d7180eccfa2.f577480f-c459-4849-b588-11787d70e7c4 1G Nov 06 11:59:04 devstack sudo[104957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:59:04 devstack sudo[104957]: pam_unix(sudo:session): session closed for user root Nov 06 11:59:04 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-ad94c98c-1fd9-43f8-ae5e-4aac415297c5 tempest-TestStampPattern-949619326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-4b9d12f5-bc74-4263-acb9-1d7180eccfa2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-4b9d12f5-bc74-4263-acb9-1d7180eccfa2.f577480f-c459-4849-b588-11787d70e7c4 1G" returned: 0 in 0.453s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:59:04 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-ad94c98c-1fd9-43f8-ae5e-4aac415297c5 tempest-TestStampPattern-949619326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4b9d12f5-bc74-4263-acb9-1d7180eccfa2 -F qcow2 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-4b9d12f5-bc74-4263-acb9-1d7180eccfa2.f577480f-c459-4849-b588-11787d70e7c4 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:59:04 devstack sudo[104963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4b9d12f5-bc74-4263-acb9-1d7180eccfa2 -F qcow2 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-4b9d12f5-bc74-4263-acb9-1d7180eccfa2.f577480f-c459-4849-b588-11787d70e7c4 Nov 06 11:59:04 devstack sudo[104963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:59:05 devstack sudo[104963]: pam_unix(sudo:session): session closed for user root Nov 06 11:59:05 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-ad94c98c-1fd9-43f8-ae5e-4aac415297c5 tempest-TestStampPattern-949619326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4b9d12f5-bc74-4263-acb9-1d7180eccfa2 -F qcow2 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-4b9d12f5-bc74-4263-acb9-1d7180eccfa2.f577480f-c459-4849-b588-11787d70e7c4" returned: 0 in 0.293s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:59:05 devstack cinder-volume[87116]: WARNING cinder.volume.drivers.remotefs [None req-ad94c98c-1fd9-43f8-ae5e-4aac415297c5 tempest-TestStampPattern-949619326 None] /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-4b9d12f5-bc74-4263-acb9-1d7180eccfa2.f577480f-c459-4849-b588-11787d70e7c4 is being set with open permissions: ugo+rw Nov 06 11:59:05 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-ad94c98c-1fd9-43f8-ae5e-4aac415297c5 tempest-TestStampPattern-949619326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-4b9d12f5-bc74-4263-acb9-1d7180eccfa2.f577480f-c459-4849-b588-11787d70e7c4 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:59:05 devstack sudo[104968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-4b9d12f5-bc74-4263-acb9-1d7180eccfa2.f577480f-c459-4849-b588-11787d70e7c4 Nov 06 11:59:05 devstack sudo[104968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:59:05 devstack sudo[104968]: pam_unix(sudo:session): session closed for user root Nov 06 11:59:05 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-ad94c98c-1fd9-43f8-ae5e-4aac415297c5 tempest-TestStampPattern-949619326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-4b9d12f5-bc74-4263-acb9-1d7180eccfa2.f577480f-c459-4849-b588-11787d70e7c4" returned: 0 in 0.250s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:59:05 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-ad94c98c-1fd9-43f8-ae5e-4aac415297c5 tempest-TestStampPattern-949619326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-4b9d12f5-bc74-4263-acb9-1d7180eccfa2.info {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:59:05 devstack sudo[104972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-4b9d12f5-bc74-4263-acb9-1d7180eccfa2.info Nov 06 11:59:05 devstack sudo[104972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:59:05 devstack sudo[104972]: pam_unix(sudo:session): session closed for user root Nov 06 11:59:05 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-ad94c98c-1fd9-43f8-ae5e-4aac415297c5 tempest-TestStampPattern-949619326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-4b9d12f5-bc74-4263-acb9-1d7180eccfa2.info" returned: 0 in 0.268s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:59:05 devstack cinder-volume[87116]: WARNING cinder.volume.drivers.remotefs [None req-ad94c98c-1fd9-43f8-ae5e-4aac415297c5 tempest-TestStampPattern-949619326 None] /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-4b9d12f5-bc74-4263-acb9-1d7180eccfa2.info is being set with open permissions: ugo+rw Nov 06 11:59:05 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-ad94c98c-1fd9-43f8-ae5e-4aac415297c5 tempest-TestStampPattern-949619326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-4b9d12f5-bc74-4263-acb9-1d7180eccfa2.info {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:59:05 devstack sudo[104975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-4b9d12f5-bc74-4263-acb9-1d7180eccfa2.info Nov 06 11:59:05 devstack sudo[104975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:59:06 devstack sudo[104975]: pam_unix(sudo:session): session closed for user root Nov 06 11:59:06 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-ad94c98c-1fd9-43f8-ae5e-4aac415297c5 tempest-TestStampPattern-949619326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-4b9d12f5-bc74-4263-acb9-1d7180eccfa2.info" returned: 0 in 0.282s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:59:06 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-ad94c98c-1fd9-43f8-ae5e-4aac415297c5 tempest-TestStampPattern-949619326 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.036s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 11:59:06 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-ad94c98c-1fd9-43f8-ae5e-4aac415297c5 tempest-TestStampPattern-949619326 None] Create snapshot completed successfully Nov 06 11:59:12 devstack cinder-volume[87116]: DEBUG cinder.volume.flows.manager.create_volume [None req-d702c9c4-9871-4dd2-a1f0-e2d7947a45f0 tempest-ProjectReaderTests-2022335332 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87116) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 11:59:12 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-d702c9c4-9871-4dd2-a1f0-e2d7947a45f0 tempest-ProjectReaderTests-2022335332 None] Flow 'volume_create_manager' (6aec7b6e-8b96-44ca-9550-5156e976cc2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 11:59:12 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-d702c9c4-9871-4dd2-a1f0-e2d7947a45f0 tempest-ProjectReaderTests-2022335332 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (679dd10b-b675-4c5b-a641-fac3582208a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:59:12 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-d702c9c4-9871-4dd2-a1f0-e2d7947a45f0 tempest-ProjectReaderTests-2022335332 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (679dd10b-b675-4c5b-a641-fac3582208a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T10:59:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1043904958',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3bd6a2b8-d255-4d3f-a3f3-bd00a521f9e6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a21fe613760f4d0c865d8ab4ce21bd5c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T10:59:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T10:59:12Z,use_quota=True,user_id='f5aed5e3f1ab445998f2b11d499a0db8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(34d3b144-d9b7-480a-a2e3-01e45f3d54c1),volume_type_id=34d3b144-d9b7-480a-a2e3-01e45f3d54c1)' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:59:12 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-d702c9c4-9871-4dd2-a1f0-e2d7947a45f0 tempest-ProjectReaderTests-2022335332 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a04a0f27-6edb-4dc8-adb9-ff0acdc576ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:59:12 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-d702c9c4-9871-4dd2-a1f0-e2d7947a45f0 tempest-ProjectReaderTests-2022335332 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a04a0f27-6edb-4dc8-adb9-ff0acdc576ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:59:12 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-d702c9c4-9871-4dd2-a1f0-e2d7947a45f0 tempest-ProjectReaderTests-2022335332 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (64466e3c-036e-4759-a868-f8150692eb62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:59:12 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-d702c9c4-9871-4dd2-a1f0-e2d7947a45f0 tempest-ProjectReaderTests-2022335332 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (64466e3c-036e-4759-a868-f8150692eb62) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3bd6a2b8-d255-4d3f-a3f3-bd00a521f9e6', 'volume_name': 'volume-3bd6a2b8-d255-4d3f-a3f3-bd00a521f9e6', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:59:12 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-d702c9c4-9871-4dd2-a1f0-e2d7947a45f0 tempest-ProjectReaderTests-2022335332 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a55ea33a-0b2f-4fd8-bfa1-0a016b09fe4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:59:12 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-d702c9c4-9871-4dd2-a1f0-e2d7947a45f0 tempest-ProjectReaderTests-2022335332 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a55ea33a-0b2f-4fd8-bfa1-0a016b09fe4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:59:12 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-d702c9c4-9871-4dd2-a1f0-e2d7947a45f0 tempest-ProjectReaderTests-2022335332 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4960c443-8ad0-40ee-8a8e-6e9fe7dcba0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:59:12 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-d702c9c4-9871-4dd2-a1f0-e2d7947a45f0 tempest-ProjectReaderTests-2022335332 None] Volume 3bd6a2b8-d255-4d3f-a3f3-bd00a521f9e6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3bd6a2b8-d255-4d3f-a3f3-bd00a521f9e6', 'volume_size': 1} Nov 06 11:59:12 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-d702c9c4-9871-4dd2-a1f0-e2d7947a45f0 tempest-ProjectReaderTests-2022335332 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 11:59:12 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-d702c9c4-9871-4dd2-a1f0-e2d7947a45f0 tempest-ProjectReaderTests-2022335332 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 11:59:12 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-d702c9c4-9871-4dd2-a1f0-e2d7947a45f0 tempest-ProjectReaderTests-2022335332 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T10:59:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1043904958',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3bd6a2b8-d255-4d3f-a3f3-bd00a521f9e6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a21fe613760f4d0c865d8ab4ce21bd5c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T10:59:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T10:59:12Z,use_quota=True,user_id='f5aed5e3f1ab445998f2b11d499a0db8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(34d3b144-d9b7-480a-a2e3-01e45f3d54c1),volume_type_id=34d3b144-d9b7-480a-a2e3-01e45f3d54c1)}" {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 11:59:12 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-d702c9c4-9871-4dd2-a1f0-e2d7947a45f0 tempest-ProjectReaderTests-2022335332 None] Creating volume 3bd6a2b8-d255-4d3f-a3f3-bd00a521f9e6 {{(pid=87116) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 11:59:12 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-d702c9c4-9871-4dd2-a1f0-e2d7947a45f0 tempest-ProjectReaderTests-2022335332 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 11:59:12 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-d702c9c4-9871-4dd2-a1f0-e2d7947a45f0 tempest-ProjectReaderTests-2022335332 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 11:59:12 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-d702c9c4-9871-4dd2-a1f0-e2d7947a45f0 tempest-ProjectReaderTests-2022335332 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 11:59:12 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-d702c9c4-9871-4dd2-a1f0-e2d7947a45f0 tempest-ProjectReaderTests-2022335332 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 11:59:12 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-d702c9c4-9871-4dd2-a1f0-e2d7947a45f0 tempest-ProjectReaderTests-2022335332 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 11:59:12 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-d702c9c4-9871-4dd2-a1f0-e2d7947a45f0 tempest-ProjectReaderTests-2022335332 None] Selected osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f as target Quobyte volume. {{(pid=87116) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 11:59:12 devstack cinder-volume[87116]: INFO cinder.volume.drivers.remotefs [None req-d702c9c4-9871-4dd2-a1f0-e2d7947a45f0 tempest-ProjectReaderTests-2022335332 None] casted to osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f Nov 06 11:59:12 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-d702c9c4-9871-4dd2-a1f0-e2d7947a45f0 tempest-ProjectReaderTests-2022335332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-3bd6a2b8-d255-4d3f-a3f3-bd00a521f9e6 1073741824 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:59:12 devstack sudo[105014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-3bd6a2b8-d255-4d3f-a3f3-bd00a521f9e6 1073741824 Nov 06 11:59:12 devstack sudo[105014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:59:13 devstack sudo[105014]: pam_unix(sudo:session): session closed for user root Nov 06 11:59:13 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-d702c9c4-9871-4dd2-a1f0-e2d7947a45f0 tempest-ProjectReaderTests-2022335332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-3bd6a2b8-d255-4d3f-a3f3-bd00a521f9e6 1073741824" returned: 0 in 0.421s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:59:13 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-d702c9c4-9871-4dd2-a1f0-e2d7947a45f0 tempest-ProjectReaderTests-2022335332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-3bd6a2b8-d255-4d3f-a3f3-bd00a521f9e6 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:59:13 devstack sudo[105021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-3bd6a2b8-d255-4d3f-a3f3-bd00a521f9e6 Nov 06 11:59:13 devstack sudo[105021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:59:13 devstack sudo[105021]: pam_unix(sudo:session): session closed for user root Nov 06 11:59:13 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-d702c9c4-9871-4dd2-a1f0-e2d7947a45f0 tempest-ProjectReaderTests-2022335332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-3bd6a2b8-d255-4d3f-a3f3-bd00a521f9e6" returned: 0 in 0.259s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:59:13 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-d702c9c4-9871-4dd2-a1f0-e2d7947a45f0 tempest-ProjectReaderTests-2022335332 None] <== create_volume: return (727ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f'} {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 11:59:13 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-d702c9c4-9871-4dd2-a1f0-e2d7947a45f0 tempest-ProjectReaderTests-2022335332 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.730s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 11:59:13 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-d702c9c4-9871-4dd2-a1f0-e2d7947a45f0 tempest-ProjectReaderTests-2022335332 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4960c443-8ad0-40ee-8a8e-6e9fe7dcba0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3bd6a2b8-d255-4d3f-a3f3-bd00a521f9e6', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:59:13 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-d702c9c4-9871-4dd2-a1f0-e2d7947a45f0 tempest-ProjectReaderTests-2022335332 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8a9eb1e7-593e-4fcb-a387-9cdc614a97e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:59:13 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-d702c9c4-9871-4dd2-a1f0-e2d7947a45f0 tempest-ProjectReaderTests-2022335332 None] Volume volume-3bd6a2b8-d255-4d3f-a3f3-bd00a521f9e6 (3bd6a2b8-d255-4d3f-a3f3-bd00a521f9e6): created successfully Nov 06 11:59:13 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-d702c9c4-9871-4dd2-a1f0-e2d7947a45f0 tempest-ProjectReaderTests-2022335332 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8a9eb1e7-593e-4fcb-a387-9cdc614a97e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:59:13 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-d702c9c4-9871-4dd2-a1f0-e2d7947a45f0 tempest-ProjectReaderTests-2022335332 None] Flow 'volume_create_manager' (6aec7b6e-8b96-44ca-9550-5156e976cc2d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 11:59:13 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-d702c9c4-9871-4dd2-a1f0-e2d7947a45f0 tempest-ProjectReaderTests-2022335332 None] Created volume successfully. Nov 06 11:59:13 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-3c07c129-35df-4e4d-8567-9b3502beae07 tempest-ProjectReaderTests-2022335332 None] Acquiring lock "cinder-3bd6a2b8-d255-4d3f-a3f3-bd00a521f9e6-delete_volume" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 11:59:13 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-3c07c129-35df-4e4d-8567-9b3502beae07 tempest-ProjectReaderTests-2022335332 None] Lock "cinder-3bd6a2b8-d255-4d3f-a3f3-bd00a521f9e6-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 11:59:13 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-3c07c129-35df-4e4d-8567-9b3502beae07 tempest-ProjectReaderTests-2022335332 None] Acquiring lock "cinder-quobyte-3bd6a2b8-d255-4d3f-a3f3-bd00a521f9e6" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 11:59:13 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-3c07c129-35df-4e4d-8567-9b3502beae07 tempest-ProjectReaderTests-2022335332 None] Lock "cinder-quobyte-3bd6a2b8-d255-4d3f-a3f3-bd00a521f9e6" acquired by "delete_volume" :: waited 0.024s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 11:59:13 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[680577a5-4137-46e1-8d09-79ecee905edb]: (4, 'qcow2') {{(pid=88420) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 11:59:13 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-3c07c129-35df-4e4d-8567-9b3502beae07 tempest-ProjectReaderTests-2022335332 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-3bd6a2b8-d255-4d3f-a3f3-bd00a521f9e6 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:59:13 devstack sudo[105024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-3bd6a2b8-d255-4d3f-a3f3-bd00a521f9e6 Nov 06 11:59:13 devstack sudo[105024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:59:14 devstack cinder-volume[87116]: DEBUG cinder.volume.flows.manager.create_volume [None req-13834840-268f-4592-8623-557fcf5d2794 tempest-TestStampPattern-949619326 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87116) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 11:59:14 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-13834840-268f-4592-8623-557fcf5d2794 tempest-TestStampPattern-949619326 None] Flow 'volume_create_manager' (ae3716f7-8b94-4d77-9f99-79d44ebe5ae9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 11:59:14 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-13834840-268f-4592-8623-557fcf5d2794 tempest-TestStampPattern-949619326 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f69d9eee-d02f-473c-b6cc-af8d75ce0a08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:59:14 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-13834840-268f-4592-8623-557fcf5d2794 tempest-TestStampPattern-949619326 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f69d9eee-d02f-473c-b6cc-af8d75ce0a08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T10:59:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1436659456',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=846110b0-01b0-443f-a58e-86b19f5b87e7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da923cf98fce43ca95251edc67ad6245',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T10:59:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=f577480f-c459-4849-b588-11787d70e7c4,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T10:59:14Z,use_quota=True,user_id='32e6decf0db5486c9827a4cb36276515',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(34d3b144-d9b7-480a-a2e3-01e45f3d54c1),volume_type_id=34d3b144-d9b7-480a-a2e3-01e45f3d54c1)' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:59:14 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-13834840-268f-4592-8623-557fcf5d2794 tempest-TestStampPattern-949619326 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d6490fcc-8134-4927-b8f5-02ba4e9938ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:59:14 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-13834840-268f-4592-8623-557fcf5d2794 tempest-TestStampPattern-949619326 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d6490fcc-8134-4927-b8f5-02ba4e9938ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:59:14 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-13834840-268f-4592-8623-557fcf5d2794 tempest-TestStampPattern-949619326 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (037def55-598c-4296-8997-2ad9878579cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:59:14 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-13834840-268f-4592-8623-557fcf5d2794 tempest-TestStampPattern-949619326 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (037def55-598c-4296-8997-2ad9878579cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '846110b0-01b0-443f-a58e-86b19f5b87e7', 'volume_name': 'volume-846110b0-01b0-443f-a58e-86b19f5b87e7', 'volume_size': 1, 'snapshot_id': 'f577480f-c459-4849-b588-11787d70e7c4'}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:59:14 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-13834840-268f-4592-8623-557fcf5d2794 tempest-TestStampPattern-949619326 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3f524dad-e959-4feb-8885-eff99aff958f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:59:14 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-13834840-268f-4592-8623-557fcf5d2794 tempest-TestStampPattern-949619326 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3f524dad-e959-4feb-8885-eff99aff958f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:59:14 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-13834840-268f-4592-8623-557fcf5d2794 tempest-TestStampPattern-949619326 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (37efb292-cf55-4caa-b546-1791535707e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:59:14 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-13834840-268f-4592-8623-557fcf5d2794 tempest-TestStampPattern-949619326 None] Volume 846110b0-01b0-443f-a58e-86b19f5b87e7: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-846110b0-01b0-443f-a58e-86b19f5b87e7', 'volume_size': 1, 'snapshot_id': 'f577480f-c459-4849-b588-11787d70e7c4'} Nov 06 11:59:14 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-13834840-268f-4592-8623-557fcf5d2794 tempest-TestStampPattern-949619326 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 11:59:14 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-13834840-268f-4592-8623-557fcf5d2794 tempest-TestStampPattern-949619326 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 11:59:14 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-13834840-268f-4592-8623-557fcf5d2794 tempest-TestStampPattern-949619326 None] Acquiring lock "cinder-quobyte-f577480f-c459-4849-b588-11787d70e7c4-846110b0-01b0-443f-a58e-86b19f5b87e7" by "_create_volume_from_snapshot" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 11:59:14 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-13834840-268f-4592-8623-557fcf5d2794 tempest-TestStampPattern-949619326 None] Lock "cinder-quobyte-f577480f-c459-4849-b588-11787d70e7c4-846110b0-01b0-443f-a58e-86b19f5b87e7" acquired by "_create_volume_from_snapshot" :: waited 0.017s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 11:59:14 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-13834840-268f-4592-8623-557fcf5d2794 tempest-TestStampPattern-949619326 None] Creating volume 846110b0-01b0-443f-a58e-86b19f5b87e7 from snapshot f577480f-c459-4849-b588-11787d70e7c4 {{(pid=87116) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Nov 06 11:59:14 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-13834840-268f-4592-8623-557fcf5d2794 tempest-TestStampPattern-949619326 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 11:59:14 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-13834840-268f-4592-8623-557fcf5d2794 tempest-TestStampPattern-949619326 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 11:59:14 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-13834840-268f-4592-8623-557fcf5d2794 tempest-TestStampPattern-949619326 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 11:59:14 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-13834840-268f-4592-8623-557fcf5d2794 tempest-TestStampPattern-949619326 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 11:59:14 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-13834840-268f-4592-8623-557fcf5d2794 tempest-TestStampPattern-949619326 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 11:59:14 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-13834840-268f-4592-8623-557fcf5d2794 tempest-TestStampPattern-949619326 None] Selected osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f as target Quobyte volume. {{(pid=87116) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 11:59:14 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-13834840-268f-4592-8623-557fcf5d2794 tempest-TestStampPattern-949619326 None] Acquiring lock "cinder-quobyte-846110b0-01b0-443f-a58e-86b19f5b87e7" by "_copy_volume_from_snapshot" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 11:59:14 devstack sudo[105024]: pam_unix(sudo:session): session closed for user root Nov 06 11:59:14 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-13834840-268f-4592-8623-557fcf5d2794 tempest-TestStampPattern-949619326 None] Lock "cinder-quobyte-846110b0-01b0-443f-a58e-86b19f5b87e7" acquired by "_copy_volume_from_snapshot" :: waited 0.022s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 11:59:14 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-13834840-268f-4592-8623-557fcf5d2794 tempest-TestStampPattern-949619326 None] snapshot: f577480f-c459-4849-b588-11787d70e7c4, volume: 846110b0-01b0-443f-a58e-86b19f5b87e7, {{(pid=87116) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 06 11:59:14 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-3c07c129-35df-4e4d-8567-9b3502beae07 tempest-ProjectReaderTests-2022335332 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-3bd6a2b8-d255-4d3f-a3f3-bd00a521f9e6" returned: 0 in 0.425s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:59:14 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-3c07c129-35df-4e4d-8567-9b3502beae07 tempest-ProjectReaderTests-2022335332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-3bd6a2b8-d255-4d3f-a3f3-bd00a521f9e6 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:59:14 devstack sudo[105029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-3bd6a2b8-d255-4d3f-a3f3-bd00a521f9e6 Nov 06 11:59:14 devstack sudo[105029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:59:14 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-13834840-268f-4592-8623-557fcf5d2794 tempest-TestStampPattern-949619326 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 11:59:14 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-13834840-268f-4592-8623-557fcf5d2794 tempest-TestStampPattern-949619326 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 11:59:14 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-13834840-268f-4592-8623-557fcf5d2794 tempest-TestStampPattern-949619326 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 11:59:14 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-13834840-268f-4592-8623-557fcf5d2794 tempest-TestStampPattern-949619326 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 11:59:14 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-13834840-268f-4592-8623-557fcf5d2794 tempest-TestStampPattern-949619326 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 11:59:14 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[33f42b39-7713-4c11-9205-85c9e5b8d991]: (4, 'qcow2') {{(pid=88420) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 11:59:14 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-13834840-268f-4592-8623-557fcf5d2794 tempest-TestStampPattern-949619326 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-4b9d12f5-bc74-4263-acb9-1d7180eccfa2.f577480f-c459-4849-b588-11787d70e7c4 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:59:14 devstack sudo[105031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-4b9d12f5-bc74-4263-acb9-1d7180eccfa2.f577480f-c459-4849-b588-11787d70e7c4 Nov 06 11:59:14 devstack sudo[105031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:59:14 devstack sudo[105029]: pam_unix(sudo:session): session closed for user root Nov 06 11:59:14 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-3c07c129-35df-4e4d-8567-9b3502beae07 tempest-ProjectReaderTests-2022335332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-3bd6a2b8-d255-4d3f-a3f3-bd00a521f9e6" returned: 0 in 0.273s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:59:14 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-3c07c129-35df-4e4d-8567-9b3502beae07 tempest-ProjectReaderTests-2022335332 None] Lock "cinder-quobyte-3bd6a2b8-d255-4d3f-a3f3-bd00a521f9e6" released by "delete_volume" :: held 0.755s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 11:59:14 devstack cinder-volume[87116]: DEBUG cinder.quota [None req-3c07c129-35df-4e4d-8567-9b3502beae07 tempest-ProjectReaderTests-2022335332 None] Created reservations ['569ceb92-fc6d-40d3-bfb2-0ece9e2e707d', '9f688c55-21d9-4e20-9b3f-3b13274dd9d5', 'f2367e11-74b9-45a3-9639-1da64cabe6cf', '42f3fde6-0101-43a0-b03f-a835269a9332'] {{(pid=87116) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 11:59:14 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-3c07c129-35df-4e4d-8567-9b3502beae07 tempest-ProjectReaderTests-2022335332 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 11:59:14 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-3c07c129-35df-4e4d-8567-9b3502beae07 tempest-ProjectReaderTests-2022335332 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 11:59:14 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-3c07c129-35df-4e4d-8567-9b3502beae07 tempest-ProjectReaderTests-2022335332 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 11:59:14 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-3c07c129-35df-4e4d-8567-9b3502beae07 tempest-ProjectReaderTests-2022335332 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 11:59:14 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-3c07c129-35df-4e4d-8567-9b3502beae07 tempest-ProjectReaderTests-2022335332 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 11:59:14 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-3c07c129-35df-4e4d-8567-9b3502beae07 tempest-ProjectReaderTests-2022335332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:59:14 devstack sudo[105031]: pam_unix(sudo:session): session closed for user root Nov 06 11:59:14 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-13834840-268f-4592-8623-557fcf5d2794 tempest-TestStampPattern-949619326 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-4b9d12f5-bc74-4263-acb9-1d7180eccfa2.f577480f-c459-4849-b588-11787d70e7c4" returned: 0 in 0.391s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:59:14 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-13834840-268f-4592-8623-557fcf5d2794 tempest-TestStampPattern-949619326 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4b9d12f5-bc74-4263-acb9-1d7180eccfa2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87116) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 11:59:14 devstack sudo[105038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756 Nov 06 11:59:14 devstack sudo[105038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:59:14 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa3b1aea-97e9-421a-a92e-fed13599bdf7]: (4, 'qcow2') {{(pid=88420) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 11:59:14 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-13834840-268f-4592-8623-557fcf5d2794 tempest-TestStampPattern-949619326 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-4b9d12f5-bc74-4263-acb9-1d7180eccfa2 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:59:14 devstack sudo[105040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-4b9d12f5-bc74-4263-acb9-1d7180eccfa2 Nov 06 11:59:14 devstack sudo[105040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:59:14 devstack sudo[105038]: pam_unix(sudo:session): session closed for user root Nov 06 11:59:14 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-3c07c129-35df-4e4d-8567-9b3502beae07 tempest-ProjectReaderTests-2022335332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756" returned: 0 in 0.282s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:59:14 devstack cinder-volume[87116]: DEBUG cinder.manager [None req-3c07c129-35df-4e4d-8567-9b3502beae07 tempest-ProjectReaderTests-2022335332 None] Notifying Schedulers of capabilities ... {{(pid=87116) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 11:59:14 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-3c07c129-35df-4e4d-8567-9b3502beae07 tempest-ProjectReaderTests-2022335332 None] Deleted volume successfully. Nov 06 11:59:14 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-3c07c129-35df-4e4d-8567-9b3502beae07 tempest-ProjectReaderTests-2022335332 None] Lock "cinder-3bd6a2b8-d255-4d3f-a3f3-bd00a521f9e6-delete_volume" released by "delete_volume" :: held 1.299s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 11:59:15 devstack sudo[105040]: pam_unix(sudo:session): session closed for user root Nov 06 11:59:15 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-13834840-268f-4592-8623-557fcf5d2794 tempest-TestStampPattern-949619326 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-4b9d12f5-bc74-4263-acb9-1d7180eccfa2" returned: 0 in 0.462s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:59:15 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-13834840-268f-4592-8623-557fcf5d2794 tempest-TestStampPattern-949619326 None] will copy from snapshot at /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-4b9d12f5-bc74-4263-acb9-1d7180eccfa2 {{(pid=87116) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 06 11:59:15 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-13834840-268f-4592-8623-557fcf5d2794 tempest-TestStampPattern-949619326 None] Creating direct copy from snapshot {{(pid=87116) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 06 11:59:15 devstack cinder-volume[87116]: DEBUG cinder.utils [None req-13834840-268f-4592-8623-557fcf5d2794 tempest-TestStampPattern-949619326 None] Path /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-846110b0-01b0-443f-a58e-86b19f5b87e7 not found in is_blk_device check {{(pid=87116) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 06 11:59:15 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-13834840-268f-4592-8623-557fcf5d2794 tempest-TestStampPattern-949619326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-4b9d12f5-bc74-4263-acb9-1d7180eccfa2 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-846110b0-01b0-443f-a58e-86b19f5b87e7 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:59:15 devstack sudo[105049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-4b9d12f5-bc74-4263-acb9-1d7180eccfa2 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-846110b0-01b0-443f-a58e-86b19f5b87e7 Nov 06 11:59:15 devstack sudo[105049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:59:15 devstack cinder-volume[87116]: DEBUG cinder.volume.flows.manager.create_volume [None req-2ed9166e-03a7-40d2-82c1-716230307f2e tempest-ProjectReaderTests-2022335332 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87116) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 11:59:15 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-2ed9166e-03a7-40d2-82c1-716230307f2e tempest-ProjectReaderTests-2022335332 None] Flow 'volume_create_manager' (795622b1-7a40-44f2-a81a-4d779270410c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 11:59:15 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-2ed9166e-03a7-40d2-82c1-716230307f2e tempest-ProjectReaderTests-2022335332 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (24189433-2d93-47ed-b778-562747111bc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:59:15 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-2ed9166e-03a7-40d2-82c1-716230307f2e tempest-ProjectReaderTests-2022335332 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (24189433-2d93-47ed-b778-562747111bc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T10:59:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1607486717',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7d2a21b6-ee0f-4b2f-98bd-6b23d652237d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a21fe613760f4d0c865d8ab4ce21bd5c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T10:59:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T10:59:15Z,use_quota=True,user_id='f5aed5e3f1ab445998f2b11d499a0db8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(34d3b144-d9b7-480a-a2e3-01e45f3d54c1),volume_type_id=34d3b144-d9b7-480a-a2e3-01e45f3d54c1)' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:59:15 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-2ed9166e-03a7-40d2-82c1-716230307f2e tempest-ProjectReaderTests-2022335332 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f40764e8-38af-4f7c-a723-8f626985e48c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:59:15 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-2ed9166e-03a7-40d2-82c1-716230307f2e tempest-ProjectReaderTests-2022335332 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f40764e8-38af-4f7c-a723-8f626985e48c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:59:15 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-2ed9166e-03a7-40d2-82c1-716230307f2e tempest-ProjectReaderTests-2022335332 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ff11bb0-7594-4202-9b08-8d711afa81f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:59:15 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-2ed9166e-03a7-40d2-82c1-716230307f2e tempest-ProjectReaderTests-2022335332 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ff11bb0-7594-4202-9b08-8d711afa81f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7d2a21b6-ee0f-4b2f-98bd-6b23d652237d', 'volume_name': 'volume-7d2a21b6-ee0f-4b2f-98bd-6b23d652237d', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:59:15 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-2ed9166e-03a7-40d2-82c1-716230307f2e tempest-ProjectReaderTests-2022335332 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (70854058-b86a-43a6-b2d7-5b510823d5aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:59:15 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-2ed9166e-03a7-40d2-82c1-716230307f2e tempest-ProjectReaderTests-2022335332 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (70854058-b86a-43a6-b2d7-5b510823d5aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:59:15 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-2ed9166e-03a7-40d2-82c1-716230307f2e tempest-ProjectReaderTests-2022335332 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5f969f37-459b-4d71-b083-ec6ceb1e2f93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:59:15 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-2ed9166e-03a7-40d2-82c1-716230307f2e tempest-ProjectReaderTests-2022335332 None] Volume 7d2a21b6-ee0f-4b2f-98bd-6b23d652237d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7d2a21b6-ee0f-4b2f-98bd-6b23d652237d', 'volume_size': 1} Nov 06 11:59:15 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-2ed9166e-03a7-40d2-82c1-716230307f2e tempest-ProjectReaderTests-2022335332 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 11:59:23 devstack sudo[105049]: pam_unix(sudo:session): session closed for user root Nov 06 11:59:23 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-13834840-268f-4592-8623-557fcf5d2794 tempest-TestStampPattern-949619326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-4b9d12f5-bc74-4263-acb9-1d7180eccfa2 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-846110b0-01b0-443f-a58e-86b19f5b87e7" returned: 0 in 8.277s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:59:23 devstack cinder-volume[87116]: DEBUG cinder.image.image_utils [None req-13834840-268f-4592-8623-557fcf5d2794 tempest-TestStampPattern-949619326 None] Image conversion details: src /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-4b9d12f5-bc74-4263-acb9-1d7180eccfa2, size 1024.00 MB, duration 8.28 sec, destination /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-846110b0-01b0-443f-a58e-86b19f5b87e7 {{(pid=87116) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 06 11:59:23 devstack cinder-volume[87116]: INFO cinder.image.image_utils [None req-13834840-268f-4592-8623-557fcf5d2794 tempest-TestStampPattern-949619326 None] Converted 1024.00 MB image at 123.69 MB/s Nov 06 11:59:23 devstack cinder-volume[87116]: WARNING cinder.volume.drivers.remotefs [None req-13834840-268f-4592-8623-557fcf5d2794 tempest-TestStampPattern-949619326 None] /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-846110b0-01b0-443f-a58e-86b19f5b87e7 is being set with open permissions: ugo+rw Nov 06 11:59:23 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-13834840-268f-4592-8623-557fcf5d2794 tempest-TestStampPattern-949619326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-846110b0-01b0-443f-a58e-86b19f5b87e7 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:59:23 devstack sudo[105103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-846110b0-01b0-443f-a58e-86b19f5b87e7 Nov 06 11:59:23 devstack sudo[105103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:59:23 devstack sudo[105103]: pam_unix(sudo:session): session closed for user root Nov 06 11:59:23 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-13834840-268f-4592-8623-557fcf5d2794 tempest-TestStampPattern-949619326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-846110b0-01b0-443f-a58e-86b19f5b87e7" returned: 0 in 0.391s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:59:23 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-13834840-268f-4592-8623-557fcf5d2794 tempest-TestStampPattern-949619326 None] Lock "cinder-quobyte-846110b0-01b0-443f-a58e-86b19f5b87e7" released by "_copy_volume_from_snapshot" :: held 9.650s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 11:59:23 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-13834840-268f-4592-8623-557fcf5d2794 tempest-TestStampPattern-949619326 None] Lock "cinder-quobyte-f577480f-c459-4849-b588-11787d70e7c4-846110b0-01b0-443f-a58e-86b19f5b87e7" released by "_create_volume_from_snapshot" :: held 9.755s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 11:59:23 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-13834840-268f-4592-8623-557fcf5d2794 tempest-TestStampPattern-949619326 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.773s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 11:59:23 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-2ed9166e-03a7-40d2-82c1-716230307f2e tempest-ProjectReaderTests-2022335332 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.424s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 11:59:23 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-2ed9166e-03a7-40d2-82c1-716230307f2e tempest-ProjectReaderTests-2022335332 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T10:59:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1607486717',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7d2a21b6-ee0f-4b2f-98bd-6b23d652237d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a21fe613760f4d0c865d8ab4ce21bd5c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T10:59:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T10:59:15Z,use_quota=True,user_id='f5aed5e3f1ab445998f2b11d499a0db8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(34d3b144-d9b7-480a-a2e3-01e45f3d54c1),volume_type_id=34d3b144-d9b7-480a-a2e3-01e45f3d54c1)}" {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 11:59:23 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-2ed9166e-03a7-40d2-82c1-716230307f2e tempest-ProjectReaderTests-2022335332 None] Creating volume 7d2a21b6-ee0f-4b2f-98bd-6b23d652237d {{(pid=87116) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 11:59:23 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-2ed9166e-03a7-40d2-82c1-716230307f2e tempest-ProjectReaderTests-2022335332 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 11:59:23 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-2ed9166e-03a7-40d2-82c1-716230307f2e tempest-ProjectReaderTests-2022335332 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 11:59:23 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-2ed9166e-03a7-40d2-82c1-716230307f2e tempest-ProjectReaderTests-2022335332 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 11:59:23 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-2ed9166e-03a7-40d2-82c1-716230307f2e tempest-ProjectReaderTests-2022335332 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 11:59:23 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-2ed9166e-03a7-40d2-82c1-716230307f2e tempest-ProjectReaderTests-2022335332 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 11:59:23 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-2ed9166e-03a7-40d2-82c1-716230307f2e tempest-ProjectReaderTests-2022335332 None] Selected osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f as target Quobyte volume. {{(pid=87116) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 11:59:23 devstack cinder-volume[87116]: INFO cinder.volume.drivers.remotefs [None req-2ed9166e-03a7-40d2-82c1-716230307f2e tempest-ProjectReaderTests-2022335332 None] casted to osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f Nov 06 11:59:23 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-2ed9166e-03a7-40d2-82c1-716230307f2e tempest-ProjectReaderTests-2022335332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-7d2a21b6-ee0f-4b2f-98bd-6b23d652237d 1073741824 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:59:24 devstack sudo[105135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-7d2a21b6-ee0f-4b2f-98bd-6b23d652237d 1073741824 Nov 06 11:59:24 devstack sudo[105135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:59:24 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-13834840-268f-4592-8623-557fcf5d2794 tempest-TestStampPattern-949619326 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (37efb292-cf55-4caa-b546-1791535707e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-846110b0-01b0-443f-a58e-86b19f5b87e7', 'volume_size': 1, 'snapshot_id': 'f577480f-c459-4849-b588-11787d70e7c4'}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:59:24 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-13834840-268f-4592-8623-557fcf5d2794 tempest-TestStampPattern-949619326 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (39e04248-e312-4184-8a88-d82cdd8252af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:59:24 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-13834840-268f-4592-8623-557fcf5d2794 tempest-TestStampPattern-949619326 None] Volume volume-846110b0-01b0-443f-a58e-86b19f5b87e7 (846110b0-01b0-443f-a58e-86b19f5b87e7): created successfully Nov 06 11:59:24 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-13834840-268f-4592-8623-557fcf5d2794 tempest-TestStampPattern-949619326 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (39e04248-e312-4184-8a88-d82cdd8252af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:59:24 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-13834840-268f-4592-8623-557fcf5d2794 tempest-TestStampPattern-949619326 None] Flow 'volume_create_manager' (ae3716f7-8b94-4d77-9f99-79d44ebe5ae9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 11:59:24 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-13834840-268f-4592-8623-557fcf5d2794 tempest-TestStampPattern-949619326 None] Created volume successfully. Nov 06 11:59:24 devstack sudo[105135]: pam_unix(sudo:session): session closed for user root Nov 06 11:59:24 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-2ed9166e-03a7-40d2-82c1-716230307f2e tempest-ProjectReaderTests-2022335332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-7d2a21b6-ee0f-4b2f-98bd-6b23d652237d 1073741824" returned: 0 in 0.639s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:59:24 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-2ed9166e-03a7-40d2-82c1-716230307f2e tempest-ProjectReaderTests-2022335332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-7d2a21b6-ee0f-4b2f-98bd-6b23d652237d {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:59:24 devstack sudo[105142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-7d2a21b6-ee0f-4b2f-98bd-6b23d652237d Nov 06 11:59:24 devstack sudo[105142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:59:24 devstack sudo[105142]: pam_unix(sudo:session): session closed for user root Nov 06 11:59:24 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-2ed9166e-03a7-40d2-82c1-716230307f2e tempest-ProjectReaderTests-2022335332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-7d2a21b6-ee0f-4b2f-98bd-6b23d652237d" returned: 0 in 0.230s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:59:24 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-2ed9166e-03a7-40d2-82c1-716230307f2e tempest-ProjectReaderTests-2022335332 None] <== create_volume: return (918ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f'} {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 11:59:24 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-2ed9166e-03a7-40d2-82c1-716230307f2e tempest-ProjectReaderTests-2022335332 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.921s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 11:59:24 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-2ed9166e-03a7-40d2-82c1-716230307f2e tempest-ProjectReaderTests-2022335332 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5f969f37-459b-4d71-b083-ec6ceb1e2f93) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7d2a21b6-ee0f-4b2f-98bd-6b23d652237d', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:59:24 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-2ed9166e-03a7-40d2-82c1-716230307f2e tempest-ProjectReaderTests-2022335332 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e6f75ad8-fd1d-450b-96da-8dba24678ece) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:59:24 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-2ed9166e-03a7-40d2-82c1-716230307f2e tempest-ProjectReaderTests-2022335332 None] Volume volume-7d2a21b6-ee0f-4b2f-98bd-6b23d652237d (7d2a21b6-ee0f-4b2f-98bd-6b23d652237d): created successfully Nov 06 11:59:24 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-2ed9166e-03a7-40d2-82c1-716230307f2e tempest-ProjectReaderTests-2022335332 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e6f75ad8-fd1d-450b-96da-8dba24678ece) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:59:24 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-2ed9166e-03a7-40d2-82c1-716230307f2e tempest-ProjectReaderTests-2022335332 None] Flow 'volume_create_manager' (795622b1-7a40-44f2-a81a-4d779270410c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 11:59:24 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-2ed9166e-03a7-40d2-82c1-716230307f2e tempest-ProjectReaderTests-2022335332 None] Created volume successfully. Nov 06 11:59:25 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-0763e133-6854-44ff-837e-298b4be62450 tempest-ProjectReaderTests-2022335332 None] Acquiring lock "cinder-7d2a21b6-ee0f-4b2f-98bd-6b23d652237d-delete_volume" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 11:59:25 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-0763e133-6854-44ff-837e-298b4be62450 tempest-ProjectReaderTests-2022335332 None] Lock "cinder-7d2a21b6-ee0f-4b2f-98bd-6b23d652237d-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 11:59:25 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-0763e133-6854-44ff-837e-298b4be62450 tempest-ProjectReaderTests-2022335332 None] Acquiring lock "cinder-quobyte-7d2a21b6-ee0f-4b2f-98bd-6b23d652237d" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 11:59:25 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-0763e133-6854-44ff-837e-298b4be62450 tempest-ProjectReaderTests-2022335332 None] Lock "cinder-quobyte-7d2a21b6-ee0f-4b2f-98bd-6b23d652237d" acquired by "delete_volume" :: waited 0.029s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 11:59:25 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[f638777c-8ee5-4fe8-8cc1-30e8db560161]: (4, 'qcow2') {{(pid=88420) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 11:59:25 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-0763e133-6854-44ff-837e-298b4be62450 tempest-ProjectReaderTests-2022335332 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-7d2a21b6-ee0f-4b2f-98bd-6b23d652237d {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:59:25 devstack sudo[105147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-7d2a21b6-ee0f-4b2f-98bd-6b23d652237d Nov 06 11:59:25 devstack sudo[105147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:59:26 devstack sudo[105147]: pam_unix(sudo:session): session closed for user root Nov 06 11:59:26 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-0763e133-6854-44ff-837e-298b4be62450 tempest-ProjectReaderTests-2022335332 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-7d2a21b6-ee0f-4b2f-98bd-6b23d652237d" returned: 0 in 0.430s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:59:26 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-0763e133-6854-44ff-837e-298b4be62450 tempest-ProjectReaderTests-2022335332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-7d2a21b6-ee0f-4b2f-98bd-6b23d652237d {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:59:26 devstack sudo[105152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-7d2a21b6-ee0f-4b2f-98bd-6b23d652237d Nov 06 11:59:26 devstack sudo[105152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:59:26 devstack sudo[105152]: pam_unix(sudo:session): session closed for user root Nov 06 11:59:26 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-0763e133-6854-44ff-837e-298b4be62450 tempest-ProjectReaderTests-2022335332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-7d2a21b6-ee0f-4b2f-98bd-6b23d652237d" returned: 0 in 0.297s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:59:26 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-0763e133-6854-44ff-837e-298b4be62450 tempest-ProjectReaderTests-2022335332 None] Lock "cinder-quobyte-7d2a21b6-ee0f-4b2f-98bd-6b23d652237d" released by "delete_volume" :: held 0.788s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 11:59:26 devstack cinder-volume[87116]: DEBUG cinder.quota [None req-0763e133-6854-44ff-837e-298b4be62450 tempest-ProjectReaderTests-2022335332 None] Created reservations ['04da9c1c-c9c1-421b-9243-776dd2a43e55', 'eedc5204-753d-4ce3-923b-bf560ea745da', '8b2f4b6e-67cb-4e18-bc8f-d7f01deb5c9f', 'a2d4df64-974d-43cd-b3d7-3b066a2ef48a'] {{(pid=87116) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 11:59:26 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-0763e133-6854-44ff-837e-298b4be62450 tempest-ProjectReaderTests-2022335332 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 11:59:26 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-0763e133-6854-44ff-837e-298b4be62450 tempest-ProjectReaderTests-2022335332 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 11:59:26 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-0763e133-6854-44ff-837e-298b4be62450 tempest-ProjectReaderTests-2022335332 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 11:59:26 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-0763e133-6854-44ff-837e-298b4be62450 tempest-ProjectReaderTests-2022335332 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 11:59:26 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-0763e133-6854-44ff-837e-298b4be62450 tempest-ProjectReaderTests-2022335332 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 11:59:26 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-0763e133-6854-44ff-837e-298b4be62450 tempest-ProjectReaderTests-2022335332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:59:26 devstack sudo[105155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756 Nov 06 11:59:26 devstack sudo[105155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:59:26 devstack sudo[105155]: pam_unix(sudo:session): session closed for user root Nov 06 11:59:26 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-0763e133-6854-44ff-837e-298b4be62450 tempest-ProjectReaderTests-2022335332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756" returned: 0 in 0.305s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:59:26 devstack cinder-volume[87116]: DEBUG cinder.manager [None req-0763e133-6854-44ff-837e-298b4be62450 tempest-ProjectReaderTests-2022335332 None] Notifying Schedulers of capabilities ... {{(pid=87116) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 11:59:26 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-0763e133-6854-44ff-837e-298b4be62450 tempest-ProjectReaderTests-2022335332 None] Deleted volume successfully. Nov 06 11:59:26 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-0763e133-6854-44ff-837e-298b4be62450 tempest-ProjectReaderTests-2022335332 None] Lock "cinder-7d2a21b6-ee0f-4b2f-98bd-6b23d652237d-delete_volume" released by "delete_volume" :: held 1.358s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 11:59:36 devstack cinder-volume[87116]: DEBUG dbcounter [-] [87116] Writing DB stats cinder:SELECT=37,cinder:UPDATE=37,cinder:INSERT=9,cinder:DELETE=4 {{(pid=87116) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 11:59:36 devstack cinder-volume[87116]: DEBUG dbcounter [-] [87116] Writing DB stats cinder:SELECT=30,cinder:UPDATE=37,cinder:INSERT=7,cinder:DELETE=3 {{(pid=87116) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 11:59:39 devstack cinder-volume[87116]: DEBUG oslo_service.periodic_task [None req-4fab4816-ec2b-4b19-b2ff-8548f2084354 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87116) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 11:59:39 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-4fab4816-ec2b-4b19-b2ff-8548f2084354 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 11:59:39 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-4fab4816-ec2b-4b19-b2ff-8548f2084354 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 11:59:39 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-4fab4816-ec2b-4b19-b2ff-8548f2084354 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 11:59:39 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-4fab4816-ec2b-4b19-b2ff-8548f2084354 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 11:59:39 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-4fab4816-ec2b-4b19-b2ff-8548f2084354 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 11:59:39 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-4fab4816-ec2b-4b19-b2ff-8548f2084354 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:59:39 devstack sudo[105232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756 Nov 06 11:59:39 devstack sudo[105232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:59:40 devstack sudo[105232]: pam_unix(sudo:session): session closed for user root Nov 06 11:59:40 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-4fab4816-ec2b-4b19-b2ff-8548f2084354 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756" returned: 0 in 0.260s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:59:40 devstack cinder-volume[87116]: DEBUG cinder.manager [None req-4fab4816-ec2b-4b19-b2ff-8548f2084354 None None] Notifying Schedulers of capabilities ... {{(pid=87116) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 11:59:40 devstack cinder-volume[87116]: DEBUG oslo_service.periodic_task [None req-4fab4816-ec2b-4b19-b2ff-8548f2084354 None None] Running periodic task VolumeManager._thread_info {{(pid=87116) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 11:59:40 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-4fab4816-ec2b-4b19-b2ff-8548f2084354 None None] thread count: 28 {{(pid=87116) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 06 11:59:40 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-4fab4816-ec2b-4b19-b2ff-8548f2084354 None None] thread info: [<_MainThread(MainThread, started 131399520669824)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87116) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 06 11:59:54 devstack cinder-volume[87116]: DEBUG cinder.volume.flows.manager.create_volume [None req-938442a7-6f12-4523-ae7e-be537d7b969c tempest-SnapshotDependencyTests-662794901 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87116) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 11:59:54 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-938442a7-6f12-4523-ae7e-be537d7b969c tempest-SnapshotDependencyTests-662794901 None] Flow 'volume_create_manager' (4a5f5b2a-14a4-43f1-a72d-a84950ef441b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 11:59:54 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-938442a7-6f12-4523-ae7e-be537d7b969c tempest-SnapshotDependencyTests-662794901 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bc4b854c-b1b9-4b30-9821-077998d45871) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:59:54 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-938442a7-6f12-4523-ae7e-be537d7b969c tempest-SnapshotDependencyTests-662794901 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bc4b854c-b1b9-4b30-9821-077998d45871) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T10:59:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1339058079',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e26d4517-7b80-4f9c-bbb4-8935ff90ed77,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc63df2a835548e6b1f3edeafa6e7637',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T10:59:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T10:59:54Z,use_quota=True,user_id='4527b77b728341cb9b8a7d114d426c5f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(34d3b144-d9b7-480a-a2e3-01e45f3d54c1),volume_type_id=34d3b144-d9b7-480a-a2e3-01e45f3d54c1)' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:59:54 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-938442a7-6f12-4523-ae7e-be537d7b969c tempest-SnapshotDependencyTests-662794901 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (32e9785f-955f-487b-8af8-8fa656257daa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:59:54 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-938442a7-6f12-4523-ae7e-be537d7b969c tempest-SnapshotDependencyTests-662794901 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (32e9785f-955f-487b-8af8-8fa656257daa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:59:54 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-938442a7-6f12-4523-ae7e-be537d7b969c tempest-SnapshotDependencyTests-662794901 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (88fb1bb1-846f-4e9b-a89d-29e688d70f81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:59:54 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-938442a7-6f12-4523-ae7e-be537d7b969c tempest-SnapshotDependencyTests-662794901 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (88fb1bb1-846f-4e9b-a89d-29e688d70f81) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e26d4517-7b80-4f9c-bbb4-8935ff90ed77', 'volume_name': 'volume-e26d4517-7b80-4f9c-bbb4-8935ff90ed77', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:59:54 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-938442a7-6f12-4523-ae7e-be537d7b969c tempest-SnapshotDependencyTests-662794901 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a8c0d236-891e-4bbd-be8e-052e02d718f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:59:54 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-938442a7-6f12-4523-ae7e-be537d7b969c tempest-SnapshotDependencyTests-662794901 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a8c0d236-891e-4bbd-be8e-052e02d718f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:59:54 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-938442a7-6f12-4523-ae7e-be537d7b969c tempest-SnapshotDependencyTests-662794901 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (21011cb2-dcf2-4a96-844d-a80304922515) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:59:54 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-938442a7-6f12-4523-ae7e-be537d7b969c tempest-SnapshotDependencyTests-662794901 None] Volume e26d4517-7b80-4f9c-bbb4-8935ff90ed77: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e26d4517-7b80-4f9c-bbb4-8935ff90ed77', 'volume_size': 1} Nov 06 11:59:54 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-938442a7-6f12-4523-ae7e-be537d7b969c tempest-SnapshotDependencyTests-662794901 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 11:59:54 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-938442a7-6f12-4523-ae7e-be537d7b969c tempest-SnapshotDependencyTests-662794901 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 11:59:54 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-938442a7-6f12-4523-ae7e-be537d7b969c tempest-SnapshotDependencyTests-662794901 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T10:59:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1339058079',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e26d4517-7b80-4f9c-bbb4-8935ff90ed77,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc63df2a835548e6b1f3edeafa6e7637',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T10:59:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T10:59:54Z,use_quota=True,user_id='4527b77b728341cb9b8a7d114d426c5f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(34d3b144-d9b7-480a-a2e3-01e45f3d54c1),volume_type_id=34d3b144-d9b7-480a-a2e3-01e45f3d54c1)}" {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 11:59:54 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-938442a7-6f12-4523-ae7e-be537d7b969c tempest-SnapshotDependencyTests-662794901 None] Creating volume e26d4517-7b80-4f9c-bbb4-8935ff90ed77 {{(pid=87116) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 11:59:54 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-938442a7-6f12-4523-ae7e-be537d7b969c tempest-SnapshotDependencyTests-662794901 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 11:59:54 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-938442a7-6f12-4523-ae7e-be537d7b969c tempest-SnapshotDependencyTests-662794901 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 11:59:54 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-938442a7-6f12-4523-ae7e-be537d7b969c tempest-SnapshotDependencyTests-662794901 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 11:59:54 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-938442a7-6f12-4523-ae7e-be537d7b969c tempest-SnapshotDependencyTests-662794901 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 11:59:54 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-938442a7-6f12-4523-ae7e-be537d7b969c tempest-SnapshotDependencyTests-662794901 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 11:59:54 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-938442a7-6f12-4523-ae7e-be537d7b969c tempest-SnapshotDependencyTests-662794901 None] Selected osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f as target Quobyte volume. {{(pid=87116) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 11:59:54 devstack cinder-volume[87116]: INFO cinder.volume.drivers.remotefs [None req-938442a7-6f12-4523-ae7e-be537d7b969c tempest-SnapshotDependencyTests-662794901 None] casted to osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f Nov 06 11:59:54 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-938442a7-6f12-4523-ae7e-be537d7b969c tempest-SnapshotDependencyTests-662794901 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-e26d4517-7b80-4f9c-bbb4-8935ff90ed77 1073741824 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:59:54 devstack sudo[105238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-e26d4517-7b80-4f9c-bbb4-8935ff90ed77 1073741824 Nov 06 11:59:54 devstack sudo[105238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:59:54 devstack sudo[105238]: pam_unix(sudo:session): session closed for user root Nov 06 11:59:54 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-938442a7-6f12-4523-ae7e-be537d7b969c tempest-SnapshotDependencyTests-662794901 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-e26d4517-7b80-4f9c-bbb4-8935ff90ed77 1073741824" returned: 0 in 0.406s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:59:54 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-938442a7-6f12-4523-ae7e-be537d7b969c tempest-SnapshotDependencyTests-662794901 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-e26d4517-7b80-4f9c-bbb4-8935ff90ed77 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:59:54 devstack sudo[105244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-e26d4517-7b80-4f9c-bbb4-8935ff90ed77 Nov 06 11:59:54 devstack sudo[105244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:59:54 devstack sudo[105244]: pam_unix(sudo:session): session closed for user root Nov 06 11:59:54 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-938442a7-6f12-4523-ae7e-be537d7b969c tempest-SnapshotDependencyTests-662794901 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-e26d4517-7b80-4f9c-bbb4-8935ff90ed77" returned: 0 in 0.233s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:59:54 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-938442a7-6f12-4523-ae7e-be537d7b969c tempest-SnapshotDependencyTests-662794901 None] <== create_volume: return (677ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f'} {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 11:59:54 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-938442a7-6f12-4523-ae7e-be537d7b969c tempest-SnapshotDependencyTests-662794901 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.679s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 11:59:54 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-938442a7-6f12-4523-ae7e-be537d7b969c tempest-SnapshotDependencyTests-662794901 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (21011cb2-dcf2-4a96-844d-a80304922515) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e26d4517-7b80-4f9c-bbb4-8935ff90ed77', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:59:54 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-938442a7-6f12-4523-ae7e-be537d7b969c tempest-SnapshotDependencyTests-662794901 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6dc2a003-bb0b-4024-80b5-9c4a74c3aa59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:59:54 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-938442a7-6f12-4523-ae7e-be537d7b969c tempest-SnapshotDependencyTests-662794901 None] Volume volume-e26d4517-7b80-4f9c-bbb4-8935ff90ed77 (e26d4517-7b80-4f9c-bbb4-8935ff90ed77): created successfully Nov 06 11:59:54 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-938442a7-6f12-4523-ae7e-be537d7b969c tempest-SnapshotDependencyTests-662794901 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6dc2a003-bb0b-4024-80b5-9c4a74c3aa59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:59:54 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-938442a7-6f12-4523-ae7e-be537d7b969c tempest-SnapshotDependencyTests-662794901 None] Flow 'volume_create_manager' (4a5f5b2a-14a4-43f1-a72d-a84950ef441b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 11:59:54 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-938442a7-6f12-4523-ae7e-be537d7b969c tempest-SnapshotDependencyTests-662794901 None] Created volume successfully. Nov 06 11:59:55 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-859c709b-f64a-4d70-8d5f-c3df168efcaf tempest-SnapshotDependencyTests-662794901 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 11:59:55 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-859c709b-f64a-4d70-8d5f-c3df168efcaf tempest-SnapshotDependencyTests-662794901 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 11:59:55 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-859c709b-f64a-4d70-8d5f-c3df168efcaf tempest-SnapshotDependencyTests-662794901 None] Creating offline snapshot 442cab63-ead9-4fbc-9f80-bcd5a5f79d68 of volume e26d4517-7b80-4f9c-bbb4-8935ff90ed77 {{(pid=87116) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 06 11:59:55 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ad919fc-8a44-4908-8fcf-9b292947df2a]: (4, 'qcow2') {{(pid=88420) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 11:59:55 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-859c709b-f64a-4d70-8d5f-c3df168efcaf tempest-SnapshotDependencyTests-662794901 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-e26d4517-7b80-4f9c-bbb4-8935ff90ed77 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:59:55 devstack sudo[105247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-e26d4517-7b80-4f9c-bbb4-8935ff90ed77 Nov 06 11:59:55 devstack sudo[105247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:59:55 devstack sudo[105247]: pam_unix(sudo:session): session closed for user root Nov 06 11:59:55 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-859c709b-f64a-4d70-8d5f-c3df168efcaf tempest-SnapshotDependencyTests-662794901 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-e26d4517-7b80-4f9c-bbb4-8935ff90ed77" returned: 0 in 0.402s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:59:55 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-859c709b-f64a-4d70-8d5f-c3df168efcaf tempest-SnapshotDependencyTests-662794901 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-e26d4517-7b80-4f9c-bbb4-8935ff90ed77,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-e26d4517-7b80-4f9c-bbb4-8935ff90ed77.442cab63-ead9-4fbc-9f80-bcd5a5f79d68 1G {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:59:55 devstack sudo[105253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-e26d4517-7b80-4f9c-bbb4-8935ff90ed77,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-e26d4517-7b80-4f9c-bbb4-8935ff90ed77.442cab63-ead9-4fbc-9f80-bcd5a5f79d68 1G Nov 06 11:59:55 devstack sudo[105253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:59:56 devstack sudo[105253]: pam_unix(sudo:session): session closed for user root Nov 06 11:59:56 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-859c709b-f64a-4d70-8d5f-c3df168efcaf tempest-SnapshotDependencyTests-662794901 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-e26d4517-7b80-4f9c-bbb4-8935ff90ed77,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-e26d4517-7b80-4f9c-bbb4-8935ff90ed77.442cab63-ead9-4fbc-9f80-bcd5a5f79d68 1G" returned: 0 in 0.462s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:59:56 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-859c709b-f64a-4d70-8d5f-c3df168efcaf tempest-SnapshotDependencyTests-662794901 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e26d4517-7b80-4f9c-bbb4-8935ff90ed77 -F qcow2 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-e26d4517-7b80-4f9c-bbb4-8935ff90ed77.442cab63-ead9-4fbc-9f80-bcd5a5f79d68 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:59:56 devstack sudo[105259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e26d4517-7b80-4f9c-bbb4-8935ff90ed77 -F qcow2 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-e26d4517-7b80-4f9c-bbb4-8935ff90ed77.442cab63-ead9-4fbc-9f80-bcd5a5f79d68 Nov 06 11:59:56 devstack sudo[105259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:59:56 devstack sudo[105259]: pam_unix(sudo:session): session closed for user root Nov 06 11:59:56 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-859c709b-f64a-4d70-8d5f-c3df168efcaf tempest-SnapshotDependencyTests-662794901 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e26d4517-7b80-4f9c-bbb4-8935ff90ed77 -F qcow2 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-e26d4517-7b80-4f9c-bbb4-8935ff90ed77.442cab63-ead9-4fbc-9f80-bcd5a5f79d68" returned: 0 in 0.316s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:59:56 devstack cinder-volume[87116]: WARNING cinder.volume.drivers.remotefs [None req-859c709b-f64a-4d70-8d5f-c3df168efcaf tempest-SnapshotDependencyTests-662794901 None] /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-e26d4517-7b80-4f9c-bbb4-8935ff90ed77.442cab63-ead9-4fbc-9f80-bcd5a5f79d68 is being set with open permissions: ugo+rw Nov 06 11:59:56 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-859c709b-f64a-4d70-8d5f-c3df168efcaf tempest-SnapshotDependencyTests-662794901 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-e26d4517-7b80-4f9c-bbb4-8935ff90ed77.442cab63-ead9-4fbc-9f80-bcd5a5f79d68 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:59:56 devstack sudo[105264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-e26d4517-7b80-4f9c-bbb4-8935ff90ed77.442cab63-ead9-4fbc-9f80-bcd5a5f79d68 Nov 06 11:59:56 devstack sudo[105264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:59:56 devstack sudo[105264]: pam_unix(sudo:session): session closed for user root Nov 06 11:59:56 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-859c709b-f64a-4d70-8d5f-c3df168efcaf tempest-SnapshotDependencyTests-662794901 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-e26d4517-7b80-4f9c-bbb4-8935ff90ed77.442cab63-ead9-4fbc-9f80-bcd5a5f79d68" returned: 0 in 0.271s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:59:56 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-859c709b-f64a-4d70-8d5f-c3df168efcaf tempest-SnapshotDependencyTests-662794901 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-e26d4517-7b80-4f9c-bbb4-8935ff90ed77.info {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:59:56 devstack sudo[105267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-e26d4517-7b80-4f9c-bbb4-8935ff90ed77.info Nov 06 11:59:56 devstack sudo[105267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:59:57 devstack sudo[105267]: pam_unix(sudo:session): session closed for user root Nov 06 11:59:57 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-859c709b-f64a-4d70-8d5f-c3df168efcaf tempest-SnapshotDependencyTests-662794901 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-e26d4517-7b80-4f9c-bbb4-8935ff90ed77.info" returned: 0 in 0.262s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:59:57 devstack cinder-volume[87116]: WARNING cinder.volume.drivers.remotefs [None req-859c709b-f64a-4d70-8d5f-c3df168efcaf tempest-SnapshotDependencyTests-662794901 None] /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-e26d4517-7b80-4f9c-bbb4-8935ff90ed77.info is being set with open permissions: ugo+rw Nov 06 11:59:57 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-859c709b-f64a-4d70-8d5f-c3df168efcaf tempest-SnapshotDependencyTests-662794901 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-e26d4517-7b80-4f9c-bbb4-8935ff90ed77.info {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:59:57 devstack sudo[105270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-e26d4517-7b80-4f9c-bbb4-8935ff90ed77.info Nov 06 11:59:57 devstack sudo[105270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:59:57 devstack sudo[105270]: pam_unix(sudo:session): session closed for user root Nov 06 11:59:57 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-859c709b-f64a-4d70-8d5f-c3df168efcaf tempest-SnapshotDependencyTests-662794901 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-e26d4517-7b80-4f9c-bbb4-8935ff90ed77.info" returned: 0 in 0.232s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:59:57 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-859c709b-f64a-4d70-8d5f-c3df168efcaf tempest-SnapshotDependencyTests-662794901 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.045s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 11:59:57 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-859c709b-f64a-4d70-8d5f-c3df168efcaf tempest-SnapshotDependencyTests-662794901 None] Create snapshot completed successfully Nov 06 11:59:58 devstack cinder-volume[87116]: DEBUG cinder.volume.flows.manager.create_volume [None req-97e84593-efa3-4086-b25a-8cdab563aad8 tempest-SnapshotDependencyTests-662794901 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87116) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 11:59:58 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-97e84593-efa3-4086-b25a-8cdab563aad8 tempest-SnapshotDependencyTests-662794901 None] Flow 'volume_create_manager' (edb37bd7-3fc1-45da-8994-7041c6364119) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 11:59:58 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-97e84593-efa3-4086-b25a-8cdab563aad8 tempest-SnapshotDependencyTests-662794901 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eaacda4f-5dd6-4899-ba10-4a6d1e3fdaa5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:59:58 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-97e84593-efa3-4086-b25a-8cdab563aad8 tempest-SnapshotDependencyTests-662794901 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eaacda4f-5dd6-4899-ba10-4a6d1e3fdaa5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T10:59:59Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=48ec0860-bb9d-4f7e-a643-2a206cf49daf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc63df2a835548e6b1f3edeafa6e7637',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T10:59:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=442cab63-ead9-4fbc-9f80-bcd5a5f79d68,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T10:59:59Z,use_quota=True,user_id='4527b77b728341cb9b8a7d114d426c5f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(34d3b144-d9b7-480a-a2e3-01e45f3d54c1),volume_type_id=34d3b144-d9b7-480a-a2e3-01e45f3d54c1)' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:59:58 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-97e84593-efa3-4086-b25a-8cdab563aad8 tempest-SnapshotDependencyTests-662794901 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (36de8a8b-ee24-4a52-8183-cb4638bc337b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:59:59 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-97e84593-efa3-4086-b25a-8cdab563aad8 tempest-SnapshotDependencyTests-662794901 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (36de8a8b-ee24-4a52-8183-cb4638bc337b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:59:59 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-97e84593-efa3-4086-b25a-8cdab563aad8 tempest-SnapshotDependencyTests-662794901 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cd2f252b-7ba2-4a80-b3d8-e779fe9d580d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:59:59 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-97e84593-efa3-4086-b25a-8cdab563aad8 tempest-SnapshotDependencyTests-662794901 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cd2f252b-7ba2-4a80-b3d8-e779fe9d580d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '48ec0860-bb9d-4f7e-a643-2a206cf49daf', 'volume_name': 'volume-48ec0860-bb9d-4f7e-a643-2a206cf49daf', 'volume_size': 1, 'snapshot_id': '442cab63-ead9-4fbc-9f80-bcd5a5f79d68'}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:59:59 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-97e84593-efa3-4086-b25a-8cdab563aad8 tempest-SnapshotDependencyTests-662794901 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8a12a2d5-567e-4ad2-91c7-b420b6a5a287) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:59:59 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-97e84593-efa3-4086-b25a-8cdab563aad8 tempest-SnapshotDependencyTests-662794901 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8a12a2d5-567e-4ad2-91c7-b420b6a5a287) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 11:59:59 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-97e84593-efa3-4086-b25a-8cdab563aad8 tempest-SnapshotDependencyTests-662794901 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b7e06117-d625-4b84-becf-f93c02889bd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 11:59:59 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-97e84593-efa3-4086-b25a-8cdab563aad8 tempest-SnapshotDependencyTests-662794901 None] Volume 48ec0860-bb9d-4f7e-a643-2a206cf49daf: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-48ec0860-bb9d-4f7e-a643-2a206cf49daf', 'volume_size': 1, 'snapshot_id': '442cab63-ead9-4fbc-9f80-bcd5a5f79d68'} Nov 06 11:59:59 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-97e84593-efa3-4086-b25a-8cdab563aad8 tempest-SnapshotDependencyTests-662794901 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 11:59:59 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-97e84593-efa3-4086-b25a-8cdab563aad8 tempest-SnapshotDependencyTests-662794901 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 11:59:59 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-97e84593-efa3-4086-b25a-8cdab563aad8 tempest-SnapshotDependencyTests-662794901 None] Acquiring lock "cinder-quobyte-442cab63-ead9-4fbc-9f80-bcd5a5f79d68-48ec0860-bb9d-4f7e-a643-2a206cf49daf" by "_create_volume_from_snapshot" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 11:59:59 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-97e84593-efa3-4086-b25a-8cdab563aad8 tempest-SnapshotDependencyTests-662794901 None] Lock "cinder-quobyte-442cab63-ead9-4fbc-9f80-bcd5a5f79d68-48ec0860-bb9d-4f7e-a643-2a206cf49daf" acquired by "_create_volume_from_snapshot" :: waited 0.012s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 11:59:59 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-97e84593-efa3-4086-b25a-8cdab563aad8 tempest-SnapshotDependencyTests-662794901 None] Creating volume 48ec0860-bb9d-4f7e-a643-2a206cf49daf from snapshot 442cab63-ead9-4fbc-9f80-bcd5a5f79d68 {{(pid=87116) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Nov 06 11:59:59 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-97e84593-efa3-4086-b25a-8cdab563aad8 tempest-SnapshotDependencyTests-662794901 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 11:59:59 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-97e84593-efa3-4086-b25a-8cdab563aad8 tempest-SnapshotDependencyTests-662794901 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 11:59:59 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-97e84593-efa3-4086-b25a-8cdab563aad8 tempest-SnapshotDependencyTests-662794901 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 11:59:59 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-97e84593-efa3-4086-b25a-8cdab563aad8 tempest-SnapshotDependencyTests-662794901 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 11:59:59 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-97e84593-efa3-4086-b25a-8cdab563aad8 tempest-SnapshotDependencyTests-662794901 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 11:59:59 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-97e84593-efa3-4086-b25a-8cdab563aad8 tempest-SnapshotDependencyTests-662794901 None] Selected osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f as target Quobyte volume. {{(pid=87116) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 11:59:59 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-97e84593-efa3-4086-b25a-8cdab563aad8 tempest-SnapshotDependencyTests-662794901 None] Acquiring lock "cinder-quobyte-48ec0860-bb9d-4f7e-a643-2a206cf49daf" by "_copy_volume_from_snapshot" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 11:59:59 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-97e84593-efa3-4086-b25a-8cdab563aad8 tempest-SnapshotDependencyTests-662794901 None] Lock "cinder-quobyte-48ec0860-bb9d-4f7e-a643-2a206cf49daf" acquired by "_copy_volume_from_snapshot" :: waited 0.012s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 11:59:59 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-97e84593-efa3-4086-b25a-8cdab563aad8 tempest-SnapshotDependencyTests-662794901 None] snapshot: 442cab63-ead9-4fbc-9f80-bcd5a5f79d68, volume: 48ec0860-bb9d-4f7e-a643-2a206cf49daf, {{(pid=87116) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 06 11:59:59 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-97e84593-efa3-4086-b25a-8cdab563aad8 tempest-SnapshotDependencyTests-662794901 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 11:59:59 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-97e84593-efa3-4086-b25a-8cdab563aad8 tempest-SnapshotDependencyTests-662794901 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 11:59:59 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-97e84593-efa3-4086-b25a-8cdab563aad8 tempest-SnapshotDependencyTests-662794901 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 11:59:59 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-97e84593-efa3-4086-b25a-8cdab563aad8 tempest-SnapshotDependencyTests-662794901 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 11:59:59 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-97e84593-efa3-4086-b25a-8cdab563aad8 tempest-SnapshotDependencyTests-662794901 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 11:59:59 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[65dc81b1-37bc-496b-9a88-9be6934c7bb2]: (4, 'qcow2') {{(pid=88420) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 11:59:59 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-97e84593-efa3-4086-b25a-8cdab563aad8 tempest-SnapshotDependencyTests-662794901 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-e26d4517-7b80-4f9c-bbb4-8935ff90ed77.442cab63-ead9-4fbc-9f80-bcd5a5f79d68 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:59:59 devstack sudo[105273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-e26d4517-7b80-4f9c-bbb4-8935ff90ed77.442cab63-ead9-4fbc-9f80-bcd5a5f79d68 Nov 06 11:59:59 devstack sudo[105273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:59:59 devstack sudo[105273]: pam_unix(sudo:session): session closed for user root Nov 06 11:59:59 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-97e84593-efa3-4086-b25a-8cdab563aad8 tempest-SnapshotDependencyTests-662794901 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-e26d4517-7b80-4f9c-bbb4-8935ff90ed77.442cab63-ead9-4fbc-9f80-bcd5a5f79d68" returned: 0 in 0.356s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:59:59 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-97e84593-efa3-4086-b25a-8cdab563aad8 tempest-SnapshotDependencyTests-662794901 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e26d4517-7b80-4f9c-bbb4-8935ff90ed77(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87116) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 11:59:59 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[b415da57-eb20-499b-a7da-68297893e0c2]: (4, 'qcow2') {{(pid=88420) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 11:59:59 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-97e84593-efa3-4086-b25a-8cdab563aad8 tempest-SnapshotDependencyTests-662794901 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-e26d4517-7b80-4f9c-bbb4-8935ff90ed77 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:59:59 devstack sudo[105278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-e26d4517-7b80-4f9c-bbb4-8935ff90ed77 Nov 06 11:59:59 devstack sudo[105278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 11:59:59 devstack sudo[105278]: pam_unix(sudo:session): session closed for user root Nov 06 11:59:59 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-97e84593-efa3-4086-b25a-8cdab563aad8 tempest-SnapshotDependencyTests-662794901 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-e26d4517-7b80-4f9c-bbb4-8935ff90ed77" returned: 0 in 0.355s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 11:59:59 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-97e84593-efa3-4086-b25a-8cdab563aad8 tempest-SnapshotDependencyTests-662794901 None] will copy from snapshot at /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-e26d4517-7b80-4f9c-bbb4-8935ff90ed77 {{(pid=87116) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 06 11:59:59 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-97e84593-efa3-4086-b25a-8cdab563aad8 tempest-SnapshotDependencyTests-662794901 None] Creating direct copy from snapshot {{(pid=87116) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 06 11:59:59 devstack cinder-volume[87116]: DEBUG cinder.utils [None req-97e84593-efa3-4086-b25a-8cdab563aad8 tempest-SnapshotDependencyTests-662794901 None] Path /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-48ec0860-bb9d-4f7e-a643-2a206cf49daf not found in is_blk_device check {{(pid=87116) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 06 11:59:59 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-97e84593-efa3-4086-b25a-8cdab563aad8 tempest-SnapshotDependencyTests-662794901 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-e26d4517-7b80-4f9c-bbb4-8935ff90ed77 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-48ec0860-bb9d-4f7e-a643-2a206cf49daf {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 11:59:59 devstack sudo[105283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-e26d4517-7b80-4f9c-bbb4-8935ff90ed77 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-48ec0860-bb9d-4f7e-a643-2a206cf49daf Nov 06 11:59:59 devstack sudo[105283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 12:00:05 devstack sudo[105283]: pam_unix(sudo:session): session closed for user root Nov 06 12:00:05 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-97e84593-efa3-4086-b25a-8cdab563aad8 tempest-SnapshotDependencyTests-662794901 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-e26d4517-7b80-4f9c-bbb4-8935ff90ed77 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-48ec0860-bb9d-4f7e-a643-2a206cf49daf" returned: 0 in 5.728s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 12:00:05 devstack cinder-volume[87116]: DEBUG cinder.image.image_utils [None req-97e84593-efa3-4086-b25a-8cdab563aad8 tempest-SnapshotDependencyTests-662794901 None] Image conversion details: src /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-e26d4517-7b80-4f9c-bbb4-8935ff90ed77, size 1024.00 MB, duration 5.73 sec, destination /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-48ec0860-bb9d-4f7e-a643-2a206cf49daf {{(pid=87116) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 06 12:00:05 devstack cinder-volume[87116]: INFO cinder.image.image_utils [None req-97e84593-efa3-4086-b25a-8cdab563aad8 tempest-SnapshotDependencyTests-662794901 None] Converted 1024.00 MB image at 178.74 MB/s Nov 06 12:00:05 devstack cinder-volume[87116]: WARNING cinder.volume.drivers.remotefs [None req-97e84593-efa3-4086-b25a-8cdab563aad8 tempest-SnapshotDependencyTests-662794901 None] /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-48ec0860-bb9d-4f7e-a643-2a206cf49daf is being set with open permissions: ugo+rw Nov 06 12:00:05 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-97e84593-efa3-4086-b25a-8cdab563aad8 tempest-SnapshotDependencyTests-662794901 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-48ec0860-bb9d-4f7e-a643-2a206cf49daf {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 12:00:05 devstack sudo[105304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-48ec0860-bb9d-4f7e-a643-2a206cf49daf Nov 06 12:00:05 devstack sudo[105304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 12:00:05 devstack sudo[105304]: pam_unix(sudo:session): session closed for user root Nov 06 12:00:05 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-97e84593-efa3-4086-b25a-8cdab563aad8 tempest-SnapshotDependencyTests-662794901 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-48ec0860-bb9d-4f7e-a643-2a206cf49daf" returned: 0 in 0.256s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 12:00:05 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-97e84593-efa3-4086-b25a-8cdab563aad8 tempest-SnapshotDependencyTests-662794901 None] Lock "cinder-quobyte-48ec0860-bb9d-4f7e-a643-2a206cf49daf" released by "_copy_volume_from_snapshot" :: held 6.774s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 12:00:05 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-97e84593-efa3-4086-b25a-8cdab563aad8 tempest-SnapshotDependencyTests-662794901 None] Lock "cinder-quobyte-442cab63-ead9-4fbc-9f80-bcd5a5f79d68-48ec0860-bb9d-4f7e-a643-2a206cf49daf" released by "_create_volume_from_snapshot" :: held 6.838s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 12:00:05 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-97e84593-efa3-4086-b25a-8cdab563aad8 tempest-SnapshotDependencyTests-662794901 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 6.852s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 12:00:05 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [req-8a066a1f-80ef-4211-982e-67cb4e36bf65 req-33c7cfba-57be-4979-8511-335af7904fc1 tempest-TestStampPattern-949619326 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 12:00:05 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [req-8a066a1f-80ef-4211-982e-67cb4e36bf65 req-33c7cfba-57be-4979-8511-335af7904fc1 tempest-TestStampPattern-949619326 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 12:00:05 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [req-8a066a1f-80ef-4211-982e-67cb4e36bf65 req-33c7cfba-57be-4979-8511-335af7904fc1 tempest-TestStampPattern-949619326 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.017s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 12:00:05 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-97e84593-efa3-4086-b25a-8cdab563aad8 tempest-SnapshotDependencyTests-662794901 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b7e06117-d625-4b84-becf-f93c02889bd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-48ec0860-bb9d-4f7e-a643-2a206cf49daf', 'volume_size': 1, 'snapshot_id': '442cab63-ead9-4fbc-9f80-bcd5a5f79d68'}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 12:00:05 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-97e84593-efa3-4086-b25a-8cdab563aad8 tempest-SnapshotDependencyTests-662794901 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3ed683d0-44aa-4e42-9054-a2f7ed483b85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 12:00:05 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-97e84593-efa3-4086-b25a-8cdab563aad8 tempest-SnapshotDependencyTests-662794901 None] Volume volume-48ec0860-bb9d-4f7e-a643-2a206cf49daf (48ec0860-bb9d-4f7e-a643-2a206cf49daf): created successfully Nov 06 12:00:05 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-97e84593-efa3-4086-b25a-8cdab563aad8 tempest-SnapshotDependencyTests-662794901 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3ed683d0-44aa-4e42-9054-a2f7ed483b85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 12:00:05 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-97e84593-efa3-4086-b25a-8cdab563aad8 tempest-SnapshotDependencyTests-662794901 None] Flow 'volume_create_manager' (edb37bd7-3fc1-45da-8994-7041c6364119) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 12:00:05 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [req-8a066a1f-80ef-4211-982e-67cb4e36bf65 req-33c7cfba-57be-4979-8511-335af7904fc1 tempest-TestStampPattern-949619326 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f', 'name': 'volume-846110b0-01b0-443f-a58e-86b19f5b87e7', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '3abb7dba-ddd6-44d4-8313-5f2ced647bd6', 'enforce_multipath': True} {{(pid=87116) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 06 12:00:05 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-97e84593-efa3-4086-b25a-8cdab563aad8 tempest-SnapshotDependencyTests-662794901 None] Created volume successfully. Nov 06 12:00:06 devstack cinder-volume[87116]: INFO cinder.volume.manager [req-8a066a1f-80ef-4211-982e-67cb4e36bf65 req-33c7cfba-57be-4979-8511-335af7904fc1 tempest-TestStampPattern-949619326 None] attachment_update completed successfully. Nov 06 12:00:06 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-79a7d238-277a-4883-ae18-2ec739d886d2 tempest-SnapshotDependencyTests-662794901 None] Acquiring lock "cinder-442cab63-ead9-4fbc-9f80-bcd5a5f79d68-delete_snapshot" by "delete_snapshot" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 12:00:06 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-79a7d238-277a-4883-ae18-2ec739d886d2 tempest-SnapshotDependencyTests-662794901 None] Lock "cinder-442cab63-ead9-4fbc-9f80-bcd5a5f79d68-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 12:00:06 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-79a7d238-277a-4883-ae18-2ec739d886d2 tempest-SnapshotDependencyTests-662794901 None] Acquiring lock "cinder-quobyte-e26d4517-7b80-4f9c-bbb4-8935ff90ed77" by "delete_snapshot" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 12:00:06 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-79a7d238-277a-4883-ae18-2ec739d886d2 tempest-SnapshotDependencyTests-662794901 None] Lock "cinder-quobyte-e26d4517-7b80-4f9c-bbb4-8935ff90ed77" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 12:00:06 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-79a7d238-277a-4883-ae18-2ec739d886d2 tempest-SnapshotDependencyTests-662794901 None] Acquiring lock "cinder-quobyte-442cab63-ead9-4fbc-9f80-bcd5a5f79d68" by "_delete_snapshot" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 12:00:06 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-79a7d238-277a-4883-ae18-2ec739d886d2 tempest-SnapshotDependencyTests-662794901 None] Lock "cinder-quobyte-442cab63-ead9-4fbc-9f80-bcd5a5f79d68" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 12:00:06 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-79a7d238-277a-4883-ae18-2ec739d886d2 tempest-SnapshotDependencyTests-662794901 None] Deleting offline snapshot 442cab63-ead9-4fbc-9f80-bcd5a5f79d68 of volume e26d4517-7b80-4f9c-bbb4-8935ff90ed77 {{(pid=87116) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 06 12:00:06 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-79a7d238-277a-4883-ae18-2ec739d886d2 tempest-SnapshotDependencyTests-662794901 None] snapshot_file for this snap is: volume-e26d4517-7b80-4f9c-bbb4-8935ff90ed77.442cab63-ead9-4fbc-9f80-bcd5a5f79d68 {{(pid=87116) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 06 12:00:06 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[274675d5-fa1f-4bbc-8bc0-23bb5ac84314]: (4, 'qcow2') {{(pid=88420) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 12:00:06 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-79a7d238-277a-4883-ae18-2ec739d886d2 tempest-SnapshotDependencyTests-662794901 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-e26d4517-7b80-4f9c-bbb4-8935ff90ed77.442cab63-ead9-4fbc-9f80-bcd5a5f79d68 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 12:00:06 devstack sudo[105733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-e26d4517-7b80-4f9c-bbb4-8935ff90ed77.442cab63-ead9-4fbc-9f80-bcd5a5f79d68 Nov 06 12:00:06 devstack sudo[105733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 12:00:07 devstack sudo[105733]: pam_unix(sudo:session): session closed for user root Nov 06 12:00:07 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-79a7d238-277a-4883-ae18-2ec739d886d2 tempest-SnapshotDependencyTests-662794901 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-e26d4517-7b80-4f9c-bbb4-8935ff90ed77.442cab63-ead9-4fbc-9f80-bcd5a5f79d68" returned: 0 in 0.357s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 12:00:07 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-79a7d238-277a-4883-ae18-2ec739d886d2 tempest-SnapshotDependencyTests-662794901 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e26d4517-7b80-4f9c-bbb4-8935ff90ed77(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87116) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 12:00:07 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[d78e377c-3f19-400e-bb96-4e3c689e492a]: (4, 'qcow2') {{(pid=88420) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 12:00:07 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-79a7d238-277a-4883-ae18-2ec739d886d2 tempest-SnapshotDependencyTests-662794901 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-e26d4517-7b80-4f9c-bbb4-8935ff90ed77 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 12:00:07 devstack sudo[105739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-e26d4517-7b80-4f9c-bbb4-8935ff90ed77 Nov 06 12:00:07 devstack sudo[105739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 12:00:07 devstack sudo[105739]: pam_unix(sudo:session): session closed for user root Nov 06 12:00:07 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-79a7d238-277a-4883-ae18-2ec739d886d2 tempest-SnapshotDependencyTests-662794901 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-e26d4517-7b80-4f9c-bbb4-8935ff90ed77" returned: 0 in 0.478s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 12:00:07 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-79a7d238-277a-4883-ae18-2ec739d886d2 tempest-SnapshotDependencyTests-662794901 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-e26d4517-7b80-4f9c-bbb4-8935ff90ed77.442cab63-ead9-4fbc-9f80-bcd5a5f79d68 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 12:00:07 devstack sudo[105744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-e26d4517-7b80-4f9c-bbb4-8935ff90ed77.442cab63-ead9-4fbc-9f80-bcd5a5f79d68 Nov 06 12:00:07 devstack sudo[105744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 12:00:07 devstack sudo[105744]: pam_unix(sudo:session): session closed for user root Nov 06 12:00:07 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-79a7d238-277a-4883-ae18-2ec739d886d2 tempest-SnapshotDependencyTests-662794901 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-e26d4517-7b80-4f9c-bbb4-8935ff90ed77.442cab63-ead9-4fbc-9f80-bcd5a5f79d68" returned: 0 in 0.342s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 12:00:07 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-79a7d238-277a-4883-ae18-2ec739d886d2 tempest-SnapshotDependencyTests-662794901 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-e26d4517-7b80-4f9c-bbb4-8935ff90ed77.442cab63-ead9-4fbc-9f80-bcd5a5f79d68 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 12:00:07 devstack sudo[105751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-e26d4517-7b80-4f9c-bbb4-8935ff90ed77.442cab63-ead9-4fbc-9f80-bcd5a5f79d68 Nov 06 12:00:07 devstack sudo[105751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 12:00:08 devstack sudo[105751]: pam_unix(sudo:session): session closed for user root Nov 06 12:00:08 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-79a7d238-277a-4883-ae18-2ec739d886d2 tempest-SnapshotDependencyTests-662794901 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-e26d4517-7b80-4f9c-bbb4-8935ff90ed77.442cab63-ead9-4fbc-9f80-bcd5a5f79d68" returned: 0 in 0.243s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 12:00:08 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-79a7d238-277a-4883-ae18-2ec739d886d2 tempest-SnapshotDependencyTests-662794901 None] Lock "cinder-quobyte-442cab63-ead9-4fbc-9f80-bcd5a5f79d68" released by "_delete_snapshot" :: held 1.525s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 12:00:08 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-79a7d238-277a-4883-ae18-2ec739d886d2 tempest-SnapshotDependencyTests-662794901 None] Lock "cinder-quobyte-e26d4517-7b80-4f9c-bbb4-8935ff90ed77" released by "delete_snapshot" :: held 1.548s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 12:00:08 devstack cinder-volume[87116]: DEBUG cinder.quota [None req-79a7d238-277a-4883-ae18-2ec739d886d2 tempest-SnapshotDependencyTests-662794901 None] Created reservations ['04e2423b-750c-4923-a92d-82685e74847f', 'e78d89bc-dd8e-4ca5-8953-d94c165f0faa', 'd1fb6cd6-1602-41d4-981a-f7bf8211f538', '82fe18b7-0b46-412d-aa84-726039a8604b'] {{(pid=87116) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 12:00:08 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-79a7d238-277a-4883-ae18-2ec739d886d2 tempest-SnapshotDependencyTests-662794901 None] Delete snapshot completed successfully. Nov 06 12:00:08 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-79a7d238-277a-4883-ae18-2ec739d886d2 tempest-SnapshotDependencyTests-662794901 None] Lock "cinder-442cab63-ead9-4fbc-9f80-bcd5a5f79d68-delete_snapshot" released by "delete_snapshot" :: held 1.685s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 12:00:08 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-8c43aa42-d7f3-4721-9ae2-1836ba232a55 tempest-SnapshotDependencyTests-662794901 None] Acquiring lock "cinder-e26d4517-7b80-4f9c-bbb4-8935ff90ed77-delete_volume" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 12:00:08 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-8c43aa42-d7f3-4721-9ae2-1836ba232a55 tempest-SnapshotDependencyTests-662794901 None] Lock "cinder-e26d4517-7b80-4f9c-bbb4-8935ff90ed77-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 12:00:08 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-8c43aa42-d7f3-4721-9ae2-1836ba232a55 tempest-SnapshotDependencyTests-662794901 None] Acquiring lock "cinder-quobyte-e26d4517-7b80-4f9c-bbb4-8935ff90ed77" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 12:00:08 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-8c43aa42-d7f3-4721-9ae2-1836ba232a55 tempest-SnapshotDependencyTests-662794901 None] Lock "cinder-quobyte-e26d4517-7b80-4f9c-bbb4-8935ff90ed77" acquired by "delete_volume" :: waited 0.020s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 12:00:08 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[264d3fc6-8e7e-4147-9f3b-ce536f298549]: (4, 'qcow2') {{(pid=88420) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 12:00:08 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-8c43aa42-d7f3-4721-9ae2-1836ba232a55 tempest-SnapshotDependencyTests-662794901 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-e26d4517-7b80-4f9c-bbb4-8935ff90ed77 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 12:00:09 devstack sudo[105768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-e26d4517-7b80-4f9c-bbb4-8935ff90ed77 Nov 06 12:00:09 devstack sudo[105768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 12:00:09 devstack sudo[105768]: pam_unix(sudo:session): session closed for user root Nov 06 12:00:09 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-8c43aa42-d7f3-4721-9ae2-1836ba232a55 tempest-SnapshotDependencyTests-662794901 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-e26d4517-7b80-4f9c-bbb4-8935ff90ed77" returned: 0 in 0.354s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 12:00:09 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-8c43aa42-d7f3-4721-9ae2-1836ba232a55 tempest-SnapshotDependencyTests-662794901 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-e26d4517-7b80-4f9c-bbb4-8935ff90ed77 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 12:00:09 devstack sudo[105773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-e26d4517-7b80-4f9c-bbb4-8935ff90ed77 Nov 06 12:00:09 devstack sudo[105773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 12:00:09 devstack cinder-volume[87116]: INFO cinder.volume.manager [req-b5604594-c208-469f-aeae-b5e70f3fdc42 req-93c7a524-d903-45ee-a1ec-ed81542de619 tempest-TestStampPattern-949619326 None] Terminate volume connection completed successfully. Nov 06 12:00:09 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [req-b5604594-c208-469f-aeae-b5e70f3fdc42 req-93c7a524-d903-45ee-a1ec-ed81542de619 tempest-TestStampPattern-949619326 None] Deleting attachment 3abb7dba-ddd6-44d4-8313-5f2ced647bd6. {{(pid=87116) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 06 12:00:09 devstack sudo[105773]: pam_unix(sudo:session): session closed for user root Nov 06 12:00:09 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-8c43aa42-d7f3-4721-9ae2-1836ba232a55 tempest-SnapshotDependencyTests-662794901 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-e26d4517-7b80-4f9c-bbb4-8935ff90ed77" returned: 0 in 0.269s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 12:00:09 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-8c43aa42-d7f3-4721-9ae2-1836ba232a55 tempest-SnapshotDependencyTests-662794901 None] Lock "cinder-quobyte-e26d4517-7b80-4f9c-bbb4-8935ff90ed77" released by "delete_volume" :: held 0.697s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 12:00:09 devstack cinder-volume[87116]: DEBUG cinder.quota [None req-8c43aa42-d7f3-4721-9ae2-1836ba232a55 tempest-SnapshotDependencyTests-662794901 None] Created reservations ['a3e0c231-9c51-4c84-90f5-ad394c6a8510', 'ddaf1d66-74ae-45f0-9377-86a8f3a0ce72', 'ae3c1682-51db-40f9-9a7a-8e31da1c1db0', '366828dd-407a-47ac-b5ae-2867ff13b586'] {{(pid=87116) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 12:00:09 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-8c43aa42-d7f3-4721-9ae2-1836ba232a55 tempest-SnapshotDependencyTests-662794901 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 12:00:09 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-8c43aa42-d7f3-4721-9ae2-1836ba232a55 tempest-SnapshotDependencyTests-662794901 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 12:00:09 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-8c43aa42-d7f3-4721-9ae2-1836ba232a55 tempest-SnapshotDependencyTests-662794901 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 12:00:09 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-8c43aa42-d7f3-4721-9ae2-1836ba232a55 tempest-SnapshotDependencyTests-662794901 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 12:00:09 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-8c43aa42-d7f3-4721-9ae2-1836ba232a55 tempest-SnapshotDependencyTests-662794901 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 12:00:09 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-8c43aa42-d7f3-4721-9ae2-1836ba232a55 tempest-SnapshotDependencyTests-662794901 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 12:00:09 devstack sudo[105803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756 Nov 06 12:00:09 devstack sudo[105803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 12:00:09 devstack sudo[105803]: pam_unix(sudo:session): session closed for user root Nov 06 12:00:09 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-8c43aa42-d7f3-4721-9ae2-1836ba232a55 tempest-SnapshotDependencyTests-662794901 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756" returned: 0 in 0.237s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 12:00:09 devstack cinder-volume[87116]: DEBUG cinder.manager [None req-8c43aa42-d7f3-4721-9ae2-1836ba232a55 tempest-SnapshotDependencyTests-662794901 None] Notifying Schedulers of capabilities ... {{(pid=87116) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 12:00:09 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-8c43aa42-d7f3-4721-9ae2-1836ba232a55 tempest-SnapshotDependencyTests-662794901 None] Deleted volume successfully. Nov 06 12:00:09 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-8c43aa42-d7f3-4721-9ae2-1836ba232a55 tempest-SnapshotDependencyTests-662794901 None] Lock "cinder-e26d4517-7b80-4f9c-bbb4-8935ff90ed77-delete_volume" released by "delete_volume" :: held 1.153s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 12:00:09 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-2093aac8-5858-4e9e-9277-7cfc913d3f10 tempest-SnapshotDependencyTests-662794901 None] Acquiring lock "cinder-48ec0860-bb9d-4f7e-a643-2a206cf49daf-delete_volume" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 12:00:09 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-2093aac8-5858-4e9e-9277-7cfc913d3f10 tempest-SnapshotDependencyTests-662794901 None] Lock "cinder-48ec0860-bb9d-4f7e-a643-2a206cf49daf-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 12:00:10 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-2093aac8-5858-4e9e-9277-7cfc913d3f10 tempest-SnapshotDependencyTests-662794901 None] Acquiring lock "cinder-quobyte-48ec0860-bb9d-4f7e-a643-2a206cf49daf" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 12:00:10 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-2093aac8-5858-4e9e-9277-7cfc913d3f10 tempest-SnapshotDependencyTests-662794901 None] Lock "cinder-quobyte-48ec0860-bb9d-4f7e-a643-2a206cf49daf" acquired by "delete_volume" :: waited 0.016s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 12:00:10 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3536559-808a-4616-8628-f3d9826bf9d5]: (4, 'qcow2') {{(pid=88420) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 12:00:10 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-2093aac8-5858-4e9e-9277-7cfc913d3f10 tempest-SnapshotDependencyTests-662794901 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-48ec0860-bb9d-4f7e-a643-2a206cf49daf {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 12:00:10 devstack sudo[105806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-48ec0860-bb9d-4f7e-a643-2a206cf49daf Nov 06 12:00:10 devstack sudo[105806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 12:00:10 devstack sudo[105806]: pam_unix(sudo:session): session closed for user root Nov 06 12:00:10 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-2093aac8-5858-4e9e-9277-7cfc913d3f10 tempest-SnapshotDependencyTests-662794901 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-48ec0860-bb9d-4f7e-a643-2a206cf49daf" returned: 0 in 0.386s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 12:00:10 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-2093aac8-5858-4e9e-9277-7cfc913d3f10 tempest-SnapshotDependencyTests-662794901 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-48ec0860-bb9d-4f7e-a643-2a206cf49daf {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 12:00:10 devstack sudo[105811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-48ec0860-bb9d-4f7e-a643-2a206cf49daf Nov 06 12:00:10 devstack sudo[105811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 12:00:10 devstack sudo[105811]: pam_unix(sudo:session): session closed for user root Nov 06 12:00:10 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-2093aac8-5858-4e9e-9277-7cfc913d3f10 tempest-SnapshotDependencyTests-662794901 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-48ec0860-bb9d-4f7e-a643-2a206cf49daf" returned: 0 in 0.319s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 12:00:10 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-2093aac8-5858-4e9e-9277-7cfc913d3f10 tempest-SnapshotDependencyTests-662794901 None] Lock "cinder-quobyte-48ec0860-bb9d-4f7e-a643-2a206cf49daf" released by "delete_volume" :: held 0.749s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 12:00:10 devstack cinder-volume[87116]: DEBUG cinder.quota [None req-2093aac8-5858-4e9e-9277-7cfc913d3f10 tempest-SnapshotDependencyTests-662794901 None] Created reservations ['da6aacb3-d6f6-42f7-a371-9cbe9c47ccaa', '6ad29595-f235-4d8e-b240-637f2a626a27', 'b0409aa0-87df-49f3-9424-747bd0779560', '61c30011-417b-41b4-918c-d785c2ea0edd'] {{(pid=87116) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 12:00:11 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-2093aac8-5858-4e9e-9277-7cfc913d3f10 tempest-SnapshotDependencyTests-662794901 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 12:00:11 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-2093aac8-5858-4e9e-9277-7cfc913d3f10 tempest-SnapshotDependencyTests-662794901 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 12:00:11 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-2093aac8-5858-4e9e-9277-7cfc913d3f10 tempest-SnapshotDependencyTests-662794901 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 12:00:11 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-2093aac8-5858-4e9e-9277-7cfc913d3f10 tempest-SnapshotDependencyTests-662794901 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 12:00:11 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-2093aac8-5858-4e9e-9277-7cfc913d3f10 tempest-SnapshotDependencyTests-662794901 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.030s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 12:00:11 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-2093aac8-5858-4e9e-9277-7cfc913d3f10 tempest-SnapshotDependencyTests-662794901 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 12:00:11 devstack sudo[105816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756 Nov 06 12:00:11 devstack sudo[105816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 12:00:11 devstack sudo[105816]: pam_unix(sudo:session): session closed for user root Nov 06 12:00:11 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-2093aac8-5858-4e9e-9277-7cfc913d3f10 tempest-SnapshotDependencyTests-662794901 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756" returned: 0 in 0.383s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 12:00:11 devstack cinder-volume[87116]: DEBUG cinder.manager [None req-2093aac8-5858-4e9e-9277-7cfc913d3f10 tempest-SnapshotDependencyTests-662794901 None] Notifying Schedulers of capabilities ... {{(pid=87116) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 12:00:11 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-2093aac8-5858-4e9e-9277-7cfc913d3f10 tempest-SnapshotDependencyTests-662794901 None] Deleted volume successfully. Nov 06 12:00:11 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-2093aac8-5858-4e9e-9277-7cfc913d3f10 tempest-SnapshotDependencyTests-662794901 None] Lock "cinder-48ec0860-bb9d-4f7e-a643-2a206cf49daf-delete_volume" released by "delete_volume" :: held 1.514s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 12:00:13 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-d2a98a2b-428c-4a03-abeb-399e772d3db0 tempest-TestStampPattern-949619326 None] Acquiring lock "cinder-846110b0-01b0-443f-a58e-86b19f5b87e7-delete_volume" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 12:00:13 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-d2a98a2b-428c-4a03-abeb-399e772d3db0 tempest-TestStampPattern-949619326 None] Lock "cinder-846110b0-01b0-443f-a58e-86b19f5b87e7-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 12:00:14 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-d2a98a2b-428c-4a03-abeb-399e772d3db0 tempest-TestStampPattern-949619326 None] Acquiring lock "cinder-quobyte-846110b0-01b0-443f-a58e-86b19f5b87e7" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 12:00:14 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-d2a98a2b-428c-4a03-abeb-399e772d3db0 tempest-TestStampPattern-949619326 None] Lock "cinder-quobyte-846110b0-01b0-443f-a58e-86b19f5b87e7" acquired by "delete_volume" :: waited 0.021s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 12:00:14 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc95f9fe-37b6-42cb-b169-936c71f33dea]: (4, 'qcow2') {{(pid=88420) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 12:00:14 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-d2a98a2b-428c-4a03-abeb-399e772d3db0 tempest-TestStampPattern-949619326 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-846110b0-01b0-443f-a58e-86b19f5b87e7 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 12:00:14 devstack sudo[105847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-846110b0-01b0-443f-a58e-86b19f5b87e7 Nov 06 12:00:14 devstack sudo[105847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 12:00:14 devstack sudo[105847]: pam_unix(sudo:session): session closed for user root Nov 06 12:00:14 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-d2a98a2b-428c-4a03-abeb-399e772d3db0 tempest-TestStampPattern-949619326 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-846110b0-01b0-443f-a58e-86b19f5b87e7" returned: 0 in 0.337s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 12:00:14 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-d2a98a2b-428c-4a03-abeb-399e772d3db0 tempest-TestStampPattern-949619326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-846110b0-01b0-443f-a58e-86b19f5b87e7 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 12:00:14 devstack sudo[105852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-846110b0-01b0-443f-a58e-86b19f5b87e7 Nov 06 12:00:14 devstack sudo[105852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 12:00:14 devstack sudo[105852]: pam_unix(sudo:session): session closed for user root Nov 06 12:00:14 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-d2a98a2b-428c-4a03-abeb-399e772d3db0 tempest-TestStampPattern-949619326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-846110b0-01b0-443f-a58e-86b19f5b87e7" returned: 0 in 0.243s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 12:00:14 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-d2a98a2b-428c-4a03-abeb-399e772d3db0 tempest-TestStampPattern-949619326 None] Lock "cinder-quobyte-846110b0-01b0-443f-a58e-86b19f5b87e7" released by "delete_volume" :: held 0.636s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 12:00:14 devstack cinder-volume[87116]: DEBUG cinder.quota [None req-d2a98a2b-428c-4a03-abeb-399e772d3db0 tempest-TestStampPattern-949619326 None] Created reservations ['cc04d400-5c39-42c2-8f3f-ee5cd51f4ebd', '6e3dd199-ee88-45ea-a093-858ad2356594', '98bf196f-bc62-4ec5-8490-0e60f7fb0646', 'c26ea482-d42b-4962-b40d-9fcec3b8327d'] {{(pid=87116) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 12:00:14 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-d2a98a2b-428c-4a03-abeb-399e772d3db0 tempest-TestStampPattern-949619326 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 12:00:14 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-d2a98a2b-428c-4a03-abeb-399e772d3db0 tempest-TestStampPattern-949619326 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 12:00:14 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-d2a98a2b-428c-4a03-abeb-399e772d3db0 tempest-TestStampPattern-949619326 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 12:00:14 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-d2a98a2b-428c-4a03-abeb-399e772d3db0 tempest-TestStampPattern-949619326 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 12:00:14 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-d2a98a2b-428c-4a03-abeb-399e772d3db0 tempest-TestStampPattern-949619326 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 12:00:14 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-d2a98a2b-428c-4a03-abeb-399e772d3db0 tempest-TestStampPattern-949619326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 12:00:14 devstack sudo[105855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756 Nov 06 12:00:14 devstack sudo[105855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 12:00:15 devstack sudo[105855]: pam_unix(sudo:session): session closed for user root Nov 06 12:00:15 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-d2a98a2b-428c-4a03-abeb-399e772d3db0 tempest-TestStampPattern-949619326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756" returned: 0 in 0.291s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 12:00:15 devstack cinder-volume[87116]: DEBUG cinder.manager [None req-d2a98a2b-428c-4a03-abeb-399e772d3db0 tempest-TestStampPattern-949619326 None] Notifying Schedulers of capabilities ... {{(pid=87116) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 12:00:15 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-d2a98a2b-428c-4a03-abeb-399e772d3db0 tempest-TestStampPattern-949619326 None] Deleted volume successfully. Nov 06 12:00:15 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-d2a98a2b-428c-4a03-abeb-399e772d3db0 tempest-TestStampPattern-949619326 None] Lock "cinder-846110b0-01b0-443f-a58e-86b19f5b87e7-delete_volume" released by "delete_volume" :: held 1.171s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 12:00:15 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-1833608a-d799-4d97-87af-cccdaf054d29 tempest-TestStampPattern-949619326 None] Acquiring lock "cinder-f577480f-c459-4849-b588-11787d70e7c4-delete_snapshot" by "delete_snapshot" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 12:00:15 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-1833608a-d799-4d97-87af-cccdaf054d29 tempest-TestStampPattern-949619326 None] Lock "cinder-f577480f-c459-4849-b588-11787d70e7c4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 12:00:15 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-1833608a-d799-4d97-87af-cccdaf054d29 tempest-TestStampPattern-949619326 None] Acquiring lock "cinder-quobyte-4b9d12f5-bc74-4263-acb9-1d7180eccfa2" by "delete_snapshot" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 12:00:15 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-1833608a-d799-4d97-87af-cccdaf054d29 tempest-TestStampPattern-949619326 None] Lock "cinder-quobyte-4b9d12f5-bc74-4263-acb9-1d7180eccfa2" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 12:00:15 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-1833608a-d799-4d97-87af-cccdaf054d29 tempest-TestStampPattern-949619326 None] Acquiring lock "cinder-quobyte-f577480f-c459-4849-b588-11787d70e7c4" by "_delete_snapshot" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 12:00:15 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-1833608a-d799-4d97-87af-cccdaf054d29 tempest-TestStampPattern-949619326 None] Lock "cinder-quobyte-f577480f-c459-4849-b588-11787d70e7c4" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 12:00:15 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-1833608a-d799-4d97-87af-cccdaf054d29 tempest-TestStampPattern-949619326 None] Deleting offline snapshot f577480f-c459-4849-b588-11787d70e7c4 of volume 4b9d12f5-bc74-4263-acb9-1d7180eccfa2 {{(pid=87116) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 06 12:00:15 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-1833608a-d799-4d97-87af-cccdaf054d29 tempest-TestStampPattern-949619326 None] snapshot_file for this snap is: volume-4b9d12f5-bc74-4263-acb9-1d7180eccfa2.f577480f-c459-4849-b588-11787d70e7c4 {{(pid=87116) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 06 12:00:15 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbe8a566-e060-4a43-8824-03e11f6695d4]: (4, 'qcow2') {{(pid=88420) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 12:00:15 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-1833608a-d799-4d97-87af-cccdaf054d29 tempest-TestStampPattern-949619326 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-4b9d12f5-bc74-4263-acb9-1d7180eccfa2.f577480f-c459-4849-b588-11787d70e7c4 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 12:00:15 devstack sudo[105858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-4b9d12f5-bc74-4263-acb9-1d7180eccfa2.f577480f-c459-4849-b588-11787d70e7c4 Nov 06 12:00:15 devstack sudo[105858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 12:00:15 devstack sudo[105858]: pam_unix(sudo:session): session closed for user root Nov 06 12:00:15 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-1833608a-d799-4d97-87af-cccdaf054d29 tempest-TestStampPattern-949619326 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-4b9d12f5-bc74-4263-acb9-1d7180eccfa2.f577480f-c459-4849-b588-11787d70e7c4" returned: 0 in 0.427s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 12:00:15 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-1833608a-d799-4d97-87af-cccdaf054d29 tempest-TestStampPattern-949619326 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4b9d12f5-bc74-4263-acb9-1d7180eccfa2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87116) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 12:00:15 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[0dcb1f42-3acf-478b-a418-cbf886c3a57a]: (4, 'qcow2') {{(pid=88420) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 12:00:15 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-1833608a-d799-4d97-87af-cccdaf054d29 tempest-TestStampPattern-949619326 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-4b9d12f5-bc74-4263-acb9-1d7180eccfa2 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 12:00:16 devstack sudo[105864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-4b9d12f5-bc74-4263-acb9-1d7180eccfa2 Nov 06 12:00:16 devstack sudo[105864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 12:00:16 devstack sudo[105864]: pam_unix(sudo:session): session closed for user root Nov 06 12:00:16 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-1833608a-d799-4d97-87af-cccdaf054d29 tempest-TestStampPattern-949619326 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-4b9d12f5-bc74-4263-acb9-1d7180eccfa2" returned: 0 in 0.555s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 12:00:16 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-1833608a-d799-4d97-87af-cccdaf054d29 tempest-TestStampPattern-949619326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-4b9d12f5-bc74-4263-acb9-1d7180eccfa2.f577480f-c459-4849-b588-11787d70e7c4 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 12:00:16 devstack sudo[105869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-4b9d12f5-bc74-4263-acb9-1d7180eccfa2.f577480f-c459-4849-b588-11787d70e7c4 Nov 06 12:00:16 devstack sudo[105869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 12:00:16 devstack sudo[105869]: pam_unix(sudo:session): session closed for user root Nov 06 12:00:16 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-1833608a-d799-4d97-87af-cccdaf054d29 tempest-TestStampPattern-949619326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-4b9d12f5-bc74-4263-acb9-1d7180eccfa2.f577480f-c459-4849-b588-11787d70e7c4" returned: 0 in 0.358s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 12:00:16 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-1833608a-d799-4d97-87af-cccdaf054d29 tempest-TestStampPattern-949619326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-4b9d12f5-bc74-4263-acb9-1d7180eccfa2.f577480f-c459-4849-b588-11787d70e7c4 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 12:00:16 devstack sudo[105875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-4b9d12f5-bc74-4263-acb9-1d7180eccfa2.f577480f-c459-4849-b588-11787d70e7c4 Nov 06 12:00:16 devstack sudo[105875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 12:00:17 devstack sudo[105875]: pam_unix(sudo:session): session closed for user root Nov 06 12:00:17 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-1833608a-d799-4d97-87af-cccdaf054d29 tempest-TestStampPattern-949619326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-4b9d12f5-bc74-4263-acb9-1d7180eccfa2.f577480f-c459-4849-b588-11787d70e7c4" returned: 0 in 0.237s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 12:00:17 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-1833608a-d799-4d97-87af-cccdaf054d29 tempest-TestStampPattern-949619326 None] Lock "cinder-quobyte-f577480f-c459-4849-b588-11787d70e7c4" released by "_delete_snapshot" :: held 1.707s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 12:00:17 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-1833608a-d799-4d97-87af-cccdaf054d29 tempest-TestStampPattern-949619326 None] Lock "cinder-quobyte-4b9d12f5-bc74-4263-acb9-1d7180eccfa2" released by "delete_snapshot" :: held 1.730s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 12:00:17 devstack cinder-volume[87116]: DEBUG cinder.quota [None req-1833608a-d799-4d97-87af-cccdaf054d29 tempest-TestStampPattern-949619326 None] Created reservations ['1b514f0b-599f-4409-8a32-d4cb2a95a0dd', '991b784d-0e28-40f7-bec2-3794192e82e5', '7685a031-f9bb-4830-aff8-6b1e675a827a', 'c7908c10-0970-4004-ab2f-68cce4f07fee'] {{(pid=87116) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 12:00:17 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-1833608a-d799-4d97-87af-cccdaf054d29 tempest-TestStampPattern-949619326 None] Delete snapshot completed successfully. Nov 06 12:00:17 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-1833608a-d799-4d97-87af-cccdaf054d29 tempest-TestStampPattern-949619326 None] Lock "cinder-f577480f-c459-4849-b588-11787d70e7c4-delete_snapshot" released by "delete_snapshot" :: held 1.890s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 12:00:21 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-d7927617-adbd-4f92-8283-4dbf648c927d tempest-TestStampPattern-949619326 None] Acquiring lock "cinder-4b9d12f5-bc74-4263-acb9-1d7180eccfa2-delete_volume" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 12:00:21 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-d7927617-adbd-4f92-8283-4dbf648c927d tempest-TestStampPattern-949619326 None] Lock "cinder-4b9d12f5-bc74-4263-acb9-1d7180eccfa2-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 12:00:21 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-d7927617-adbd-4f92-8283-4dbf648c927d tempest-TestStampPattern-949619326 None] Acquiring lock "cinder-quobyte-4b9d12f5-bc74-4263-acb9-1d7180eccfa2" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 12:00:21 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-d7927617-adbd-4f92-8283-4dbf648c927d tempest-TestStampPattern-949619326 None] Lock "cinder-quobyte-4b9d12f5-bc74-4263-acb9-1d7180eccfa2" acquired by "delete_volume" :: waited 0.018s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 12:00:21 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd81bb04-2c9e-471e-aff4-45c068451edf]: (4, 'qcow2') {{(pid=88420) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 12:00:21 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-d7927617-adbd-4f92-8283-4dbf648c927d tempest-TestStampPattern-949619326 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-4b9d12f5-bc74-4263-acb9-1d7180eccfa2 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 12:00:21 devstack sudo[105910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-4b9d12f5-bc74-4263-acb9-1d7180eccfa2 Nov 06 12:00:21 devstack sudo[105910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 12:00:22 devstack sudo[105910]: pam_unix(sudo:session): session closed for user root Nov 06 12:00:22 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-d7927617-adbd-4f92-8283-4dbf648c927d tempest-TestStampPattern-949619326 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-4b9d12f5-bc74-4263-acb9-1d7180eccfa2" returned: 0 in 0.394s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 12:00:22 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-d7927617-adbd-4f92-8283-4dbf648c927d tempest-TestStampPattern-949619326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-4b9d12f5-bc74-4263-acb9-1d7180eccfa2 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 12:00:22 devstack sudo[105915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-4b9d12f5-bc74-4263-acb9-1d7180eccfa2 Nov 06 12:00:22 devstack sudo[105915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 12:00:22 devstack sudo[105915]: pam_unix(sudo:session): session closed for user root Nov 06 12:00:22 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-d7927617-adbd-4f92-8283-4dbf648c927d tempest-TestStampPattern-949619326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-4b9d12f5-bc74-4263-acb9-1d7180eccfa2" returned: 0 in 0.239s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 12:00:22 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-d7927617-adbd-4f92-8283-4dbf648c927d tempest-TestStampPattern-949619326 None] Lock "cinder-quobyte-4b9d12f5-bc74-4263-acb9-1d7180eccfa2" released by "delete_volume" :: held 0.707s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 12:00:22 devstack cinder-volume[87116]: DEBUG cinder.quota [None req-d7927617-adbd-4f92-8283-4dbf648c927d tempest-TestStampPattern-949619326 None] Created reservations ['adf5cc29-ed30-43bc-bfcc-410b6cfc1819', '319d9967-3250-44bf-927d-464b06f5fac8', '8e8331ac-c418-4858-9da3-770207c14641', 'c5c971f1-cc31-4235-b057-481e286638c9'] {{(pid=87116) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 12:00:22 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-d7927617-adbd-4f92-8283-4dbf648c927d tempest-TestStampPattern-949619326 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 12:00:22 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-d7927617-adbd-4f92-8283-4dbf648c927d tempest-TestStampPattern-949619326 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 12:00:22 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-d7927617-adbd-4f92-8283-4dbf648c927d tempest-TestStampPattern-949619326 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 12:00:22 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-d7927617-adbd-4f92-8283-4dbf648c927d tempest-TestStampPattern-949619326 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 12:00:22 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-d7927617-adbd-4f92-8283-4dbf648c927d tempest-TestStampPattern-949619326 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 12:00:22 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-d7927617-adbd-4f92-8283-4dbf648c927d tempest-TestStampPattern-949619326 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 12:00:22 devstack sudo[105918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756 Nov 06 12:00:22 devstack sudo[105918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 12:00:22 devstack sudo[105918]: pam_unix(sudo:session): session closed for user root Nov 06 12:00:22 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-d7927617-adbd-4f92-8283-4dbf648c927d tempest-TestStampPattern-949619326 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756" returned: 0 in 0.251s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 12:00:22 devstack cinder-volume[87116]: DEBUG cinder.manager [None req-d7927617-adbd-4f92-8283-4dbf648c927d tempest-TestStampPattern-949619326 None] Notifying Schedulers of capabilities ... {{(pid=87116) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 12:00:22 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-d7927617-adbd-4f92-8283-4dbf648c927d tempest-TestStampPattern-949619326 None] Deleted volume successfully. Nov 06 12:00:22 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-d7927617-adbd-4f92-8283-4dbf648c927d tempest-TestStampPattern-949619326 None] Lock "cinder-4b9d12f5-bc74-4263-acb9-1d7180eccfa2-delete_volume" released by "delete_volume" :: held 1.231s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 12:00:32 devstack cinder-volume[87116]: DEBUG dbcounter [-] [87116] Writing DB stats cinder:SELECT=49,cinder:UPDATE=52,cinder:DELETE=5,cinder:INSERT=15 {{(pid=87116) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 12:00:32 devstack cinder-volume[87116]: DEBUG dbcounter [-] [87116] Writing DB stats cinder:SELECT=46,cinder:UPDATE=52,cinder:INSERT=12,cinder:DELETE=2 {{(pid=87116) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 12:00:39 devstack cinder-volume[87116]: DEBUG oslo_service.periodic_task [None req-4fab4816-ec2b-4b19-b2ff-8548f2084354 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87116) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 12:00:39 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-4fab4816-ec2b-4b19-b2ff-8548f2084354 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 12:00:39 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-4fab4816-ec2b-4b19-b2ff-8548f2084354 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 12:00:39 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-4fab4816-ec2b-4b19-b2ff-8548f2084354 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 12:00:39 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-4fab4816-ec2b-4b19-b2ff-8548f2084354 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 12:00:39 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-4fab4816-ec2b-4b19-b2ff-8548f2084354 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 12:00:39 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-4fab4816-ec2b-4b19-b2ff-8548f2084354 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 12:00:39 devstack sudo[105993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756 Nov 06 12:00:39 devstack sudo[105993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 12:00:40 devstack sudo[105993]: pam_unix(sudo:session): session closed for user root Nov 06 12:00:40 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-4fab4816-ec2b-4b19-b2ff-8548f2084354 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756" returned: 0 in 0.249s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 12:00:40 devstack cinder-volume[87116]: DEBUG cinder.manager [None req-4fab4816-ec2b-4b19-b2ff-8548f2084354 None None] Notifying Schedulers of capabilities ... {{(pid=87116) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 12:00:40 devstack cinder-volume[87116]: DEBUG oslo_service.periodic_task [None req-4fab4816-ec2b-4b19-b2ff-8548f2084354 None None] Running periodic task VolumeManager._thread_info {{(pid=87116) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 12:00:40 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-4fab4816-ec2b-4b19-b2ff-8548f2084354 None None] thread count: 28 {{(pid=87116) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 06 12:00:40 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-4fab4816-ec2b-4b19-b2ff-8548f2084354 None None] thread info: [<_MainThread(MainThread, started 131399520669824)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87116) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 06 12:00:47 devstack cinder-volume[87116]: DEBUG cinder.volume.flows.manager.create_volume [None req-5560ae0f-21ba-4bfa-85bb-1229002fc4be tempest-CreateVolumesFromImageTest-1244366109 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87116) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 12:00:47 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-5560ae0f-21ba-4bfa-85bb-1229002fc4be tempest-CreateVolumesFromImageTest-1244366109 None] Flow 'volume_create_manager' (7125fd37-a3cf-4088-94a5-925873c4d1f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 12:00:47 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-5560ae0f-21ba-4bfa-85bb-1229002fc4be tempest-CreateVolumesFromImageTest-1244366109 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (40d697aa-3bd4-450b-b919-670afe41cf34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 12:00:47 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-5560ae0f-21ba-4bfa-85bb-1229002fc4be tempest-CreateVolumesFromImageTest-1244366109 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (40d697aa-3bd4-450b-b919-670afe41cf34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T11:00:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2115526844',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ad482c0b-8f61-49e2-b20c-b6b2d6dfa8ed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='110f736963c340ca9fdf4eed04e7f6ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T11:00:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T11:00:47Z,use_quota=True,user_id='fd8154bf76e6442a9edc0fe2bc22c2d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(34d3b144-d9b7-480a-a2e3-01e45f3d54c1),volume_type_id=34d3b144-d9b7-480a-a2e3-01e45f3d54c1)' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 12:00:47 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-5560ae0f-21ba-4bfa-85bb-1229002fc4be tempest-CreateVolumesFromImageTest-1244366109 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fd31d609-3d3f-4f67-92f9-d574e5e2c06b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 12:00:47 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-5560ae0f-21ba-4bfa-85bb-1229002fc4be tempest-CreateVolumesFromImageTest-1244366109 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fd31d609-3d3f-4f67-92f9-d574e5e2c06b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 12:00:47 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-5560ae0f-21ba-4bfa-85bb-1229002fc4be tempest-CreateVolumesFromImageTest-1244366109 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (39f30138-1e5f-4e64-a392-608c3cd480ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 12:00:47 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-5560ae0f-21ba-4bfa-85bb-1229002fc4be tempest-CreateVolumesFromImageTest-1244366109 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (39f30138-1e5f-4e64-a392-608c3cd480ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ad482c0b-8f61-49e2-b20c-b6b2d6dfa8ed', 'volume_name': 'volume-ad482c0b-8f61-49e2-b20c-b6b2d6dfa8ed', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 12:00:47 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-5560ae0f-21ba-4bfa-85bb-1229002fc4be tempest-CreateVolumesFromImageTest-1244366109 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b1e09942-f7ca-4993-9fb5-189203913281) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 12:00:47 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-5560ae0f-21ba-4bfa-85bb-1229002fc4be tempest-CreateVolumesFromImageTest-1244366109 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b1e09942-f7ca-4993-9fb5-189203913281) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 12:00:47 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-5560ae0f-21ba-4bfa-85bb-1229002fc4be tempest-CreateVolumesFromImageTest-1244366109 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cf2bfd4c-80fe-410a-9617-9fd9224eea1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 12:00:47 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-5560ae0f-21ba-4bfa-85bb-1229002fc4be tempest-CreateVolumesFromImageTest-1244366109 None] Volume ad482c0b-8f61-49e2-b20c-b6b2d6dfa8ed: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ad482c0b-8f61-49e2-b20c-b6b2d6dfa8ed', 'volume_size': 1} Nov 06 12:00:47 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-5560ae0f-21ba-4bfa-85bb-1229002fc4be tempest-CreateVolumesFromImageTest-1244366109 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 12:00:47 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-5560ae0f-21ba-4bfa-85bb-1229002fc4be tempest-CreateVolumesFromImageTest-1244366109 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 12:00:47 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-5560ae0f-21ba-4bfa-85bb-1229002fc4be tempest-CreateVolumesFromImageTest-1244366109 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T11:00:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2115526844',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ad482c0b-8f61-49e2-b20c-b6b2d6dfa8ed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='110f736963c340ca9fdf4eed04e7f6ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T11:00:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T11:00:47Z,use_quota=True,user_id='fd8154bf76e6442a9edc0fe2bc22c2d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(34d3b144-d9b7-480a-a2e3-01e45f3d54c1),volume_type_id=34d3b144-d9b7-480a-a2e3-01e45f3d54c1)}" {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 12:00:47 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-5560ae0f-21ba-4bfa-85bb-1229002fc4be tempest-CreateVolumesFromImageTest-1244366109 None] Creating volume ad482c0b-8f61-49e2-b20c-b6b2d6dfa8ed {{(pid=87116) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 12:00:47 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-5560ae0f-21ba-4bfa-85bb-1229002fc4be tempest-CreateVolumesFromImageTest-1244366109 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 12:00:47 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-5560ae0f-21ba-4bfa-85bb-1229002fc4be tempest-CreateVolumesFromImageTest-1244366109 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 12:00:47 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-5560ae0f-21ba-4bfa-85bb-1229002fc4be tempest-CreateVolumesFromImageTest-1244366109 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 12:00:47 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-5560ae0f-21ba-4bfa-85bb-1229002fc4be tempest-CreateVolumesFromImageTest-1244366109 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 12:00:47 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-5560ae0f-21ba-4bfa-85bb-1229002fc4be tempest-CreateVolumesFromImageTest-1244366109 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 12:00:47 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-5560ae0f-21ba-4bfa-85bb-1229002fc4be tempest-CreateVolumesFromImageTest-1244366109 None] Selected osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f as target Quobyte volume. {{(pid=87116) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 12:00:47 devstack cinder-volume[87116]: INFO cinder.volume.drivers.remotefs [None req-5560ae0f-21ba-4bfa-85bb-1229002fc4be tempest-CreateVolumesFromImageTest-1244366109 None] casted to osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f Nov 06 12:00:47 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-5560ae0f-21ba-4bfa-85bb-1229002fc4be tempest-CreateVolumesFromImageTest-1244366109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-ad482c0b-8f61-49e2-b20c-b6b2d6dfa8ed 1073741824 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 12:00:47 devstack sudo[106013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-ad482c0b-8f61-49e2-b20c-b6b2d6dfa8ed 1073741824 Nov 06 12:00:47 devstack sudo[106013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 12:00:47 devstack cinder-volume[87116]: DEBUG cinder.volume.flows.manager.create_volume [None req-2af2140e-80aa-4d2c-a7b5-a518ad25aa58 tempest-CreateVolumesFromSourceVolumeTest-141026190 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87116) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 12:00:47 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-2af2140e-80aa-4d2c-a7b5-a518ad25aa58 tempest-CreateVolumesFromSourceVolumeTest-141026190 None] Flow 'volume_create_manager' (95452f41-054a-408f-a5f9-10cb5b6f2baf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 12:00:47 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-2af2140e-80aa-4d2c-a7b5-a518ad25aa58 tempest-CreateVolumesFromSourceVolumeTest-141026190 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b4c5aa1e-387b-4574-a0f4-e31b6758dd00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 12:00:47 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-2af2140e-80aa-4d2c-a7b5-a518ad25aa58 tempest-CreateVolumesFromSourceVolumeTest-141026190 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b4c5aa1e-387b-4574-a0f4-e31b6758dd00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T11:00:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-540969303',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c9b9e74c-3b17-4f15-b83a-e391b682cada,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='04ebe05017d84cc0aff66a885bb6e75e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T11:00:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T11:00:47Z,use_quota=True,user_id='80278ec1f89a4cdd8c1d2d44168b043f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(34d3b144-d9b7-480a-a2e3-01e45f3d54c1),volume_type_id=34d3b144-d9b7-480a-a2e3-01e45f3d54c1)' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 12:00:47 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-2af2140e-80aa-4d2c-a7b5-a518ad25aa58 tempest-CreateVolumesFromSourceVolumeTest-141026190 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3c7efde3-4c40-4922-9ced-ef98218cf129) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 12:00:47 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-2af2140e-80aa-4d2c-a7b5-a518ad25aa58 tempest-CreateVolumesFromSourceVolumeTest-141026190 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3c7efde3-4c40-4922-9ced-ef98218cf129) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 12:00:47 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-2af2140e-80aa-4d2c-a7b5-a518ad25aa58 tempest-CreateVolumesFromSourceVolumeTest-141026190 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (917f9d24-0aa9-4394-9e0d-0a36e28eda00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 12:00:47 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-2af2140e-80aa-4d2c-a7b5-a518ad25aa58 tempest-CreateVolumesFromSourceVolumeTest-141026190 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (917f9d24-0aa9-4394-9e0d-0a36e28eda00) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c9b9e74c-3b17-4f15-b83a-e391b682cada', 'volume_name': 'volume-c9b9e74c-3b17-4f15-b83a-e391b682cada', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 12:00:47 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-2af2140e-80aa-4d2c-a7b5-a518ad25aa58 tempest-CreateVolumesFromSourceVolumeTest-141026190 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4daebd02-22df-4179-a5af-c77fb0e894e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 12:00:47 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-2af2140e-80aa-4d2c-a7b5-a518ad25aa58 tempest-CreateVolumesFromSourceVolumeTest-141026190 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4daebd02-22df-4179-a5af-c77fb0e894e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 12:00:47 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-2af2140e-80aa-4d2c-a7b5-a518ad25aa58 tempest-CreateVolumesFromSourceVolumeTest-141026190 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (77358124-e0cf-4186-aec1-4e2153bc1394) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 12:00:47 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-2af2140e-80aa-4d2c-a7b5-a518ad25aa58 tempest-CreateVolumesFromSourceVolumeTest-141026190 None] Volume c9b9e74c-3b17-4f15-b83a-e391b682cada: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c9b9e74c-3b17-4f15-b83a-e391b682cada', 'volume_size': 1} Nov 06 12:00:47 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-2af2140e-80aa-4d2c-a7b5-a518ad25aa58 tempest-CreateVolumesFromSourceVolumeTest-141026190 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 12:00:47 devstack cinder-volume[87116]: DEBUG cinder.volume.flows.manager.create_volume [None req-680fa14f-0473-464f-935a-5fab0554fc8c tempest-CreateVolumesFromImageTest-1244366109 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87116) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 12:00:47 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-680fa14f-0473-464f-935a-5fab0554fc8c tempest-CreateVolumesFromImageTest-1244366109 None] Flow 'volume_create_manager' (0d71a44e-fe46-4b27-b79b-e0a20b0d49dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 12:00:47 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-680fa14f-0473-464f-935a-5fab0554fc8c tempest-CreateVolumesFromImageTest-1244366109 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (434d55e6-4f5a-4fc7-ad30-65677612eb27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 12:00:47 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-680fa14f-0473-464f-935a-5fab0554fc8c tempest-CreateVolumesFromImageTest-1244366109 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (434d55e6-4f5a-4fc7-ad30-65677612eb27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T11:00:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-571389435',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=47d75b65-4451-4f47-b7aa-8b8708290ecb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='110f736963c340ca9fdf4eed04e7f6ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T11:00:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T11:00:47Z,use_quota=True,user_id='fd8154bf76e6442a9edc0fe2bc22c2d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(34d3b144-d9b7-480a-a2e3-01e45f3d54c1),volume_type_id=34d3b144-d9b7-480a-a2e3-01e45f3d54c1)' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 12:00:47 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-680fa14f-0473-464f-935a-5fab0554fc8c tempest-CreateVolumesFromImageTest-1244366109 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (88758583-cff0-4fe3-b169-b6c5ddd75fae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 12:00:47 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-680fa14f-0473-464f-935a-5fab0554fc8c tempest-CreateVolumesFromImageTest-1244366109 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (88758583-cff0-4fe3-b169-b6c5ddd75fae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 12:00:47 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-680fa14f-0473-464f-935a-5fab0554fc8c tempest-CreateVolumesFromImageTest-1244366109 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5808a000-138a-4a8c-99c9-10684a975c95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 12:00:47 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-680fa14f-0473-464f-935a-5fab0554fc8c tempest-CreateVolumesFromImageTest-1244366109 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5808a000-138a-4a8c-99c9-10684a975c95) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '47d75b65-4451-4f47-b7aa-8b8708290ecb', 'volume_name': 'volume-47d75b65-4451-4f47-b7aa-8b8708290ecb', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 12:00:47 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-680fa14f-0473-464f-935a-5fab0554fc8c tempest-CreateVolumesFromImageTest-1244366109 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a6ec9541-245c-4cd0-8bbe-375ed64f362f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 12:00:47 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-680fa14f-0473-464f-935a-5fab0554fc8c tempest-CreateVolumesFromImageTest-1244366109 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a6ec9541-245c-4cd0-8bbe-375ed64f362f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 12:00:47 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-680fa14f-0473-464f-935a-5fab0554fc8c tempest-CreateVolumesFromImageTest-1244366109 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (627ef19c-accf-4aac-b705-20f0523bcf38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 12:00:47 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-680fa14f-0473-464f-935a-5fab0554fc8c tempest-CreateVolumesFromImageTest-1244366109 None] Volume 47d75b65-4451-4f47-b7aa-8b8708290ecb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-47d75b65-4451-4f47-b7aa-8b8708290ecb', 'volume_size': 1} Nov 06 12:00:47 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-680fa14f-0473-464f-935a-5fab0554fc8c tempest-CreateVolumesFromImageTest-1244366109 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 12:00:47 devstack sudo[106013]: pam_unix(sudo:session): session closed for user root Nov 06 12:00:47 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-5560ae0f-21ba-4bfa-85bb-1229002fc4be tempest-CreateVolumesFromImageTest-1244366109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-ad482c0b-8f61-49e2-b20c-b6b2d6dfa8ed 1073741824" returned: 0 in 0.604s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 12:00:47 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-5560ae0f-21ba-4bfa-85bb-1229002fc4be tempest-CreateVolumesFromImageTest-1244366109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-ad482c0b-8f61-49e2-b20c-b6b2d6dfa8ed {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 12:00:47 devstack sudo[106019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-ad482c0b-8f61-49e2-b20c-b6b2d6dfa8ed Nov 06 12:00:47 devstack sudo[106019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 12:00:48 devstack cinder-volume[87116]: DEBUG cinder.volume.flows.manager.create_volume [None req-82d32ad3-fb68-4255-8777-0ddd09f774ed tempest-VolumeDependencyTests-892718679 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87116) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 12:00:48 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-82d32ad3-fb68-4255-8777-0ddd09f774ed tempest-VolumeDependencyTests-892718679 None] Flow 'volume_create_manager' (85ae775f-e9dc-401c-91e0-01332d7b212b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 12:00:48 devstack sudo[106019]: pam_unix(sudo:session): session closed for user root Nov 06 12:00:48 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-82d32ad3-fb68-4255-8777-0ddd09f774ed tempest-VolumeDependencyTests-892718679 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3828e22d-1490-4fed-bf32-ee3e6f75221f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 12:00:48 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-5560ae0f-21ba-4bfa-85bb-1229002fc4be tempest-CreateVolumesFromImageTest-1244366109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-ad482c0b-8f61-49e2-b20c-b6b2d6dfa8ed" returned: 0 in 0.346s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 12:00:48 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-5560ae0f-21ba-4bfa-85bb-1229002fc4be tempest-CreateVolumesFromImageTest-1244366109 None] <== create_volume: return (1011ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f'} {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 12:00:48 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-5560ae0f-21ba-4bfa-85bb-1229002fc4be tempest-CreateVolumesFromImageTest-1244366109 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.014s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 12:00:48 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-2af2140e-80aa-4d2c-a7b5-a518ad25aa58 tempest-CreateVolumesFromSourceVolumeTest-141026190 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.847s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 12:00:48 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-2af2140e-80aa-4d2c-a7b5-a518ad25aa58 tempest-CreateVolumesFromSourceVolumeTest-141026190 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T11:00:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-540969303',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c9b9e74c-3b17-4f15-b83a-e391b682cada,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='04ebe05017d84cc0aff66a885bb6e75e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T11:00:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T11:00:47Z,use_quota=True,user_id='80278ec1f89a4cdd8c1d2d44168b043f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(34d3b144-d9b7-480a-a2e3-01e45f3d54c1),volume_type_id=34d3b144-d9b7-480a-a2e3-01e45f3d54c1)}" {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 12:00:48 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-2af2140e-80aa-4d2c-a7b5-a518ad25aa58 tempest-CreateVolumesFromSourceVolumeTest-141026190 None] Creating volume c9b9e74c-3b17-4f15-b83a-e391b682cada {{(pid=87116) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 12:00:48 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-2af2140e-80aa-4d2c-a7b5-a518ad25aa58 tempest-CreateVolumesFromSourceVolumeTest-141026190 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 12:00:48 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-2af2140e-80aa-4d2c-a7b5-a518ad25aa58 tempest-CreateVolumesFromSourceVolumeTest-141026190 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 12:00:48 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-2af2140e-80aa-4d2c-a7b5-a518ad25aa58 tempest-CreateVolumesFromSourceVolumeTest-141026190 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 12:00:48 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-2af2140e-80aa-4d2c-a7b5-a518ad25aa58 tempest-CreateVolumesFromSourceVolumeTest-141026190 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 12:00:48 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-2af2140e-80aa-4d2c-a7b5-a518ad25aa58 tempest-CreateVolumesFromSourceVolumeTest-141026190 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 12:00:48 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-2af2140e-80aa-4d2c-a7b5-a518ad25aa58 tempest-CreateVolumesFromSourceVolumeTest-141026190 None] Selected osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f as target Quobyte volume. {{(pid=87116) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 12:00:48 devstack cinder-volume[87116]: INFO cinder.volume.drivers.remotefs [None req-2af2140e-80aa-4d2c-a7b5-a518ad25aa58 tempest-CreateVolumesFromSourceVolumeTest-141026190 None] casted to osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f Nov 06 12:00:48 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-2af2140e-80aa-4d2c-a7b5-a518ad25aa58 tempest-CreateVolumesFromSourceVolumeTest-141026190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-c9b9e74c-3b17-4f15-b83a-e391b682cada 1073741824 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 12:00:48 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-82d32ad3-fb68-4255-8777-0ddd09f774ed tempest-VolumeDependencyTests-892718679 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3828e22d-1490-4fed-bf32-ee3e6f75221f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T11:00:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-110976426',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f8790c84-0fea-4fdd-8fed-8f7870effb49,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2c7a69fab6b74d6498176b18a505da28',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T11:00:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T11:00:48Z,use_quota=True,user_id='894cd30a3b7c46209217d52b4546b5e0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(34d3b144-d9b7-480a-a2e3-01e45f3d54c1),volume_type_id=34d3b144-d9b7-480a-a2e3-01e45f3d54c1)' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 12:00:48 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-82d32ad3-fb68-4255-8777-0ddd09f774ed tempest-VolumeDependencyTests-892718679 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (987d95c1-65b3-41f7-842a-2b063ba18740) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 12:00:48 devstack sudo[106023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-c9b9e74c-3b17-4f15-b83a-e391b682cada 1073741824 Nov 06 12:00:48 devstack sudo[106023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 12:00:48 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-82d32ad3-fb68-4255-8777-0ddd09f774ed tempest-VolumeDependencyTests-892718679 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (987d95c1-65b3-41f7-842a-2b063ba18740) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 12:00:48 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-82d32ad3-fb68-4255-8777-0ddd09f774ed tempest-VolumeDependencyTests-892718679 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e6b25ec1-d86b-4347-9ba3-3e8708739154) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 12:00:48 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-82d32ad3-fb68-4255-8777-0ddd09f774ed tempest-VolumeDependencyTests-892718679 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e6b25ec1-d86b-4347-9ba3-3e8708739154) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f8790c84-0fea-4fdd-8fed-8f7870effb49', 'volume_name': 'volume-f8790c84-0fea-4fdd-8fed-8f7870effb49', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 12:00:48 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-82d32ad3-fb68-4255-8777-0ddd09f774ed tempest-VolumeDependencyTests-892718679 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eb5a0576-be33-44ae-bed0-6df523168546) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 12:00:48 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-82d32ad3-fb68-4255-8777-0ddd09f774ed tempest-VolumeDependencyTests-892718679 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eb5a0576-be33-44ae-bed0-6df523168546) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 12:00:48 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-82d32ad3-fb68-4255-8777-0ddd09f774ed tempest-VolumeDependencyTests-892718679 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5b2aadad-885d-48d2-a1de-bf8156ab3b9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 12:00:48 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-82d32ad3-fb68-4255-8777-0ddd09f774ed tempest-VolumeDependencyTests-892718679 None] Volume f8790c84-0fea-4fdd-8fed-8f7870effb49: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f8790c84-0fea-4fdd-8fed-8f7870effb49', 'volume_size': 1} Nov 06 12:00:48 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-82d32ad3-fb68-4255-8777-0ddd09f774ed tempest-VolumeDependencyTests-892718679 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 12:00:48 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-5560ae0f-21ba-4bfa-85bb-1229002fc4be tempest-CreateVolumesFromImageTest-1244366109 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cf2bfd4c-80fe-410a-9617-9fd9224eea1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ad482c0b-8f61-49e2-b20c-b6b2d6dfa8ed', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 12:00:48 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-5560ae0f-21ba-4bfa-85bb-1229002fc4be tempest-CreateVolumesFromImageTest-1244366109 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (94a274c1-a407-46d2-85c8-9f7bbc379bf6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 12:00:48 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-5560ae0f-21ba-4bfa-85bb-1229002fc4be tempest-CreateVolumesFromImageTest-1244366109 None] Volume volume-ad482c0b-8f61-49e2-b20c-b6b2d6dfa8ed (ad482c0b-8f61-49e2-b20c-b6b2d6dfa8ed): created successfully Nov 06 12:00:48 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-5560ae0f-21ba-4bfa-85bb-1229002fc4be tempest-CreateVolumesFromImageTest-1244366109 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (94a274c1-a407-46d2-85c8-9f7bbc379bf6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 12:00:48 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-5560ae0f-21ba-4bfa-85bb-1229002fc4be tempest-CreateVolumesFromImageTest-1244366109 None] Flow 'volume_create_manager' (7125fd37-a3cf-4088-94a5-925873c4d1f1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 12:00:48 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-5560ae0f-21ba-4bfa-85bb-1229002fc4be tempest-CreateVolumesFromImageTest-1244366109 None] Created volume successfully. Nov 06 12:00:48 devstack cinder-volume[87116]: DEBUG cinder.volume.flows.manager.create_volume [None req-011b55fe-5e3e-4e4a-95b7-41f09197686c tempest-CreateVolumesFromImageTest-1244366109 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87116) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 12:00:48 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-011b55fe-5e3e-4e4a-95b7-41f09197686c tempest-CreateVolumesFromImageTest-1244366109 None] Flow 'volume_create_manager' (55b6fa70-539f-4e25-89d1-fb78d71311e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 12:00:48 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-011b55fe-5e3e-4e4a-95b7-41f09197686c tempest-CreateVolumesFromImageTest-1244366109 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (06a07c02-0fb4-4a2d-9160-0a6c62f95b72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 12:00:48 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-011b55fe-5e3e-4e4a-95b7-41f09197686c tempest-CreateVolumesFromImageTest-1244366109 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (06a07c02-0fb4-4a2d-9160-0a6c62f95b72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T11:00:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1976101441',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ace3ec41-22de-40fd-84fb-54ca14bd8254,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='110f736963c340ca9fdf4eed04e7f6ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T11:00:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T11:00:48Z,use_quota=True,user_id='fd8154bf76e6442a9edc0fe2bc22c2d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(34d3b144-d9b7-480a-a2e3-01e45f3d54c1),volume_type_id=34d3b144-d9b7-480a-a2e3-01e45f3d54c1)' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 12:00:48 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-011b55fe-5e3e-4e4a-95b7-41f09197686c tempest-CreateVolumesFromImageTest-1244366109 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (daff97a1-df2a-41d6-91e6-b7b6032aaa64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 12:00:48 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-011b55fe-5e3e-4e4a-95b7-41f09197686c tempest-CreateVolumesFromImageTest-1244366109 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (daff97a1-df2a-41d6-91e6-b7b6032aaa64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 12:00:48 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-011b55fe-5e3e-4e4a-95b7-41f09197686c tempest-CreateVolumesFromImageTest-1244366109 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7cfe97f9-81aa-4bfa-b411-1cf3cd89fead) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 12:00:48 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-011b55fe-5e3e-4e4a-95b7-41f09197686c tempest-CreateVolumesFromImageTest-1244366109 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7cfe97f9-81aa-4bfa-b411-1cf3cd89fead) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ace3ec41-22de-40fd-84fb-54ca14bd8254', 'volume_name': 'volume-ace3ec41-22de-40fd-84fb-54ca14bd8254', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 12:00:48 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-011b55fe-5e3e-4e4a-95b7-41f09197686c tempest-CreateVolumesFromImageTest-1244366109 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (60fc7ca0-7e7a-436a-9c7a-fd4a8df731a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 12:00:48 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-011b55fe-5e3e-4e4a-95b7-41f09197686c tempest-CreateVolumesFromImageTest-1244366109 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (60fc7ca0-7e7a-436a-9c7a-fd4a8df731a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 12:00:48 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-011b55fe-5e3e-4e4a-95b7-41f09197686c tempest-CreateVolumesFromImageTest-1244366109 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7f1a8ff5-6b9f-49e3-96d4-9d6332a060d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 12:00:48 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-011b55fe-5e3e-4e4a-95b7-41f09197686c tempest-CreateVolumesFromImageTest-1244366109 None] Volume ace3ec41-22de-40fd-84fb-54ca14bd8254: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ace3ec41-22de-40fd-84fb-54ca14bd8254', 'volume_size': 1} Nov 06 12:00:48 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-011b55fe-5e3e-4e4a-95b7-41f09197686c tempest-CreateVolumesFromImageTest-1244366109 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 12:00:48 devstack cinder-volume[87116]: DEBUG cinder.volume.flows.manager.create_volume [None req-3eea1884-635a-495f-a164-af9699bb2cfb tempest-CreateVolumesFromImageTest-1244366109 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87116) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 12:00:48 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-3eea1884-635a-495f-a164-af9699bb2cfb tempest-CreateVolumesFromImageTest-1244366109 None] Flow 'volume_create_manager' (6a3b8fe3-a55a-46be-80d2-2b026d187f9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 12:00:48 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-3eea1884-635a-495f-a164-af9699bb2cfb tempest-CreateVolumesFromImageTest-1244366109 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cc50bfd5-588d-4a5e-b4de-584db5a8eba9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 12:00:48 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-3eea1884-635a-495f-a164-af9699bb2cfb tempest-CreateVolumesFromImageTest-1244366109 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cc50bfd5-588d-4a5e-b4de-584db5a8eba9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T11:00:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1460118630',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cfd52e82-4b7a-4873-9465-1c6e28b3f2d8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='110f736963c340ca9fdf4eed04e7f6ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T11:00:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T11:00:48Z,use_quota=True,user_id='fd8154bf76e6442a9edc0fe2bc22c2d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(34d3b144-d9b7-480a-a2e3-01e45f3d54c1),volume_type_id=34d3b144-d9b7-480a-a2e3-01e45f3d54c1)' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 12:00:48 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-3eea1884-635a-495f-a164-af9699bb2cfb tempest-CreateVolumesFromImageTest-1244366109 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9f1d9bd9-e205-4862-b3bd-f5038b839b7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 12:00:48 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-3eea1884-635a-495f-a164-af9699bb2cfb tempest-CreateVolumesFromImageTest-1244366109 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9f1d9bd9-e205-4862-b3bd-f5038b839b7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 12:00:48 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-3eea1884-635a-495f-a164-af9699bb2cfb tempest-CreateVolumesFromImageTest-1244366109 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b94faaa8-46b4-44d3-b419-cc592532feca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 12:00:48 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-3eea1884-635a-495f-a164-af9699bb2cfb tempest-CreateVolumesFromImageTest-1244366109 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b94faaa8-46b4-44d3-b419-cc592532feca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cfd52e82-4b7a-4873-9465-1c6e28b3f2d8', 'volume_name': 'volume-cfd52e82-4b7a-4873-9465-1c6e28b3f2d8', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 12:00:48 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-3eea1884-635a-495f-a164-af9699bb2cfb tempest-CreateVolumesFromImageTest-1244366109 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c68f0a5a-1409-46d7-9a5e-f02907c17d98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 12:00:48 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-3eea1884-635a-495f-a164-af9699bb2cfb tempest-CreateVolumesFromImageTest-1244366109 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c68f0a5a-1409-46d7-9a5e-f02907c17d98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 12:00:48 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-3eea1884-635a-495f-a164-af9699bb2cfb tempest-CreateVolumesFromImageTest-1244366109 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5139b594-f229-47a0-9ef5-3d35b9b46972) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 12:00:48 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-3eea1884-635a-495f-a164-af9699bb2cfb tempest-CreateVolumesFromImageTest-1244366109 None] Volume cfd52e82-4b7a-4873-9465-1c6e28b3f2d8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cfd52e82-4b7a-4873-9465-1c6e28b3f2d8', 'volume_size': 1} Nov 06 12:00:48 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-3eea1884-635a-495f-a164-af9699bb2cfb tempest-CreateVolumesFromImageTest-1244366109 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 12:00:48 devstack cinder-volume[87116]: DEBUG cinder.volume.flows.manager.create_volume [None req-5791f25e-7af3-4982-9194-0b8dc55c600b tempest-CreateVolumesFromImageTest-1244366109 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87116) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 12:00:48 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-5791f25e-7af3-4982-9194-0b8dc55c600b tempest-CreateVolumesFromImageTest-1244366109 None] Flow 'volume_create_manager' (8ca03362-6903-4ad8-89a1-73770e9c403f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 12:00:48 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-5791f25e-7af3-4982-9194-0b8dc55c600b tempest-CreateVolumesFromImageTest-1244366109 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d8c260e0-a7cc-41f7-a0e5-d72fd6864696) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 12:00:48 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-5791f25e-7af3-4982-9194-0b8dc55c600b tempest-CreateVolumesFromImageTest-1244366109 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d8c260e0-a7cc-41f7-a0e5-d72fd6864696) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T11:00:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-175596006',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1cf562eb-d7ce-4a30-884d-44586643841a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='110f736963c340ca9fdf4eed04e7f6ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T11:00:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T11:00:49Z,use_quota=True,user_id='fd8154bf76e6442a9edc0fe2bc22c2d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(34d3b144-d9b7-480a-a2e3-01e45f3d54c1),volume_type_id=34d3b144-d9b7-480a-a2e3-01e45f3d54c1)' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 12:00:48 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-5791f25e-7af3-4982-9194-0b8dc55c600b tempest-CreateVolumesFromImageTest-1244366109 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (72f6515b-4b5c-46f4-84a5-101a142789c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 12:00:48 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-5791f25e-7af3-4982-9194-0b8dc55c600b tempest-CreateVolumesFromImageTest-1244366109 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (72f6515b-4b5c-46f4-84a5-101a142789c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 12:00:48 devstack sudo[106023]: pam_unix(sudo:session): session closed for user root Nov 06 12:00:48 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-5791f25e-7af3-4982-9194-0b8dc55c600b tempest-CreateVolumesFromImageTest-1244366109 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d4bbcc41-49ed-46b7-b3bb-d031eadf18b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 12:00:48 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-5791f25e-7af3-4982-9194-0b8dc55c600b tempest-CreateVolumesFromImageTest-1244366109 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d4bbcc41-49ed-46b7-b3bb-d031eadf18b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1cf562eb-d7ce-4a30-884d-44586643841a', 'volume_name': 'volume-1cf562eb-d7ce-4a30-884d-44586643841a', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 12:00:48 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-5791f25e-7af3-4982-9194-0b8dc55c600b tempest-CreateVolumesFromImageTest-1244366109 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3fe9c00c-9e3a-44a2-9ce5-2b0af0887289) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 12:00:48 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-5791f25e-7af3-4982-9194-0b8dc55c600b tempest-CreateVolumesFromImageTest-1244366109 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3fe9c00c-9e3a-44a2-9ce5-2b0af0887289) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 12:00:48 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-5791f25e-7af3-4982-9194-0b8dc55c600b tempest-CreateVolumesFromImageTest-1244366109 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aba42b15-81a1-4044-a96d-37440731d364) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 12:00:48 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-5791f25e-7af3-4982-9194-0b8dc55c600b tempest-CreateVolumesFromImageTest-1244366109 None] Volume 1cf562eb-d7ce-4a30-884d-44586643841a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1cf562eb-d7ce-4a30-884d-44586643841a', 'volume_size': 1} Nov 06 12:00:48 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-5791f25e-7af3-4982-9194-0b8dc55c600b tempest-CreateVolumesFromImageTest-1244366109 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 12:00:48 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-2af2140e-80aa-4d2c-a7b5-a518ad25aa58 tempest-CreateVolumesFromSourceVolumeTest-141026190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-c9b9e74c-3b17-4f15-b83a-e391b682cada 1073741824" returned: 0 in 0.694s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 12:00:48 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-2af2140e-80aa-4d2c-a7b5-a518ad25aa58 tempest-CreateVolumesFromSourceVolumeTest-141026190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-c9b9e74c-3b17-4f15-b83a-e391b682cada {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 12:00:49 devstack sudo[106029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-c9b9e74c-3b17-4f15-b83a-e391b682cada Nov 06 12:00:49 devstack sudo[106029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 12:00:49 devstack sudo[106029]: pam_unix(sudo:session): session closed for user root Nov 06 12:00:49 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-2af2140e-80aa-4d2c-a7b5-a518ad25aa58 tempest-CreateVolumesFromSourceVolumeTest-141026190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-c9b9e74c-3b17-4f15-b83a-e391b682cada" returned: 0 in 0.246s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 12:00:49 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-2af2140e-80aa-4d2c-a7b5-a518ad25aa58 tempest-CreateVolumesFromSourceVolumeTest-141026190 None] <== create_volume: return (982ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f'} {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 12:00:49 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-2af2140e-80aa-4d2c-a7b5-a518ad25aa58 tempest-CreateVolumesFromSourceVolumeTest-141026190 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.986s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 12:00:49 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-680fa14f-0473-464f-935a-5fab0554fc8c tempest-CreateVolumesFromImageTest-1244366109 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.590s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 12:00:49 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-680fa14f-0473-464f-935a-5fab0554fc8c tempest-CreateVolumesFromImageTest-1244366109 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T11:00:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-571389435',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=47d75b65-4451-4f47-b7aa-8b8708290ecb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='110f736963c340ca9fdf4eed04e7f6ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T11:00:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T11:00:47Z,use_quota=True,user_id='fd8154bf76e6442a9edc0fe2bc22c2d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(34d3b144-d9b7-480a-a2e3-01e45f3d54c1),volume_type_id=34d3b144-d9b7-480a-a2e3-01e45f3d54c1)}" {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 12:00:49 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-680fa14f-0473-464f-935a-5fab0554fc8c tempest-CreateVolumesFromImageTest-1244366109 None] Creating volume 47d75b65-4451-4f47-b7aa-8b8708290ecb {{(pid=87116) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 12:00:49 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-680fa14f-0473-464f-935a-5fab0554fc8c tempest-CreateVolumesFromImageTest-1244366109 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 12:00:49 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-680fa14f-0473-464f-935a-5fab0554fc8c tempest-CreateVolumesFromImageTest-1244366109 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 12:00:49 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-680fa14f-0473-464f-935a-5fab0554fc8c tempest-CreateVolumesFromImageTest-1244366109 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 12:00:49 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-680fa14f-0473-464f-935a-5fab0554fc8c tempest-CreateVolumesFromImageTest-1244366109 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 12:00:49 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-680fa14f-0473-464f-935a-5fab0554fc8c tempest-CreateVolumesFromImageTest-1244366109 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 12:00:49 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-680fa14f-0473-464f-935a-5fab0554fc8c tempest-CreateVolumesFromImageTest-1244366109 None] Selected osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f as target Quobyte volume. {{(pid=87116) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 12:00:49 devstack cinder-volume[87116]: INFO cinder.volume.drivers.remotefs [None req-680fa14f-0473-464f-935a-5fab0554fc8c tempest-CreateVolumesFromImageTest-1244366109 None] casted to osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f Nov 06 12:00:49 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-680fa14f-0473-464f-935a-5fab0554fc8c tempest-CreateVolumesFromImageTest-1244366109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-47d75b65-4451-4f47-b7aa-8b8708290ecb 1073741824 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 12:00:49 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-2af2140e-80aa-4d2c-a7b5-a518ad25aa58 tempest-CreateVolumesFromSourceVolumeTest-141026190 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (77358124-e0cf-4186-aec1-4e2153bc1394) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c9b9e74c-3b17-4f15-b83a-e391b682cada', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 12:00:49 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-2af2140e-80aa-4d2c-a7b5-a518ad25aa58 tempest-CreateVolumesFromSourceVolumeTest-141026190 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (542c7650-653d-47be-b3de-113549477941) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 12:00:49 devstack sudo[106032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-47d75b65-4451-4f47-b7aa-8b8708290ecb 1073741824 Nov 06 12:00:49 devstack sudo[106032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 12:00:49 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-2af2140e-80aa-4d2c-a7b5-a518ad25aa58 tempest-CreateVolumesFromSourceVolumeTest-141026190 None] Volume volume-c9b9e74c-3b17-4f15-b83a-e391b682cada (c9b9e74c-3b17-4f15-b83a-e391b682cada): created successfully Nov 06 12:00:49 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-2af2140e-80aa-4d2c-a7b5-a518ad25aa58 tempest-CreateVolumesFromSourceVolumeTest-141026190 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (542c7650-653d-47be-b3de-113549477941) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 12:00:49 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-2af2140e-80aa-4d2c-a7b5-a518ad25aa58 tempest-CreateVolumesFromSourceVolumeTest-141026190 None] Flow 'volume_create_manager' (95452f41-054a-408f-a5f9-10cb5b6f2baf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 12:00:49 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-2af2140e-80aa-4d2c-a7b5-a518ad25aa58 tempest-CreateVolumesFromSourceVolumeTest-141026190 None] Created volume successfully. Nov 06 12:00:49 devstack sudo[106032]: pam_unix(sudo:session): session closed for user root Nov 06 12:00:49 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-680fa14f-0473-464f-935a-5fab0554fc8c tempest-CreateVolumesFromImageTest-1244366109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-47d75b65-4451-4f47-b7aa-8b8708290ecb 1073741824" returned: 0 in 0.468s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 12:00:49 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-680fa14f-0473-464f-935a-5fab0554fc8c tempest-CreateVolumesFromImageTest-1244366109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-47d75b65-4451-4f47-b7aa-8b8708290ecb {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 12:00:49 devstack sudo[106038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-47d75b65-4451-4f47-b7aa-8b8708290ecb Nov 06 12:00:49 devstack sudo[106038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 12:00:50 devstack cinder-volume[87116]: DEBUG cinder.volume.flows.manager.create_volume [None req-c14514cf-b0ab-4924-a278-00f986473f7b tempest-CreateVolumesFromSourceVolumeTest-141026190 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87116) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 12:00:50 devstack sudo[106038]: pam_unix(sudo:session): session closed for user root Nov 06 12:00:50 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-c14514cf-b0ab-4924-a278-00f986473f7b tempest-CreateVolumesFromSourceVolumeTest-141026190 None] Flow 'volume_create_manager' (e92fec62-5f35-4ce7-a1d6-1ba9ea4a3faf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 12:00:50 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-c14514cf-b0ab-4924-a278-00f986473f7b tempest-CreateVolumesFromSourceVolumeTest-141026190 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (81062f1d-6caf-4860-acf6-262161081594) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 12:00:50 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-680fa14f-0473-464f-935a-5fab0554fc8c tempest-CreateVolumesFromImageTest-1244366109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-47d75b65-4451-4f47-b7aa-8b8708290ecb" returned: 0 in 0.350s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 12:00:50 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-680fa14f-0473-464f-935a-5fab0554fc8c tempest-CreateVolumesFromImageTest-1244366109 None] <== create_volume: return (862ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f'} {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 12:00:50 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-680fa14f-0473-464f-935a-5fab0554fc8c tempest-CreateVolumesFromImageTest-1244366109 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.864s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 12:00:50 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-82d32ad3-fb68-4255-8777-0ddd09f774ed tempest-VolumeDependencyTests-892718679 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.748s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 12:00:50 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-82d32ad3-fb68-4255-8777-0ddd09f774ed tempest-VolumeDependencyTests-892718679 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T11:00:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-110976426',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f8790c84-0fea-4fdd-8fed-8f7870effb49,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2c7a69fab6b74d6498176b18a505da28',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T11:00:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T11:00:48Z,use_quota=True,user_id='894cd30a3b7c46209217d52b4546b5e0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(34d3b144-d9b7-480a-a2e3-01e45f3d54c1),volume_type_id=34d3b144-d9b7-480a-a2e3-01e45f3d54c1)}" {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 12:00:50 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-82d32ad3-fb68-4255-8777-0ddd09f774ed tempest-VolumeDependencyTests-892718679 None] Creating volume f8790c84-0fea-4fdd-8fed-8f7870effb49 {{(pid=87116) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 12:00:50 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-82d32ad3-fb68-4255-8777-0ddd09f774ed tempest-VolumeDependencyTests-892718679 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 12:00:50 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-82d32ad3-fb68-4255-8777-0ddd09f774ed tempest-VolumeDependencyTests-892718679 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 12:00:50 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-82d32ad3-fb68-4255-8777-0ddd09f774ed tempest-VolumeDependencyTests-892718679 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 12:00:50 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-82d32ad3-fb68-4255-8777-0ddd09f774ed tempest-VolumeDependencyTests-892718679 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 12:00:50 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-82d32ad3-fb68-4255-8777-0ddd09f774ed tempest-VolumeDependencyTests-892718679 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 12:00:50 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-82d32ad3-fb68-4255-8777-0ddd09f774ed tempest-VolumeDependencyTests-892718679 None] Selected osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f as target Quobyte volume. {{(pid=87116) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 12:00:50 devstack cinder-volume[87116]: INFO cinder.volume.drivers.remotefs [None req-82d32ad3-fb68-4255-8777-0ddd09f774ed tempest-VolumeDependencyTests-892718679 None] casted to osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f Nov 06 12:00:50 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-82d32ad3-fb68-4255-8777-0ddd09f774ed tempest-VolumeDependencyTests-892718679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-f8790c84-0fea-4fdd-8fed-8f7870effb49 1073741824 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 12:00:50 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-c14514cf-b0ab-4924-a278-00f986473f7b tempest-CreateVolumesFromSourceVolumeTest-141026190 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (81062f1d-6caf-4860-acf6-262161081594) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T11:00:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-731986796',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a9365c8a-df8b-4e6c-9e3a-6609627f75f9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='04ebe05017d84cc0aff66a885bb6e75e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T11:00:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T11:00:50Z,use_quota=True,user_id='80278ec1f89a4cdd8c1d2d44168b043f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(34d3b144-d9b7-480a-a2e3-01e45f3d54c1),volume_type_id=34d3b144-d9b7-480a-a2e3-01e45f3d54c1)' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 12:00:50 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-c14514cf-b0ab-4924-a278-00f986473f7b tempest-CreateVolumesFromSourceVolumeTest-141026190 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (62b22eda-9b4b-411b-8802-9e36eb907870) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 12:00:50 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-c14514cf-b0ab-4924-a278-00f986473f7b tempest-CreateVolumesFromSourceVolumeTest-141026190 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (62b22eda-9b4b-411b-8802-9e36eb907870) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 12:00:50 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-c14514cf-b0ab-4924-a278-00f986473f7b tempest-CreateVolumesFromSourceVolumeTest-141026190 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8ef00c44-4b36-4cb3-b004-c8a67a72a14f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 12:00:50 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-c14514cf-b0ab-4924-a278-00f986473f7b tempest-CreateVolumesFromSourceVolumeTest-141026190 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8ef00c44-4b36-4cb3-b004-c8a67a72a14f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a9365c8a-df8b-4e6c-9e3a-6609627f75f9', 'volume_name': 'volume-a9365c8a-df8b-4e6c-9e3a-6609627f75f9', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 12:00:50 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-c14514cf-b0ab-4924-a278-00f986473f7b tempest-CreateVolumesFromSourceVolumeTest-141026190 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5128159a-c069-49c0-b673-1202ceab336c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 12:00:50 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-c14514cf-b0ab-4924-a278-00f986473f7b tempest-CreateVolumesFromSourceVolumeTest-141026190 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5128159a-c069-49c0-b673-1202ceab336c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 12:00:50 devstack sudo[106041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-f8790c84-0fea-4fdd-8fed-8f7870effb49 1073741824 Nov 06 12:00:50 devstack sudo[106041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 12:00:50 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-c14514cf-b0ab-4924-a278-00f986473f7b tempest-CreateVolumesFromSourceVolumeTest-141026190 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (66d42fbf-e67a-4960-b13f-9d89ed31bed5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 12:00:50 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-c14514cf-b0ab-4924-a278-00f986473f7b tempest-CreateVolumesFromSourceVolumeTest-141026190 None] Volume a9365c8a-df8b-4e6c-9e3a-6609627f75f9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a9365c8a-df8b-4e6c-9e3a-6609627f75f9', 'volume_size': 1} Nov 06 12:00:50 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-c14514cf-b0ab-4924-a278-00f986473f7b tempest-CreateVolumesFromSourceVolumeTest-141026190 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 12:00:50 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-680fa14f-0473-464f-935a-5fab0554fc8c tempest-CreateVolumesFromImageTest-1244366109 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (627ef19c-accf-4aac-b705-20f0523bcf38) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-47d75b65-4451-4f47-b7aa-8b8708290ecb', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 12:00:50 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-680fa14f-0473-464f-935a-5fab0554fc8c tempest-CreateVolumesFromImageTest-1244366109 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b072e5b1-5186-4c48-97e4-c12b9dbbafe3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 12:00:50 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-680fa14f-0473-464f-935a-5fab0554fc8c tempest-CreateVolumesFromImageTest-1244366109 None] Volume volume-47d75b65-4451-4f47-b7aa-8b8708290ecb (47d75b65-4451-4f47-b7aa-8b8708290ecb): created successfully Nov 06 12:00:50 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-680fa14f-0473-464f-935a-5fab0554fc8c tempest-CreateVolumesFromImageTest-1244366109 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b072e5b1-5186-4c48-97e4-c12b9dbbafe3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 12:00:50 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-680fa14f-0473-464f-935a-5fab0554fc8c tempest-CreateVolumesFromImageTest-1244366109 None] Flow 'volume_create_manager' (0d71a44e-fe46-4b27-b79b-e0a20b0d49dd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 12:00:50 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-680fa14f-0473-464f-935a-5fab0554fc8c tempest-CreateVolumesFromImageTest-1244366109 None] Created volume successfully. Nov 06 12:00:50 devstack cinder-volume[87116]: DEBUG cinder.volume.flows.manager.create_volume [None req-9d18bfd7-15b8-417f-87a7-12f882f5e1b7 tempest-CreateVolumesFromSourceVolumeTest-141026190 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87116) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 12:00:50 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-9d18bfd7-15b8-417f-87a7-12f882f5e1b7 tempest-CreateVolumesFromSourceVolumeTest-141026190 None] Flow 'volume_create_manager' (b448d998-ae0a-494f-9870-a0e8e003ed51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 12:00:50 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-9d18bfd7-15b8-417f-87a7-12f882f5e1b7 tempest-CreateVolumesFromSourceVolumeTest-141026190 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (31736d6c-8b03-4860-9e43-1718c62b3bb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 12:00:50 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-9d18bfd7-15b8-417f-87a7-12f882f5e1b7 tempest-CreateVolumesFromSourceVolumeTest-141026190 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (31736d6c-8b03-4860-9e43-1718c62b3bb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T11:00:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1968565829',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9840bff3-e388-45ca-9233-14ec00ebeda0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='04ebe05017d84cc0aff66a885bb6e75e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T11:00:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T11:00:50Z,use_quota=True,user_id='80278ec1f89a4cdd8c1d2d44168b043f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(34d3b144-d9b7-480a-a2e3-01e45f3d54c1),volume_type_id=34d3b144-d9b7-480a-a2e3-01e45f3d54c1)' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 12:00:50 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-9d18bfd7-15b8-417f-87a7-12f882f5e1b7 tempest-CreateVolumesFromSourceVolumeTest-141026190 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b8fd2229-7eda-4e30-9b57-0c43b54cdb44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 12:00:50 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-9d18bfd7-15b8-417f-87a7-12f882f5e1b7 tempest-CreateVolumesFromSourceVolumeTest-141026190 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b8fd2229-7eda-4e30-9b57-0c43b54cdb44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 12:00:50 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-9d18bfd7-15b8-417f-87a7-12f882f5e1b7 tempest-CreateVolumesFromSourceVolumeTest-141026190 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9c13be30-6c27-4fe2-8929-40a59c9b2f67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 12:00:50 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-9d18bfd7-15b8-417f-87a7-12f882f5e1b7 tempest-CreateVolumesFromSourceVolumeTest-141026190 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9c13be30-6c27-4fe2-8929-40a59c9b2f67) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9840bff3-e388-45ca-9233-14ec00ebeda0', 'volume_name': 'volume-9840bff3-e388-45ca-9233-14ec00ebeda0', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 12:00:50 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-9d18bfd7-15b8-417f-87a7-12f882f5e1b7 tempest-CreateVolumesFromSourceVolumeTest-141026190 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f0d1b5a4-6118-49f4-b960-cf3b464101f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 12:00:50 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-9d18bfd7-15b8-417f-87a7-12f882f5e1b7 tempest-CreateVolumesFromSourceVolumeTest-141026190 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f0d1b5a4-6118-49f4-b960-cf3b464101f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 12:00:50 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-9d18bfd7-15b8-417f-87a7-12f882f5e1b7 tempest-CreateVolumesFromSourceVolumeTest-141026190 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (02b283b4-aef4-42d5-8cdf-1518e7837a64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 12:00:50 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-9d18bfd7-15b8-417f-87a7-12f882f5e1b7 tempest-CreateVolumesFromSourceVolumeTest-141026190 None] Volume 9840bff3-e388-45ca-9233-14ec00ebeda0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9840bff3-e388-45ca-9233-14ec00ebeda0', 'volume_size': 1} Nov 06 12:00:50 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-9d18bfd7-15b8-417f-87a7-12f882f5e1b7 tempest-CreateVolumesFromSourceVolumeTest-141026190 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 12:00:50 devstack sudo[106041]: pam_unix(sudo:session): session closed for user root Nov 06 12:00:50 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-82d32ad3-fb68-4255-8777-0ddd09f774ed tempest-VolumeDependencyTests-892718679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-f8790c84-0fea-4fdd-8fed-8f7870effb49 1073741824" returned: 0 in 0.557s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 12:00:50 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-82d32ad3-fb68-4255-8777-0ddd09f774ed tempest-VolumeDependencyTests-892718679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-f8790c84-0fea-4fdd-8fed-8f7870effb49 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 12:00:50 devstack sudo[106047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-f8790c84-0fea-4fdd-8fed-8f7870effb49 Nov 06 12:00:50 devstack sudo[106047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 12:00:50 devstack cinder-volume[87116]: DEBUG cinder.volume.flows.manager.create_volume [None req-12baff7f-4025-451b-b441-2469afbff95e tempest-CreateVolumesFromSourceVolumeTest-141026190 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87116) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 12:00:50 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-12baff7f-4025-451b-b441-2469afbff95e tempest-CreateVolumesFromSourceVolumeTest-141026190 None] Flow 'volume_create_manager' (3032d7e5-4ae7-4dcf-8786-9c2d1bcdc96e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 12:00:50 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-12baff7f-4025-451b-b441-2469afbff95e tempest-CreateVolumesFromSourceVolumeTest-141026190 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0b7533b2-85f4-4201-a66c-f25cd4fd50d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 12:00:51 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-12baff7f-4025-451b-b441-2469afbff95e tempest-CreateVolumesFromSourceVolumeTest-141026190 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0b7533b2-85f4-4201-a66c-f25cd4fd50d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T11:00:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1072376708',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b0b4ae59-b11f-4b85-a77d-4519b933d1e1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='04ebe05017d84cc0aff66a885bb6e75e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T11:00:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T11:00:51Z,use_quota=True,user_id='80278ec1f89a4cdd8c1d2d44168b043f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(34d3b144-d9b7-480a-a2e3-01e45f3d54c1),volume_type_id=34d3b144-d9b7-480a-a2e3-01e45f3d54c1)' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 12:00:51 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-12baff7f-4025-451b-b441-2469afbff95e tempest-CreateVolumesFromSourceVolumeTest-141026190 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c7702c09-882d-41f2-995d-e1c4aba0b018) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 12:00:51 devstack sudo[106047]: pam_unix(sudo:session): session closed for user root Nov 06 12:00:51 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-12baff7f-4025-451b-b441-2469afbff95e tempest-CreateVolumesFromSourceVolumeTest-141026190 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c7702c09-882d-41f2-995d-e1c4aba0b018) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 12:00:51 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-12baff7f-4025-451b-b441-2469afbff95e tempest-CreateVolumesFromSourceVolumeTest-141026190 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ba2ec329-b2bb-487c-b6aa-f64781c45d97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 12:00:51 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-12baff7f-4025-451b-b441-2469afbff95e tempest-CreateVolumesFromSourceVolumeTest-141026190 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ba2ec329-b2bb-487c-b6aa-f64781c45d97) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b0b4ae59-b11f-4b85-a77d-4519b933d1e1', 'volume_name': 'volume-b0b4ae59-b11f-4b85-a77d-4519b933d1e1', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 12:00:51 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-12baff7f-4025-451b-b441-2469afbff95e tempest-CreateVolumesFromSourceVolumeTest-141026190 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (640e0713-857d-4d97-ab95-7575af9e8e08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 12:00:51 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-12baff7f-4025-451b-b441-2469afbff95e tempest-CreateVolumesFromSourceVolumeTest-141026190 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (640e0713-857d-4d97-ab95-7575af9e8e08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 12:00:51 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-12baff7f-4025-451b-b441-2469afbff95e tempest-CreateVolumesFromSourceVolumeTest-141026190 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9382301f-54ed-4b82-8bf0-8930ed7ed01a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 12:00:51 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-12baff7f-4025-451b-b441-2469afbff95e tempest-CreateVolumesFromSourceVolumeTest-141026190 None] Volume b0b4ae59-b11f-4b85-a77d-4519b933d1e1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b0b4ae59-b11f-4b85-a77d-4519b933d1e1', 'volume_size': 1} Nov 06 12:00:51 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-12baff7f-4025-451b-b441-2469afbff95e tempest-CreateVolumesFromSourceVolumeTest-141026190 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 12:00:51 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-82d32ad3-fb68-4255-8777-0ddd09f774ed tempest-VolumeDependencyTests-892718679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-f8790c84-0fea-4fdd-8fed-8f7870effb49" returned: 0 in 0.375s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 12:00:51 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-82d32ad3-fb68-4255-8777-0ddd09f774ed tempest-VolumeDependencyTests-892718679 None] <== create_volume: return (983ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f'} {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 12:00:51 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-82d32ad3-fb68-4255-8777-0ddd09f774ed tempest-VolumeDependencyTests-892718679 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.987s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 12:00:51 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-011b55fe-5e3e-4e4a-95b7-41f09197686c tempest-CreateVolumesFromImageTest-1244366109 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.457s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 12:00:51 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-011b55fe-5e3e-4e4a-95b7-41f09197686c tempest-CreateVolumesFromImageTest-1244366109 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T11:00:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1976101441',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ace3ec41-22de-40fd-84fb-54ca14bd8254,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='110f736963c340ca9fdf4eed04e7f6ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T11:00:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T11:00:48Z,use_quota=True,user_id='fd8154bf76e6442a9edc0fe2bc22c2d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(34d3b144-d9b7-480a-a2e3-01e45f3d54c1),volume_type_id=34d3b144-d9b7-480a-a2e3-01e45f3d54c1)}" {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 12:00:51 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-011b55fe-5e3e-4e4a-95b7-41f09197686c tempest-CreateVolumesFromImageTest-1244366109 None] Creating volume ace3ec41-22de-40fd-84fb-54ca14bd8254 {{(pid=87116) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 12:00:51 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-011b55fe-5e3e-4e4a-95b7-41f09197686c tempest-CreateVolumesFromImageTest-1244366109 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 12:00:51 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-011b55fe-5e3e-4e4a-95b7-41f09197686c tempest-CreateVolumesFromImageTest-1244366109 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 12:00:51 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-011b55fe-5e3e-4e4a-95b7-41f09197686c tempest-CreateVolumesFromImageTest-1244366109 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 12:00:51 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-011b55fe-5e3e-4e4a-95b7-41f09197686c tempest-CreateVolumesFromImageTest-1244366109 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 12:00:51 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-011b55fe-5e3e-4e4a-95b7-41f09197686c tempest-CreateVolumesFromImageTest-1244366109 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 12:00:51 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-011b55fe-5e3e-4e4a-95b7-41f09197686c tempest-CreateVolumesFromImageTest-1244366109 None] Selected osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f as target Quobyte volume. {{(pid=87116) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 12:00:51 devstack cinder-volume[87116]: INFO cinder.volume.drivers.remotefs [None req-011b55fe-5e3e-4e4a-95b7-41f09197686c tempest-CreateVolumesFromImageTest-1244366109 None] casted to osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f Nov 06 12:00:51 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-011b55fe-5e3e-4e4a-95b7-41f09197686c tempest-CreateVolumesFromImageTest-1244366109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-ace3ec41-22de-40fd-84fb-54ca14bd8254 1073741824 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 12:00:51 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-82d32ad3-fb68-4255-8777-0ddd09f774ed tempest-VolumeDependencyTests-892718679 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5b2aadad-885d-48d2-a1de-bf8156ab3b9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f8790c84-0fea-4fdd-8fed-8f7870effb49', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 12:00:51 devstack sudo[106050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-ace3ec41-22de-40fd-84fb-54ca14bd8254 1073741824 Nov 06 12:00:51 devstack sudo[106050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 12:00:51 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-82d32ad3-fb68-4255-8777-0ddd09f774ed tempest-VolumeDependencyTests-892718679 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c148e8fb-49b7-42de-92e9-8d10ebc43489) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 12:00:51 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-82d32ad3-fb68-4255-8777-0ddd09f774ed tempest-VolumeDependencyTests-892718679 None] Volume volume-f8790c84-0fea-4fdd-8fed-8f7870effb49 (f8790c84-0fea-4fdd-8fed-8f7870effb49): created successfully Nov 06 12:00:51 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-82d32ad3-fb68-4255-8777-0ddd09f774ed tempest-VolumeDependencyTests-892718679 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c148e8fb-49b7-42de-92e9-8d10ebc43489) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 12:00:51 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-82d32ad3-fb68-4255-8777-0ddd09f774ed tempest-VolumeDependencyTests-892718679 None] Flow 'volume_create_manager' (85ae775f-e9dc-401c-91e0-01332d7b212b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 12:00:51 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-82d32ad3-fb68-4255-8777-0ddd09f774ed tempest-VolumeDependencyTests-892718679 None] Created volume successfully. Nov 06 12:00:51 devstack cinder-volume[87116]: DEBUG cinder.volume.flows.manager.create_volume [None req-c8eec833-a330-4c28-ada1-11ad87f0082c tempest-CreateVolumesFromSourceVolumeTest-141026190 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87116) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 12:00:51 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-c8eec833-a330-4c28-ada1-11ad87f0082c tempest-CreateVolumesFromSourceVolumeTest-141026190 None] Flow 'volume_create_manager' (f0591582-e3cb-475b-9f53-db48d36d4513) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 12:00:51 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-c8eec833-a330-4c28-ada1-11ad87f0082c tempest-CreateVolumesFromSourceVolumeTest-141026190 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8fdaa76f-47b8-4bab-a7e4-7ae01a442b06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 12:00:51 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-c8eec833-a330-4c28-ada1-11ad87f0082c tempest-CreateVolumesFromSourceVolumeTest-141026190 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8fdaa76f-47b8-4bab-a7e4-7ae01a442b06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T11:00:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-517105797',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6faa751e-46db-47d5-ada3-1ad8e7e3cd7e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='04ebe05017d84cc0aff66a885bb6e75e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T11:00:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T11:00:51Z,use_quota=True,user_id='80278ec1f89a4cdd8c1d2d44168b043f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(34d3b144-d9b7-480a-a2e3-01e45f3d54c1),volume_type_id=34d3b144-d9b7-480a-a2e3-01e45f3d54c1)' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 12:00:51 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-c8eec833-a330-4c28-ada1-11ad87f0082c tempest-CreateVolumesFromSourceVolumeTest-141026190 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (98371f23-44e0-4153-852c-243e0f1e2eff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 12:00:51 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-c8eec833-a330-4c28-ada1-11ad87f0082c tempest-CreateVolumesFromSourceVolumeTest-141026190 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (98371f23-44e0-4153-852c-243e0f1e2eff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 12:00:51 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-c8eec833-a330-4c28-ada1-11ad87f0082c tempest-CreateVolumesFromSourceVolumeTest-141026190 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f9b8e20-c252-43c1-8cc8-a321940414ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 12:00:51 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-c8eec833-a330-4c28-ada1-11ad87f0082c tempest-CreateVolumesFromSourceVolumeTest-141026190 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f9b8e20-c252-43c1-8cc8-a321940414ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6faa751e-46db-47d5-ada3-1ad8e7e3cd7e', 'volume_name': 'volume-6faa751e-46db-47d5-ada3-1ad8e7e3cd7e', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 12:00:51 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-c8eec833-a330-4c28-ada1-11ad87f0082c tempest-CreateVolumesFromSourceVolumeTest-141026190 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (88374426-f65a-47b4-bf2d-9353b3ff2cdd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 12:00:51 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-c8eec833-a330-4c28-ada1-11ad87f0082c tempest-CreateVolumesFromSourceVolumeTest-141026190 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (88374426-f65a-47b4-bf2d-9353b3ff2cdd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 12:00:51 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-c8eec833-a330-4c28-ada1-11ad87f0082c tempest-CreateVolumesFromSourceVolumeTest-141026190 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5c8bf8a9-63dc-4e92-b7a3-9bdb614ceed4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 12:00:51 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-c8eec833-a330-4c28-ada1-11ad87f0082c tempest-CreateVolumesFromSourceVolumeTest-141026190 None] Volume 6faa751e-46db-47d5-ada3-1ad8e7e3cd7e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6faa751e-46db-47d5-ada3-1ad8e7e3cd7e', 'volume_size': 1} Nov 06 12:00:51 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-c8eec833-a330-4c28-ada1-11ad87f0082c tempest-CreateVolumesFromSourceVolumeTest-141026190 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 12:00:51 devstack cinder-volume[87116]: DEBUG cinder.volume.flows.manager.create_volume [None req-96fb73c2-b11d-4aea-944e-a10bc7c35336 tempest-CreateVolumesFromSourceVolumeTest-141026190 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87116) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 12:00:51 devstack sudo[106050]: pam_unix(sudo:session): session closed for user root Nov 06 12:00:51 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-96fb73c2-b11d-4aea-944e-a10bc7c35336 tempest-CreateVolumesFromSourceVolumeTest-141026190 None] Flow 'volume_create_manager' (3fc7693e-12ff-4769-a021-243de5774e4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 12:00:51 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-96fb73c2-b11d-4aea-944e-a10bc7c35336 tempest-CreateVolumesFromSourceVolumeTest-141026190 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (00dff22e-c5b2-4f01-93dd-4c0d39680323) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 12:00:51 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-011b55fe-5e3e-4e4a-95b7-41f09197686c tempest-CreateVolumesFromImageTest-1244366109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-ace3ec41-22de-40fd-84fb-54ca14bd8254 1073741824" returned: 0 in 0.624s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 12:00:51 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-96fb73c2-b11d-4aea-944e-a10bc7c35336 tempest-CreateVolumesFromSourceVolumeTest-141026190 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (00dff22e-c5b2-4f01-93dd-4c0d39680323) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T11:00:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2007933151',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2ad490eb-d22e-4ac3-9702-20b0431601db,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='04ebe05017d84cc0aff66a885bb6e75e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T11:00:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T11:00:52Z,use_quota=True,user_id='80278ec1f89a4cdd8c1d2d44168b043f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(34d3b144-d9b7-480a-a2e3-01e45f3d54c1),volume_type_id=34d3b144-d9b7-480a-a2e3-01e45f3d54c1)' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 12:00:51 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-96fb73c2-b11d-4aea-944e-a10bc7c35336 tempest-CreateVolumesFromSourceVolumeTest-141026190 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fae9d12e-5cdb-43b7-b2d8-3daf9ef51f57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 12:00:51 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-96fb73c2-b11d-4aea-944e-a10bc7c35336 tempest-CreateVolumesFromSourceVolumeTest-141026190 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fae9d12e-5cdb-43b7-b2d8-3daf9ef51f57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 12:00:51 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-96fb73c2-b11d-4aea-944e-a10bc7c35336 tempest-CreateVolumesFromSourceVolumeTest-141026190 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e8181251-3651-4b22-9cb1-c78594320ffb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 12:00:51 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-96fb73c2-b11d-4aea-944e-a10bc7c35336 tempest-CreateVolumesFromSourceVolumeTest-141026190 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e8181251-3651-4b22-9cb1-c78594320ffb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2ad490eb-d22e-4ac3-9702-20b0431601db', 'volume_name': 'volume-2ad490eb-d22e-4ac3-9702-20b0431601db', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 12:00:51 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-96fb73c2-b11d-4aea-944e-a10bc7c35336 tempest-CreateVolumesFromSourceVolumeTest-141026190 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (36570757-3680-4c93-8c16-621260a701e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 12:00:51 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-96fb73c2-b11d-4aea-944e-a10bc7c35336 tempest-CreateVolumesFromSourceVolumeTest-141026190 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (36570757-3680-4c93-8c16-621260a701e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 12:00:51 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-96fb73c2-b11d-4aea-944e-a10bc7c35336 tempest-CreateVolumesFromSourceVolumeTest-141026190 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8e298396-ca5f-420a-9e84-a5fbc64c4d73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 12:00:51 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-96fb73c2-b11d-4aea-944e-a10bc7c35336 tempest-CreateVolumesFromSourceVolumeTest-141026190 None] Volume 2ad490eb-d22e-4ac3-9702-20b0431601db: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2ad490eb-d22e-4ac3-9702-20b0431601db', 'volume_size': 1} Nov 06 12:00:51 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-96fb73c2-b11d-4aea-944e-a10bc7c35336 tempest-CreateVolumesFromSourceVolumeTest-141026190 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 12:00:51 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-011b55fe-5e3e-4e4a-95b7-41f09197686c tempest-CreateVolumesFromImageTest-1244366109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-ace3ec41-22de-40fd-84fb-54ca14bd8254 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 12:00:51 devstack sudo[106057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-ace3ec41-22de-40fd-84fb-54ca14bd8254 Nov 06 12:00:51 devstack sudo[106057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 12:00:52 devstack cinder-volume[87116]: DEBUG cinder.volume.flows.manager.create_volume [None req-abc9dfec-210d-4ba8-bacb-0e8c36a479ec tempest-VolumeAndVolumeTypeFromImageTest-1559663696 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87116) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 12:00:52 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-abc9dfec-210d-4ba8-bacb-0e8c36a479ec tempest-VolumeAndVolumeTypeFromImageTest-1559663696 None] Flow 'volume_create_manager' (4298fc45-baf2-4eb1-8897-82e272a2e6ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 12:00:52 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-abc9dfec-210d-4ba8-bacb-0e8c36a479ec tempest-VolumeAndVolumeTypeFromImageTest-1559663696 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4656e3c6-88e8-4cf3-bae7-70a590cda796) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 12:00:52 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-abc9dfec-210d-4ba8-bacb-0e8c36a479ec tempest-VolumeAndVolumeTypeFromImageTest-1559663696 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4656e3c6-88e8-4cf3-bae7-70a590cda796) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T11:00:52Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=45dd2432-9eab-4aa2-9a73-bad99e686c47,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='99d6df4d85a74ec6a44093feb2aa49bd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T11:00:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T11:00:52Z,use_quota=True,user_id='9241a8d97a784ecb84f6b02e74d40e02',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(90b006af-efaf-4241-a7c0-4bc02137c188),volume_type_id=90b006af-efaf-4241-a7c0-4bc02137c188)' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 12:00:52 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-abc9dfec-210d-4ba8-bacb-0e8c36a479ec tempest-VolumeAndVolumeTypeFromImageTest-1559663696 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (048f9f12-1fc6-409d-830a-95ee3855ceee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 12:00:52 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-abc9dfec-210d-4ba8-bacb-0e8c36a479ec tempest-VolumeAndVolumeTypeFromImageTest-1559663696 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (048f9f12-1fc6-409d-830a-95ee3855ceee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 12:00:52 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-abc9dfec-210d-4ba8-bacb-0e8c36a479ec tempest-VolumeAndVolumeTypeFromImageTest-1559663696 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (07501111-e02e-4504-9d19-bf1deb348aca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 12:00:52 devstack cinder-volume[87116]: DEBUG cinder.image.glance [None req-abc9dfec-210d-4ba8-bacb-0e8c36a479ec tempest-VolumeAndVolumeTypeFromImageTest-1559663696 None] Creating Keystone auth plugin from conf {{(pid=87116) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 06 12:00:52 devstack sudo[106057]: pam_unix(sudo:session): session closed for user root Nov 06 12:00:52 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-011b55fe-5e3e-4e4a-95b7-41f09197686c tempest-CreateVolumesFromImageTest-1244366109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-ace3ec41-22de-40fd-84fb-54ca14bd8254" returned: 0 in 0.289s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 12:00:52 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-011b55fe-5e3e-4e4a-95b7-41f09197686c tempest-CreateVolumesFromImageTest-1244366109 None] <== create_volume: return (1025ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f'} {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 12:00:52 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-011b55fe-5e3e-4e4a-95b7-41f09197686c tempest-CreateVolumesFromImageTest-1244366109 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.028s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 12:00:52 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-3eea1884-635a-495f-a164-af9699bb2cfb tempest-CreateVolumesFromImageTest-1244366109 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.359s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 12:00:52 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-3eea1884-635a-495f-a164-af9699bb2cfb tempest-CreateVolumesFromImageTest-1244366109 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T11:00:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1460118630',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cfd52e82-4b7a-4873-9465-1c6e28b3f2d8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='110f736963c340ca9fdf4eed04e7f6ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T11:00:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T11:00:48Z,use_quota=True,user_id='fd8154bf76e6442a9edc0fe2bc22c2d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(34d3b144-d9b7-480a-a2e3-01e45f3d54c1),volume_type_id=34d3b144-d9b7-480a-a2e3-01e45f3d54c1)}" {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 12:00:52 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-3eea1884-635a-495f-a164-af9699bb2cfb tempest-CreateVolumesFromImageTest-1244366109 None] Creating volume cfd52e82-4b7a-4873-9465-1c6e28b3f2d8 {{(pid=87116) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 12:00:52 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-3eea1884-635a-495f-a164-af9699bb2cfb tempest-CreateVolumesFromImageTest-1244366109 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 12:00:52 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-3eea1884-635a-495f-a164-af9699bb2cfb tempest-CreateVolumesFromImageTest-1244366109 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 12:00:52 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-3eea1884-635a-495f-a164-af9699bb2cfb tempest-CreateVolumesFromImageTest-1244366109 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 12:00:52 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-3eea1884-635a-495f-a164-af9699bb2cfb tempest-CreateVolumesFromImageTest-1244366109 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 12:00:52 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-3eea1884-635a-495f-a164-af9699bb2cfb tempest-CreateVolumesFromImageTest-1244366109 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 12:00:52 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-3eea1884-635a-495f-a164-af9699bb2cfb tempest-CreateVolumesFromImageTest-1244366109 None] Selected osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f as target Quobyte volume. {{(pid=87116) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 12:00:52 devstack cinder-volume[87116]: INFO cinder.volume.drivers.remotefs [None req-3eea1884-635a-495f-a164-af9699bb2cfb tempest-CreateVolumesFromImageTest-1244366109 None] casted to osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f Nov 06 12:00:52 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-3eea1884-635a-495f-a164-af9699bb2cfb tempest-CreateVolumesFromImageTest-1244366109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-cfd52e82-4b7a-4873-9465-1c6e28b3f2d8 1073741824 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 12:00:52 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-011b55fe-5e3e-4e4a-95b7-41f09197686c tempest-CreateVolumesFromImageTest-1244366109 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7f1a8ff5-6b9f-49e3-96d4-9d6332a060d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ace3ec41-22de-40fd-84fb-54ca14bd8254', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 12:00:52 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-011b55fe-5e3e-4e4a-95b7-41f09197686c tempest-CreateVolumesFromImageTest-1244366109 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f0663db8-56cc-4418-b95c-c5d47a194e75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 12:00:52 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-011b55fe-5e3e-4e4a-95b7-41f09197686c tempest-CreateVolumesFromImageTest-1244366109 None] Volume volume-ace3ec41-22de-40fd-84fb-54ca14bd8254 (ace3ec41-22de-40fd-84fb-54ca14bd8254): created successfully Nov 06 12:00:52 devstack sudo[106060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-cfd52e82-4b7a-4873-9465-1c6e28b3f2d8 1073741824 Nov 06 12:00:52 devstack sudo[106060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 12:00:52 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-011b55fe-5e3e-4e4a-95b7-41f09197686c tempest-CreateVolumesFromImageTest-1244366109 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f0663db8-56cc-4418-b95c-c5d47a194e75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 12:00:52 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-011b55fe-5e3e-4e4a-95b7-41f09197686c tempest-CreateVolumesFromImageTest-1244366109 None] Flow 'volume_create_manager' (55b6fa70-539f-4e25-89d1-fb78d71311e8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 12:00:52 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-011b55fe-5e3e-4e4a-95b7-41f09197686c tempest-CreateVolumesFromImageTest-1244366109 None] Created volume successfully. Nov 06 12:00:52 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-84c5c71b-7333-4c66-91b9-76d3af832d22 tempest-VolumeDependencyTests-892718679 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 12:00:52 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-abc9dfec-210d-4ba8-bacb-0e8c36a479ec tempest-VolumeAndVolumeTypeFromImageTest-1559663696 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (07501111-e02e-4504-9d19-bf1deb348aca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '45dd2432-9eab-4aa2-9a73-bad99e686c47', 'volume_name': 'volume-45dd2432-9eab-4aa2-9a73-bad99e686c47', 'volume_size': 1, 'image_id': '7b27872f-3678-471a-8e07-a573613df10e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/7b27872f-3678-471a-8e07-a573613df10e', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '78cacfa693d0b1d21520ae0ef44312dd', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '99d6df4d85a74ec6a44093feb2aa49bd', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '238dd91e50d76b35b0905505389b130ac2d8aa30df090053e7983f6ddf4b9cb544843105dd1b52e31ad76d7deb653e95477301c82cbb1d9049f1f6bc341f9ce6', 'id': '7b27872f-3678-471a-8e07-a573613df10e', 'created_at': datetime.datetime(2026, 11, 6, 11, 0, 49, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 6, 11, 0, 51, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/7b27872f-3678-471a-8e07-a573613df10e/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 12:00:52 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-abc9dfec-210d-4ba8-bacb-0e8c36a479ec tempest-VolumeAndVolumeTypeFromImageTest-1559663696 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (66bfa2f3-563b-4be3-86eb-bc62107bd35c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 12:00:52 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-abc9dfec-210d-4ba8-bacb-0e8c36a479ec tempest-VolumeAndVolumeTypeFromImageTest-1559663696 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (66bfa2f3-563b-4be3-86eb-bc62107bd35c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 12:00:52 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-abc9dfec-210d-4ba8-bacb-0e8c36a479ec tempest-VolumeAndVolumeTypeFromImageTest-1559663696 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e182951f-caf4-44ea-8e49-6246c0ed997b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 12:00:52 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-abc9dfec-210d-4ba8-bacb-0e8c36a479ec tempest-VolumeAndVolumeTypeFromImageTest-1559663696 None] Volume 45dd2432-9eab-4aa2-9a73-bad99e686c47: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-45dd2432-9eab-4aa2-9a73-bad99e686c47', 'volume_size': 1, 'image_id': '7b27872f-3678-471a-8e07-a573613df10e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/7b27872f-3678-471a-8e07-a573613df10e', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '78cacfa693d0b1d21520ae0ef44312dd', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '99d6df4d85a74ec6a44093feb2aa49bd', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '238dd91e50d76b35b0905505389b130ac2d8aa30df090053e7983f6ddf4b9cb544843105dd1b52e31ad76d7deb653e95477301c82cbb1d9049f1f6bc341f9ce6', 'id': '7b27872f-3678-471a-8e07-a573613df10e', 'created_at': datetime.datetime(2026, 11, 6, 11, 0, 49, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 6, 11, 0, 51, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/7b27872f-3678-471a-8e07-a573613df10e/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Nov 06 12:00:52 devstack cinder-volume[87116]: DEBUG cinder.volume.flows.manager.create_volume [None req-abc9dfec-210d-4ba8-bacb-0e8c36a479ec tempest-VolumeAndVolumeTypeFromImageTest-1559663696 None] Trying to clone 45dd2432-9eab-4aa2-9a73-bad99e686c47 from image 7b27872f-3678-471a-8e07-a573613df10e at location (None, [{'url': 'file:///opt/stack/data/glance/images/7b27872f-3678-471a-8e07-a573613df10e', 'metadata': {}}]). {{(pid=87116) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Nov 06 12:00:52 devstack cinder-volume[87116]: DEBUG cinder.image.image_utils [None req-abc9dfec-210d-4ba8-bacb-0e8c36a479ec tempest-VolumeAndVolumeTypeFromImageTest-1559663696 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_7b27872f-3678-471a-8e07-a573613df10e_wwad7w6ydevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87116) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Nov 06 12:00:52 devstack cinder-volume[87116]: INFO cinder.image.image_utils [None req-abc9dfec-210d-4ba8-bacb-0e8c36a479ec tempest-VolumeAndVolumeTypeFromImageTest-1559663696 None] Image download 0.00 MB at 0.00 MB/s Nov 06 12:00:52 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[a585c2c1-0646-498e-811d-71a050a70d71]: (4, 'raw') {{(pid=88420) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 12:00:52 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-abc9dfec-210d-4ba8-bacb-0e8c36a479ec tempest-VolumeAndVolumeTypeFromImageTest-1559663696 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_7b27872f-3678-471a-8e07-a573613df10e_wwad7w6ydevstack@QuobyteHD {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 12:00:52 devstack sudo[106060]: pam_unix(sudo:session): session closed for user root Nov 06 12:00:52 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-3eea1884-635a-495f-a164-af9699bb2cfb tempest-CreateVolumesFromImageTest-1244366109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-cfd52e82-4b7a-4873-9465-1c6e28b3f2d8 1073741824" returned: 0 in 0.541s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 12:00:52 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-3eea1884-635a-495f-a164-af9699bb2cfb tempest-CreateVolumesFromImageTest-1244366109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-cfd52e82-4b7a-4873-9465-1c6e28b3f2d8 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 12:00:52 devstack sudo[106065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_7b27872f-3678-471a-8e07-a573613df10e_wwad7w6ydevstack@QuobyteHD Nov 06 12:00:52 devstack sudo[106065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 12:00:52 devstack sudo[106066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-cfd52e82-4b7a-4873-9465-1c6e28b3f2d8 Nov 06 12:00:52 devstack sudo[106066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 12:00:52 devstack sudo[106066]: pam_unix(sudo:session): session closed for user root Nov 06 12:00:52 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-3eea1884-635a-495f-a164-af9699bb2cfb tempest-CreateVolumesFromImageTest-1244366109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-cfd52e82-4b7a-4873-9465-1c6e28b3f2d8" returned: 0 in 0.244s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 12:00:52 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-3eea1884-635a-495f-a164-af9699bb2cfb tempest-CreateVolumesFromImageTest-1244366109 None] <== create_volume: return (828ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f'} {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 12:00:52 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-3eea1884-635a-495f-a164-af9699bb2cfb tempest-CreateVolumesFromImageTest-1244366109 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.831s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 12:00:52 devstack sudo[106065]: pam_unix(sudo:session): session closed for user root Nov 06 12:00:52 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-5791f25e-7af3-4982-9194-0b8dc55c600b tempest-CreateVolumesFromImageTest-1244366109 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.021s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 12:00:52 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-5791f25e-7af3-4982-9194-0b8dc55c600b tempest-CreateVolumesFromImageTest-1244366109 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T11:00:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-175596006',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1cf562eb-d7ce-4a30-884d-44586643841a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='110f736963c340ca9fdf4eed04e7f6ce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T11:00:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T11:00:49Z,use_quota=True,user_id='fd8154bf76e6442a9edc0fe2bc22c2d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(34d3b144-d9b7-480a-a2e3-01e45f3d54c1),volume_type_id=34d3b144-d9b7-480a-a2e3-01e45f3d54c1)}" {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 12:00:52 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-5791f25e-7af3-4982-9194-0b8dc55c600b tempest-CreateVolumesFromImageTest-1244366109 None] Creating volume 1cf562eb-d7ce-4a30-884d-44586643841a {{(pid=87116) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 12:00:52 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-5791f25e-7af3-4982-9194-0b8dc55c600b tempest-CreateVolumesFromImageTest-1244366109 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 12:00:52 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-5791f25e-7af3-4982-9194-0b8dc55c600b tempest-CreateVolumesFromImageTest-1244366109 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 12:00:52 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-5791f25e-7af3-4982-9194-0b8dc55c600b tempest-CreateVolumesFromImageTest-1244366109 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 12:00:52 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-5791f25e-7af3-4982-9194-0b8dc55c600b tempest-CreateVolumesFromImageTest-1244366109 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 12:00:52 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-5791f25e-7af3-4982-9194-0b8dc55c600b tempest-CreateVolumesFromImageTest-1244366109 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 12:00:52 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-5791f25e-7af3-4982-9194-0b8dc55c600b tempest-CreateVolumesFromImageTest-1244366109 None] Selected osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f as target Quobyte volume. {{(pid=87116) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 12:00:52 devstack cinder-volume[87116]: INFO cinder.volume.drivers.remotefs [None req-5791f25e-7af3-4982-9194-0b8dc55c600b tempest-CreateVolumesFromImageTest-1244366109 None] casted to osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f Nov 06 12:00:52 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-5791f25e-7af3-4982-9194-0b8dc55c600b tempest-CreateVolumesFromImageTest-1244366109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-1cf562eb-d7ce-4a30-884d-44586643841a 1073741824 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 12:00:53 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-abc9dfec-210d-4ba8-bacb-0e8c36a479ec tempest-VolumeAndVolumeTypeFromImageTest-1559663696 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_7b27872f-3678-471a-8e07-a573613df10e_wwad7w6ydevstack@QuobyteHD" returned: 0 in 0.376s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 12:00:53 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-abc9dfec-210d-4ba8-bacb-0e8c36a479ec tempest-VolumeAndVolumeTypeFromImageTest-1559663696 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7b27872f-3678-471a-8e07-a573613df10e_wwad7w6ydevstack@QuobyteHD {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 12:00:53 devstack sudo[106073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-1cf562eb-d7ce-4a30-884d-44586643841a 1073741824 Nov 06 12:00:53 devstack sudo[106073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 12:00:53 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-3eea1884-635a-495f-a164-af9699bb2cfb tempest-CreateVolumesFromImageTest-1244366109 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5139b594-f229-47a0-9ef5-3d35b9b46972) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cfd52e82-4b7a-4873-9465-1c6e28b3f2d8', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 12:00:53 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-3eea1884-635a-495f-a164-af9699bb2cfb tempest-CreateVolumesFromImageTest-1244366109 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (316d0b2a-e2b0-4d0e-ae24-5d0724f45949) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 12:00:53 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-3eea1884-635a-495f-a164-af9699bb2cfb tempest-CreateVolumesFromImageTest-1244366109 None] Volume volume-cfd52e82-4b7a-4873-9465-1c6e28b3f2d8 (cfd52e82-4b7a-4873-9465-1c6e28b3f2d8): created successfully Nov 06 12:00:53 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-3eea1884-635a-495f-a164-af9699bb2cfb tempest-CreateVolumesFromImageTest-1244366109 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (316d0b2a-e2b0-4d0e-ae24-5d0724f45949) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 12:00:53 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-3eea1884-635a-495f-a164-af9699bb2cfb tempest-CreateVolumesFromImageTest-1244366109 None] Flow 'volume_create_manager' (6a3b8fe3-a55a-46be-80d2-2b026d187f9a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 12:00:53 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-3eea1884-635a-495f-a164-af9699bb2cfb tempest-CreateVolumesFromImageTest-1244366109 None] Created volume successfully. Nov 06 12:00:53 devstack sudo[106074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7b27872f-3678-471a-8e07-a573613df10e_wwad7w6ydevstack@QuobyteHD Nov 06 12:00:53 devstack sudo[106074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 12:00:53 devstack sudo[106074]: pam_unix(sudo:session): session closed for user root Nov 06 12:00:53 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-abc9dfec-210d-4ba8-bacb-0e8c36a479ec tempest-VolumeAndVolumeTypeFromImageTest-1559663696 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7b27872f-3678-471a-8e07-a573613df10e_wwad7w6ydevstack@QuobyteHD" returned: 1 in 0.339s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 12:00:53 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-abc9dfec-210d-4ba8-bacb-0e8c36a479ec tempest-VolumeAndVolumeTypeFromImageTest-1559663696 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7b27872f-3678-471a-8e07-a573613df10e_wwad7w6ydevstack@QuobyteHD' failed. Not Retrying. {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 06 12:00:53 devstack cinder-volume[87116]: DEBUG cinder.image.image_utils [None req-abc9dfec-210d-4ba8-bacb-0e8c36a479ec tempest-VolumeAndVolumeTypeFromImageTest-1559663696 None] Temporary image 7b27872f-3678-471a-8e07-a573613df10e is fetched for user 9241a8d97a784ecb84f6b02e74d40e02. {{(pid=87116) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Nov 06 12:00:53 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[7551657b-5554-4561-a7b2-db3fc5587847]: (4, 'raw') {{(pid=88420) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 12:00:53 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-abc9dfec-210d-4ba8-bacb-0e8c36a479ec tempest-VolumeAndVolumeTypeFromImageTest-1559663696 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_7b27872f-3678-471a-8e07-a573613df10e_wwad7w6ydevstack@QuobyteHD {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 12:00:53 devstack sudo[106073]: pam_unix(sudo:session): session closed for user root Nov 06 12:00:53 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-5791f25e-7af3-4982-9194-0b8dc55c600b tempest-CreateVolumesFromImageTest-1244366109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-1cf562eb-d7ce-4a30-884d-44586643841a 1073741824" returned: 0 in 0.460s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 12:00:53 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-5791f25e-7af3-4982-9194-0b8dc55c600b tempest-CreateVolumesFromImageTest-1244366109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-1cf562eb-d7ce-4a30-884d-44586643841a {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 12:00:53 devstack sudo[106085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-1cf562eb-d7ce-4a30-884d-44586643841a Nov 06 12:00:53 devstack sudo[106085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 12:00:53 devstack sudo[106084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_7b27872f-3678-471a-8e07-a573613df10e_wwad7w6ydevstack@QuobyteHD Nov 06 12:00:53 devstack sudo[106084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 12:00:53 devstack sudo[106085]: pam_unix(sudo:session): session closed for user root Nov 06 12:00:53 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-5791f25e-7af3-4982-9194-0b8dc55c600b tempest-CreateVolumesFromImageTest-1244366109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-1cf562eb-d7ce-4a30-884d-44586643841a" returned: 0 in 0.263s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 12:00:53 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-5791f25e-7af3-4982-9194-0b8dc55c600b tempest-CreateVolumesFromImageTest-1244366109 None] <== create_volume: return (769ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f'} {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 12:00:53 devstack sudo[106084]: pam_unix(sudo:session): session closed for user root Nov 06 12:00:53 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-5791f25e-7af3-4982-9194-0b8dc55c600b tempest-CreateVolumesFromImageTest-1244366109 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.772s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 12:00:53 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-c14514cf-b0ab-4924-a278-00f986473f7b tempest-CreateVolumesFromSourceVolumeTest-141026190 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.576s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 12:00:53 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-c14514cf-b0ab-4924-a278-00f986473f7b tempest-CreateVolumesFromSourceVolumeTest-141026190 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T11:00:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-731986796',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a9365c8a-df8b-4e6c-9e3a-6609627f75f9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='04ebe05017d84cc0aff66a885bb6e75e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T11:00:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T11:00:50Z,use_quota=True,user_id='80278ec1f89a4cdd8c1d2d44168b043f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(34d3b144-d9b7-480a-a2e3-01e45f3d54c1),volume_type_id=34d3b144-d9b7-480a-a2e3-01e45f3d54c1)}" {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 12:00:53 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-c14514cf-b0ab-4924-a278-00f986473f7b tempest-CreateVolumesFromSourceVolumeTest-141026190 None] Creating volume a9365c8a-df8b-4e6c-9e3a-6609627f75f9 {{(pid=87116) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 12:00:53 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-c14514cf-b0ab-4924-a278-00f986473f7b tempest-CreateVolumesFromSourceVolumeTest-141026190 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 12:00:53 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-c14514cf-b0ab-4924-a278-00f986473f7b tempest-CreateVolumesFromSourceVolumeTest-141026190 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 12:00:53 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-c14514cf-b0ab-4924-a278-00f986473f7b tempest-CreateVolumesFromSourceVolumeTest-141026190 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 12:00:53 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-c14514cf-b0ab-4924-a278-00f986473f7b tempest-CreateVolumesFromSourceVolumeTest-141026190 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 12:00:53 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-c14514cf-b0ab-4924-a278-00f986473f7b tempest-CreateVolumesFromSourceVolumeTest-141026190 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 12:00:53 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-c14514cf-b0ab-4924-a278-00f986473f7b tempest-CreateVolumesFromSourceVolumeTest-141026190 None] Selected osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f as target Quobyte volume. {{(pid=87116) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 12:00:53 devstack cinder-volume[87116]: INFO cinder.volume.drivers.remotefs [None req-c14514cf-b0ab-4924-a278-00f986473f7b tempest-CreateVolumesFromSourceVolumeTest-141026190 None] casted to osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f Nov 06 12:00:53 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-c14514cf-b0ab-4924-a278-00f986473f7b tempest-CreateVolumesFromSourceVolumeTest-141026190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-a9365c8a-df8b-4e6c-9e3a-6609627f75f9 1073741824 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 12:00:53 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-abc9dfec-210d-4ba8-bacb-0e8c36a479ec tempest-VolumeAndVolumeTypeFromImageTest-1559663696 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_7b27872f-3678-471a-8e07-a573613df10e_wwad7w6ydevstack@QuobyteHD" returned: 0 in 0.357s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 12:00:53 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-abc9dfec-210d-4ba8-bacb-0e8c36a479ec tempest-VolumeAndVolumeTypeFromImageTest-1559663696 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7b27872f-3678-471a-8e07-a573613df10e_wwad7w6ydevstack@QuobyteHD {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 12:00:53 devstack sudo[106091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-a9365c8a-df8b-4e6c-9e3a-6609627f75f9 1073741824 Nov 06 12:00:53 devstack sudo[106091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 12:00:53 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-5791f25e-7af3-4982-9194-0b8dc55c600b tempest-CreateVolumesFromImageTest-1244366109 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aba42b15-81a1-4044-a96d-37440731d364) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1cf562eb-d7ce-4a30-884d-44586643841a', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 12:00:53 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-5791f25e-7af3-4982-9194-0b8dc55c600b tempest-CreateVolumesFromImageTest-1244366109 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d1a7d57f-c277-4a28-842e-db34c01b1fc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 12:00:53 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-5791f25e-7af3-4982-9194-0b8dc55c600b tempest-CreateVolumesFromImageTest-1244366109 None] Volume volume-1cf562eb-d7ce-4a30-884d-44586643841a (1cf562eb-d7ce-4a30-884d-44586643841a): created successfully Nov 06 12:00:53 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-5791f25e-7af3-4982-9194-0b8dc55c600b tempest-CreateVolumesFromImageTest-1244366109 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d1a7d57f-c277-4a28-842e-db34c01b1fc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 12:00:53 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-5791f25e-7af3-4982-9194-0b8dc55c600b tempest-CreateVolumesFromImageTest-1244366109 None] Flow 'volume_create_manager' (8ca03362-6903-4ad8-89a1-73770e9c403f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 12:00:53 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-5791f25e-7af3-4982-9194-0b8dc55c600b tempest-CreateVolumesFromImageTest-1244366109 None] Created volume successfully. Nov 06 12:00:53 devstack sudo[106092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7b27872f-3678-471a-8e07-a573613df10e_wwad7w6ydevstack@QuobyteHD Nov 06 12:00:53 devstack sudo[106092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 12:00:54 devstack sudo[106091]: pam_unix(sudo:session): session closed for user root Nov 06 12:00:54 devstack sudo[106092]: pam_unix(sudo:session): session closed for user root Nov 06 12:00:54 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-c14514cf-b0ab-4924-a278-00f986473f7b tempest-CreateVolumesFromSourceVolumeTest-141026190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-a9365c8a-df8b-4e6c-9e3a-6609627f75f9 1073741824" returned: 0 in 0.427s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 12:00:54 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-abc9dfec-210d-4ba8-bacb-0e8c36a479ec tempest-VolumeAndVolumeTypeFromImageTest-1559663696 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7b27872f-3678-471a-8e07-a573613df10e_wwad7w6ydevstack@QuobyteHD" returned: 1 in 0.414s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 12:00:54 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-abc9dfec-210d-4ba8-bacb-0e8c36a479ec tempest-VolumeAndVolumeTypeFromImageTest-1559663696 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7b27872f-3678-471a-8e07-a573613df10e_wwad7w6ydevstack@QuobyteHD' failed. Not Retrying. {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 06 12:00:54 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-abc9dfec-210d-4ba8-bacb-0e8c36a479ec tempest-VolumeAndVolumeTypeFromImageTest-1559663696 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 12:00:54 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-c14514cf-b0ab-4924-a278-00f986473f7b tempest-CreateVolumesFromSourceVolumeTest-141026190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-a9365c8a-df8b-4e6c-9e3a-6609627f75f9 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 12:00:54 devstack sudo[106102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-a9365c8a-df8b-4e6c-9e3a-6609627f75f9 Nov 06 12:00:54 devstack sudo[106102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 12:00:54 devstack sudo[106102]: pam_unix(sudo:session): session closed for user root Nov 06 12:00:54 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-c14514cf-b0ab-4924-a278-00f986473f7b tempest-CreateVolumesFromSourceVolumeTest-141026190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-a9365c8a-df8b-4e6c-9e3a-6609627f75f9" returned: 0 in 0.281s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 12:00:54 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-c14514cf-b0ab-4924-a278-00f986473f7b tempest-CreateVolumesFromSourceVolumeTest-141026190 None] <== create_volume: return (748ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f'} {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 12:00:54 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-c14514cf-b0ab-4924-a278-00f986473f7b tempest-CreateVolumesFromSourceVolumeTest-141026190 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.753s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 12:00:54 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-9d18bfd7-15b8-417f-87a7-12f882f5e1b7 tempest-CreateVolumesFromSourceVolumeTest-141026190 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.943s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 12:00:54 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-9d18bfd7-15b8-417f-87a7-12f882f5e1b7 tempest-CreateVolumesFromSourceVolumeTest-141026190 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T11:00:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1968565829',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9840bff3-e388-45ca-9233-14ec00ebeda0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='04ebe05017d84cc0aff66a885bb6e75e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T11:00:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T11:00:50Z,use_quota=True,user_id='80278ec1f89a4cdd8c1d2d44168b043f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(34d3b144-d9b7-480a-a2e3-01e45f3d54c1),volume_type_id=34d3b144-d9b7-480a-a2e3-01e45f3d54c1)}" {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 12:00:54 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-9d18bfd7-15b8-417f-87a7-12f882f5e1b7 tempest-CreateVolumesFromSourceVolumeTest-141026190 None] Creating volume 9840bff3-e388-45ca-9233-14ec00ebeda0 {{(pid=87116) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 12:00:54 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-9d18bfd7-15b8-417f-87a7-12f882f5e1b7 tempest-CreateVolumesFromSourceVolumeTest-141026190 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 12:00:54 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-9d18bfd7-15b8-417f-87a7-12f882f5e1b7 tempest-CreateVolumesFromSourceVolumeTest-141026190 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 12:00:54 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-9d18bfd7-15b8-417f-87a7-12f882f5e1b7 tempest-CreateVolumesFromSourceVolumeTest-141026190 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 12:00:54 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-9d18bfd7-15b8-417f-87a7-12f882f5e1b7 tempest-CreateVolumesFromSourceVolumeTest-141026190 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 12:00:54 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-9d18bfd7-15b8-417f-87a7-12f882f5e1b7 tempest-CreateVolumesFromSourceVolumeTest-141026190 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 12:00:54 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-9d18bfd7-15b8-417f-87a7-12f882f5e1b7 tempest-CreateVolumesFromSourceVolumeTest-141026190 None] Selected osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f as target Quobyte volume. {{(pid=87116) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 12:00:54 devstack cinder-volume[87116]: INFO cinder.volume.drivers.remotefs [None req-9d18bfd7-15b8-417f-87a7-12f882f5e1b7 tempest-CreateVolumesFromSourceVolumeTest-141026190 None] casted to osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f Nov 06 12:00:54 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-9d18bfd7-15b8-417f-87a7-12f882f5e1b7 tempest-CreateVolumesFromSourceVolumeTest-141026190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-9840bff3-e388-45ca-9233-14ec00ebeda0 1073741824 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 12:00:54 devstack sudo[106105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-9840bff3-e388-45ca-9233-14ec00ebeda0 1073741824 Nov 06 12:00:54 devstack sudo[106105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 12:00:54 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-c14514cf-b0ab-4924-a278-00f986473f7b tempest-CreateVolumesFromSourceVolumeTest-141026190 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (66d42fbf-e67a-4960-b13f-9d89ed31bed5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a9365c8a-df8b-4e6c-9e3a-6609627f75f9', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 12:00:54 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-c14514cf-b0ab-4924-a278-00f986473f7b tempest-CreateVolumesFromSourceVolumeTest-141026190 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (460f3189-2a0d-442b-a33d-7bcaabecc8ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 12:00:54 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-aef175b6-a02e-4a1c-a764-bdd8c51060c1 tempest-CreateVolumesFromImageTest-1244366109 None] Acquiring lock "cinder-1cf562eb-d7ce-4a30-884d-44586643841a-delete_volume" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 12:00:54 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-c14514cf-b0ab-4924-a278-00f986473f7b tempest-CreateVolumesFromSourceVolumeTest-141026190 None] Volume volume-a9365c8a-df8b-4e6c-9e3a-6609627f75f9 (a9365c8a-df8b-4e6c-9e3a-6609627f75f9): created successfully Nov 06 12:00:54 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-c14514cf-b0ab-4924-a278-00f986473f7b tempest-CreateVolumesFromSourceVolumeTest-141026190 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (460f3189-2a0d-442b-a33d-7bcaabecc8ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 12:00:54 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-c14514cf-b0ab-4924-a278-00f986473f7b tempest-CreateVolumesFromSourceVolumeTest-141026190 None] Flow 'volume_create_manager' (e92fec62-5f35-4ce7-a1d6-1ba9ea4a3faf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 12:00:54 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-aef175b6-a02e-4a1c-a764-bdd8c51060c1 tempest-CreateVolumesFromImageTest-1244366109 None] Lock "cinder-1cf562eb-d7ce-4a30-884d-44586643841a-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 12:00:54 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-c14514cf-b0ab-4924-a278-00f986473f7b tempest-CreateVolumesFromSourceVolumeTest-141026190 None] Created volume successfully. Nov 06 12:00:54 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-aef175b6-a02e-4a1c-a764-bdd8c51060c1 tempest-CreateVolumesFromImageTest-1244366109 None] Acquiring lock "cinder-quobyte-1cf562eb-d7ce-4a30-884d-44586643841a" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 12:00:54 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-aef175b6-a02e-4a1c-a764-bdd8c51060c1 tempest-CreateVolumesFromImageTest-1244366109 None] Lock "cinder-quobyte-1cf562eb-d7ce-4a30-884d-44586643841a" acquired by "delete_volume" :: waited 0.017s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 12:00:54 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fc48204-909a-4e72-8b21-1dc2563433f8]: (4, 'qcow2') {{(pid=88420) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 12:00:54 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-aef175b6-a02e-4a1c-a764-bdd8c51060c1 tempest-CreateVolumesFromImageTest-1244366109 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-1cf562eb-d7ce-4a30-884d-44586643841a {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 12:00:54 devstack sudo[106107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-1cf562eb-d7ce-4a30-884d-44586643841a Nov 06 12:00:54 devstack sudo[106107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 12:00:54 devstack sudo[106105]: pam_unix(sudo:session): session closed for user root Nov 06 12:00:54 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-9d18bfd7-15b8-417f-87a7-12f882f5e1b7 tempest-CreateVolumesFromSourceVolumeTest-141026190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-9840bff3-e388-45ca-9233-14ec00ebeda0 1073741824" returned: 0 in 0.465s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 12:00:55 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-9d18bfd7-15b8-417f-87a7-12f882f5e1b7 tempest-CreateVolumesFromSourceVolumeTest-141026190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-9840bff3-e388-45ca-9233-14ec00ebeda0 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 12:00:55 devstack sudo[106115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-9840bff3-e388-45ca-9233-14ec00ebeda0 Nov 06 12:00:55 devstack sudo[106115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 12:00:55 devstack sudo[106107]: pam_unix(sudo:session): session closed for user root Nov 06 12:00:55 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-aef175b6-a02e-4a1c-a764-bdd8c51060c1 tempest-CreateVolumesFromImageTest-1244366109 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-1cf562eb-d7ce-4a30-884d-44586643841a" returned: 0 in 0.398s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 12:00:55 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-aef175b6-a02e-4a1c-a764-bdd8c51060c1 tempest-CreateVolumesFromImageTest-1244366109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-1cf562eb-d7ce-4a30-884d-44586643841a {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 12:00:55 devstack sudo[106118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-1cf562eb-d7ce-4a30-884d-44586643841a Nov 06 12:00:55 devstack sudo[106118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 12:00:55 devstack sudo[106115]: pam_unix(sudo:session): session closed for user root Nov 06 12:00:55 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-9d18bfd7-15b8-417f-87a7-12f882f5e1b7 tempest-CreateVolumesFromSourceVolumeTest-141026190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-9840bff3-e388-45ca-9233-14ec00ebeda0" returned: 0 in 0.254s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 12:00:55 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-9d18bfd7-15b8-417f-87a7-12f882f5e1b7 tempest-CreateVolumesFromSourceVolumeTest-141026190 None] <== create_volume: return (770ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f'} {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 12:00:55 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-9d18bfd7-15b8-417f-87a7-12f882f5e1b7 tempest-CreateVolumesFromSourceVolumeTest-141026190 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.773s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 12:00:55 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-12baff7f-4025-451b-b441-2469afbff95e tempest-CreateVolumesFromSourceVolumeTest-141026190 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.191s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 12:00:55 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-12baff7f-4025-451b-b441-2469afbff95e tempest-CreateVolumesFromSourceVolumeTest-141026190 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T11:00:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1072376708',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b0b4ae59-b11f-4b85-a77d-4519b933d1e1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='04ebe05017d84cc0aff66a885bb6e75e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T11:00:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T11:00:51Z,use_quota=True,user_id='80278ec1f89a4cdd8c1d2d44168b043f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(34d3b144-d9b7-480a-a2e3-01e45f3d54c1),volume_type_id=34d3b144-d9b7-480a-a2e3-01e45f3d54c1)}" {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 12:00:55 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-12baff7f-4025-451b-b441-2469afbff95e tempest-CreateVolumesFromSourceVolumeTest-141026190 None] Creating volume b0b4ae59-b11f-4b85-a77d-4519b933d1e1 {{(pid=87116) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 12:00:55 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-12baff7f-4025-451b-b441-2469afbff95e tempest-CreateVolumesFromSourceVolumeTest-141026190 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 12:00:55 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-12baff7f-4025-451b-b441-2469afbff95e tempest-CreateVolumesFromSourceVolumeTest-141026190 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 12:00:55 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-12baff7f-4025-451b-b441-2469afbff95e tempest-CreateVolumesFromSourceVolumeTest-141026190 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 12:00:55 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-12baff7f-4025-451b-b441-2469afbff95e tempest-CreateVolumesFromSourceVolumeTest-141026190 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 12:00:55 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-12baff7f-4025-451b-b441-2469afbff95e tempest-CreateVolumesFromSourceVolumeTest-141026190 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 12:00:55 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-12baff7f-4025-451b-b441-2469afbff95e tempest-CreateVolumesFromSourceVolumeTest-141026190 None] Selected osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f as target Quobyte volume. {{(pid=87116) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 12:00:55 devstack cinder-volume[87116]: INFO cinder.volume.drivers.remotefs [None req-12baff7f-4025-451b-b441-2469afbff95e tempest-CreateVolumesFromSourceVolumeTest-141026190 None] casted to osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f Nov 06 12:00:55 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-12baff7f-4025-451b-b441-2469afbff95e tempest-CreateVolumesFromSourceVolumeTest-141026190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-b0b4ae59-b11f-4b85-a77d-4519b933d1e1 1073741824 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 12:00:55 devstack sudo[106121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-b0b4ae59-b11f-4b85-a77d-4519b933d1e1 1073741824 Nov 06 12:00:55 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-9d18bfd7-15b8-417f-87a7-12f882f5e1b7 tempest-CreateVolumesFromSourceVolumeTest-141026190 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (02b283b4-aef4-42d5-8cdf-1518e7837a64) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9840bff3-e388-45ca-9233-14ec00ebeda0', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 12:00:55 devstack sudo[106121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 12:00:55 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-9d18bfd7-15b8-417f-87a7-12f882f5e1b7 tempest-CreateVolumesFromSourceVolumeTest-141026190 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3ae75aee-3f24-410a-b7a6-69eba09cb423) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 12:00:55 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-9d18bfd7-15b8-417f-87a7-12f882f5e1b7 tempest-CreateVolumesFromSourceVolumeTest-141026190 None] Volume volume-9840bff3-e388-45ca-9233-14ec00ebeda0 (9840bff3-e388-45ca-9233-14ec00ebeda0): created successfully Nov 06 12:00:55 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-9d18bfd7-15b8-417f-87a7-12f882f5e1b7 tempest-CreateVolumesFromSourceVolumeTest-141026190 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3ae75aee-3f24-410a-b7a6-69eba09cb423) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 12:00:55 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-9d18bfd7-15b8-417f-87a7-12f882f5e1b7 tempest-CreateVolumesFromSourceVolumeTest-141026190 None] Flow 'volume_create_manager' (b448d998-ae0a-494f-9870-a0e8e003ed51) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 12:00:55 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-9d18bfd7-15b8-417f-87a7-12f882f5e1b7 tempest-CreateVolumesFromSourceVolumeTest-141026190 None] Created volume successfully. Nov 06 12:00:55 devstack sudo[106118]: pam_unix(sudo:session): session closed for user root Nov 06 12:00:55 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-aef175b6-a02e-4a1c-a764-bdd8c51060c1 tempest-CreateVolumesFromImageTest-1244366109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-1cf562eb-d7ce-4a30-884d-44586643841a" returned: 0 in 0.282s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 12:00:55 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-aef175b6-a02e-4a1c-a764-bdd8c51060c1 tempest-CreateVolumesFromImageTest-1244366109 None] Lock "cinder-quobyte-1cf562eb-d7ce-4a30-884d-44586643841a" released by "delete_volume" :: held 0.726s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 12:00:55 devstack cinder-volume[87116]: DEBUG cinder.quota [None req-aef175b6-a02e-4a1c-a764-bdd8c51060c1 tempest-CreateVolumesFromImageTest-1244366109 None] Created reservations ['d8513a2c-f051-477a-8ee0-392c9de17603', '385f91b6-1b25-4ec2-9fdf-83376e28b66d', '7a7418c6-8ae5-4d82-b6df-e60fa6492709', 'ddb60270-66a4-44c7-8bfd-64a7172d5631'] {{(pid=87116) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 12:00:55 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-aef175b6-a02e-4a1c-a764-bdd8c51060c1 tempest-CreateVolumesFromImageTest-1244366109 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 12:00:55 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-aef175b6-a02e-4a1c-a764-bdd8c51060c1 tempest-CreateVolumesFromImageTest-1244366109 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 12:00:55 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-aef175b6-a02e-4a1c-a764-bdd8c51060c1 tempest-CreateVolumesFromImageTest-1244366109 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 12:00:55 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-aef175b6-a02e-4a1c-a764-bdd8c51060c1 tempest-CreateVolumesFromImageTest-1244366109 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 12:00:55 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-aef175b6-a02e-4a1c-a764-bdd8c51060c1 tempest-CreateVolumesFromImageTest-1244366109 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 12:00:55 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-aef175b6-a02e-4a1c-a764-bdd8c51060c1 tempest-CreateVolumesFromImageTest-1244366109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 12:00:55 devstack sudo[106126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756 Nov 06 12:00:55 devstack sudo[106126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 12:00:55 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-f0d124f9-5389-4d9c-8a39-38dbf597e33f tempest-CreateVolumesFromImageTest-1244366109 None] Acquiring lock "cinder-cfd52e82-4b7a-4873-9465-1c6e28b3f2d8-delete_volume" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 12:00:55 devstack sudo[106121]: pam_unix(sudo:session): session closed for user root Nov 06 12:00:55 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-12baff7f-4025-451b-b441-2469afbff95e tempest-CreateVolumesFromSourceVolumeTest-141026190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-b0b4ae59-b11f-4b85-a77d-4519b933d1e1 1073741824" returned: 0 in 0.476s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 12:00:55 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-f0d124f9-5389-4d9c-8a39-38dbf597e33f tempest-CreateVolumesFromImageTest-1244366109 None] Lock "cinder-cfd52e82-4b7a-4873-9465-1c6e28b3f2d8-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 12:00:55 devstack sudo[106126]: pam_unix(sudo:session): session closed for user root Nov 06 12:00:55 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-12baff7f-4025-451b-b441-2469afbff95e tempest-CreateVolumesFromSourceVolumeTest-141026190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-b0b4ae59-b11f-4b85-a77d-4519b933d1e1 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 12:00:55 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-aef175b6-a02e-4a1c-a764-bdd8c51060c1 tempest-CreateVolumesFromImageTest-1244366109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756" returned: 0 in 0.323s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 12:00:55 devstack cinder-volume[87116]: DEBUG cinder.manager [None req-aef175b6-a02e-4a1c-a764-bdd8c51060c1 tempest-CreateVolumesFromImageTest-1244366109 None] Notifying Schedulers of capabilities ... {{(pid=87116) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 12:00:55 devstack sudo[106131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-b0b4ae59-b11f-4b85-a77d-4519b933d1e1 Nov 06 12:00:55 devstack sudo[106131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 12:00:55 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-aef175b6-a02e-4a1c-a764-bdd8c51060c1 tempest-CreateVolumesFromImageTest-1244366109 None] Deleted volume successfully. Nov 06 12:00:55 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-f0d124f9-5389-4d9c-8a39-38dbf597e33f tempest-CreateVolumesFromImageTest-1244366109 None] Acquiring lock "cinder-quobyte-cfd52e82-4b7a-4873-9465-1c6e28b3f2d8" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 12:00:55 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-aef175b6-a02e-4a1c-a764-bdd8c51060c1 tempest-CreateVolumesFromImageTest-1244366109 None] Lock "cinder-1cf562eb-d7ce-4a30-884d-44586643841a-delete_volume" released by "delete_volume" :: held 1.292s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 12:00:55 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-f0d124f9-5389-4d9c-8a39-38dbf597e33f tempest-CreateVolumesFromImageTest-1244366109 None] Lock "cinder-quobyte-cfd52e82-4b7a-4873-9465-1c6e28b3f2d8" acquired by "delete_volume" :: waited 0.030s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 12:00:55 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[d870b42d-07a2-41f6-8b39-532096d98ba5]: (4, 'qcow2') {{(pid=88420) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 12:00:55 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-f0d124f9-5389-4d9c-8a39-38dbf597e33f tempest-CreateVolumesFromImageTest-1244366109 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-cfd52e82-4b7a-4873-9465-1c6e28b3f2d8 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 12:00:56 devstack sudo[106133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-cfd52e82-4b7a-4873-9465-1c6e28b3f2d8 Nov 06 12:00:56 devstack sudo[106133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 12:00:56 devstack sudo[106131]: pam_unix(sudo:session): session closed for user root Nov 06 12:00:56 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-12baff7f-4025-451b-b441-2469afbff95e tempest-CreateVolumesFromSourceVolumeTest-141026190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-b0b4ae59-b11f-4b85-a77d-4519b933d1e1" returned: 0 in 0.302s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 12:00:56 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-12baff7f-4025-451b-b441-2469afbff95e tempest-CreateVolumesFromSourceVolumeTest-141026190 None] <== create_volume: return (841ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f'} {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 12:00:56 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-12baff7f-4025-451b-b441-2469afbff95e tempest-CreateVolumesFromSourceVolumeTest-141026190 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.845s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 12:00:56 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-c8eec833-a330-4c28-ada1-11ad87f0082c tempest-CreateVolumesFromSourceVolumeTest-141026190 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.626s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 12:00:56 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-c8eec833-a330-4c28-ada1-11ad87f0082c tempest-CreateVolumesFromSourceVolumeTest-141026190 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T11:00:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-517105797',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6faa751e-46db-47d5-ada3-1ad8e7e3cd7e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='04ebe05017d84cc0aff66a885bb6e75e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T11:00:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T11:00:51Z,use_quota=True,user_id='80278ec1f89a4cdd8c1d2d44168b043f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(34d3b144-d9b7-480a-a2e3-01e45f3d54c1),volume_type_id=34d3b144-d9b7-480a-a2e3-01e45f3d54c1)}" {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 12:00:56 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-c8eec833-a330-4c28-ada1-11ad87f0082c tempest-CreateVolumesFromSourceVolumeTest-141026190 None] Creating volume 6faa751e-46db-47d5-ada3-1ad8e7e3cd7e {{(pid=87116) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 12:00:56 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-c8eec833-a330-4c28-ada1-11ad87f0082c tempest-CreateVolumesFromSourceVolumeTest-141026190 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 12:00:56 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-c8eec833-a330-4c28-ada1-11ad87f0082c tempest-CreateVolumesFromSourceVolumeTest-141026190 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 12:00:56 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-c8eec833-a330-4c28-ada1-11ad87f0082c tempest-CreateVolumesFromSourceVolumeTest-141026190 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 12:00:56 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-c8eec833-a330-4c28-ada1-11ad87f0082c tempest-CreateVolumesFromSourceVolumeTest-141026190 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 12:00:56 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-c8eec833-a330-4c28-ada1-11ad87f0082c tempest-CreateVolumesFromSourceVolumeTest-141026190 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 12:00:56 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-c8eec833-a330-4c28-ada1-11ad87f0082c tempest-CreateVolumesFromSourceVolumeTest-141026190 None] Selected osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f as target Quobyte volume. {{(pid=87116) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 12:00:56 devstack cinder-volume[87116]: INFO cinder.volume.drivers.remotefs [None req-c8eec833-a330-4c28-ada1-11ad87f0082c tempest-CreateVolumesFromSourceVolumeTest-141026190 None] casted to osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f Nov 06 12:00:56 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-c8eec833-a330-4c28-ada1-11ad87f0082c tempest-CreateVolumesFromSourceVolumeTest-141026190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-6faa751e-46db-47d5-ada3-1ad8e7e3cd7e 1073741824 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 12:00:56 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-12baff7f-4025-451b-b441-2469afbff95e tempest-CreateVolumesFromSourceVolumeTest-141026190 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9382301f-54ed-4b82-8bf0-8930ed7ed01a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b0b4ae59-b11f-4b85-a77d-4519b933d1e1', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 12:00:56 devstack sudo[106136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-6faa751e-46db-47d5-ada3-1ad8e7e3cd7e 1073741824 Nov 06 12:00:56 devstack sudo[106136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 12:00:56 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-12baff7f-4025-451b-b441-2469afbff95e tempest-CreateVolumesFromSourceVolumeTest-141026190 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c07a589f-6554-44e4-b240-6ec251204a0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 12:00:56 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-12baff7f-4025-451b-b441-2469afbff95e tempest-CreateVolumesFromSourceVolumeTest-141026190 None] Volume volume-b0b4ae59-b11f-4b85-a77d-4519b933d1e1 (b0b4ae59-b11f-4b85-a77d-4519b933d1e1): created successfully Nov 06 12:00:56 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-12baff7f-4025-451b-b441-2469afbff95e tempest-CreateVolumesFromSourceVolumeTest-141026190 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c07a589f-6554-44e4-b240-6ec251204a0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 12:00:56 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-12baff7f-4025-451b-b441-2469afbff95e tempest-CreateVolumesFromSourceVolumeTest-141026190 None] Flow 'volume_create_manager' (3032d7e5-4ae7-4dcf-8786-9c2d1bcdc96e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 12:00:56 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-12baff7f-4025-451b-b441-2469afbff95e tempest-CreateVolumesFromSourceVolumeTest-141026190 None] Created volume successfully. Nov 06 12:00:56 devstack sudo[106133]: pam_unix(sudo:session): session closed for user root Nov 06 12:00:56 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-f0d124f9-5389-4d9c-8a39-38dbf597e33f tempest-CreateVolumesFromImageTest-1244366109 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-cfd52e82-4b7a-4873-9465-1c6e28b3f2d8" returned: 0 in 0.410s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 12:00:56 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-f0d124f9-5389-4d9c-8a39-38dbf597e33f tempest-CreateVolumesFromImageTest-1244366109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-cfd52e82-4b7a-4873-9465-1c6e28b3f2d8 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 12:00:56 devstack sudo[106143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-cfd52e82-4b7a-4873-9465-1c6e28b3f2d8 Nov 06 12:00:56 devstack sudo[106143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 12:00:56 devstack sudo[106136]: pam_unix(sudo:session): session closed for user root Nov 06 12:00:56 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-c8eec833-a330-4c28-ada1-11ad87f0082c tempest-CreateVolumesFromSourceVolumeTest-141026190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-6faa751e-46db-47d5-ada3-1ad8e7e3cd7e 1073741824" returned: 0 in 0.466s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 12:00:56 devstack sudo[106143]: pam_unix(sudo:session): session closed for user root Nov 06 12:00:56 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-c8eec833-a330-4c28-ada1-11ad87f0082c tempest-CreateVolumesFromSourceVolumeTest-141026190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-6faa751e-46db-47d5-ada3-1ad8e7e3cd7e {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 12:00:56 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-f0d124f9-5389-4d9c-8a39-38dbf597e33f tempest-CreateVolumesFromImageTest-1244366109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-cfd52e82-4b7a-4873-9465-1c6e28b3f2d8" returned: 0 in 0.294s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 12:00:56 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-f0d124f9-5389-4d9c-8a39-38dbf597e33f tempest-CreateVolumesFromImageTest-1244366109 None] Lock "cinder-quobyte-cfd52e82-4b7a-4873-9465-1c6e28b3f2d8" released by "delete_volume" :: held 0.760s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 12:00:56 devstack sudo[106148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-6faa751e-46db-47d5-ada3-1ad8e7e3cd7e Nov 06 12:00:56 devstack sudo[106148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 12:00:56 devstack cinder-volume[87116]: DEBUG cinder.quota [None req-f0d124f9-5389-4d9c-8a39-38dbf597e33f tempest-CreateVolumesFromImageTest-1244366109 None] Created reservations ['e290a875-722f-4287-b65b-47b2f4ca6006', 'bdb41b3d-5902-4108-abe9-1349cfc3bc81', '513fd82a-044e-4746-8284-c4e138fa6bbe', 'e80eb477-42ac-4940-91b7-ba6c0cd955d0'] {{(pid=87116) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 12:00:56 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-f0d124f9-5389-4d9c-8a39-38dbf597e33f tempest-CreateVolumesFromImageTest-1244366109 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 12:00:56 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-f0d124f9-5389-4d9c-8a39-38dbf597e33f tempest-CreateVolumesFromImageTest-1244366109 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 12:00:56 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-f0d124f9-5389-4d9c-8a39-38dbf597e33f tempest-CreateVolumesFromImageTest-1244366109 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 12:00:56 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-f0d124f9-5389-4d9c-8a39-38dbf597e33f tempest-CreateVolumesFromImageTest-1244366109 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 12:00:56 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-f0d124f9-5389-4d9c-8a39-38dbf597e33f tempest-CreateVolumesFromImageTest-1244366109 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 12:00:56 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-f0d124f9-5389-4d9c-8a39-38dbf597e33f tempest-CreateVolumesFromImageTest-1244366109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 12:00:56 devstack sudo[106150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756 Nov 06 12:00:56 devstack sudo[106150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 12:00:56 devstack sudo[106148]: pam_unix(sudo:session): session closed for user root Nov 06 12:00:56 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-c8eec833-a330-4c28-ada1-11ad87f0082c tempest-CreateVolumesFromSourceVolumeTest-141026190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-6faa751e-46db-47d5-ada3-1ad8e7e3cd7e" returned: 0 in 0.279s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 12:00:56 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-c8eec833-a330-4c28-ada1-11ad87f0082c tempest-CreateVolumesFromSourceVolumeTest-141026190 None] <== create_volume: return (791ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f'} {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 12:00:56 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-c8eec833-a330-4c28-ada1-11ad87f0082c tempest-CreateVolumesFromSourceVolumeTest-141026190 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.796s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 12:00:56 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-96fb73c2-b11d-4aea-944e-a10bc7c35336 tempest-CreateVolumesFromSourceVolumeTest-141026190 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.125s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 12:00:56 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-96fb73c2-b11d-4aea-944e-a10bc7c35336 tempest-CreateVolumesFromSourceVolumeTest-141026190 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T11:00:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2007933151',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2ad490eb-d22e-4ac3-9702-20b0431601db,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='04ebe05017d84cc0aff66a885bb6e75e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T11:00:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T11:00:52Z,use_quota=True,user_id='80278ec1f89a4cdd8c1d2d44168b043f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(34d3b144-d9b7-480a-a2e3-01e45f3d54c1),volume_type_id=34d3b144-d9b7-480a-a2e3-01e45f3d54c1)}" {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 12:00:56 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-96fb73c2-b11d-4aea-944e-a10bc7c35336 tempest-CreateVolumesFromSourceVolumeTest-141026190 None] Creating volume 2ad490eb-d22e-4ac3-9702-20b0431601db {{(pid=87116) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 12:00:56 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-96fb73c2-b11d-4aea-944e-a10bc7c35336 tempest-CreateVolumesFromSourceVolumeTest-141026190 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 12:00:56 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-96fb73c2-b11d-4aea-944e-a10bc7c35336 tempest-CreateVolumesFromSourceVolumeTest-141026190 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 12:00:56 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-96fb73c2-b11d-4aea-944e-a10bc7c35336 tempest-CreateVolumesFromSourceVolumeTest-141026190 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 12:00:56 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-96fb73c2-b11d-4aea-944e-a10bc7c35336 tempest-CreateVolumesFromSourceVolumeTest-141026190 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 12:00:56 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-96fb73c2-b11d-4aea-944e-a10bc7c35336 tempest-CreateVolumesFromSourceVolumeTest-141026190 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 12:00:56 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-96fb73c2-b11d-4aea-944e-a10bc7c35336 tempest-CreateVolumesFromSourceVolumeTest-141026190 None] Selected osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f as target Quobyte volume. {{(pid=87116) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 12:00:56 devstack cinder-volume[87116]: INFO cinder.volume.drivers.remotefs [None req-96fb73c2-b11d-4aea-944e-a10bc7c35336 tempest-CreateVolumesFromSourceVolumeTest-141026190 None] casted to osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f Nov 06 12:00:56 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-96fb73c2-b11d-4aea-944e-a10bc7c35336 tempest-CreateVolumesFromSourceVolumeTest-141026190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-2ad490eb-d22e-4ac3-9702-20b0431601db 1073741824 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 12:00:56 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-4ff08451-5c71-41d1-bff5-141cc03421c7 tempest-CreateVolumesFromImageTest-1244366109 None] Acquiring lock "cinder-ace3ec41-22de-40fd-84fb-54ca14bd8254-delete_volume" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 12:00:56 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-c8eec833-a330-4c28-ada1-11ad87f0082c tempest-CreateVolumesFromSourceVolumeTest-141026190 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5c8bf8a9-63dc-4e92-b7a3-9bdb614ceed4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6faa751e-46db-47d5-ada3-1ad8e7e3cd7e', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 12:00:56 devstack sudo[106153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-2ad490eb-d22e-4ac3-9702-20b0431601db 1073741824 Nov 06 12:00:56 devstack sudo[106153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 12:00:57 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-c8eec833-a330-4c28-ada1-11ad87f0082c tempest-CreateVolumesFromSourceVolumeTest-141026190 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (21fbdb71-8b09-42fd-bb66-9c49f1a68b8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 12:00:57 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-4ff08451-5c71-41d1-bff5-141cc03421c7 tempest-CreateVolumesFromImageTest-1244366109 None] Lock "cinder-ace3ec41-22de-40fd-84fb-54ca14bd8254-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 12:00:57 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-c8eec833-a330-4c28-ada1-11ad87f0082c tempest-CreateVolumesFromSourceVolumeTest-141026190 None] Volume volume-6faa751e-46db-47d5-ada3-1ad8e7e3cd7e (6faa751e-46db-47d5-ada3-1ad8e7e3cd7e): created successfully Nov 06 12:00:57 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-c8eec833-a330-4c28-ada1-11ad87f0082c tempest-CreateVolumesFromSourceVolumeTest-141026190 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (21fbdb71-8b09-42fd-bb66-9c49f1a68b8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 12:00:57 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-c8eec833-a330-4c28-ada1-11ad87f0082c tempest-CreateVolumesFromSourceVolumeTest-141026190 None] Flow 'volume_create_manager' (f0591582-e3cb-475b-9f53-db48d36d4513) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 12:00:57 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-c8eec833-a330-4c28-ada1-11ad87f0082c tempest-CreateVolumesFromSourceVolumeTest-141026190 None] Created volume successfully. Nov 06 12:00:57 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-4ff08451-5c71-41d1-bff5-141cc03421c7 tempest-CreateVolumesFromImageTest-1244366109 None] Acquiring lock "cinder-quobyte-ace3ec41-22de-40fd-84fb-54ca14bd8254" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 12:00:57 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-4ff08451-5c71-41d1-bff5-141cc03421c7 tempest-CreateVolumesFromImageTest-1244366109 None] Lock "cinder-quobyte-ace3ec41-22de-40fd-84fb-54ca14bd8254" acquired by "delete_volume" :: waited 0.017s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 12:00:57 devstack sudo[106150]: pam_unix(sudo:session): session closed for user root Nov 06 12:00:57 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-f0d124f9-5389-4d9c-8a39-38dbf597e33f tempest-CreateVolumesFromImageTest-1244366109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756" returned: 0 in 0.343s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 12:00:57 devstack cinder-volume[87116]: DEBUG cinder.manager [None req-f0d124f9-5389-4d9c-8a39-38dbf597e33f tempest-CreateVolumesFromImageTest-1244366109 None] Notifying Schedulers of capabilities ... {{(pid=87116) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 12:00:57 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-f0d124f9-5389-4d9c-8a39-38dbf597e33f tempest-CreateVolumesFromImageTest-1244366109 None] Deleted volume successfully. Nov 06 12:00:57 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[8623c5a3-0b4f-454b-975b-2e3e304bbc8e]: (4, 'qcow2') {{(pid=88420) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 12:00:57 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-4ff08451-5c71-41d1-bff5-141cc03421c7 tempest-CreateVolumesFromImageTest-1244366109 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-ace3ec41-22de-40fd-84fb-54ca14bd8254 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 12:00:57 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-f0d124f9-5389-4d9c-8a39-38dbf597e33f tempest-CreateVolumesFromImageTest-1244366109 None] Lock "cinder-cfd52e82-4b7a-4873-9465-1c6e28b3f2d8-delete_volume" released by "delete_volume" :: held 1.379s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 12:00:57 devstack sudo[106156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-ace3ec41-22de-40fd-84fb-54ca14bd8254 Nov 06 12:00:57 devstack sudo[106156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 12:00:57 devstack sudo[106153]: pam_unix(sudo:session): session closed for user root Nov 06 12:00:57 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-96fb73c2-b11d-4aea-944e-a10bc7c35336 tempest-CreateVolumesFromSourceVolumeTest-141026190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-2ad490eb-d22e-4ac3-9702-20b0431601db 1073741824" returned: 0 in 0.509s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 12:00:57 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-96fb73c2-b11d-4aea-944e-a10bc7c35336 tempest-CreateVolumesFromSourceVolumeTest-141026190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-2ad490eb-d22e-4ac3-9702-20b0431601db {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 12:00:57 devstack sudo[106162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-2ad490eb-d22e-4ac3-9702-20b0431601db Nov 06 12:00:57 devstack sudo[106162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 12:00:57 devstack sudo[106156]: pam_unix(sudo:session): session closed for user root Nov 06 12:00:57 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-4ff08451-5c71-41d1-bff5-141cc03421c7 tempest-CreateVolumesFromImageTest-1244366109 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-ace3ec41-22de-40fd-84fb-54ca14bd8254" returned: 0 in 0.461s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 12:00:57 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-4ff08451-5c71-41d1-bff5-141cc03421c7 tempest-CreateVolumesFromImageTest-1244366109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-ace3ec41-22de-40fd-84fb-54ca14bd8254 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 12:00:57 devstack sudo[106166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-ace3ec41-22de-40fd-84fb-54ca14bd8254 Nov 06 12:00:57 devstack sudo[106166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 12:00:57 devstack sudo[106162]: pam_unix(sudo:session): session closed for user root Nov 06 12:00:57 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-96fb73c2-b11d-4aea-944e-a10bc7c35336 tempest-CreateVolumesFromSourceVolumeTest-141026190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-2ad490eb-d22e-4ac3-9702-20b0431601db" returned: 0 in 0.253s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 12:00:57 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-96fb73c2-b11d-4aea-944e-a10bc7c35336 tempest-CreateVolumesFromSourceVolumeTest-141026190 None] <== create_volume: return (810ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f'} {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 12:00:57 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-96fb73c2-b11d-4aea-944e-a10bc7c35336 tempest-CreateVolumesFromSourceVolumeTest-141026190 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.815s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 12:00:57 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-84c5c71b-7333-4c66-91b9-76d3af832d22 tempest-VolumeDependencyTests-892718679 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 5.338s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 12:00:57 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-84c5c71b-7333-4c66-91b9-76d3af832d22 tempest-VolumeDependencyTests-892718679 None] Creating offline snapshot 4770c10c-8f9d-4eb5-bf49-4313c531e1cb of volume f8790c84-0fea-4fdd-8fed-8f7870effb49 {{(pid=87116) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 06 12:00:57 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-96fb73c2-b11d-4aea-944e-a10bc7c35336 tempest-CreateVolumesFromSourceVolumeTest-141026190 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8e298396-ca5f-420a-9e84-a5fbc64c4d73) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2ad490eb-d22e-4ac3-9702-20b0431601db', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 12:00:57 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-96fb73c2-b11d-4aea-944e-a10bc7c35336 tempest-CreateVolumesFromSourceVolumeTest-141026190 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1debb522-addb-444c-b6d3-8ac58904ded5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 12:00:57 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab688077-2cb1-4044-8ec9-8432733b16a7]: (4, 'qcow2') {{(pid=88420) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 12:00:57 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-84c5c71b-7333-4c66-91b9-76d3af832d22 tempest-VolumeDependencyTests-892718679 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-f8790c84-0fea-4fdd-8fed-8f7870effb49 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 12:00:57 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-96fb73c2-b11d-4aea-944e-a10bc7c35336 tempest-CreateVolumesFromSourceVolumeTest-141026190 None] Volume volume-2ad490eb-d22e-4ac3-9702-20b0431601db (2ad490eb-d22e-4ac3-9702-20b0431601db): created successfully Nov 06 12:00:57 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-96fb73c2-b11d-4aea-944e-a10bc7c35336 tempest-CreateVolumesFromSourceVolumeTest-141026190 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1debb522-addb-444c-b6d3-8ac58904ded5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 12:00:57 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-96fb73c2-b11d-4aea-944e-a10bc7c35336 tempest-CreateVolumesFromSourceVolumeTest-141026190 None] Flow 'volume_create_manager' (3fc7693e-12ff-4769-a021-243de5774e4c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 12:00:57 devstack sudo[106166]: pam_unix(sudo:session): session closed for user root Nov 06 12:00:57 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-96fb73c2-b11d-4aea-944e-a10bc7c35336 tempest-CreateVolumesFromSourceVolumeTest-141026190 None] Created volume successfully. Nov 06 12:00:57 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-4ff08451-5c71-41d1-bff5-141cc03421c7 tempest-CreateVolumesFromImageTest-1244366109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-ace3ec41-22de-40fd-84fb-54ca14bd8254" returned: 0 in 0.265s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 12:00:57 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-4ff08451-5c71-41d1-bff5-141cc03421c7 tempest-CreateVolumesFromImageTest-1244366109 None] Lock "cinder-quobyte-ace3ec41-22de-40fd-84fb-54ca14bd8254" released by "delete_volume" :: held 0.784s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 12:00:57 devstack sudo[106169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-f8790c84-0fea-4fdd-8fed-8f7870effb49 Nov 06 12:00:57 devstack sudo[106169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 12:00:57 devstack cinder-volume[87116]: DEBUG cinder.quota [None req-4ff08451-5c71-41d1-bff5-141cc03421c7 tempest-CreateVolumesFromImageTest-1244366109 None] Created reservations ['1840deec-ffb8-43fc-9fec-2d6c22c2e410', '68739d1f-9263-4ae5-a6f7-5b81e0441ca1', '566ae91e-600a-46f6-8721-45b5bd16a2dc', '5e526441-37e3-47b3-84ec-a54a2bfa196d'] {{(pid=87116) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 12:00:58 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-4ff08451-5c71-41d1-bff5-141cc03421c7 tempest-CreateVolumesFromImageTest-1244366109 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 12:00:58 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-4ff08451-5c71-41d1-bff5-141cc03421c7 tempest-CreateVolumesFromImageTest-1244366109 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 12:00:58 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-4ff08451-5c71-41d1-bff5-141cc03421c7 tempest-CreateVolumesFromImageTest-1244366109 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 12:00:58 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-4ff08451-5c71-41d1-bff5-141cc03421c7 tempest-CreateVolumesFromImageTest-1244366109 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 12:00:58 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-4ff08451-5c71-41d1-bff5-141cc03421c7 tempest-CreateVolumesFromImageTest-1244366109 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 12:00:58 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-4ff08451-5c71-41d1-bff5-141cc03421c7 tempest-CreateVolumesFromImageTest-1244366109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 12:00:58 devstack sudo[106172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756 Nov 06 12:00:58 devstack sudo[106172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 12:00:58 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-02ff78ae-e801-4c13-a1e8-83bd967482c3 tempest-CreateVolumesFromImageTest-1244366109 None] Acquiring lock "cinder-47d75b65-4451-4f47-b7aa-8b8708290ecb-delete_volume" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 12:00:58 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-02ff78ae-e801-4c13-a1e8-83bd967482c3 tempest-CreateVolumesFromImageTest-1244366109 None] Lock "cinder-47d75b65-4451-4f47-b7aa-8b8708290ecb-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 12:00:58 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-02ff78ae-e801-4c13-a1e8-83bd967482c3 tempest-CreateVolumesFromImageTest-1244366109 None] Acquiring lock "cinder-quobyte-47d75b65-4451-4f47-b7aa-8b8708290ecb" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 12:00:58 devstack sudo[106169]: pam_unix(sudo:session): session closed for user root Nov 06 12:00:58 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-84c5c71b-7333-4c66-91b9-76d3af832d22 tempest-VolumeDependencyTests-892718679 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-f8790c84-0fea-4fdd-8fed-8f7870effb49" returned: 0 in 0.418s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 12:00:58 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-84c5c71b-7333-4c66-91b9-76d3af832d22 tempest-VolumeDependencyTests-892718679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-f8790c84-0fea-4fdd-8fed-8f7870effb49,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-f8790c84-0fea-4fdd-8fed-8f7870effb49.4770c10c-8f9d-4eb5-bf49-4313c531e1cb 1G {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 12:00:58 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-02ff78ae-e801-4c13-a1e8-83bd967482c3 tempest-CreateVolumesFromImageTest-1244366109 None] Lock "cinder-quobyte-47d75b65-4451-4f47-b7aa-8b8708290ecb" acquired by "delete_volume" :: waited 0.034s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 12:00:58 devstack sudo[106178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-f8790c84-0fea-4fdd-8fed-8f7870effb49,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-f8790c84-0fea-4fdd-8fed-8f7870effb49.4770c10c-8f9d-4eb5-bf49-4313c531e1cb 1G Nov 06 12:00:58 devstack sudo[106178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 12:00:58 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f09ee06-1f89-45ac-a7b4-826716a511a7]: (4, 'qcow2') {{(pid=88420) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 12:00:58 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-02ff78ae-e801-4c13-a1e8-83bd967482c3 tempest-CreateVolumesFromImageTest-1244366109 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-47d75b65-4451-4f47-b7aa-8b8708290ecb {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 12:00:58 devstack sudo[106172]: pam_unix(sudo:session): session closed for user root Nov 06 12:00:58 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-4ff08451-5c71-41d1-bff5-141cc03421c7 tempest-CreateVolumesFromImageTest-1244366109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756" returned: 0 in 0.337s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 12:00:58 devstack cinder-volume[87116]: DEBUG cinder.manager [None req-4ff08451-5c71-41d1-bff5-141cc03421c7 tempest-CreateVolumesFromImageTest-1244366109 None] Notifying Schedulers of capabilities ... {{(pid=87116) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 12:00:58 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-4ff08451-5c71-41d1-bff5-141cc03421c7 tempest-CreateVolumesFromImageTest-1244366109 None] Deleted volume successfully. Nov 06 12:00:58 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-4ff08451-5c71-41d1-bff5-141cc03421c7 tempest-CreateVolumesFromImageTest-1244366109 None] Lock "cinder-ace3ec41-22de-40fd-84fb-54ca14bd8254-delete_volume" released by "delete_volume" :: held 1.375s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 12:00:58 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-0b09133c-d81c-4568-ae78-4c138c656a68 tempest-CreateVolumesFromSourceVolumeTest-141026190 None] Acquiring lock "cinder-2ad490eb-d22e-4ac3-9702-20b0431601db-delete_volume" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 12:00:58 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-0b09133c-d81c-4568-ae78-4c138c656a68 tempest-CreateVolumesFromSourceVolumeTest-141026190 None] Lock "cinder-2ad490eb-d22e-4ac3-9702-20b0431601db-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 12:00:58 devstack sudo[106181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-47d75b65-4451-4f47-b7aa-8b8708290ecb Nov 06 12:00:58 devstack sudo[106181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 12:00:58 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-0b09133c-d81c-4568-ae78-4c138c656a68 tempest-CreateVolumesFromSourceVolumeTest-141026190 None] Acquiring lock "cinder-quobyte-2ad490eb-d22e-4ac3-9702-20b0431601db" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 12:00:58 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-0b09133c-d81c-4568-ae78-4c138c656a68 tempest-CreateVolumesFromSourceVolumeTest-141026190 None] Lock "cinder-quobyte-2ad490eb-d22e-4ac3-9702-20b0431601db" acquired by "delete_volume" :: waited 0.023s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 12:00:58 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[221a8ff0-5ddb-4614-bc20-282d99e4e165]: (4, 'qcow2') {{(pid=88420) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 12:00:58 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-0b09133c-d81c-4568-ae78-4c138c656a68 tempest-CreateVolumesFromSourceVolumeTest-141026190 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-2ad490eb-d22e-4ac3-9702-20b0431601db {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 12:00:58 devstack sudo[106186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-2ad490eb-d22e-4ac3-9702-20b0431601db Nov 06 12:00:58 devstack sudo[106186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 12:00:58 devstack sudo[106178]: pam_unix(sudo:session): session closed for user root Nov 06 12:00:58 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-84c5c71b-7333-4c66-91b9-76d3af832d22 tempest-VolumeDependencyTests-892718679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-f8790c84-0fea-4fdd-8fed-8f7870effb49,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-f8790c84-0fea-4fdd-8fed-8f7870effb49.4770c10c-8f9d-4eb5-bf49-4313c531e1cb 1G" returned: 0 in 0.502s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 12:00:58 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-84c5c71b-7333-4c66-91b9-76d3af832d22 tempest-VolumeDependencyTests-892718679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f8790c84-0fea-4fdd-8fed-8f7870effb49 -F qcow2 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-f8790c84-0fea-4fdd-8fed-8f7870effb49.4770c10c-8f9d-4eb5-bf49-4313c531e1cb {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 12:00:58 devstack sudo[106192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f8790c84-0fea-4fdd-8fed-8f7870effb49 -F qcow2 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-f8790c84-0fea-4fdd-8fed-8f7870effb49.4770c10c-8f9d-4eb5-bf49-4313c531e1cb Nov 06 12:00:58 devstack sudo[106192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 12:00:58 devstack sudo[106181]: pam_unix(sudo:session): session closed for user root Nov 06 12:00:58 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-02ff78ae-e801-4c13-a1e8-83bd967482c3 tempest-CreateVolumesFromImageTest-1244366109 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-47d75b65-4451-4f47-b7aa-8b8708290ecb" returned: 0 in 0.491s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 12:00:58 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-02ff78ae-e801-4c13-a1e8-83bd967482c3 tempest-CreateVolumesFromImageTest-1244366109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-47d75b65-4451-4f47-b7aa-8b8708290ecb {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 12:00:58 devstack sudo[106194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-47d75b65-4451-4f47-b7aa-8b8708290ecb Nov 06 12:00:58 devstack sudo[106194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 12:00:58 devstack sudo[106186]: pam_unix(sudo:session): session closed for user root Nov 06 12:00:58 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-0b09133c-d81c-4568-ae78-4c138c656a68 tempest-CreateVolumesFromSourceVolumeTest-141026190 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-2ad490eb-d22e-4ac3-9702-20b0431601db" returned: 0 in 0.399s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 12:00:58 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-0b09133c-d81c-4568-ae78-4c138c656a68 tempest-CreateVolumesFromSourceVolumeTest-141026190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-2ad490eb-d22e-4ac3-9702-20b0431601db {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 12:00:58 devstack sudo[106199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-2ad490eb-d22e-4ac3-9702-20b0431601db Nov 06 12:00:58 devstack sudo[106199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 12:00:59 devstack sudo[106192]: pam_unix(sudo:session): session closed for user root Nov 06 12:00:59 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-84c5c71b-7333-4c66-91b9-76d3af832d22 tempest-VolumeDependencyTests-892718679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f8790c84-0fea-4fdd-8fed-8f7870effb49 -F qcow2 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-f8790c84-0fea-4fdd-8fed-8f7870effb49.4770c10c-8f9d-4eb5-bf49-4313c531e1cb" returned: 0 in 0.316s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 12:00:59 devstack cinder-volume[87116]: WARNING cinder.volume.drivers.remotefs [None req-84c5c71b-7333-4c66-91b9-76d3af832d22 tempest-VolumeDependencyTests-892718679 None] /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-f8790c84-0fea-4fdd-8fed-8f7870effb49.4770c10c-8f9d-4eb5-bf49-4313c531e1cb is being set with open permissions: ugo+rw Nov 06 12:00:59 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-84c5c71b-7333-4c66-91b9-76d3af832d22 tempest-VolumeDependencyTests-892718679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-f8790c84-0fea-4fdd-8fed-8f7870effb49.4770c10c-8f9d-4eb5-bf49-4313c531e1cb {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 12:00:59 devstack sudo[106205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-f8790c84-0fea-4fdd-8fed-8f7870effb49.4770c10c-8f9d-4eb5-bf49-4313c531e1cb Nov 06 12:00:59 devstack sudo[106205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 12:00:59 devstack sudo[106194]: pam_unix(sudo:session): session closed for user root Nov 06 12:00:59 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-02ff78ae-e801-4c13-a1e8-83bd967482c3 tempest-CreateVolumesFromImageTest-1244366109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-47d75b65-4451-4f47-b7aa-8b8708290ecb" returned: 0 in 0.321s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 12:00:59 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-02ff78ae-e801-4c13-a1e8-83bd967482c3 tempest-CreateVolumesFromImageTest-1244366109 None] Lock "cinder-quobyte-47d75b65-4451-4f47-b7aa-8b8708290ecb" released by "delete_volume" :: held 0.878s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 12:00:59 devstack sudo[106199]: pam_unix(sudo:session): session closed for user root Nov 06 12:00:59 devstack cinder-volume[87116]: DEBUG cinder.quota [None req-02ff78ae-e801-4c13-a1e8-83bd967482c3 tempest-CreateVolumesFromImageTest-1244366109 None] Created reservations ['e4595e46-9e7b-4d23-a4d2-87c551dc4950', 'd523e38e-c5b7-464e-ba7f-9cb85e8b2cb4', '0c03d608-69b8-4f23-9b5d-3c16960df80f', 'ddc79fdd-b9b0-49b4-9112-37fcda281ff9'] {{(pid=87116) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 12:00:59 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-0b09133c-d81c-4568-ae78-4c138c656a68 tempest-CreateVolumesFromSourceVolumeTest-141026190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-2ad490eb-d22e-4ac3-9702-20b0431601db" returned: 0 in 0.261s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 12:00:59 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-0b09133c-d81c-4568-ae78-4c138c656a68 tempest-CreateVolumesFromSourceVolumeTest-141026190 None] Lock "cinder-quobyte-2ad490eb-d22e-4ac3-9702-20b0431601db" released by "delete_volume" :: held 0.715s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 12:00:59 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-02ff78ae-e801-4c13-a1e8-83bd967482c3 tempest-CreateVolumesFromImageTest-1244366109 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 12:00:59 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-02ff78ae-e801-4c13-a1e8-83bd967482c3 tempest-CreateVolumesFromImageTest-1244366109 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 12:00:59 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-02ff78ae-e801-4c13-a1e8-83bd967482c3 tempest-CreateVolumesFromImageTest-1244366109 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 12:00:59 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-02ff78ae-e801-4c13-a1e8-83bd967482c3 tempest-CreateVolumesFromImageTest-1244366109 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 12:00:59 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-02ff78ae-e801-4c13-a1e8-83bd967482c3 tempest-CreateVolumesFromImageTest-1244366109 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 12:00:59 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-02ff78ae-e801-4c13-a1e8-83bd967482c3 tempest-CreateVolumesFromImageTest-1244366109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 12:00:59 devstack cinder-volume[87116]: DEBUG cinder.quota [None req-0b09133c-d81c-4568-ae78-4c138c656a68 tempest-CreateVolumesFromSourceVolumeTest-141026190 None] Created reservations ['735d102a-b4f0-4bf1-8c5c-5b10df41f527', 'fa7eb1e9-8ac1-4d58-883b-2629bec2613f', '43109f14-8062-4f10-834e-1a3205736337', 'd18ad18c-48ea-4da2-abd9-6d33fa6cb79e'] {{(pid=87116) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 12:00:59 devstack sudo[106209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756 Nov 06 12:00:59 devstack sudo[106205]: pam_unix(sudo:session): session closed for user root Nov 06 12:00:59 devstack sudo[106209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 12:00:59 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-84c5c71b-7333-4c66-91b9-76d3af832d22 tempest-VolumeDependencyTests-892718679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-f8790c84-0fea-4fdd-8fed-8f7870effb49.4770c10c-8f9d-4eb5-bf49-4313c531e1cb" returned: 0 in 0.281s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 12:00:59 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-84c5c71b-7333-4c66-91b9-76d3af832d22 tempest-VolumeDependencyTests-892718679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-f8790c84-0fea-4fdd-8fed-8f7870effb49.info {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 12:00:59 devstack sudo[106211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-f8790c84-0fea-4fdd-8fed-8f7870effb49.info Nov 06 12:00:59 devstack sudo[106211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 12:00:59 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-0b09133c-d81c-4568-ae78-4c138c656a68 tempest-CreateVolumesFromSourceVolumeTest-141026190 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 12:00:59 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-0b09133c-d81c-4568-ae78-4c138c656a68 tempest-CreateVolumesFromSourceVolumeTest-141026190 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 12:00:59 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-0b09133c-d81c-4568-ae78-4c138c656a68 tempest-CreateVolumesFromSourceVolumeTest-141026190 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 12:00:59 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-0b09133c-d81c-4568-ae78-4c138c656a68 tempest-CreateVolumesFromSourceVolumeTest-141026190 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 12:00:59 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-0b09133c-d81c-4568-ae78-4c138c656a68 tempest-CreateVolumesFromSourceVolumeTest-141026190 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 12:00:59 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-0b09133c-d81c-4568-ae78-4c138c656a68 tempest-CreateVolumesFromSourceVolumeTest-141026190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 12:00:59 devstack sudo[106213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756 Nov 06 12:00:59 devstack sudo[106213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 12:00:59 devstack sudo[106209]: pam_unix(sudo:session): session closed for user root Nov 06 12:00:59 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-02ff78ae-e801-4c13-a1e8-83bd967482c3 tempest-CreateVolumesFromImageTest-1244366109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756" returned: 0 in 0.277s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 12:00:59 devstack cinder-volume[87116]: DEBUG cinder.manager [None req-02ff78ae-e801-4c13-a1e8-83bd967482c3 tempest-CreateVolumesFromImageTest-1244366109 None] Notifying Schedulers of capabilities ... {{(pid=87116) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 12:00:59 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-02ff78ae-e801-4c13-a1e8-83bd967482c3 tempest-CreateVolumesFromImageTest-1244366109 None] Deleted volume successfully. Nov 06 12:00:59 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-754ab3ae-fa8e-4068-9d8e-04401b0d31a3 tempest-CreateVolumesFromSourceVolumeTest-141026190 None] Acquiring lock "cinder-6faa751e-46db-47d5-ada3-1ad8e7e3cd7e-delete_volume" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 12:00:59 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-02ff78ae-e801-4c13-a1e8-83bd967482c3 tempest-CreateVolumesFromImageTest-1244366109 None] Lock "cinder-47d75b65-4451-4f47-b7aa-8b8708290ecb-delete_volume" released by "delete_volume" :: held 1.455s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 12:00:59 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-754ab3ae-fa8e-4068-9d8e-04401b0d31a3 tempest-CreateVolumesFromSourceVolumeTest-141026190 None] Lock "cinder-6faa751e-46db-47d5-ada3-1ad8e7e3cd7e-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 12:00:59 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-754ab3ae-fa8e-4068-9d8e-04401b0d31a3 tempest-CreateVolumesFromSourceVolumeTest-141026190 None] Acquiring lock "cinder-quobyte-6faa751e-46db-47d5-ada3-1ad8e7e3cd7e" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 12:00:59 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-754ab3ae-fa8e-4068-9d8e-04401b0d31a3 tempest-CreateVolumesFromSourceVolumeTest-141026190 None] Lock "cinder-quobyte-6faa751e-46db-47d5-ada3-1ad8e7e3cd7e" acquired by "delete_volume" :: waited 0.017s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 12:00:59 devstack sudo[106211]: pam_unix(sudo:session): session closed for user root Nov 06 12:00:59 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-84c5c71b-7333-4c66-91b9-76d3af832d22 tempest-VolumeDependencyTests-892718679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-f8790c84-0fea-4fdd-8fed-8f7870effb49.info" returned: 0 in 0.341s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 12:00:59 devstack cinder-volume[87116]: WARNING cinder.volume.drivers.remotefs [None req-84c5c71b-7333-4c66-91b9-76d3af832d22 tempest-VolumeDependencyTests-892718679 None] /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-f8790c84-0fea-4fdd-8fed-8f7870effb49.info is being set with open permissions: ugo+rw Nov 06 12:00:59 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-84c5c71b-7333-4c66-91b9-76d3af832d22 tempest-VolumeDependencyTests-892718679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-f8790c84-0fea-4fdd-8fed-8f7870effb49.info {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 12:00:59 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[29f44dc3-8758-4621-97d0-8dd36e78a20c]: (4, 'qcow2') {{(pid=88420) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 12:00:59 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-754ab3ae-fa8e-4068-9d8e-04401b0d31a3 tempest-CreateVolumesFromSourceVolumeTest-141026190 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-6faa751e-46db-47d5-ada3-1ad8e7e3cd7e {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 12:00:59 devstack sudo[106213]: pam_unix(sudo:session): session closed for user root Nov 06 12:00:59 devstack sudo[106218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-f8790c84-0fea-4fdd-8fed-8f7870effb49.info Nov 06 12:00:59 devstack sudo[106218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 12:00:59 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-0b09133c-d81c-4568-ae78-4c138c656a68 tempest-CreateVolumesFromSourceVolumeTest-141026190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756" returned: 0 in 0.323s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 12:00:59 devstack cinder-volume[87116]: DEBUG cinder.manager [None req-0b09133c-d81c-4568-ae78-4c138c656a68 tempest-CreateVolumesFromSourceVolumeTest-141026190 None] Notifying Schedulers of capabilities ... {{(pid=87116) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 12:00:59 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-0b09133c-d81c-4568-ae78-4c138c656a68 tempest-CreateVolumesFromSourceVolumeTest-141026190 None] Deleted volume successfully. Nov 06 12:00:59 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-0b09133c-d81c-4568-ae78-4c138c656a68 tempest-CreateVolumesFromSourceVolumeTest-141026190 None] Lock "cinder-2ad490eb-d22e-4ac3-9702-20b0431601db-delete_volume" released by "delete_volume" :: held 1.358s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 12:00:59 devstack sudo[106219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-6faa751e-46db-47d5-ada3-1ad8e7e3cd7e Nov 06 12:00:59 devstack sudo[106219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 12:00:59 devstack sudo[106218]: pam_unix(sudo:session): session closed for user root Nov 06 12:00:59 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-84c5c71b-7333-4c66-91b9-76d3af832d22 tempest-VolumeDependencyTests-892718679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-f8790c84-0fea-4fdd-8fed-8f7870effb49.info" returned: 0 in 0.256s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 12:01:00 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-84c5c71b-7333-4c66-91b9-76d3af832d22 tempest-VolumeDependencyTests-892718679 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.243s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 12:01:00 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-abc9dfec-210d-4ba8-bacb-0e8c36a479ec tempest-VolumeAndVolumeTypeFromImageTest-1559663696 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.818s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 12:01:00 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-abc9dfec-210d-4ba8-bacb-0e8c36a479ec tempest-VolumeAndVolumeTypeFromImageTest-1559663696 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T11:00:52Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=45dd2432-9eab-4aa2-9a73-bad99e686c47,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='99d6df4d85a74ec6a44093feb2aa49bd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T11:00:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T11:00:52Z,use_quota=True,user_id='9241a8d97a784ecb84f6b02e74d40e02',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(90b006af-efaf-4241-a7c0-4bc02137c188),volume_type_id=90b006af-efaf-4241-a7c0-4bc02137c188)}" {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 12:01:00 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-abc9dfec-210d-4ba8-bacb-0e8c36a479ec tempest-VolumeAndVolumeTypeFromImageTest-1559663696 None] Creating volume 45dd2432-9eab-4aa2-9a73-bad99e686c47 {{(pid=87116) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 12:01:00 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-abc9dfec-210d-4ba8-bacb-0e8c36a479ec tempest-VolumeAndVolumeTypeFromImageTest-1559663696 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 12:01:00 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-abc9dfec-210d-4ba8-bacb-0e8c36a479ec tempest-VolumeAndVolumeTypeFromImageTest-1559663696 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 12:01:00 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-abc9dfec-210d-4ba8-bacb-0e8c36a479ec tempest-VolumeAndVolumeTypeFromImageTest-1559663696 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 12:01:00 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-abc9dfec-210d-4ba8-bacb-0e8c36a479ec tempest-VolumeAndVolumeTypeFromImageTest-1559663696 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 12:01:00 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-abc9dfec-210d-4ba8-bacb-0e8c36a479ec tempest-VolumeAndVolumeTypeFromImageTest-1559663696 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 12:01:00 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-abc9dfec-210d-4ba8-bacb-0e8c36a479ec tempest-VolumeAndVolumeTypeFromImageTest-1559663696 None] Selected osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f as target Quobyte volume. {{(pid=87116) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 12:01:00 devstack cinder-volume[87116]: INFO cinder.volume.drivers.remotefs [None req-abc9dfec-210d-4ba8-bacb-0e8c36a479ec tempest-VolumeAndVolumeTypeFromImageTest-1559663696 None] casted to osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f Nov 06 12:01:00 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-abc9dfec-210d-4ba8-bacb-0e8c36a479ec tempest-VolumeAndVolumeTypeFromImageTest-1559663696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-45dd2432-9eab-4aa2-9a73-bad99e686c47 1073741824 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 12:01:00 devstack sudo[106223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-45dd2432-9eab-4aa2-9a73-bad99e686c47 1073741824 Nov 06 12:01:00 devstack sudo[106223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 12:01:00 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-84c5c71b-7333-4c66-91b9-76d3af832d22 tempest-VolumeDependencyTests-892718679 None] Create snapshot completed successfully Nov 06 12:01:00 devstack sudo[106219]: pam_unix(sudo:session): session closed for user root Nov 06 12:01:00 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-754ab3ae-fa8e-4068-9d8e-04401b0d31a3 tempest-CreateVolumesFromSourceVolumeTest-141026190 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-6faa751e-46db-47d5-ada3-1ad8e7e3cd7e" returned: 0 in 0.390s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 12:01:00 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-754ab3ae-fa8e-4068-9d8e-04401b0d31a3 tempest-CreateVolumesFromSourceVolumeTest-141026190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-6faa751e-46db-47d5-ada3-1ad8e7e3cd7e {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 12:01:00 devstack sudo[106228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-6faa751e-46db-47d5-ada3-1ad8e7e3cd7e Nov 06 12:01:00 devstack sudo[106228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 12:01:00 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-ea270279-d7ff-44a3-98b0-c30bdfa52b59 tempest-CreateVolumesFromImageTest-1244366109 None] Acquiring lock "cinder-ad482c0b-8f61-49e2-b20c-b6b2d6dfa8ed-delete_volume" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 12:01:00 devstack sudo[106228]: pam_unix(sudo:session): session closed for user root Nov 06 12:01:00 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-ea270279-d7ff-44a3-98b0-c30bdfa52b59 tempest-CreateVolumesFromImageTest-1244366109 None] Lock "cinder-ad482c0b-8f61-49e2-b20c-b6b2d6dfa8ed-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 12:01:00 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-754ab3ae-fa8e-4068-9d8e-04401b0d31a3 tempest-CreateVolumesFromSourceVolumeTest-141026190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-6faa751e-46db-47d5-ada3-1ad8e7e3cd7e" returned: 0 in 0.289s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 12:01:00 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-754ab3ae-fa8e-4068-9d8e-04401b0d31a3 tempest-CreateVolumesFromSourceVolumeTest-141026190 None] Lock "cinder-quobyte-6faa751e-46db-47d5-ada3-1ad8e7e3cd7e" released by "delete_volume" :: held 0.739s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 12:01:00 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-ea270279-d7ff-44a3-98b0-c30bdfa52b59 tempest-CreateVolumesFromImageTest-1244366109 None] Acquiring lock "cinder-quobyte-ad482c0b-8f61-49e2-b20c-b6b2d6dfa8ed" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 12:01:00 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-ea270279-d7ff-44a3-98b0-c30bdfa52b59 tempest-CreateVolumesFromImageTest-1244366109 None] Lock "cinder-quobyte-ad482c0b-8f61-49e2-b20c-b6b2d6dfa8ed" acquired by "delete_volume" :: waited 0.027s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 12:01:00 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[e55d4dec-e4bc-4e9a-9b29-79a3f59b18d9]: (4, 'qcow2') {{(pid=88420) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 12:01:00 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-ea270279-d7ff-44a3-98b0-c30bdfa52b59 tempest-CreateVolumesFromImageTest-1244366109 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-ad482c0b-8f61-49e2-b20c-b6b2d6dfa8ed {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 12:01:00 devstack sudo[106223]: pam_unix(sudo:session): session closed for user root Nov 06 12:01:00 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-abc9dfec-210d-4ba8-bacb-0e8c36a479ec tempest-VolumeAndVolumeTypeFromImageTest-1559663696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-45dd2432-9eab-4aa2-9a73-bad99e686c47 1073741824" returned: 0 in 0.516s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 12:01:00 devstack cinder-volume[87116]: DEBUG cinder.quota [None req-754ab3ae-fa8e-4068-9d8e-04401b0d31a3 tempest-CreateVolumesFromSourceVolumeTest-141026190 None] Created reservations ['06e3cc50-dc8b-40e6-96c6-fdd3caa13c83', '7bae8d9d-a458-4fc8-ab33-6c77d62c92e0', '98ea299c-b1e3-4191-8344-e1759caa2043', '78db13df-e873-44fe-8702-d0487d90ed5c'] {{(pid=87116) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 12:01:00 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-abc9dfec-210d-4ba8-bacb-0e8c36a479ec tempest-VolumeAndVolumeTypeFromImageTest-1559663696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-45dd2432-9eab-4aa2-9a73-bad99e686c47 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 12:01:00 devstack sudo[106236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-45dd2432-9eab-4aa2-9a73-bad99e686c47 Nov 06 12:01:00 devstack sudo[106236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 12:01:00 devstack sudo[106235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-ad482c0b-8f61-49e2-b20c-b6b2d6dfa8ed Nov 06 12:01:00 devstack sudo[106235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 12:01:00 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-754ab3ae-fa8e-4068-9d8e-04401b0d31a3 tempest-CreateVolumesFromSourceVolumeTest-141026190 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 12:01:00 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-754ab3ae-fa8e-4068-9d8e-04401b0d31a3 tempest-CreateVolumesFromSourceVolumeTest-141026190 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 12:01:00 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-754ab3ae-fa8e-4068-9d8e-04401b0d31a3 tempest-CreateVolumesFromSourceVolumeTest-141026190 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 12:01:00 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-754ab3ae-fa8e-4068-9d8e-04401b0d31a3 tempest-CreateVolumesFromSourceVolumeTest-141026190 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 12:01:00 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-754ab3ae-fa8e-4068-9d8e-04401b0d31a3 tempest-CreateVolumesFromSourceVolumeTest-141026190 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 12:01:00 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-754ab3ae-fa8e-4068-9d8e-04401b0d31a3 tempest-CreateVolumesFromSourceVolumeTest-141026190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 12:01:00 devstack sudo[106239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756 Nov 06 12:01:00 devstack sudo[106239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 12:01:00 devstack sudo[106236]: pam_unix(sudo:session): session closed for user root Nov 06 12:01:00 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-abc9dfec-210d-4ba8-bacb-0e8c36a479ec tempest-VolumeAndVolumeTypeFromImageTest-1559663696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-45dd2432-9eab-4aa2-9a73-bad99e686c47" returned: 0 in 0.282s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 12:01:00 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-abc9dfec-210d-4ba8-bacb-0e8c36a479ec tempest-VolumeAndVolumeTypeFromImageTest-1559663696 None] <== create_volume: return (854ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f'} {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 12:01:00 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-abc9dfec-210d-4ba8-bacb-0e8c36a479ec tempest-VolumeAndVolumeTypeFromImageTest-1559663696 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.859s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 12:01:00 devstack sudo[106239]: pam_unix(sudo:session): session closed for user root Nov 06 12:01:00 devstack cinder-volume[87116]: DEBUG cinder.volume.volume_utils [None req-abc9dfec-210d-4ba8-bacb-0e8c36a479ec tempest-VolumeAndVolumeTypeFromImageTest-1559663696 None] Attempting download of 7b27872f-3678-471a-8e07-a573613df10e ((None, [{'url': 'file:///opt/stack/data/glance/images/7b27872f-3678-471a-8e07-a573613df10e', 'metadata': {}}])) to volume 45dd2432-9eab-4aa2-9a73-bad99e686c47. {{(pid=87116) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Nov 06 12:01:00 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-754ab3ae-fa8e-4068-9d8e-04401b0d31a3 tempest-CreateVolumesFromSourceVolumeTest-141026190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756" returned: 0 in 0.291s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 12:01:00 devstack cinder-volume[87116]: DEBUG cinder.manager [None req-754ab3ae-fa8e-4068-9d8e-04401b0d31a3 tempest-CreateVolumesFromSourceVolumeTest-141026190 None] Notifying Schedulers of capabilities ... {{(pid=87116) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 12:01:00 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-754ab3ae-fa8e-4068-9d8e-04401b0d31a3 tempest-CreateVolumesFromSourceVolumeTest-141026190 None] Deleted volume successfully. Nov 06 12:01:00 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-754ab3ae-fa8e-4068-9d8e-04401b0d31a3 tempest-CreateVolumesFromSourceVolumeTest-141026190 None] Lock "cinder-6faa751e-46db-47d5-ada3-1ad8e7e3cd7e-delete_volume" released by "delete_volume" :: held 1.359s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 12:01:01 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[36b9ef8a-31ec-4910-a4f0-2ed326774fc6]: (4, 'raw') {{(pid=88420) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 12:01:01 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-abc9dfec-210d-4ba8-bacb-0e8c36a479ec tempest-VolumeAndVolumeTypeFromImageTest-1559663696 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_7b27872f-3678-471a-8e07-a573613df10e_zpeahtfx {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 12:01:01 devstack sudo[106235]: pam_unix(sudo:session): session closed for user root Nov 06 12:01:01 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-ea270279-d7ff-44a3-98b0-c30bdfa52b59 tempest-CreateVolumesFromImageTest-1244366109 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-ad482c0b-8f61-49e2-b20c-b6b2d6dfa8ed" returned: 0 in 0.508s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 12:01:01 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-ea270279-d7ff-44a3-98b0-c30bdfa52b59 tempest-CreateVolumesFromImageTest-1244366109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-ad482c0b-8f61-49e2-b20c-b6b2d6dfa8ed {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 12:01:01 devstack sudo[106247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-ad482c0b-8f61-49e2-b20c-b6b2d6dfa8ed Nov 06 12:01:01 devstack sudo[106247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 12:01:01 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-de37bd2c-a292-4d8d-bb2a-f6fafbf2da29 tempest-CreateVolumesFromSourceVolumeTest-141026190 None] Acquiring lock "cinder-b0b4ae59-b11f-4b85-a77d-4519b933d1e1-delete_volume" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 12:01:01 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-de37bd2c-a292-4d8d-bb2a-f6fafbf2da29 tempest-CreateVolumesFromSourceVolumeTest-141026190 None] Lock "cinder-b0b4ae59-b11f-4b85-a77d-4519b933d1e1-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 12:01:01 devstack sudo[106246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_7b27872f-3678-471a-8e07-a573613df10e_zpeahtfx Nov 06 12:01:01 devstack sudo[106246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 12:01:01 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-de37bd2c-a292-4d8d-bb2a-f6fafbf2da29 tempest-CreateVolumesFromSourceVolumeTest-141026190 None] Acquiring lock "cinder-quobyte-b0b4ae59-b11f-4b85-a77d-4519b933d1e1" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 12:01:01 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-de37bd2c-a292-4d8d-bb2a-f6fafbf2da29 tempest-CreateVolumesFromSourceVolumeTest-141026190 None] Lock "cinder-quobyte-b0b4ae59-b11f-4b85-a77d-4519b933d1e1" acquired by "delete_volume" :: waited 0.026s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 12:01:01 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[a06b92de-a752-49ea-b484-ff4e160674bd]: (4, 'qcow2') {{(pid=88420) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 12:01:01 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-de37bd2c-a292-4d8d-bb2a-f6fafbf2da29 tempest-CreateVolumesFromSourceVolumeTest-141026190 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-b0b4ae59-b11f-4b85-a77d-4519b933d1e1 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 12:01:01 devstack sudo[106247]: pam_unix(sudo:session): session closed for user root Nov 06 12:01:01 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-ea270279-d7ff-44a3-98b0-c30bdfa52b59 tempest-CreateVolumesFromImageTest-1244366109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-ad482c0b-8f61-49e2-b20c-b6b2d6dfa8ed" returned: 0 in 0.383s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 12:01:01 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-ea270279-d7ff-44a3-98b0-c30bdfa52b59 tempest-CreateVolumesFromImageTest-1244366109 None] Lock "cinder-quobyte-ad482c0b-8f61-49e2-b20c-b6b2d6dfa8ed" released by "delete_volume" :: held 0.940s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 12:01:01 devstack sudo[106246]: pam_unix(sudo:session): session closed for user root Nov 06 12:01:01 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-abc9dfec-210d-4ba8-bacb-0e8c36a479ec tempest-VolumeAndVolumeTypeFromImageTest-1559663696 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_7b27872f-3678-471a-8e07-a573613df10e_zpeahtfx" returned: 0 in 0.446s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 12:01:01 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-abc9dfec-210d-4ba8-bacb-0e8c36a479ec tempest-VolumeAndVolumeTypeFromImageTest-1559663696 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7b27872f-3678-471a-8e07-a573613df10e_zpeahtfx {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 12:01:01 devstack sudo[106250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-b0b4ae59-b11f-4b85-a77d-4519b933d1e1 Nov 06 12:01:01 devstack sudo[106250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 12:01:01 devstack cinder-volume[87116]: DEBUG cinder.quota [None req-ea270279-d7ff-44a3-98b0-c30bdfa52b59 tempest-CreateVolumesFromImageTest-1244366109 None] Created reservations ['53a4b577-d441-43d4-bd38-0a278e1062b1', '4ce10ce4-560b-47a7-94ca-e1823bb29b7a', '988b62c3-1464-4c14-b8c5-267e5097b8ba', 'b9ae8734-2180-444c-81a1-ebae2180bf97'] {{(pid=87116) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 12:01:01 devstack cinder-volume[87116]: DEBUG cinder.volume.flows.manager.create_volume [None req-308f84ad-9e44-4050-b6d4-385471884003 tempest-VolumeDependencyTests-892718679 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87116) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 12:01:01 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-308f84ad-9e44-4050-b6d4-385471884003 tempest-VolumeDependencyTests-892718679 None] Flow 'volume_create_manager' (d0166626-6132-424b-ad1e-a8246e78456a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 12:01:01 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-308f84ad-9e44-4050-b6d4-385471884003 tempest-VolumeDependencyTests-892718679 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c2ffe01-b762-4b82-aa27-25ae828496a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 12:01:01 devstack sudo[106254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7b27872f-3678-471a-8e07-a573613df10e_zpeahtfx Nov 06 12:01:01 devstack sudo[106254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 12:01:01 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-308f84ad-9e44-4050-b6d4-385471884003 tempest-VolumeDependencyTests-892718679 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c2ffe01-b762-4b82-aa27-25ae828496a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T11:01:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-841224257',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=049c7a65-bffc-4f08-b308-0998e46e4fed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2c7a69fab6b74d6498176b18a505da28',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T11:01:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=4770c10c-8f9d-4eb5-bf49-4313c531e1cb,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T11:01:01Z,use_quota=True,user_id='894cd30a3b7c46209217d52b4546b5e0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(34d3b144-d9b7-480a-a2e3-01e45f3d54c1),volume_type_id=34d3b144-d9b7-480a-a2e3-01e45f3d54c1)' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 12:01:01 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-308f84ad-9e44-4050-b6d4-385471884003 tempest-VolumeDependencyTests-892718679 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0da25f76-4d3c-43df-8c9e-3708d5b45611) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 12:01:01 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-308f84ad-9e44-4050-b6d4-385471884003 tempest-VolumeDependencyTests-892718679 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0da25f76-4d3c-43df-8c9e-3708d5b45611) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 12:01:01 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-308f84ad-9e44-4050-b6d4-385471884003 tempest-VolumeDependencyTests-892718679 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (34246c50-ecab-4e82-b7fe-056a7ae5b40a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 12:01:01 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-308f84ad-9e44-4050-b6d4-385471884003 tempest-VolumeDependencyTests-892718679 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (34246c50-ecab-4e82-b7fe-056a7ae5b40a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '049c7a65-bffc-4f08-b308-0998e46e4fed', 'volume_name': 'volume-049c7a65-bffc-4f08-b308-0998e46e4fed', 'volume_size': 1, 'snapshot_id': '4770c10c-8f9d-4eb5-bf49-4313c531e1cb'}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 12:01:01 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-308f84ad-9e44-4050-b6d4-385471884003 tempest-VolumeDependencyTests-892718679 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d0718b4-b21a-41ee-a60c-be606fa1c530) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 12:01:01 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-308f84ad-9e44-4050-b6d4-385471884003 tempest-VolumeDependencyTests-892718679 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d0718b4-b21a-41ee-a60c-be606fa1c530) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 12:01:01 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-308f84ad-9e44-4050-b6d4-385471884003 tempest-VolumeDependencyTests-892718679 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5753cc0f-f6a7-4706-b14c-4040cb5f3771) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 12:01:01 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-308f84ad-9e44-4050-b6d4-385471884003 tempest-VolumeDependencyTests-892718679 None] Volume 049c7a65-bffc-4f08-b308-0998e46e4fed: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-049c7a65-bffc-4f08-b308-0998e46e4fed', 'volume_size': 1, 'snapshot_id': '4770c10c-8f9d-4eb5-bf49-4313c531e1cb'} Nov 06 12:01:01 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-308f84ad-9e44-4050-b6d4-385471884003 tempest-VolumeDependencyTests-892718679 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 12:01:01 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-308f84ad-9e44-4050-b6d4-385471884003 tempest-VolumeDependencyTests-892718679 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 12:01:01 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-308f84ad-9e44-4050-b6d4-385471884003 tempest-VolumeDependencyTests-892718679 None] Acquiring lock "cinder-quobyte-4770c10c-8f9d-4eb5-bf49-4313c531e1cb-049c7a65-bffc-4f08-b308-0998e46e4fed" by "_create_volume_from_snapshot" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 12:01:01 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-308f84ad-9e44-4050-b6d4-385471884003 tempest-VolumeDependencyTests-892718679 None] Lock "cinder-quobyte-4770c10c-8f9d-4eb5-bf49-4313c531e1cb-049c7a65-bffc-4f08-b308-0998e46e4fed" acquired by "_create_volume_from_snapshot" :: waited 0.026s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 12:01:01 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-308f84ad-9e44-4050-b6d4-385471884003 tempest-VolumeDependencyTests-892718679 None] Creating volume 049c7a65-bffc-4f08-b308-0998e46e4fed from snapshot 4770c10c-8f9d-4eb5-bf49-4313c531e1cb {{(pid=87116) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Nov 06 12:01:01 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-308f84ad-9e44-4050-b6d4-385471884003 tempest-VolumeDependencyTests-892718679 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 12:01:01 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-308f84ad-9e44-4050-b6d4-385471884003 tempest-VolumeDependencyTests-892718679 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 12:01:01 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-308f84ad-9e44-4050-b6d4-385471884003 tempest-VolumeDependencyTests-892718679 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 12:01:01 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-308f84ad-9e44-4050-b6d4-385471884003 tempest-VolumeDependencyTests-892718679 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 12:01:01 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-308f84ad-9e44-4050-b6d4-385471884003 tempest-VolumeDependencyTests-892718679 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 12:01:01 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-308f84ad-9e44-4050-b6d4-385471884003 tempest-VolumeDependencyTests-892718679 None] Selected osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f as target Quobyte volume. {{(pid=87116) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 12:01:01 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-308f84ad-9e44-4050-b6d4-385471884003 tempest-VolumeDependencyTests-892718679 None] Acquiring lock "cinder-quobyte-049c7a65-bffc-4f08-b308-0998e46e4fed" by "_copy_volume_from_snapshot" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 12:01:01 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-ea270279-d7ff-44a3-98b0-c30bdfa52b59 tempest-CreateVolumesFromImageTest-1244366109 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 12:01:01 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-ea270279-d7ff-44a3-98b0-c30bdfa52b59 tempest-CreateVolumesFromImageTest-1244366109 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 12:01:01 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-ea270279-d7ff-44a3-98b0-c30bdfa52b59 tempest-CreateVolumesFromImageTest-1244366109 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 12:01:01 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-ea270279-d7ff-44a3-98b0-c30bdfa52b59 tempest-CreateVolumesFromImageTest-1244366109 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 12:01:01 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-ea270279-d7ff-44a3-98b0-c30bdfa52b59 tempest-CreateVolumesFromImageTest-1244366109 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 12:01:01 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-ea270279-d7ff-44a3-98b0-c30bdfa52b59 tempest-CreateVolumesFromImageTest-1244366109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 12:01:01 devstack sudo[106250]: pam_unix(sudo:session): session closed for user root Nov 06 12:01:01 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-308f84ad-9e44-4050-b6d4-385471884003 tempest-VolumeDependencyTests-892718679 None] Lock "cinder-quobyte-049c7a65-bffc-4f08-b308-0998e46e4fed" acquired by "_copy_volume_from_snapshot" :: waited 0.042s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 12:01:01 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-308f84ad-9e44-4050-b6d4-385471884003 tempest-VolumeDependencyTests-892718679 None] snapshot: 4770c10c-8f9d-4eb5-bf49-4313c531e1cb, volume: 049c7a65-bffc-4f08-b308-0998e46e4fed, {{(pid=87116) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 06 12:01:01 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-de37bd2c-a292-4d8d-bb2a-f6fafbf2da29 tempest-CreateVolumesFromSourceVolumeTest-141026190 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-b0b4ae59-b11f-4b85-a77d-4519b933d1e1" returned: 0 in 0.492s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 12:01:01 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-de37bd2c-a292-4d8d-bb2a-f6fafbf2da29 tempest-CreateVolumesFromSourceVolumeTest-141026190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-b0b4ae59-b11f-4b85-a77d-4519b933d1e1 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 12:01:01 devstack sudo[106260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756 Nov 06 12:01:01 devstack sudo[106260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 12:01:01 devstack sudo[106261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-b0b4ae59-b11f-4b85-a77d-4519b933d1e1 Nov 06 12:01:01 devstack sudo[106261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 12:01:01 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-308f84ad-9e44-4050-b6d4-385471884003 tempest-VolumeDependencyTests-892718679 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 12:01:01 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-308f84ad-9e44-4050-b6d4-385471884003 tempest-VolumeDependencyTests-892718679 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 12:01:01 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-308f84ad-9e44-4050-b6d4-385471884003 tempest-VolumeDependencyTests-892718679 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 12:01:01 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-308f84ad-9e44-4050-b6d4-385471884003 tempest-VolumeDependencyTests-892718679 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 12:01:01 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-308f84ad-9e44-4050-b6d4-385471884003 tempest-VolumeDependencyTests-892718679 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 12:01:01 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[23347794-478d-4725-85cc-5d25196c8faf]: (4, 'qcow2') {{(pid=88420) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 12:01:01 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-308f84ad-9e44-4050-b6d4-385471884003 tempest-VolumeDependencyTests-892718679 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-f8790c84-0fea-4fdd-8fed-8f7870effb49.4770c10c-8f9d-4eb5-bf49-4313c531e1cb {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 12:01:01 devstack sudo[106254]: pam_unix(sudo:session): session closed for user root Nov 06 12:01:01 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-abc9dfec-210d-4ba8-bacb-0e8c36a479ec tempest-VolumeAndVolumeTypeFromImageTest-1559663696 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7b27872f-3678-471a-8e07-a573613df10e_zpeahtfx" returned: 1 in 0.478s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 12:01:01 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-abc9dfec-210d-4ba8-bacb-0e8c36a479ec tempest-VolumeAndVolumeTypeFromImageTest-1559663696 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_7b27872f-3678-471a-8e07-a573613df10e_zpeahtfx' failed. Not Retrying. {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 06 12:01:01 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[c373fc87-d1af-4dab-80c3-4fe4df88093c]: (4, 'raw') {{(pid=88420) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 12:01:01 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-abc9dfec-210d-4ba8-bacb-0e8c36a479ec tempest-VolumeAndVolumeTypeFromImageTest-1559663696 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_7b27872f-3678-471a-8e07-a573613df10e_wwad7w6ydevstack@QuobyteHD {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 12:01:02 devstack sudo[106266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-f8790c84-0fea-4fdd-8fed-8f7870effb49.4770c10c-8f9d-4eb5-bf49-4313c531e1cb Nov 06 12:01:02 devstack sudo[106266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 12:01:02 devstack sudo[106260]: pam_unix(sudo:session): session closed for user root Nov 06 12:01:02 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-ea270279-d7ff-44a3-98b0-c30bdfa52b59 tempest-CreateVolumesFromImageTest-1244366109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756" returned: 0 in 0.317s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 12:01:02 devstack cinder-volume[87116]: DEBUG cinder.manager [None req-ea270279-d7ff-44a3-98b0-c30bdfa52b59 tempest-CreateVolumesFromImageTest-1244366109 None] Notifying Schedulers of capabilities ... {{(pid=87116) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 12:01:02 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-ea270279-d7ff-44a3-98b0-c30bdfa52b59 tempest-CreateVolumesFromImageTest-1244366109 None] Deleted volume successfully. Nov 06 12:01:02 devstack sudo[106261]: pam_unix(sudo:session): session closed for user root Nov 06 12:01:02 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-de37bd2c-a292-4d8d-bb2a-f6fafbf2da29 tempest-CreateVolumesFromSourceVolumeTest-141026190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-b0b4ae59-b11f-4b85-a77d-4519b933d1e1" returned: 0 in 0.318s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 12:01:02 devstack sudo[106267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_7b27872f-3678-471a-8e07-a573613df10e_wwad7w6ydevstack@QuobyteHD Nov 06 12:01:02 devstack sudo[106267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 12:01:02 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-de37bd2c-a292-4d8d-bb2a-f6fafbf2da29 tempest-CreateVolumesFromSourceVolumeTest-141026190 None] Lock "cinder-quobyte-b0b4ae59-b11f-4b85-a77d-4519b933d1e1" released by "delete_volume" :: held 0.881s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 12:01:02 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-ea270279-d7ff-44a3-98b0-c30bdfa52b59 tempest-CreateVolumesFromImageTest-1244366109 None] Lock "cinder-ad482c0b-8f61-49e2-b20c-b6b2d6dfa8ed-delete_volume" released by "delete_volume" :: held 1.735s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 12:01:02 devstack cinder-volume[87116]: DEBUG cinder.quota [None req-de37bd2c-a292-4d8d-bb2a-f6fafbf2da29 tempest-CreateVolumesFromSourceVolumeTest-141026190 None] Created reservations ['36b7e7c3-2b67-4382-8162-934886a30364', '87661700-3065-4909-99e7-a5c3032a659c', 'db1969fc-12ed-4830-af69-217a9dfffeb2', 'cdc4013d-c227-4a96-adb2-7bc71770d9cc'] {{(pid=87116) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 12:01:02 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-de37bd2c-a292-4d8d-bb2a-f6fafbf2da29 tempest-CreateVolumesFromSourceVolumeTest-141026190 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 12:01:02 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-de37bd2c-a292-4d8d-bb2a-f6fafbf2da29 tempest-CreateVolumesFromSourceVolumeTest-141026190 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 12:01:02 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-de37bd2c-a292-4d8d-bb2a-f6fafbf2da29 tempest-CreateVolumesFromSourceVolumeTest-141026190 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 12:01:02 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-de37bd2c-a292-4d8d-bb2a-f6fafbf2da29 tempest-CreateVolumesFromSourceVolumeTest-141026190 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 12:01:02 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-de37bd2c-a292-4d8d-bb2a-f6fafbf2da29 tempest-CreateVolumesFromSourceVolumeTest-141026190 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 12:01:02 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-de37bd2c-a292-4d8d-bb2a-f6fafbf2da29 tempest-CreateVolumesFromSourceVolumeTest-141026190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 12:01:02 devstack sudo[106274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756 Nov 06 12:01:02 devstack sudo[106274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 12:01:02 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-27320c72-63a8-4a20-a3b1-ec82e1ab2a5c tempest-CreateVolumesFromSourceVolumeTest-141026190 None] Acquiring lock "cinder-9840bff3-e388-45ca-9233-14ec00ebeda0-delete_volume" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 12:01:02 devstack sudo[106266]: pam_unix(sudo:session): session closed for user root Nov 06 12:01:02 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-308f84ad-9e44-4050-b6d4-385471884003 tempest-VolumeDependencyTests-892718679 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-f8790c84-0fea-4fdd-8fed-8f7870effb49.4770c10c-8f9d-4eb5-bf49-4313c531e1cb" returned: 0 in 0.459s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 12:01:02 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-308f84ad-9e44-4050-b6d4-385471884003 tempest-VolumeDependencyTests-892718679 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f8790c84-0fea-4fdd-8fed-8f7870effb49(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87116) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 12:01:02 devstack sudo[106267]: pam_unix(sudo:session): session closed for user root Nov 06 12:01:02 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-abc9dfec-210d-4ba8-bacb-0e8c36a479ec tempest-VolumeAndVolumeTypeFromImageTest-1559663696 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_7b27872f-3678-471a-8e07-a573613df10e_wwad7w6ydevstack@QuobyteHD" returned: 0 in 0.442s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 12:01:02 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-abc9dfec-210d-4ba8-bacb-0e8c36a479ec tempest-VolumeAndVolumeTypeFromImageTest-1559663696 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7b27872f-3678-471a-8e07-a573613df10e_wwad7w6ydevstack@QuobyteHD {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 12:01:02 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-27320c72-63a8-4a20-a3b1-ec82e1ab2a5c tempest-CreateVolumesFromSourceVolumeTest-141026190 None] Lock "cinder-9840bff3-e388-45ca-9233-14ec00ebeda0-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 12:01:02 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[284299e7-6b94-4d44-ab19-371913d52826]: (4, 'qcow2') {{(pid=88420) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 12:01:02 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-308f84ad-9e44-4050-b6d4-385471884003 tempest-VolumeDependencyTests-892718679 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-f8790c84-0fea-4fdd-8fed-8f7870effb49 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 12:01:02 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-27320c72-63a8-4a20-a3b1-ec82e1ab2a5c tempest-CreateVolumesFromSourceVolumeTest-141026190 None] Acquiring lock "cinder-quobyte-9840bff3-e388-45ca-9233-14ec00ebeda0" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 12:01:02 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-27320c72-63a8-4a20-a3b1-ec82e1ab2a5c tempest-CreateVolumesFromSourceVolumeTest-141026190 None] Lock "cinder-quobyte-9840bff3-e388-45ca-9233-14ec00ebeda0" acquired by "delete_volume" :: waited 0.020s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 12:01:02 devstack sudo[106279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7b27872f-3678-471a-8e07-a573613df10e_wwad7w6ydevstack@QuobyteHD Nov 06 12:01:02 devstack sudo[106279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 12:01:02 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[57d58571-832f-40be-a247-4d48dfdbccb3]: (4, 'qcow2') {{(pid=88420) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 12:01:02 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-27320c72-63a8-4a20-a3b1-ec82e1ab2a5c tempest-CreateVolumesFromSourceVolumeTest-141026190 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-9840bff3-e388-45ca-9233-14ec00ebeda0 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 12:01:02 devstack sudo[106280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-f8790c84-0fea-4fdd-8fed-8f7870effb49 Nov 06 12:01:02 devstack sudo[106280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 12:01:02 devstack sudo[106274]: pam_unix(sudo:session): session closed for user root Nov 06 12:01:02 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-de37bd2c-a292-4d8d-bb2a-f6fafbf2da29 tempest-CreateVolumesFromSourceVolumeTest-141026190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756" returned: 0 in 0.382s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 12:01:02 devstack cinder-volume[87116]: DEBUG cinder.manager [None req-de37bd2c-a292-4d8d-bb2a-f6fafbf2da29 tempest-CreateVolumesFromSourceVolumeTest-141026190 None] Notifying Schedulers of capabilities ... {{(pid=87116) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 12:01:02 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-de37bd2c-a292-4d8d-bb2a-f6fafbf2da29 tempest-CreateVolumesFromSourceVolumeTest-141026190 None] Deleted volume successfully. Nov 06 12:01:02 devstack sudo[106282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-9840bff3-e388-45ca-9233-14ec00ebeda0 Nov 06 12:01:02 devstack sudo[106282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 12:01:02 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-de37bd2c-a292-4d8d-bb2a-f6fafbf2da29 tempest-CreateVolumesFromSourceVolumeTest-141026190 None] Lock "cinder-b0b4ae59-b11f-4b85-a77d-4519b933d1e1-delete_volume" released by "delete_volume" :: held 1.670s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 12:01:02 devstack sudo[106279]: pam_unix(sudo:session): session closed for user root Nov 06 12:01:02 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-abc9dfec-210d-4ba8-bacb-0e8c36a479ec tempest-VolumeAndVolumeTypeFromImageTest-1559663696 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7b27872f-3678-471a-8e07-a573613df10e_wwad7w6ydevstack@QuobyteHD" returned: 1 in 0.479s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 12:01:02 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-abc9dfec-210d-4ba8-bacb-0e8c36a479ec tempest-VolumeAndVolumeTypeFromImageTest-1559663696 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_7b27872f-3678-471a-8e07-a573613df10e_wwad7w6ydevstack@QuobyteHD' failed. Not Retrying. {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 06 12:01:02 devstack cinder-volume[87116]: DEBUG cinder.image.image_utils [None req-abc9dfec-210d-4ba8-bacb-0e8c36a479ec tempest-VolumeAndVolumeTypeFromImageTest-1559663696 None] 7b27872f-3678-471a-8e07-a573613df10e was raw, converting to qcow2 {{(pid=87116) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Nov 06 12:01:02 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-abc9dfec-210d-4ba8-bacb-0e8c36a479ec tempest-VolumeAndVolumeTypeFromImageTest-1559663696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_7b27872f-3678-471a-8e07-a573613df10e_wwad7w6ydevstack@QuobyteHD /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-45dd2432-9eab-4aa2-9a73-bad99e686c47 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 12:01:02 devstack sudo[106290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_7b27872f-3678-471a-8e07-a573613df10e_wwad7w6ydevstack@QuobyteHD /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-45dd2432-9eab-4aa2-9a73-bad99e686c47 Nov 06 12:01:02 devstack sudo[106290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 12:01:02 devstack sudo[106280]: pam_unix(sudo:session): session closed for user root Nov 06 12:01:02 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-308f84ad-9e44-4050-b6d4-385471884003 tempest-VolumeDependencyTests-892718679 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-f8790c84-0fea-4fdd-8fed-8f7870effb49" returned: 0 in 0.570s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 12:01:02 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-308f84ad-9e44-4050-b6d4-385471884003 tempest-VolumeDependencyTests-892718679 None] will copy from snapshot at /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-f8790c84-0fea-4fdd-8fed-8f7870effb49 {{(pid=87116) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 06 12:01:02 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-308f84ad-9e44-4050-b6d4-385471884003 tempest-VolumeDependencyTests-892718679 None] Creating direct copy from snapshot {{(pid=87116) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 06 12:01:03 devstack cinder-volume[87116]: DEBUG cinder.utils [None req-308f84ad-9e44-4050-b6d4-385471884003 tempest-VolumeDependencyTests-892718679 None] Path /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-049c7a65-bffc-4f08-b308-0998e46e4fed not found in is_blk_device check {{(pid=87116) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 06 12:01:03 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-308f84ad-9e44-4050-b6d4-385471884003 tempest-VolumeDependencyTests-892718679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-f8790c84-0fea-4fdd-8fed-8f7870effb49 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-049c7a65-bffc-4f08-b308-0998e46e4fed {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 12:01:03 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-27320c72-63a8-4a20-a3b1-ec82e1ab2a5c tempest-CreateVolumesFromSourceVolumeTest-141026190 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-9840bff3-e388-45ca-9233-14ec00ebeda0" returned: 0 in 0.591s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 12:01:03 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-27320c72-63a8-4a20-a3b1-ec82e1ab2a5c tempest-CreateVolumesFromSourceVolumeTest-141026190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-9840bff3-e388-45ca-9233-14ec00ebeda0 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 12:01:03 devstack sudo[106295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-f8790c84-0fea-4fdd-8fed-8f7870effb49 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-049c7a65-bffc-4f08-b308-0998e46e4fed Nov 06 12:01:03 devstack sudo[106295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 12:01:03 devstack sudo[106303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-9840bff3-e388-45ca-9233-14ec00ebeda0 Nov 06 12:01:03 devstack sudo[106303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 12:01:03 devstack sudo[106303]: pam_unix(sudo:session): session closed for user root Nov 06 12:01:03 devstack sudo[106290]: pam_unix(sudo:session): session closed for user root Nov 06 12:01:03 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-abc9dfec-210d-4ba8-bacb-0e8c36a479ec tempest-VolumeAndVolumeTypeFromImageTest-1559663696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_7b27872f-3678-471a-8e07-a573613df10e_wwad7w6ydevstack@QuobyteHD /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-45dd2432-9eab-4aa2-9a73-bad99e686c47" returned: 0 in 0.590s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 12:01:03 devstack cinder-volume[87116]: DEBUG cinder.image.image_utils [None req-abc9dfec-210d-4ba8-bacb-0e8c36a479ec tempest-VolumeAndVolumeTypeFromImageTest-1559663696 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_7b27872f-3678-471a-8e07-a573613df10e_wwad7w6ydevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-45dd2432-9eab-4aa2-9a73-bad99e686c47 {{(pid=87116) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 06 12:01:03 devstack cinder-volume[87116]: INFO cinder.image.image_utils [None req-abc9dfec-210d-4ba8-bacb-0e8c36a479ec tempest-VolumeAndVolumeTypeFromImageTest-1559663696 None] Converted 0.00 MB image at 0.00 MB/s Nov 06 12:01:03 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-abc9dfec-210d-4ba8-bacb-0e8c36a479ec tempest-VolumeAndVolumeTypeFromImageTest-1559663696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-45dd2432-9eab-4aa2-9a73-bad99e686c47 1G {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 12:01:03 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-27320c72-63a8-4a20-a3b1-ec82e1ab2a5c tempest-CreateVolumesFromSourceVolumeTest-141026190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-9840bff3-e388-45ca-9233-14ec00ebeda0" returned: 0 in 0.351s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 12:01:03 devstack sudo[106313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-45dd2432-9eab-4aa2-9a73-bad99e686c47 1G Nov 06 12:01:03 devstack sudo[106313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 12:01:03 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-27320c72-63a8-4a20-a3b1-ec82e1ab2a5c tempest-CreateVolumesFromSourceVolumeTest-141026190 None] Lock "cinder-quobyte-9840bff3-e388-45ca-9233-14ec00ebeda0" released by "delete_volume" :: held 1.013s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 12:01:03 devstack cinder-volume[87116]: DEBUG cinder.quota [None req-27320c72-63a8-4a20-a3b1-ec82e1ab2a5c tempest-CreateVolumesFromSourceVolumeTest-141026190 None] Created reservations ['913161fd-2fa4-4495-8eea-5d998084b60b', 'c1d4920f-0eb5-4480-b2d0-44c985e8ef2d', 'fe65bb8f-fae4-44cf-a214-5c81a8a7f30a', 'e76d5d7b-bd14-46c8-9930-9ed234d4649d'] {{(pid=87116) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 12:01:03 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-27320c72-63a8-4a20-a3b1-ec82e1ab2a5c tempest-CreateVolumesFromSourceVolumeTest-141026190 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 12:01:03 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-27320c72-63a8-4a20-a3b1-ec82e1ab2a5c tempest-CreateVolumesFromSourceVolumeTest-141026190 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 12:01:03 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-27320c72-63a8-4a20-a3b1-ec82e1ab2a5c tempest-CreateVolumesFromSourceVolumeTest-141026190 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 12:01:03 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-27320c72-63a8-4a20-a3b1-ec82e1ab2a5c tempest-CreateVolumesFromSourceVolumeTest-141026190 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 12:01:03 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-27320c72-63a8-4a20-a3b1-ec82e1ab2a5c tempest-CreateVolumesFromSourceVolumeTest-141026190 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 12:01:03 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-27320c72-63a8-4a20-a3b1-ec82e1ab2a5c tempest-CreateVolumesFromSourceVolumeTest-141026190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 12:01:03 devstack sudo[106323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756 Nov 06 12:01:03 devstack sudo[106323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 12:01:04 devstack sudo[106313]: pam_unix(sudo:session): session closed for user root Nov 06 12:01:04 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-abc9dfec-210d-4ba8-bacb-0e8c36a479ec tempest-VolumeAndVolumeTypeFromImageTest-1559663696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-45dd2432-9eab-4aa2-9a73-bad99e686c47 1G" returned: 0 in 0.671s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 12:01:04 devstack cinder-volume[87116]: DEBUG cinder.volume.volume_utils [None req-abc9dfec-210d-4ba8-bacb-0e8c36a479ec tempest-VolumeAndVolumeTypeFromImageTest-1559663696 None] Downloaded image 7b27872f-3678-471a-8e07-a573613df10e ((None, [{'url': 'file:///opt/stack/data/glance/images/7b27872f-3678-471a-8e07-a573613df10e', 'metadata': {}}])) to volume 45dd2432-9eab-4aa2-9a73-bad99e686c47 successfully. {{(pid=87116) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Nov 06 12:01:04 devstack cinder-volume[87116]: DEBUG cinder.image.image_utils [None req-abc9dfec-210d-4ba8-bacb-0e8c36a479ec tempest-VolumeAndVolumeTypeFromImageTest-1559663696 None] Temporary image 7b27872f-3678-471a-8e07-a573613df10e for user 9241a8d97a784ecb84f6b02e74d40e02 is deleted. {{(pid=87116) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Nov 06 12:01:04 devstack cinder-volume[87116]: DEBUG cinder.volume.volume_utils [None req-abc9dfec-210d-4ba8-bacb-0e8c36a479ec tempest-VolumeAndVolumeTypeFromImageTest-1559663696 None] Marking volume 45dd2432-9eab-4aa2-9a73-bad99e686c47 as bootable. {{(pid=87116) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Nov 06 12:01:04 devstack cinder-volume[87116]: DEBUG cinder.volume.flows.manager.create_volume [None req-abc9dfec-210d-4ba8-bacb-0e8c36a479ec tempest-VolumeAndVolumeTypeFromImageTest-1559663696 None] Copying metadata from image 7b27872f-3678-471a-8e07-a573613df10e to 45dd2432-9eab-4aa2-9a73-bad99e686c47. {{(pid=87116) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Nov 06 12:01:04 devstack cinder-volume[87116]: DEBUG cinder.volume.flows.manager.create_volume [None req-abc9dfec-210d-4ba8-bacb-0e8c36a479ec tempest-VolumeAndVolumeTypeFromImageTest-1559663696 None] Creating volume glance metadata for volume 45dd2432-9eab-4aa2-9a73-bad99e686c47 backed by image 7b27872f-3678-471a-8e07-a573613df10e with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '7b27872f-3678-471a-8e07-a573613df10e', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '78cacfa693d0b1d21520ae0ef44312dd', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87116) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Nov 06 12:01:04 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-abc9dfec-210d-4ba8-bacb-0e8c36a479ec tempest-VolumeAndVolumeTypeFromImageTest-1559663696 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e182951f-caf4-44ea-8e49-6246c0ed997b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-45dd2432-9eab-4aa2-9a73-bad99e686c47', 'volume_size': 1, 'image_id': '7b27872f-3678-471a-8e07-a573613df10e', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/7b27872f-3678-471a-8e07-a573613df10e', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '78cacfa693d0b1d21520ae0ef44312dd', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '99d6df4d85a74ec6a44093feb2aa49bd', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '238dd91e50d76b35b0905505389b130ac2d8aa30df090053e7983f6ddf4b9cb544843105dd1b52e31ad76d7deb653e95477301c82cbb1d9049f1f6bc341f9ce6', 'id': '7b27872f-3678-471a-8e07-a573613df10e', 'created_at': datetime.datetime(2026, 11, 6, 11, 0, 49, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 6, 11, 0, 51, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/7b27872f-3678-471a-8e07-a573613df10e/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 12:01:04 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-abc9dfec-210d-4ba8-bacb-0e8c36a479ec tempest-VolumeAndVolumeTypeFromImageTest-1559663696 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b4e23854-1ad9-446b-a0f5-504d82f1d0c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 12:01:04 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-abc9dfec-210d-4ba8-bacb-0e8c36a479ec tempest-VolumeAndVolumeTypeFromImageTest-1559663696 None] Volume volume-45dd2432-9eab-4aa2-9a73-bad99e686c47 (45dd2432-9eab-4aa2-9a73-bad99e686c47): created successfully Nov 06 12:01:04 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-abc9dfec-210d-4ba8-bacb-0e8c36a479ec tempest-VolumeAndVolumeTypeFromImageTest-1559663696 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b4e23854-1ad9-446b-a0f5-504d82f1d0c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 12:01:04 devstack sudo[106323]: pam_unix(sudo:session): session closed for user root Nov 06 12:01:04 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-abc9dfec-210d-4ba8-bacb-0e8c36a479ec tempest-VolumeAndVolumeTypeFromImageTest-1559663696 None] Flow 'volume_create_manager' (4298fc45-baf2-4eb1-8897-82e272a2e6ae) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 12:01:04 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-27320c72-63a8-4a20-a3b1-ec82e1ab2a5c tempest-CreateVolumesFromSourceVolumeTest-141026190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756" returned: 0 in 0.603s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 12:01:04 devstack cinder-volume[87116]: DEBUG cinder.manager [None req-27320c72-63a8-4a20-a3b1-ec82e1ab2a5c tempest-CreateVolumesFromSourceVolumeTest-141026190 None] Notifying Schedulers of capabilities ... {{(pid=87116) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 12:01:04 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-27320c72-63a8-4a20-a3b1-ec82e1ab2a5c tempest-CreateVolumesFromSourceVolumeTest-141026190 None] Deleted volume successfully. Nov 06 12:01:04 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-abc9dfec-210d-4ba8-bacb-0e8c36a479ec tempest-VolumeAndVolumeTypeFromImageTest-1559663696 None] Created volume successfully. Nov 06 12:01:04 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-27320c72-63a8-4a20-a3b1-ec82e1ab2a5c tempest-CreateVolumesFromSourceVolumeTest-141026190 None] Lock "cinder-9840bff3-e388-45ca-9233-14ec00ebeda0-delete_volume" released by "delete_volume" :: held 2.064s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 12:01:04 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-36d35206-36ad-4bc3-8ad1-d502483ddd6c tempest-CreateVolumesFromSourceVolumeTest-141026190 None] Acquiring lock "cinder-a9365c8a-df8b-4e6c-9e3a-6609627f75f9-delete_volume" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 12:01:04 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-36d35206-36ad-4bc3-8ad1-d502483ddd6c tempest-CreateVolumesFromSourceVolumeTest-141026190 None] Lock "cinder-a9365c8a-df8b-4e6c-9e3a-6609627f75f9-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 12:01:04 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-36d35206-36ad-4bc3-8ad1-d502483ddd6c tempest-CreateVolumesFromSourceVolumeTest-141026190 None] Acquiring lock "cinder-quobyte-a9365c8a-df8b-4e6c-9e3a-6609627f75f9" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 12:01:04 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-36d35206-36ad-4bc3-8ad1-d502483ddd6c tempest-CreateVolumesFromSourceVolumeTest-141026190 None] Lock "cinder-quobyte-a9365c8a-df8b-4e6c-9e3a-6609627f75f9" acquired by "delete_volume" :: waited 0.023s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 12:01:04 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[b94d3057-861d-4a2f-b3c9-1ae67ad89939]: (4, 'qcow2') {{(pid=88420) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 12:01:04 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-36d35206-36ad-4bc3-8ad1-d502483ddd6c tempest-CreateVolumesFromSourceVolumeTest-141026190 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-a9365c8a-df8b-4e6c-9e3a-6609627f75f9 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 12:01:05 devstack sudo[106329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-a9365c8a-df8b-4e6c-9e3a-6609627f75f9 Nov 06 12:01:05 devstack sudo[106329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 12:01:05 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-d9fc8019-50df-49db-be3d-a5d685ca6508 tempest-VolumeAndVolumeTypeFromImageTest-1559663696 None] Acquiring lock "cinder-45dd2432-9eab-4aa2-9a73-bad99e686c47-delete_volume" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 12:01:05 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-d9fc8019-50df-49db-be3d-a5d685ca6508 tempest-VolumeAndVolumeTypeFromImageTest-1559663696 None] Lock "cinder-45dd2432-9eab-4aa2-9a73-bad99e686c47-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 12:01:05 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-d9fc8019-50df-49db-be3d-a5d685ca6508 tempest-VolumeAndVolumeTypeFromImageTest-1559663696 None] Acquiring lock "cinder-quobyte-45dd2432-9eab-4aa2-9a73-bad99e686c47" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 12:01:05 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-d9fc8019-50df-49db-be3d-a5d685ca6508 tempest-VolumeAndVolumeTypeFromImageTest-1559663696 None] Lock "cinder-quobyte-45dd2432-9eab-4aa2-9a73-bad99e686c47" acquired by "delete_volume" :: waited 0.029s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 12:01:05 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[6730db44-bbbb-4b07-9089-c73ef39af3a1]: (4, 'qcow2') {{(pid=88420) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 12:01:05 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-d9fc8019-50df-49db-be3d-a5d685ca6508 tempest-VolumeAndVolumeTypeFromImageTest-1559663696 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-45dd2432-9eab-4aa2-9a73-bad99e686c47 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 12:01:05 devstack sudo[106331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-45dd2432-9eab-4aa2-9a73-bad99e686c47 Nov 06 12:01:05 devstack sudo[106331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 12:01:05 devstack sudo[106329]: pam_unix(sudo:session): session closed for user root Nov 06 12:01:05 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-36d35206-36ad-4bc3-8ad1-d502483ddd6c tempest-CreateVolumesFromSourceVolumeTest-141026190 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-a9365c8a-df8b-4e6c-9e3a-6609627f75f9" returned: 0 in 0.909s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 12:01:05 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-36d35206-36ad-4bc3-8ad1-d502483ddd6c tempest-CreateVolumesFromSourceVolumeTest-141026190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-a9365c8a-df8b-4e6c-9e3a-6609627f75f9 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 12:01:05 devstack sudo[106336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-a9365c8a-df8b-4e6c-9e3a-6609627f75f9 Nov 06 12:01:05 devstack sudo[106336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 12:01:06 devstack sudo[106331]: pam_unix(sudo:session): session closed for user root Nov 06 12:01:06 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-d9fc8019-50df-49db-be3d-a5d685ca6508 tempest-VolumeAndVolumeTypeFromImageTest-1559663696 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-45dd2432-9eab-4aa2-9a73-bad99e686c47" returned: 0 in 0.681s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 12:01:06 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-d9fc8019-50df-49db-be3d-a5d685ca6508 tempest-VolumeAndVolumeTypeFromImageTest-1559663696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-45dd2432-9eab-4aa2-9a73-bad99e686c47 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 12:01:06 devstack sudo[106341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-45dd2432-9eab-4aa2-9a73-bad99e686c47 Nov 06 12:01:06 devstack sudo[106341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 12:01:06 devstack sudo[106336]: pam_unix(sudo:session): session closed for user root Nov 06 12:01:06 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-36d35206-36ad-4bc3-8ad1-d502483ddd6c tempest-CreateVolumesFromSourceVolumeTest-141026190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-a9365c8a-df8b-4e6c-9e3a-6609627f75f9" returned: 0 in 0.479s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 12:01:06 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-36d35206-36ad-4bc3-8ad1-d502483ddd6c tempest-CreateVolumesFromSourceVolumeTest-141026190 None] Lock "cinder-quobyte-a9365c8a-df8b-4e6c-9e3a-6609627f75f9" released by "delete_volume" :: held 1.492s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 12:01:06 devstack cinder-volume[87116]: DEBUG cinder.quota [None req-36d35206-36ad-4bc3-8ad1-d502483ddd6c tempest-CreateVolumesFromSourceVolumeTest-141026190 None] Created reservations ['c06b500c-2bd1-4104-821c-565a0dece741', 'f7dc4a33-b7f0-4658-aabe-1e2bc85e3875', 'e18c4387-e3de-4e48-b8dc-ec93cb4ff3fc', '2a345f29-753c-4ced-a238-a25bd2480a8f'] {{(pid=87116) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 12:01:06 devstack sudo[106341]: pam_unix(sudo:session): session closed for user root Nov 06 12:01:06 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-d9fc8019-50df-49db-be3d-a5d685ca6508 tempest-VolumeAndVolumeTypeFromImageTest-1559663696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-45dd2432-9eab-4aa2-9a73-bad99e686c47" returned: 0 in 0.416s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 12:01:06 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-d9fc8019-50df-49db-be3d-a5d685ca6508 tempest-VolumeAndVolumeTypeFromImageTest-1559663696 None] Lock "cinder-quobyte-45dd2432-9eab-4aa2-9a73-bad99e686c47" released by "delete_volume" :: held 1.188s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 12:01:06 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-36d35206-36ad-4bc3-8ad1-d502483ddd6c tempest-CreateVolumesFromSourceVolumeTest-141026190 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 12:01:06 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-36d35206-36ad-4bc3-8ad1-d502483ddd6c tempest-CreateVolumesFromSourceVolumeTest-141026190 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 12:01:06 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-36d35206-36ad-4bc3-8ad1-d502483ddd6c tempest-CreateVolumesFromSourceVolumeTest-141026190 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 12:01:06 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-36d35206-36ad-4bc3-8ad1-d502483ddd6c tempest-CreateVolumesFromSourceVolumeTest-141026190 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 12:01:06 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-36d35206-36ad-4bc3-8ad1-d502483ddd6c tempest-CreateVolumesFromSourceVolumeTest-141026190 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 12:01:06 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-36d35206-36ad-4bc3-8ad1-d502483ddd6c tempest-CreateVolumesFromSourceVolumeTest-141026190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 12:01:06 devstack sudo[106345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756 Nov 06 12:01:06 devstack sudo[106345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 12:01:06 devstack cinder-volume[87116]: DEBUG cinder.quota [None req-d9fc8019-50df-49db-be3d-a5d685ca6508 tempest-VolumeAndVolumeTypeFromImageTest-1559663696 None] Created reservations ['16d36d1f-c58b-48da-817b-ea920d17a8b0', 'e49b9d97-1aed-4905-a977-1158db10ebc9', '58ca58a4-e20b-4708-a4d1-de0d054209bb', 'bcf53a4a-a3c0-4921-8440-14d009c5c8ca'] {{(pid=87116) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 12:01:06 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-d9fc8019-50df-49db-be3d-a5d685ca6508 tempest-VolumeAndVolumeTypeFromImageTest-1559663696 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 12:01:06 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-d9fc8019-50df-49db-be3d-a5d685ca6508 tempest-VolumeAndVolumeTypeFromImageTest-1559663696 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 12:01:06 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-d9fc8019-50df-49db-be3d-a5d685ca6508 tempest-VolumeAndVolumeTypeFromImageTest-1559663696 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 12:01:06 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-d9fc8019-50df-49db-be3d-a5d685ca6508 tempest-VolumeAndVolumeTypeFromImageTest-1559663696 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 12:01:06 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-d9fc8019-50df-49db-be3d-a5d685ca6508 tempest-VolumeAndVolumeTypeFromImageTest-1559663696 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 12:01:06 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-d9fc8019-50df-49db-be3d-a5d685ca6508 tempest-VolumeAndVolumeTypeFromImageTest-1559663696 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 12:01:06 devstack sudo[106347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756 Nov 06 12:01:06 devstack sudo[106347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 12:01:07 devstack sudo[106345]: pam_unix(sudo:session): session closed for user root Nov 06 12:01:07 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-5b49d904-8b68-42f4-b015-57ca992b713a tempest-CreateVolumesFromSourceVolumeTest-141026190 None] Acquiring lock "cinder-c9b9e74c-3b17-4f15-b83a-e391b682cada-delete_volume" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 12:01:07 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-36d35206-36ad-4bc3-8ad1-d502483ddd6c tempest-CreateVolumesFromSourceVolumeTest-141026190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756" returned: 0 in 0.606s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 12:01:07 devstack cinder-volume[87116]: DEBUG cinder.manager [None req-36d35206-36ad-4bc3-8ad1-d502483ddd6c tempest-CreateVolumesFromSourceVolumeTest-141026190 None] Notifying Schedulers of capabilities ... {{(pid=87116) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 12:01:07 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-36d35206-36ad-4bc3-8ad1-d502483ddd6c tempest-CreateVolumesFromSourceVolumeTest-141026190 None] Deleted volume successfully. Nov 06 12:01:07 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-5b49d904-8b68-42f4-b015-57ca992b713a tempest-CreateVolumesFromSourceVolumeTest-141026190 None] Lock "cinder-c9b9e74c-3b17-4f15-b83a-e391b682cada-delete_volume" acquired by "delete_volume" :: waited 0.075s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 12:01:07 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-36d35206-36ad-4bc3-8ad1-d502483ddd6c tempest-CreateVolumesFromSourceVolumeTest-141026190 None] Lock "cinder-a9365c8a-df8b-4e6c-9e3a-6609627f75f9-delete_volume" released by "delete_volume" :: held 2.634s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 12:01:07 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-5b49d904-8b68-42f4-b015-57ca992b713a tempest-CreateVolumesFromSourceVolumeTest-141026190 None] Acquiring lock "cinder-quobyte-c9b9e74c-3b17-4f15-b83a-e391b682cada" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 12:01:07 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-5b49d904-8b68-42f4-b015-57ca992b713a tempest-CreateVolumesFromSourceVolumeTest-141026190 None] Lock "cinder-quobyte-c9b9e74c-3b17-4f15-b83a-e391b682cada" acquired by "delete_volume" :: waited 0.039s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 12:01:07 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[76711675-0406-4fed-999e-80bf045a9dac]: (4, 'qcow2') {{(pid=88420) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 12:01:07 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-5b49d904-8b68-42f4-b015-57ca992b713a tempest-CreateVolumesFromSourceVolumeTest-141026190 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-c9b9e74c-3b17-4f15-b83a-e391b682cada {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 12:01:07 devstack sudo[106347]: pam_unix(sudo:session): session closed for user root Nov 06 12:01:07 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-d9fc8019-50df-49db-be3d-a5d685ca6508 tempest-VolumeAndVolumeTypeFromImageTest-1559663696 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756" returned: 0 in 0.672s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 12:01:07 devstack cinder-volume[87116]: DEBUG cinder.manager [None req-d9fc8019-50df-49db-be3d-a5d685ca6508 tempest-VolumeAndVolumeTypeFromImageTest-1559663696 None] Notifying Schedulers of capabilities ... {{(pid=87116) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 12:01:07 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-d9fc8019-50df-49db-be3d-a5d685ca6508 tempest-VolumeAndVolumeTypeFromImageTest-1559663696 None] Deleted volume successfully. Nov 06 12:01:07 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-d9fc8019-50df-49db-be3d-a5d685ca6508 tempest-VolumeAndVolumeTypeFromImageTest-1559663696 None] Lock "cinder-45dd2432-9eab-4aa2-9a73-bad99e686c47-delete_volume" released by "delete_volume" :: held 2.399s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 12:01:07 devstack sudo[106351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-c9b9e74c-3b17-4f15-b83a-e391b682cada Nov 06 12:01:07 devstack sudo[106351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 12:01:08 devstack sudo[106351]: pam_unix(sudo:session): session closed for user root Nov 06 12:01:08 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-5b49d904-8b68-42f4-b015-57ca992b713a tempest-CreateVolumesFromSourceVolumeTest-141026190 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-c9b9e74c-3b17-4f15-b83a-e391b682cada" returned: 0 in 0.761s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 12:01:08 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-5b49d904-8b68-42f4-b015-57ca992b713a tempest-CreateVolumesFromSourceVolumeTest-141026190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-c9b9e74c-3b17-4f15-b83a-e391b682cada {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 12:01:08 devstack sudo[106357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-c9b9e74c-3b17-4f15-b83a-e391b682cada Nov 06 12:01:08 devstack sudo[106357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 12:01:08 devstack sudo[106357]: pam_unix(sudo:session): session closed for user root Nov 06 12:01:08 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-5b49d904-8b68-42f4-b015-57ca992b713a tempest-CreateVolumesFromSourceVolumeTest-141026190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-c9b9e74c-3b17-4f15-b83a-e391b682cada" returned: 0 in 0.516s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 12:01:08 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-5b49d904-8b68-42f4-b015-57ca992b713a tempest-CreateVolumesFromSourceVolumeTest-141026190 None] Lock "cinder-quobyte-c9b9e74c-3b17-4f15-b83a-e391b682cada" released by "delete_volume" :: held 1.372s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 12:01:08 devstack cinder-volume[87116]: DEBUG cinder.quota [None req-5b49d904-8b68-42f4-b015-57ca992b713a tempest-CreateVolumesFromSourceVolumeTest-141026190 None] Created reservations ['eaa0fa0d-8d13-49d9-8fc0-7fd0bf730d16', '64bbea85-098d-4799-8bfc-aeabfb344014', '3a949e2b-1dc2-429c-bd39-057f3656f0e8', 'fd8b4faf-88ec-4d5f-9c54-41a9d920e142'] {{(pid=87116) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 12:01:09 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-5b49d904-8b68-42f4-b015-57ca992b713a tempest-CreateVolumesFromSourceVolumeTest-141026190 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 12:01:09 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-5b49d904-8b68-42f4-b015-57ca992b713a tempest-CreateVolumesFromSourceVolumeTest-141026190 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 12:01:09 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-5b49d904-8b68-42f4-b015-57ca992b713a tempest-CreateVolumesFromSourceVolumeTest-141026190 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 12:01:09 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-5b49d904-8b68-42f4-b015-57ca992b713a tempest-CreateVolumesFromSourceVolumeTest-141026190 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 12:01:09 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-5b49d904-8b68-42f4-b015-57ca992b713a tempest-CreateVolumesFromSourceVolumeTest-141026190 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 12:01:09 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-5b49d904-8b68-42f4-b015-57ca992b713a tempest-CreateVolumesFromSourceVolumeTest-141026190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 12:01:09 devstack sudo[106360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756 Nov 06 12:01:09 devstack sudo[106360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 12:01:09 devstack sudo[106360]: pam_unix(sudo:session): session closed for user root Nov 06 12:01:09 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-5b49d904-8b68-42f4-b015-57ca992b713a tempest-CreateVolumesFromSourceVolumeTest-141026190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756" returned: 0 in 0.477s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 12:01:09 devstack cinder-volume[87116]: DEBUG cinder.manager [None req-5b49d904-8b68-42f4-b015-57ca992b713a tempest-CreateVolumesFromSourceVolumeTest-141026190 None] Notifying Schedulers of capabilities ... {{(pid=87116) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 12:01:09 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-5b49d904-8b68-42f4-b015-57ca992b713a tempest-CreateVolumesFromSourceVolumeTest-141026190 None] Deleted volume successfully. Nov 06 12:01:09 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-5b49d904-8b68-42f4-b015-57ca992b713a tempest-CreateVolumesFromSourceVolumeTest-141026190 None] Lock "cinder-c9b9e74c-3b17-4f15-b83a-e391b682cada-delete_volume" released by "delete_volume" :: held 2.378s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 12:01:12 devstack sudo[106295]: pam_unix(sudo:session): session closed for user root Nov 06 12:01:12 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-308f84ad-9e44-4050-b6d4-385471884003 tempest-VolumeDependencyTests-892718679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-f8790c84-0fea-4fdd-8fed-8f7870effb49 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-049c7a65-bffc-4f08-b308-0998e46e4fed" returned: 0 in 9.165s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 12:01:12 devstack cinder-volume[87116]: DEBUG cinder.image.image_utils [None req-308f84ad-9e44-4050-b6d4-385471884003 tempest-VolumeDependencyTests-892718679 None] Image conversion details: src /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-f8790c84-0fea-4fdd-8fed-8f7870effb49, size 1024.00 MB, duration 9.17 sec, destination /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-049c7a65-bffc-4f08-b308-0998e46e4fed {{(pid=87116) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 06 12:01:12 devstack cinder-volume[87116]: INFO cinder.image.image_utils [None req-308f84ad-9e44-4050-b6d4-385471884003 tempest-VolumeDependencyTests-892718679 None] Converted 1024.00 MB image at 111.70 MB/s Nov 06 12:01:12 devstack cinder-volume[87116]: WARNING cinder.volume.drivers.remotefs [None req-308f84ad-9e44-4050-b6d4-385471884003 tempest-VolumeDependencyTests-892718679 None] /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-049c7a65-bffc-4f08-b308-0998e46e4fed is being set with open permissions: ugo+rw Nov 06 12:01:12 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-308f84ad-9e44-4050-b6d4-385471884003 tempest-VolumeDependencyTests-892718679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-049c7a65-bffc-4f08-b308-0998e46e4fed {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 12:01:12 devstack sudo[106363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-049c7a65-bffc-4f08-b308-0998e46e4fed Nov 06 12:01:12 devstack sudo[106363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 12:01:12 devstack sudo[106363]: pam_unix(sudo:session): session closed for user root Nov 06 12:01:12 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-308f84ad-9e44-4050-b6d4-385471884003 tempest-VolumeDependencyTests-892718679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-049c7a65-bffc-4f08-b308-0998e46e4fed" returned: 0 in 0.292s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 12:01:12 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-308f84ad-9e44-4050-b6d4-385471884003 tempest-VolumeDependencyTests-892718679 None] Lock "cinder-quobyte-049c7a65-bffc-4f08-b308-0998e46e4fed" released by "_copy_volume_from_snapshot" :: held 10.673s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 12:01:12 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-308f84ad-9e44-4050-b6d4-385471884003 tempest-VolumeDependencyTests-892718679 None] Lock "cinder-quobyte-4770c10c-8f9d-4eb5-bf49-4313c531e1cb-049c7a65-bffc-4f08-b308-0998e46e4fed" released by "_create_volume_from_snapshot" :: held 10.778s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 12:01:12 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-308f84ad-9e44-4050-b6d4-385471884003 tempest-VolumeDependencyTests-892718679 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.805s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 12:01:12 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-308f84ad-9e44-4050-b6d4-385471884003 tempest-VolumeDependencyTests-892718679 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5753cc0f-f6a7-4706-b14c-4040cb5f3771) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-049c7a65-bffc-4f08-b308-0998e46e4fed', 'volume_size': 1, 'snapshot_id': '4770c10c-8f9d-4eb5-bf49-4313c531e1cb'}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 12:01:12 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-308f84ad-9e44-4050-b6d4-385471884003 tempest-VolumeDependencyTests-892718679 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c174aaa2-af04-4625-aed0-6f77097db324) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 12:01:12 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-308f84ad-9e44-4050-b6d4-385471884003 tempest-VolumeDependencyTests-892718679 None] Volume volume-049c7a65-bffc-4f08-b308-0998e46e4fed (049c7a65-bffc-4f08-b308-0998e46e4fed): created successfully Nov 06 12:01:12 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-308f84ad-9e44-4050-b6d4-385471884003 tempest-VolumeDependencyTests-892718679 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c174aaa2-af04-4625-aed0-6f77097db324) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 12:01:12 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-308f84ad-9e44-4050-b6d4-385471884003 tempest-VolumeDependencyTests-892718679 None] Flow 'volume_create_manager' (d0166626-6132-424b-ad1e-a8246e78456a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 12:01:12 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-308f84ad-9e44-4050-b6d4-385471884003 tempest-VolumeDependencyTests-892718679 None] Created volume successfully. Nov 06 12:01:12 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-8d53d2cf-d649-47c2-92c0-75ce17ab50e7 tempest-VolumeDependencyTests-892718679 None] Acquiring lock "cinder-4770c10c-8f9d-4eb5-bf49-4313c531e1cb-delete_snapshot" by "delete_snapshot" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 12:01:12 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-8d53d2cf-d649-47c2-92c0-75ce17ab50e7 tempest-VolumeDependencyTests-892718679 None] Lock "cinder-4770c10c-8f9d-4eb5-bf49-4313c531e1cb-delete_snapshot" acquired by "delete_snapshot" :: waited 0.040s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 12:01:12 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-8d53d2cf-d649-47c2-92c0-75ce17ab50e7 tempest-VolumeDependencyTests-892718679 None] Acquiring lock "cinder-quobyte-f8790c84-0fea-4fdd-8fed-8f7870effb49" by "delete_snapshot" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 12:01:12 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-8d53d2cf-d649-47c2-92c0-75ce17ab50e7 tempest-VolumeDependencyTests-892718679 None] Lock "cinder-quobyte-f8790c84-0fea-4fdd-8fed-8f7870effb49" acquired by "delete_snapshot" :: waited 0.040s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 12:01:12 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-8d53d2cf-d649-47c2-92c0-75ce17ab50e7 tempest-VolumeDependencyTests-892718679 None] Acquiring lock "cinder-quobyte-4770c10c-8f9d-4eb5-bf49-4313c531e1cb" by "_delete_snapshot" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 12:01:12 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-8d53d2cf-d649-47c2-92c0-75ce17ab50e7 tempest-VolumeDependencyTests-892718679 None] Lock "cinder-quobyte-4770c10c-8f9d-4eb5-bf49-4313c531e1cb" acquired by "_delete_snapshot" :: waited 0.030s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 12:01:12 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-8d53d2cf-d649-47c2-92c0-75ce17ab50e7 tempest-VolumeDependencyTests-892718679 None] Deleting offline snapshot 4770c10c-8f9d-4eb5-bf49-4313c531e1cb of volume f8790c84-0fea-4fdd-8fed-8f7870effb49 {{(pid=87116) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 06 12:01:12 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-8d53d2cf-d649-47c2-92c0-75ce17ab50e7 tempest-VolumeDependencyTests-892718679 None] snapshot_file for this snap is: volume-f8790c84-0fea-4fdd-8fed-8f7870effb49.4770c10c-8f9d-4eb5-bf49-4313c531e1cb {{(pid=87116) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 06 12:01:12 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0486a5e-461c-44c3-b4ec-f3773551350b]: (4, 'qcow2') {{(pid=88420) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 12:01:12 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-8d53d2cf-d649-47c2-92c0-75ce17ab50e7 tempest-VolumeDependencyTests-892718679 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-f8790c84-0fea-4fdd-8fed-8f7870effb49.4770c10c-8f9d-4eb5-bf49-4313c531e1cb {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 12:01:13 devstack sudo[106368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-f8790c84-0fea-4fdd-8fed-8f7870effb49.4770c10c-8f9d-4eb5-bf49-4313c531e1cb Nov 06 12:01:13 devstack sudo[106368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 12:01:13 devstack sudo[106368]: pam_unix(sudo:session): session closed for user root Nov 06 12:01:13 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-8d53d2cf-d649-47c2-92c0-75ce17ab50e7 tempest-VolumeDependencyTests-892718679 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-f8790c84-0fea-4fdd-8fed-8f7870effb49.4770c10c-8f9d-4eb5-bf49-4313c531e1cb" returned: 0 in 0.433s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 12:01:13 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-8d53d2cf-d649-47c2-92c0-75ce17ab50e7 tempest-VolumeDependencyTests-892718679 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f8790c84-0fea-4fdd-8fed-8f7870effb49(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87116) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 12:01:13 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fe08f2c-45d2-4567-94ad-9b5ccc1a63f1]: (4, 'qcow2') {{(pid=88420) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 12:01:13 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-8d53d2cf-d649-47c2-92c0-75ce17ab50e7 tempest-VolumeDependencyTests-892718679 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-f8790c84-0fea-4fdd-8fed-8f7870effb49 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 12:01:13 devstack sudo[106373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-f8790c84-0fea-4fdd-8fed-8f7870effb49 Nov 06 12:01:13 devstack sudo[106373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 12:01:14 devstack cinder-volume[87116]: DEBUG cinder.volume.flows.manager.create_volume [None req-f78b830e-5975-42d4-aadf-da4b18b4c16d tempest-VolumeImageDependencyTests-1267764821 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87116) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 12:01:14 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-f78b830e-5975-42d4-aadf-da4b18b4c16d tempest-VolumeImageDependencyTests-1267764821 None] Flow 'volume_create_manager' (aa9dbf4f-5f75-4232-94b7-32fe7a04cc7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 12:01:14 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-f78b830e-5975-42d4-aadf-da4b18b4c16d tempest-VolumeImageDependencyTests-1267764821 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5e863452-dbc9-47dd-9a4e-ccccf15d39b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 12:01:14 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-f78b830e-5975-42d4-aadf-da4b18b4c16d tempest-VolumeImageDependencyTests-1267764821 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5e863452-dbc9-47dd-9a4e-ccccf15d39b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T11:01:14Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e731f3f1-a321-4803-a5e8-0ee2d57e8508,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4e4b0f1a3bce4dfe80671f0b0f109f48',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T11:01:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T11:01:14Z,use_quota=True,user_id='f75394d660c94433962dcec4711ca6a0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(34d3b144-d9b7-480a-a2e3-01e45f3d54c1),volume_type_id=34d3b144-d9b7-480a-a2e3-01e45f3d54c1)' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 12:01:14 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-f78b830e-5975-42d4-aadf-da4b18b4c16d tempest-VolumeImageDependencyTests-1267764821 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8d050715-cac0-4af5-841e-49e63ff15473) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 12:01:14 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-f78b830e-5975-42d4-aadf-da4b18b4c16d tempest-VolumeImageDependencyTests-1267764821 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8d050715-cac0-4af5-841e-49e63ff15473) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 12:01:14 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-f78b830e-5975-42d4-aadf-da4b18b4c16d tempest-VolumeImageDependencyTests-1267764821 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7bd54bd9-76d1-4230-bbcc-b2eccdf2825d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 12:01:14 devstack cinder-volume[87116]: DEBUG cinder.image.glance [None req-f78b830e-5975-42d4-aadf-da4b18b4c16d tempest-VolumeImageDependencyTests-1267764821 None] Creating Keystone auth plugin from conf {{(pid=87116) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 06 12:01:14 devstack sudo[106373]: pam_unix(sudo:session): session closed for user root Nov 06 12:01:14 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-8d53d2cf-d649-47c2-92c0-75ce17ab50e7 tempest-VolumeDependencyTests-892718679 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-f8790c84-0fea-4fdd-8fed-8f7870effb49" returned: 0 in 0.695s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 12:01:14 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-8d53d2cf-d649-47c2-92c0-75ce17ab50e7 tempest-VolumeDependencyTests-892718679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-f8790c84-0fea-4fdd-8fed-8f7870effb49.4770c10c-8f9d-4eb5-bf49-4313c531e1cb {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 12:01:14 devstack sudo[106379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-f8790c84-0fea-4fdd-8fed-8f7870effb49.4770c10c-8f9d-4eb5-bf49-4313c531e1cb Nov 06 12:01:14 devstack sudo[106379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 12:01:14 devstack sudo[106379]: pam_unix(sudo:session): session closed for user root Nov 06 12:01:14 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-8d53d2cf-d649-47c2-92c0-75ce17ab50e7 tempest-VolumeDependencyTests-892718679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-f8790c84-0fea-4fdd-8fed-8f7870effb49.4770c10c-8f9d-4eb5-bf49-4313c531e1cb" returned: 0 in 0.436s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 12:01:14 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-8d53d2cf-d649-47c2-92c0-75ce17ab50e7 tempest-VolumeDependencyTests-892718679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-f8790c84-0fea-4fdd-8fed-8f7870effb49.4770c10c-8f9d-4eb5-bf49-4313c531e1cb {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 12:01:14 devstack sudo[106384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-f8790c84-0fea-4fdd-8fed-8f7870effb49.4770c10c-8f9d-4eb5-bf49-4313c531e1cb Nov 06 12:01:14 devstack sudo[106384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 12:01:14 devstack cinder-volume[87116]: DEBUG cinder.volume.flows.manager.create_volume [None req-72923733-4738-4801-99ad-8ba8d773b6d1 tempest-CinderUnicodeTest-583245689 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87116) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 12:01:14 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-72923733-4738-4801-99ad-8ba8d773b6d1 tempest-CinderUnicodeTest-583245689 None] Flow 'volume_create_manager' (5b2fecc7-97ac-4e3a-9178-39d707ff106e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 12:01:14 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-72923733-4738-4801-99ad-8ba8d773b6d1 tempest-CinderUnicodeTest-583245689 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c6321169-1bf8-4842-9f59-b8c72591be0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 12:01:14 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-72923733-4738-4801-99ad-8ba8d773b6d1 tempest-CinderUnicodeTest-583245689 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c6321169-1bf8-4842-9f59-b8c72591be0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T11:01:14Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cb76fde7-36cf-4cce-be38-02d5e488e85d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c3bf8d1634bb4984970773dea6e5c36c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T11:01:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T11:01:15Z,use_quota=True,user_id='3bf0028fd68f4c1c9997a42468d0b7ad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(34d3b144-d9b7-480a-a2e3-01e45f3d54c1),volume_type_id=34d3b144-d9b7-480a-a2e3-01e45f3d54c1)' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 12:01:14 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-72923733-4738-4801-99ad-8ba8d773b6d1 tempest-CinderUnicodeTest-583245689 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e2bcc877-b5a7-4e39-8bab-04984b76f6e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 12:01:14 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-72923733-4738-4801-99ad-8ba8d773b6d1 tempest-CinderUnicodeTest-583245689 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e2bcc877-b5a7-4e39-8bab-04984b76f6e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 12:01:14 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-72923733-4738-4801-99ad-8ba8d773b6d1 tempest-CinderUnicodeTest-583245689 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0709dfea-e2b3-439d-ad6f-6e35ad05258e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 12:01:14 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-72923733-4738-4801-99ad-8ba8d773b6d1 tempest-CinderUnicodeTest-583245689 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0709dfea-e2b3-439d-ad6f-6e35ad05258e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cb76fde7-36cf-4cce-be38-02d5e488e85d', 'volume_name': 'volume-cb76fde7-36cf-4cce-be38-02d5e488e85d', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 12:01:14 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-72923733-4738-4801-99ad-8ba8d773b6d1 tempest-CinderUnicodeTest-583245689 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5ad8ca81-646c-44ea-b4d1-3d1ea7217a89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 12:01:14 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-72923733-4738-4801-99ad-8ba8d773b6d1 tempest-CinderUnicodeTest-583245689 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5ad8ca81-646c-44ea-b4d1-3d1ea7217a89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 12:01:14 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-72923733-4738-4801-99ad-8ba8d773b6d1 tempest-CinderUnicodeTest-583245689 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7175f995-e343-4e1c-bac3-fb1bee907720) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 12:01:14 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-72923733-4738-4801-99ad-8ba8d773b6d1 tempest-CinderUnicodeTest-583245689 None] Volume cb76fde7-36cf-4cce-be38-02d5e488e85d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cb76fde7-36cf-4cce-be38-02d5e488e85d', 'volume_size': 1} Nov 06 12:01:14 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-72923733-4738-4801-99ad-8ba8d773b6d1 tempest-CinderUnicodeTest-583245689 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 12:01:14 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-72923733-4738-4801-99ad-8ba8d773b6d1 tempest-CinderUnicodeTest-583245689 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 12:01:14 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-72923733-4738-4801-99ad-8ba8d773b6d1 tempest-CinderUnicodeTest-583245689 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T11:01:14Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cb76fde7-36cf-4cce-be38-02d5e488e85d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c3bf8d1634bb4984970773dea6e5c36c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T11:01:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T11:01:15Z,use_quota=True,user_id='3bf0028fd68f4c1c9997a42468d0b7ad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(34d3b144-d9b7-480a-a2e3-01e45f3d54c1),volume_type_id=34d3b144-d9b7-480a-a2e3-01e45f3d54c1)}" {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 12:01:14 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-72923733-4738-4801-99ad-8ba8d773b6d1 tempest-CinderUnicodeTest-583245689 None] Creating volume cb76fde7-36cf-4cce-be38-02d5e488e85d {{(pid=87116) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 12:01:14 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-72923733-4738-4801-99ad-8ba8d773b6d1 tempest-CinderUnicodeTest-583245689 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 12:01:14 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-72923733-4738-4801-99ad-8ba8d773b6d1 tempest-CinderUnicodeTest-583245689 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 12:01:14 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-72923733-4738-4801-99ad-8ba8d773b6d1 tempest-CinderUnicodeTest-583245689 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 12:01:14 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-72923733-4738-4801-99ad-8ba8d773b6d1 tempest-CinderUnicodeTest-583245689 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 12:01:14 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-72923733-4738-4801-99ad-8ba8d773b6d1 tempest-CinderUnicodeTest-583245689 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 12:01:14 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-72923733-4738-4801-99ad-8ba8d773b6d1 tempest-CinderUnicodeTest-583245689 None] Selected osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f as target Quobyte volume. {{(pid=87116) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 12:01:14 devstack cinder-volume[87116]: INFO cinder.volume.drivers.remotefs [None req-72923733-4738-4801-99ad-8ba8d773b6d1 tempest-CinderUnicodeTest-583245689 None] casted to osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f Nov 06 12:01:14 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-72923733-4738-4801-99ad-8ba8d773b6d1 tempest-CinderUnicodeTest-583245689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-cb76fde7-36cf-4cce-be38-02d5e488e85d 1073741824 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 12:01:14 devstack sudo[106384]: pam_unix(sudo:session): session closed for user root Nov 06 12:01:14 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-8d53d2cf-d649-47c2-92c0-75ce17ab50e7 tempest-VolumeDependencyTests-892718679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-f8790c84-0fea-4fdd-8fed-8f7870effb49.4770c10c-8f9d-4eb5-bf49-4313c531e1cb" returned: 0 in 0.321s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 12:01:14 devstack sudo[106387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-cb76fde7-36cf-4cce-be38-02d5e488e85d 1073741824 Nov 06 12:01:14 devstack sudo[106387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 12:01:14 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-8d53d2cf-d649-47c2-92c0-75ce17ab50e7 tempest-VolumeDependencyTests-892718679 None] Lock "cinder-quobyte-4770c10c-8f9d-4eb5-bf49-4313c531e1cb" released by "_delete_snapshot" :: held 2.045s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 12:01:14 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-8d53d2cf-d649-47c2-92c0-75ce17ab50e7 tempest-VolumeDependencyTests-892718679 None] Lock "cinder-quobyte-f8790c84-0fea-4fdd-8fed-8f7870effb49" released by "delete_snapshot" :: held 2.097s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 12:01:14 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-f78b830e-5975-42d4-aadf-da4b18b4c16d tempest-VolumeImageDependencyTests-1267764821 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7bd54bd9-76d1-4230-bbcc-b2eccdf2825d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'e731f3f1-a321-4803-a5e8-0ee2d57e8508', 'volume_name': 'volume-e731f3f1-a321-4803-a5e8-0ee2d57e8508', 'volume_size': 1, 'image_id': 'e79a5b27-9ce5-4c98-8f6d-a0c78610bc1a', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e79a5b27-9ce5-4c98-8f6d-a0c78610bc1a', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'e4fca07bc4fb8f037bf2c1dc1fe93a66', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '4e4b0f1a3bce4dfe80671f0b0f109f48', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '936fe97240d2eba03b1f1f8dd95f52cd72e626691d94e6606afcaee9c1d3a037fc31521618b2b572b194332275bda1995bbd8c62a0ba9c1f393362f014ff5dc5', 'id': 'e79a5b27-9ce5-4c98-8f6d-a0c78610bc1a', 'created_at': datetime.datetime(2026, 11, 6, 11, 1, 10, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 6, 11, 1, 12, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e79a5b27-9ce5-4c98-8f6d-a0c78610bc1a/file', 'properties': {}}, 'image_service': }' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 12:01:14 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-f78b830e-5975-42d4-aadf-da4b18b4c16d tempest-VolumeImageDependencyTests-1267764821 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (14436180-54ca-4e6f-836b-ee37c6fa3d22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 12:01:14 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-f78b830e-5975-42d4-aadf-da4b18b4c16d tempest-VolumeImageDependencyTests-1267764821 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (14436180-54ca-4e6f-836b-ee37c6fa3d22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 12:01:14 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-f78b830e-5975-42d4-aadf-da4b18b4c16d tempest-VolumeImageDependencyTests-1267764821 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cedb3138-cb6e-4610-ba05-7ce5b5fe0bf6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 12:01:14 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-f78b830e-5975-42d4-aadf-da4b18b4c16d tempest-VolumeImageDependencyTests-1267764821 None] Volume e731f3f1-a321-4803-a5e8-0ee2d57e8508: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-e731f3f1-a321-4803-a5e8-0ee2d57e8508', 'volume_size': 1, 'image_id': 'e79a5b27-9ce5-4c98-8f6d-a0c78610bc1a', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e79a5b27-9ce5-4c98-8f6d-a0c78610bc1a', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'e4fca07bc4fb8f037bf2c1dc1fe93a66', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '4e4b0f1a3bce4dfe80671f0b0f109f48', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '936fe97240d2eba03b1f1f8dd95f52cd72e626691d94e6606afcaee9c1d3a037fc31521618b2b572b194332275bda1995bbd8c62a0ba9c1f393362f014ff5dc5', 'id': 'e79a5b27-9ce5-4c98-8f6d-a0c78610bc1a', 'created_at': datetime.datetime(2026, 11, 6, 11, 1, 10, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 6, 11, 1, 12, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e79a5b27-9ce5-4c98-8f6d-a0c78610bc1a/file', 'properties': {}}, 'image_service': } Nov 06 12:01:14 devstack cinder-volume[87116]: DEBUG cinder.volume.flows.manager.create_volume [None req-f78b830e-5975-42d4-aadf-da4b18b4c16d tempest-VolumeImageDependencyTests-1267764821 None] Trying to clone e731f3f1-a321-4803-a5e8-0ee2d57e8508 from image e79a5b27-9ce5-4c98-8f6d-a0c78610bc1a at location (None, [{'url': 'file:///opt/stack/data/glance/images/e79a5b27-9ce5-4c98-8f6d-a0c78610bc1a', 'metadata': {}}]). {{(pid=87116) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Nov 06 12:01:15 devstack cinder-volume[87116]: DEBUG cinder.quota [None req-8d53d2cf-d649-47c2-92c0-75ce17ab50e7 tempest-VolumeDependencyTests-892718679 None] Created reservations ['9014f4ac-e835-4668-ba55-cf19d76b3435', '7c9a3abc-f12c-4fba-9624-fed89c8958ff', '77d2f987-199f-4664-b117-c3c2b26e9f17', '2e84ec90-267d-491c-aac3-435c751542af'] {{(pid=87116) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 12:01:15 devstack cinder-volume[87116]: DEBUG cinder.image.image_utils [None req-f78b830e-5975-42d4-aadf-da4b18b4c16d tempest-VolumeImageDependencyTests-1267764821 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_e79a5b27-9ce5-4c98-8f6d-a0c78610bc1a_cmvgbirudevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87116) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Nov 06 12:01:15 devstack cinder-volume[87116]: INFO cinder.image.image_utils [None req-f78b830e-5975-42d4-aadf-da4b18b4c16d tempest-VolumeImageDependencyTests-1267764821 None] Image download 0.00 MB at 0.00 MB/s Nov 06 12:01:15 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-8d53d2cf-d649-47c2-92c0-75ce17ab50e7 tempest-VolumeDependencyTests-892718679 None] Delete snapshot completed successfully. Nov 06 12:01:15 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-8d53d2cf-d649-47c2-92c0-75ce17ab50e7 tempest-VolumeDependencyTests-892718679 None] Lock "cinder-4770c10c-8f9d-4eb5-bf49-4313c531e1cb-delete_snapshot" released by "delete_snapshot" :: held 2.376s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 12:01:15 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d40205f-9a45-4c87-8af7-76ed8eca32e4]: (4, 'raw') {{(pid=88420) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 12:01:15 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-f78b830e-5975-42d4-aadf-da4b18b4c16d tempest-VolumeImageDependencyTests-1267764821 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e79a5b27-9ce5-4c98-8f6d-a0c78610bc1a_cmvgbirudevstack@QuobyteHD {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 12:01:15 devstack sudo[106392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e79a5b27-9ce5-4c98-8f6d-a0c78610bc1a_cmvgbirudevstack@QuobyteHD Nov 06 12:01:15 devstack sudo[106392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 12:01:15 devstack cinder-volume[87116]: DEBUG cinder.volume.flows.manager.create_volume [None req-a82e6aaa-56af-4aa9-9062-88b5d5ce22cd tempest-CreateVolumesFromSnapshotTest-801883145 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87116) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 12:01:15 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-a82e6aaa-56af-4aa9-9062-88b5d5ce22cd tempest-CreateVolumesFromSnapshotTest-801883145 None] Flow 'volume_create_manager' (be4a87a8-f134-4469-b869-e81b3ecbe839) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 12:01:15 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-a82e6aaa-56af-4aa9-9062-88b5d5ce22cd tempest-CreateVolumesFromSnapshotTest-801883145 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5516cf35-a8c7-4166-9b59-c42c2cf9bab7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 12:01:15 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-a82e6aaa-56af-4aa9-9062-88b5d5ce22cd tempest-CreateVolumesFromSnapshotTest-801883145 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5516cf35-a8c7-4166-9b59-c42c2cf9bab7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T11:01:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-349843711',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ba43e453-c830-434c-a0b8-19ccbac97763,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a5da2dc9692147e395382c9fbf06e8f1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T11:01:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T11:01:15Z,use_quota=True,user_id='5c9cccda78c7474b980ee674d31be245',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(34d3b144-d9b7-480a-a2e3-01e45f3d54c1),volume_type_id=34d3b144-d9b7-480a-a2e3-01e45f3d54c1)' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 12:01:15 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-a82e6aaa-56af-4aa9-9062-88b5d5ce22cd tempest-CreateVolumesFromSnapshotTest-801883145 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8bd5947b-67c3-49c1-b413-78ce24f5fe85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 12:01:15 devstack sudo[106387]: pam_unix(sudo:session): session closed for user root Nov 06 12:01:15 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-a82e6aaa-56af-4aa9-9062-88b5d5ce22cd tempest-CreateVolumesFromSnapshotTest-801883145 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8bd5947b-67c3-49c1-b413-78ce24f5fe85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 12:01:15 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-a82e6aaa-56af-4aa9-9062-88b5d5ce22cd tempest-CreateVolumesFromSnapshotTest-801883145 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (478c72dd-bad5-4597-af0a-12ad54c5892e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 12:01:15 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-a82e6aaa-56af-4aa9-9062-88b5d5ce22cd tempest-CreateVolumesFromSnapshotTest-801883145 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (478c72dd-bad5-4597-af0a-12ad54c5892e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ba43e453-c830-434c-a0b8-19ccbac97763', 'volume_name': 'volume-ba43e453-c830-434c-a0b8-19ccbac97763', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 12:01:15 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-a82e6aaa-56af-4aa9-9062-88b5d5ce22cd tempest-CreateVolumesFromSnapshotTest-801883145 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (687ef918-2284-482b-b2bb-89c11a7ba6f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 12:01:15 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-a82e6aaa-56af-4aa9-9062-88b5d5ce22cd tempest-CreateVolumesFromSnapshotTest-801883145 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (687ef918-2284-482b-b2bb-89c11a7ba6f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 12:01:15 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-a82e6aaa-56af-4aa9-9062-88b5d5ce22cd tempest-CreateVolumesFromSnapshotTest-801883145 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (01ce2a8d-194a-448a-bf13-2a2141d57f49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 12:01:15 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-a82e6aaa-56af-4aa9-9062-88b5d5ce22cd tempest-CreateVolumesFromSnapshotTest-801883145 None] Volume ba43e453-c830-434c-a0b8-19ccbac97763: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ba43e453-c830-434c-a0b8-19ccbac97763', 'volume_size': 1} Nov 06 12:01:15 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-a82e6aaa-56af-4aa9-9062-88b5d5ce22cd tempest-CreateVolumesFromSnapshotTest-801883145 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 12:01:15 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-72923733-4738-4801-99ad-8ba8d773b6d1 tempest-CinderUnicodeTest-583245689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-cb76fde7-36cf-4cce-be38-02d5e488e85d 1073741824" returned: 0 in 0.570s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 12:01:15 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-72923733-4738-4801-99ad-8ba8d773b6d1 tempest-CinderUnicodeTest-583245689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-cb76fde7-36cf-4cce-be38-02d5e488e85d {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 12:01:15 devstack sudo[106395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-cb76fde7-36cf-4cce-be38-02d5e488e85d Nov 06 12:01:15 devstack sudo[106395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 12:01:15 devstack sudo[106392]: pam_unix(sudo:session): session closed for user root Nov 06 12:01:15 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-f78b830e-5975-42d4-aadf-da4b18b4c16d tempest-VolumeImageDependencyTests-1267764821 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e79a5b27-9ce5-4c98-8f6d-a0c78610bc1a_cmvgbirudevstack@QuobyteHD" returned: 0 in 0.332s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 12:01:15 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-f78b830e-5975-42d4-aadf-da4b18b4c16d tempest-VolumeImageDependencyTests-1267764821 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e79a5b27-9ce5-4c98-8f6d-a0c78610bc1a_cmvgbirudevstack@QuobyteHD {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 12:01:15 devstack sudo[106399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e79a5b27-9ce5-4c98-8f6d-a0c78610bc1a_cmvgbirudevstack@QuobyteHD Nov 06 12:01:15 devstack sudo[106399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 12:01:15 devstack sudo[106395]: pam_unix(sudo:session): session closed for user root Nov 06 12:01:15 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-72923733-4738-4801-99ad-8ba8d773b6d1 tempest-CinderUnicodeTest-583245689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-cb76fde7-36cf-4cce-be38-02d5e488e85d" returned: 0 in 0.272s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 12:01:15 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-72923733-4738-4801-99ad-8ba8d773b6d1 tempest-CinderUnicodeTest-583245689 None] <== create_volume: return (880ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f'} {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 12:01:15 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-72923733-4738-4801-99ad-8ba8d773b6d1 tempest-CinderUnicodeTest-583245689 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.885s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 12:01:15 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-a82e6aaa-56af-4aa9-9062-88b5d5ce22cd tempest-CreateVolumesFromSnapshotTest-801883145 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.306s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 12:01:15 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-a82e6aaa-56af-4aa9-9062-88b5d5ce22cd tempest-CreateVolumesFromSnapshotTest-801883145 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T11:01:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-349843711',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ba43e453-c830-434c-a0b8-19ccbac97763,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a5da2dc9692147e395382c9fbf06e8f1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T11:01:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T11:01:15Z,use_quota=True,user_id='5c9cccda78c7474b980ee674d31be245',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(34d3b144-d9b7-480a-a2e3-01e45f3d54c1),volume_type_id=34d3b144-d9b7-480a-a2e3-01e45f3d54c1)}" {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 12:01:15 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-a82e6aaa-56af-4aa9-9062-88b5d5ce22cd tempest-CreateVolumesFromSnapshotTest-801883145 None] Creating volume ba43e453-c830-434c-a0b8-19ccbac97763 {{(pid=87116) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 12:01:15 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-a82e6aaa-56af-4aa9-9062-88b5d5ce22cd tempest-CreateVolumesFromSnapshotTest-801883145 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 12:01:15 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-a82e6aaa-56af-4aa9-9062-88b5d5ce22cd tempest-CreateVolumesFromSnapshotTest-801883145 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 12:01:15 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-a82e6aaa-56af-4aa9-9062-88b5d5ce22cd tempest-CreateVolumesFromSnapshotTest-801883145 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 12:01:15 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-a82e6aaa-56af-4aa9-9062-88b5d5ce22cd tempest-CreateVolumesFromSnapshotTest-801883145 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 12:01:15 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-a82e6aaa-56af-4aa9-9062-88b5d5ce22cd tempest-CreateVolumesFromSnapshotTest-801883145 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 12:01:15 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-a82e6aaa-56af-4aa9-9062-88b5d5ce22cd tempest-CreateVolumesFromSnapshotTest-801883145 None] Selected osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f as target Quobyte volume. {{(pid=87116) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 12:01:15 devstack cinder-volume[87116]: INFO cinder.volume.drivers.remotefs [None req-a82e6aaa-56af-4aa9-9062-88b5d5ce22cd tempest-CreateVolumesFromSnapshotTest-801883145 None] casted to osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f Nov 06 12:01:15 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-a82e6aaa-56af-4aa9-9062-88b5d5ce22cd tempest-CreateVolumesFromSnapshotTest-801883145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-ba43e453-c830-434c-a0b8-19ccbac97763 1073741824 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 12:01:15 devstack sudo[106402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-ba43e453-c830-434c-a0b8-19ccbac97763 1073741824 Nov 06 12:01:15 devstack sudo[106402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 12:01:15 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-72923733-4738-4801-99ad-8ba8d773b6d1 tempest-CinderUnicodeTest-583245689 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7175f995-e343-4e1c-bac3-fb1bee907720) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cb76fde7-36cf-4cce-be38-02d5e488e85d', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 12:01:15 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-72923733-4738-4801-99ad-8ba8d773b6d1 tempest-CinderUnicodeTest-583245689 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (984481d9-8365-403e-aca9-82c211414c36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 12:01:15 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-72923733-4738-4801-99ad-8ba8d773b6d1 tempest-CinderUnicodeTest-583245689 None] Volume volume-cb76fde7-36cf-4cce-be38-02d5e488e85d (cb76fde7-36cf-4cce-be38-02d5e488e85d): created successfully Nov 06 12:01:15 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-72923733-4738-4801-99ad-8ba8d773b6d1 tempest-CinderUnicodeTest-583245689 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (984481d9-8365-403e-aca9-82c211414c36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 12:01:15 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-72923733-4738-4801-99ad-8ba8d773b6d1 tempest-CinderUnicodeTest-583245689 None] Flow 'volume_create_manager' (5b2fecc7-97ac-4e3a-9178-39d707ff106e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 12:01:15 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-72923733-4738-4801-99ad-8ba8d773b6d1 tempest-CinderUnicodeTest-583245689 None] Created volume successfully. Nov 06 12:01:15 devstack sudo[106399]: pam_unix(sudo:session): session closed for user root Nov 06 12:01:15 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-f78b830e-5975-42d4-aadf-da4b18b4c16d tempest-VolumeImageDependencyTests-1267764821 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e79a5b27-9ce5-4c98-8f6d-a0c78610bc1a_cmvgbirudevstack@QuobyteHD" returned: 1 in 0.363s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 12:01:15 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-f78b830e-5975-42d4-aadf-da4b18b4c16d tempest-VolumeImageDependencyTests-1267764821 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e79a5b27-9ce5-4c98-8f6d-a0c78610bc1a_cmvgbirudevstack@QuobyteHD' failed. Not Retrying. {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 06 12:01:15 devstack cinder-volume[87116]: DEBUG cinder.image.image_utils [None req-f78b830e-5975-42d4-aadf-da4b18b4c16d tempest-VolumeImageDependencyTests-1267764821 None] Temporary image e79a5b27-9ce5-4c98-8f6d-a0c78610bc1a is fetched for user f75394d660c94433962dcec4711ca6a0. {{(pid=87116) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Nov 06 12:01:15 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5b5aaba-948d-4554-92ac-f5e36366e99f]: (4, 'raw') {{(pid=88420) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 12:01:15 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-f78b830e-5975-42d4-aadf-da4b18b4c16d tempest-VolumeImageDependencyTests-1267764821 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e79a5b27-9ce5-4c98-8f6d-a0c78610bc1a_cmvgbirudevstack@QuobyteHD {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 12:01:16 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-dceb3d13-d992-4216-ac4d-63e080eb02de tempest-VolumeDependencyTests-892718679 None] Acquiring lock "cinder-f8790c84-0fea-4fdd-8fed-8f7870effb49-delete_volume" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 12:01:16 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-dceb3d13-d992-4216-ac4d-63e080eb02de tempest-VolumeDependencyTests-892718679 None] Lock "cinder-f8790c84-0fea-4fdd-8fed-8f7870effb49-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 12:01:16 devstack sudo[106409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e79a5b27-9ce5-4c98-8f6d-a0c78610bc1a_cmvgbirudevstack@QuobyteHD Nov 06 12:01:16 devstack sudo[106409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 12:01:16 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-dceb3d13-d992-4216-ac4d-63e080eb02de tempest-VolumeDependencyTests-892718679 None] Acquiring lock "cinder-quobyte-f8790c84-0fea-4fdd-8fed-8f7870effb49" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 12:01:16 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-dceb3d13-d992-4216-ac4d-63e080eb02de tempest-VolumeDependencyTests-892718679 None] Lock "cinder-quobyte-f8790c84-0fea-4fdd-8fed-8f7870effb49" acquired by "delete_volume" :: waited 0.016s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 12:01:16 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[85b9c3b0-1791-407e-9ded-53fb7c95ba7c]: (4, 'qcow2') {{(pid=88420) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 12:01:16 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-dceb3d13-d992-4216-ac4d-63e080eb02de tempest-VolumeDependencyTests-892718679 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-f8790c84-0fea-4fdd-8fed-8f7870effb49 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 12:01:16 devstack sudo[106402]: pam_unix(sudo:session): session closed for user root Nov 06 12:01:16 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-a82e6aaa-56af-4aa9-9062-88b5d5ce22cd tempest-CreateVolumesFromSnapshotTest-801883145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-ba43e453-c830-434c-a0b8-19ccbac97763 1073741824" returned: 0 in 0.544s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 12:01:16 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-a82e6aaa-56af-4aa9-9062-88b5d5ce22cd tempest-CreateVolumesFromSnapshotTest-801883145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-ba43e453-c830-434c-a0b8-19ccbac97763 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 12:01:16 devstack sudo[106414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-ba43e453-c830-434c-a0b8-19ccbac97763 Nov 06 12:01:16 devstack sudo[106414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 12:01:16 devstack sudo[106413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-f8790c84-0fea-4fdd-8fed-8f7870effb49 Nov 06 12:01:16 devstack sudo[106413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 12:01:16 devstack sudo[106409]: pam_unix(sudo:session): session closed for user root Nov 06 12:01:16 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-f78b830e-5975-42d4-aadf-da4b18b4c16d tempest-VolumeImageDependencyTests-1267764821 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e79a5b27-9ce5-4c98-8f6d-a0c78610bc1a_cmvgbirudevstack@QuobyteHD" returned: 0 in 0.422s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 12:01:16 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-f78b830e-5975-42d4-aadf-da4b18b4c16d tempest-VolumeImageDependencyTests-1267764821 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e79a5b27-9ce5-4c98-8f6d-a0c78610bc1a_cmvgbirudevstack@QuobyteHD {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 12:01:16 devstack sudo[106419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e79a5b27-9ce5-4c98-8f6d-a0c78610bc1a_cmvgbirudevstack@QuobyteHD Nov 06 12:01:16 devstack sudo[106419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 12:01:16 devstack sudo[106414]: pam_unix(sudo:session): session closed for user root Nov 06 12:01:16 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-a82e6aaa-56af-4aa9-9062-88b5d5ce22cd tempest-CreateVolumesFromSnapshotTest-801883145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-ba43e453-c830-434c-a0b8-19ccbac97763" returned: 0 in 0.298s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 12:01:16 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-a82e6aaa-56af-4aa9-9062-88b5d5ce22cd tempest-CreateVolumesFromSnapshotTest-801883145 None] <== create_volume: return (899ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f'} {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 12:01:16 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-a82e6aaa-56af-4aa9-9062-88b5d5ce22cd tempest-CreateVolumesFromSnapshotTest-801883145 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.903s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 12:01:16 devstack sudo[106413]: pam_unix(sudo:session): session closed for user root Nov 06 12:01:16 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-dceb3d13-d992-4216-ac4d-63e080eb02de tempest-VolumeDependencyTests-892718679 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-f8790c84-0fea-4fdd-8fed-8f7870effb49" returned: 0 in 0.391s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 12:01:16 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-dceb3d13-d992-4216-ac4d-63e080eb02de tempest-VolumeDependencyTests-892718679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-f8790c84-0fea-4fdd-8fed-8f7870effb49 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 12:01:16 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-a82e6aaa-56af-4aa9-9062-88b5d5ce22cd tempest-CreateVolumesFromSnapshotTest-801883145 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (01ce2a8d-194a-448a-bf13-2a2141d57f49) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ba43e453-c830-434c-a0b8-19ccbac97763', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 12:01:16 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-a82e6aaa-56af-4aa9-9062-88b5d5ce22cd tempest-CreateVolumesFromSnapshotTest-801883145 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (44f5b168-e238-414f-90bf-e5bfbf54adda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 12:01:16 devstack sudo[106425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-f8790c84-0fea-4fdd-8fed-8f7870effb49 Nov 06 12:01:16 devstack sudo[106425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 12:01:16 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-a82e6aaa-56af-4aa9-9062-88b5d5ce22cd tempest-CreateVolumesFromSnapshotTest-801883145 None] Volume volume-ba43e453-c830-434c-a0b8-19ccbac97763 (ba43e453-c830-434c-a0b8-19ccbac97763): created successfully Nov 06 12:01:16 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-a82e6aaa-56af-4aa9-9062-88b5d5ce22cd tempest-CreateVolumesFromSnapshotTest-801883145 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (44f5b168-e238-414f-90bf-e5bfbf54adda) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 12:01:16 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-a82e6aaa-56af-4aa9-9062-88b5d5ce22cd tempest-CreateVolumesFromSnapshotTest-801883145 None] Flow 'volume_create_manager' (be4a87a8-f134-4469-b869-e81b3ecbe839) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 12:01:16 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-a82e6aaa-56af-4aa9-9062-88b5d5ce22cd tempest-CreateVolumesFromSnapshotTest-801883145 None] Created volume successfully. Nov 06 12:01:16 devstack sudo[106419]: pam_unix(sudo:session): session closed for user root Nov 06 12:01:16 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-f78b830e-5975-42d4-aadf-da4b18b4c16d tempest-VolumeImageDependencyTests-1267764821 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e79a5b27-9ce5-4c98-8f6d-a0c78610bc1a_cmvgbirudevstack@QuobyteHD" returned: 1 in 0.402s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 12:01:16 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-f78b830e-5975-42d4-aadf-da4b18b4c16d tempest-VolumeImageDependencyTests-1267764821 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e79a5b27-9ce5-4c98-8f6d-a0c78610bc1a_cmvgbirudevstack@QuobyteHD' failed. Not Retrying. {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 06 12:01:16 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-f78b830e-5975-42d4-aadf-da4b18b4c16d tempest-VolumeImageDependencyTests-1267764821 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 12:01:16 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-f78b830e-5975-42d4-aadf-da4b18b4c16d tempest-VolumeImageDependencyTests-1267764821 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 12:01:16 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-f78b830e-5975-42d4-aadf-da4b18b4c16d tempest-VolumeImageDependencyTests-1267764821 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T11:01:14Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e731f3f1-a321-4803-a5e8-0ee2d57e8508,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4e4b0f1a3bce4dfe80671f0b0f109f48',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T11:01:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T11:01:14Z,use_quota=True,user_id='f75394d660c94433962dcec4711ca6a0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(34d3b144-d9b7-480a-a2e3-01e45f3d54c1),volume_type_id=34d3b144-d9b7-480a-a2e3-01e45f3d54c1)}" {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 12:01:16 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-f78b830e-5975-42d4-aadf-da4b18b4c16d tempest-VolumeImageDependencyTests-1267764821 None] Creating volume e731f3f1-a321-4803-a5e8-0ee2d57e8508 {{(pid=87116) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 12:01:16 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-f78b830e-5975-42d4-aadf-da4b18b4c16d tempest-VolumeImageDependencyTests-1267764821 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 12:01:16 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-f78b830e-5975-42d4-aadf-da4b18b4c16d tempest-VolumeImageDependencyTests-1267764821 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 12:01:16 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-f78b830e-5975-42d4-aadf-da4b18b4c16d tempest-VolumeImageDependencyTests-1267764821 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 12:01:16 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-f78b830e-5975-42d4-aadf-da4b18b4c16d tempest-VolumeImageDependencyTests-1267764821 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 12:01:16 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-f78b830e-5975-42d4-aadf-da4b18b4c16d tempest-VolumeImageDependencyTests-1267764821 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 12:01:16 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-f78b830e-5975-42d4-aadf-da4b18b4c16d tempest-VolumeImageDependencyTests-1267764821 None] Selected osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f as target Quobyte volume. {{(pid=87116) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 12:01:16 devstack cinder-volume[87116]: INFO cinder.volume.drivers.remotefs [None req-f78b830e-5975-42d4-aadf-da4b18b4c16d tempest-VolumeImageDependencyTests-1267764821 None] casted to osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f Nov 06 12:01:16 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-f78b830e-5975-42d4-aadf-da4b18b4c16d tempest-VolumeImageDependencyTests-1267764821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-e731f3f1-a321-4803-a5e8-0ee2d57e8508 1073741824 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 12:01:16 devstack sudo[106430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-e731f3f1-a321-4803-a5e8-0ee2d57e8508 1073741824 Nov 06 12:01:16 devstack sudo[106430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 12:01:16 devstack sudo[106425]: pam_unix(sudo:session): session closed for user root Nov 06 12:01:16 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-dceb3d13-d992-4216-ac4d-63e080eb02de tempest-VolumeDependencyTests-892718679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-f8790c84-0fea-4fdd-8fed-8f7870effb49" returned: 0 in 0.328s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 12:01:17 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-dceb3d13-d992-4216-ac4d-63e080eb02de tempest-VolumeDependencyTests-892718679 None] Lock "cinder-quobyte-f8790c84-0fea-4fdd-8fed-8f7870effb49" released by "delete_volume" :: held 0.803s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 12:01:17 devstack cinder-volume[87116]: DEBUG cinder.quota [None req-dceb3d13-d992-4216-ac4d-63e080eb02de tempest-VolumeDependencyTests-892718679 None] Created reservations ['0b77816a-4090-4b91-b9a7-1f130eaa1e3d', '1c9a26c6-e019-4410-b006-37c3b96e8970', '10ce5193-8449-44be-b899-540b48f12bdc', 'ad83e956-1516-44a6-9af7-52d924d81c31'] {{(pid=87116) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 12:01:17 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-dceb3d13-d992-4216-ac4d-63e080eb02de tempest-VolumeDependencyTests-892718679 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 12:01:17 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-dceb3d13-d992-4216-ac4d-63e080eb02de tempest-VolumeDependencyTests-892718679 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 12:01:17 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-dceb3d13-d992-4216-ac4d-63e080eb02de tempest-VolumeDependencyTests-892718679 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 12:01:17 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-dceb3d13-d992-4216-ac4d-63e080eb02de tempest-VolumeDependencyTests-892718679 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 12:01:17 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-dceb3d13-d992-4216-ac4d-63e080eb02de tempest-VolumeDependencyTests-892718679 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 12:01:17 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-dceb3d13-d992-4216-ac4d-63e080eb02de tempest-VolumeDependencyTests-892718679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 12:01:17 devstack sudo[106436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756 Nov 06 12:01:17 devstack sudo[106436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 12:01:17 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-450205db-fb7d-4564-86ca-b1686ae290d6 tempest-VolumeDependencyTests-892718679 None] Acquiring lock "cinder-049c7a65-bffc-4f08-b308-0998e46e4fed-delete_volume" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 12:01:17 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-450205db-fb7d-4564-86ca-b1686ae290d6 tempest-VolumeDependencyTests-892718679 None] Lock "cinder-049c7a65-bffc-4f08-b308-0998e46e4fed-delete_volume" acquired by "delete_volume" :: waited 0.056s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 12:01:17 devstack sudo[106430]: pam_unix(sudo:session): session closed for user root Nov 06 12:01:17 devstack cinder-volume[87116]: DEBUG cinder.volume.flows.manager.create_volume [None req-32aec2a4-1c53-4840-95d3-cf4f78a41337 tempest-CinderUnicodeTest-583245689 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87116) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 12:01:17 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-32aec2a4-1c53-4840-95d3-cf4f78a41337 tempest-CinderUnicodeTest-583245689 None] Flow 'volume_create_manager' (59278a8b-15f9-48dd-9f99-9893366d31a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 12:01:17 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-32aec2a4-1c53-4840-95d3-cf4f78a41337 tempest-CinderUnicodeTest-583245689 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (14c48635-adc7-46f3-81fe-9b5b5a051fc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 12:01:17 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-450205db-fb7d-4564-86ca-b1686ae290d6 tempest-VolumeDependencyTests-892718679 None] Acquiring lock "cinder-quobyte-049c7a65-bffc-4f08-b308-0998e46e4fed" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 12:01:17 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-f78b830e-5975-42d4-aadf-da4b18b4c16d tempest-VolumeImageDependencyTests-1267764821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-e731f3f1-a321-4803-a5e8-0ee2d57e8508 1073741824" returned: 0 in 0.703s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 12:01:17 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-32aec2a4-1c53-4840-95d3-cf4f78a41337 tempest-CinderUnicodeTest-583245689 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (14c48635-adc7-46f3-81fe-9b5b5a051fc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T11:01:17Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-459643608',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5ce3f341-5849-4cbd-b9bd-f70e73bd9dc8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c3bf8d1634bb4984970773dea6e5c36c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T11:01:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T11:01:17Z,use_quota=True,user_id='3bf0028fd68f4c1c9997a42468d0b7ad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(34d3b144-d9b7-480a-a2e3-01e45f3d54c1),volume_type_id=34d3b144-d9b7-480a-a2e3-01e45f3d54c1)' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 12:01:17 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-32aec2a4-1c53-4840-95d3-cf4f78a41337 tempest-CinderUnicodeTest-583245689 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bdc18318-a1f5-4304-bf8c-8827b5d58fa5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 12:01:17 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-32aec2a4-1c53-4840-95d3-cf4f78a41337 tempest-CinderUnicodeTest-583245689 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bdc18318-a1f5-4304-bf8c-8827b5d58fa5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 12:01:17 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-32aec2a4-1c53-4840-95d3-cf4f78a41337 tempest-CinderUnicodeTest-583245689 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (32386a5c-274f-4274-baab-a950da385633) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 12:01:17 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-32aec2a4-1c53-4840-95d3-cf4f78a41337 tempest-CinderUnicodeTest-583245689 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (32386a5c-274f-4274-baab-a950da385633) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5ce3f341-5849-4cbd-b9bd-f70e73bd9dc8', 'volume_name': 'volume-5ce3f341-5849-4cbd-b9bd-f70e73bd9dc8', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 12:01:17 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-32aec2a4-1c53-4840-95d3-cf4f78a41337 tempest-CinderUnicodeTest-583245689 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ad0db52-d062-4e51-bf82-ea1165689e49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 12:01:17 devstack sudo[106436]: pam_unix(sudo:session): session closed for user root Nov 06 12:01:17 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-32aec2a4-1c53-4840-95d3-cf4f78a41337 tempest-CinderUnicodeTest-583245689 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8ad0db52-d062-4e51-bf82-ea1165689e49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 12:01:17 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-32aec2a4-1c53-4840-95d3-cf4f78a41337 tempest-CinderUnicodeTest-583245689 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (debda51a-0637-474d-8f3f-576da3b507e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 12:01:17 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-32aec2a4-1c53-4840-95d3-cf4f78a41337 tempest-CinderUnicodeTest-583245689 None] Volume 5ce3f341-5849-4cbd-b9bd-f70e73bd9dc8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5ce3f341-5849-4cbd-b9bd-f70e73bd9dc8', 'volume_size': 1} Nov 06 12:01:17 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-32aec2a4-1c53-4840-95d3-cf4f78a41337 tempest-CinderUnicodeTest-583245689 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 12:01:17 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-450205db-fb7d-4564-86ca-b1686ae290d6 tempest-VolumeDependencyTests-892718679 None] Lock "cinder-quobyte-049c7a65-bffc-4f08-b308-0998e46e4fed" acquired by "delete_volume" :: waited 0.100s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 12:01:17 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-dceb3d13-d992-4216-ac4d-63e080eb02de tempest-VolumeDependencyTests-892718679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756" returned: 0 in 0.472s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 12:01:17 devstack cinder-volume[87116]: DEBUG cinder.manager [None req-dceb3d13-d992-4216-ac4d-63e080eb02de tempest-VolumeDependencyTests-892718679 None] Notifying Schedulers of capabilities ... {{(pid=87116) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 12:01:17 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cdfce3a-6ba6-4d1c-acf3-0ea5a3ead567]: (4, 'qcow2') {{(pid=88420) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 12:01:17 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-450205db-fb7d-4564-86ca-b1686ae290d6 tempest-VolumeDependencyTests-892718679 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-049c7a65-bffc-4f08-b308-0998e46e4fed {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 12:01:17 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-dceb3d13-d992-4216-ac4d-63e080eb02de tempest-VolumeDependencyTests-892718679 None] Deleted volume successfully. Nov 06 12:01:17 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-f78b830e-5975-42d4-aadf-da4b18b4c16d tempest-VolumeImageDependencyTests-1267764821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-e731f3f1-a321-4803-a5e8-0ee2d57e8508 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 12:01:17 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-1f7d24a2-f3a5-4579-a552-771d6ab092c1 tempest-CreateVolumesFromSnapshotTest-801883145 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 12:01:17 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-dceb3d13-d992-4216-ac4d-63e080eb02de tempest-VolumeDependencyTests-892718679 None] Lock "cinder-f8790c84-0fea-4fdd-8fed-8f7870effb49-delete_volume" released by "delete_volume" :: held 1.610s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 12:01:17 devstack sudo[106441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-e731f3f1-a321-4803-a5e8-0ee2d57e8508 Nov 06 12:01:17 devstack sudo[106441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 12:01:17 devstack sudo[106440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-049c7a65-bffc-4f08-b308-0998e46e4fed Nov 06 12:01:17 devstack sudo[106440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 12:01:17 devstack sudo[106441]: pam_unix(sudo:session): session closed for user root Nov 06 12:01:17 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-f78b830e-5975-42d4-aadf-da4b18b4c16d tempest-VolumeImageDependencyTests-1267764821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-e731f3f1-a321-4803-a5e8-0ee2d57e8508" returned: 0 in 0.293s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 12:01:17 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-f78b830e-5975-42d4-aadf-da4b18b4c16d tempest-VolumeImageDependencyTests-1267764821 None] <== create_volume: return (1176ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f'} {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 12:01:17 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-f78b830e-5975-42d4-aadf-da4b18b4c16d tempest-VolumeImageDependencyTests-1267764821 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.182s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 12:01:18 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-32aec2a4-1c53-4840-95d3-cf4f78a41337 tempest-CinderUnicodeTest-583245689 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.370s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 12:01:18 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-32aec2a4-1c53-4840-95d3-cf4f78a41337 tempest-CinderUnicodeTest-583245689 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T11:01:17Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-459643608',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5ce3f341-5849-4cbd-b9bd-f70e73bd9dc8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c3bf8d1634bb4984970773dea6e5c36c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T11:01:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T11:01:17Z,use_quota=True,user_id='3bf0028fd68f4c1c9997a42468d0b7ad',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(34d3b144-d9b7-480a-a2e3-01e45f3d54c1),volume_type_id=34d3b144-d9b7-480a-a2e3-01e45f3d54c1)}" {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 12:01:18 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-32aec2a4-1c53-4840-95d3-cf4f78a41337 tempest-CinderUnicodeTest-583245689 None] Creating volume 5ce3f341-5849-4cbd-b9bd-f70e73bd9dc8 {{(pid=87116) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 12:01:18 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-32aec2a4-1c53-4840-95d3-cf4f78a41337 tempest-CinderUnicodeTest-583245689 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 12:01:18 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-32aec2a4-1c53-4840-95d3-cf4f78a41337 tempest-CinderUnicodeTest-583245689 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 12:01:18 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-32aec2a4-1c53-4840-95d3-cf4f78a41337 tempest-CinderUnicodeTest-583245689 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 12:01:18 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-32aec2a4-1c53-4840-95d3-cf4f78a41337 tempest-CinderUnicodeTest-583245689 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 12:01:18 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-32aec2a4-1c53-4840-95d3-cf4f78a41337 tempest-CinderUnicodeTest-583245689 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 12:01:18 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-32aec2a4-1c53-4840-95d3-cf4f78a41337 tempest-CinderUnicodeTest-583245689 None] Selected osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f as target Quobyte volume. {{(pid=87116) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 12:01:18 devstack cinder-volume[87116]: INFO cinder.volume.drivers.remotefs [None req-32aec2a4-1c53-4840-95d3-cf4f78a41337 tempest-CinderUnicodeTest-583245689 None] casted to osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f Nov 06 12:01:18 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-32aec2a4-1c53-4840-95d3-cf4f78a41337 tempest-CinderUnicodeTest-583245689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-5ce3f341-5849-4cbd-b9bd-f70e73bd9dc8 1073741824 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 12:01:18 devstack sudo[106448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-5ce3f341-5849-4cbd-b9bd-f70e73bd9dc8 1073741824 Nov 06 12:01:18 devstack sudo[106448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 12:01:18 devstack cinder-volume[87116]: DEBUG cinder.volume.volume_utils [None req-f78b830e-5975-42d4-aadf-da4b18b4c16d tempest-VolumeImageDependencyTests-1267764821 None] Attempting download of e79a5b27-9ce5-4c98-8f6d-a0c78610bc1a ((None, [{'url': 'file:///opt/stack/data/glance/images/e79a5b27-9ce5-4c98-8f6d-a0c78610bc1a', 'metadata': {}}])) to volume e731f3f1-a321-4803-a5e8-0ee2d57e8508. {{(pid=87116) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Nov 06 12:01:18 devstack sudo[106440]: pam_unix(sudo:session): session closed for user root Nov 06 12:01:18 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-450205db-fb7d-4564-86ca-b1686ae290d6 tempest-VolumeDependencyTests-892718679 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-049c7a65-bffc-4f08-b308-0998e46e4fed" returned: 0 in 0.413s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 12:01:18 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-450205db-fb7d-4564-86ca-b1686ae290d6 tempest-VolumeDependencyTests-892718679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-049c7a65-bffc-4f08-b308-0998e46e4fed {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 12:01:18 devstack sudo[106450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-049c7a65-bffc-4f08-b308-0998e46e4fed Nov 06 12:01:18 devstack sudo[106450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 12:01:18 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fb3496a-231b-43ad-a7ee-cf593f364d78]: (4, 'raw') {{(pid=88420) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 12:01:18 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-f78b830e-5975-42d4-aadf-da4b18b4c16d tempest-VolumeImageDependencyTests-1267764821 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e79a5b27-9ce5-4c98-8f6d-a0c78610bc1a_3is4ph63 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 12:01:18 devstack sudo[106452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e79a5b27-9ce5-4c98-8f6d-a0c78610bc1a_3is4ph63 Nov 06 12:01:18 devstack sudo[106452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 12:01:18 devstack sudo[106450]: pam_unix(sudo:session): session closed for user root Nov 06 12:01:18 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-450205db-fb7d-4564-86ca-b1686ae290d6 tempest-VolumeDependencyTests-892718679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-049c7a65-bffc-4f08-b308-0998e46e4fed" returned: 0 in 0.294s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 12:01:18 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-450205db-fb7d-4564-86ca-b1686ae290d6 tempest-VolumeDependencyTests-892718679 None] Lock "cinder-quobyte-049c7a65-bffc-4f08-b308-0998e46e4fed" released by "delete_volume" :: held 0.768s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 12:01:18 devstack cinder-volume[87116]: DEBUG cinder.quota [None req-450205db-fb7d-4564-86ca-b1686ae290d6 tempest-VolumeDependencyTests-892718679 None] Created reservations ['0ff716d6-531e-4399-a0e1-d135e6993c2f', '58c546ce-0474-4708-9ef7-bb232b19127f', '08c10cf6-cdc0-4d14-8a43-fbe76f0cf701', '1b7f4dc0-d8d9-4202-b305-1bc4d053705f'] {{(pid=87116) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 12:01:18 devstack sudo[106452]: pam_unix(sudo:session): session closed for user root Nov 06 12:01:18 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-f78b830e-5975-42d4-aadf-da4b18b4c16d tempest-VolumeImageDependencyTests-1267764821 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_e79a5b27-9ce5-4c98-8f6d-a0c78610bc1a_3is4ph63" returned: 0 in 0.404s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 12:01:18 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-f78b830e-5975-42d4-aadf-da4b18b4c16d tempest-VolumeImageDependencyTests-1267764821 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e79a5b27-9ce5-4c98-8f6d-a0c78610bc1a_3is4ph63 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 12:01:18 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-450205db-fb7d-4564-86ca-b1686ae290d6 tempest-VolumeDependencyTests-892718679 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 12:01:18 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-450205db-fb7d-4564-86ca-b1686ae290d6 tempest-VolumeDependencyTests-892718679 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 12:01:18 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-450205db-fb7d-4564-86ca-b1686ae290d6 tempest-VolumeDependencyTests-892718679 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 12:01:18 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-450205db-fb7d-4564-86ca-b1686ae290d6 tempest-VolumeDependencyTests-892718679 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 12:01:18 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-450205db-fb7d-4564-86ca-b1686ae290d6 tempest-VolumeDependencyTests-892718679 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 12:01:18 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-450205db-fb7d-4564-86ca-b1686ae290d6 tempest-VolumeDependencyTests-892718679 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 12:01:18 devstack sudo[106448]: pam_unix(sudo:session): session closed for user root Nov 06 12:01:18 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-32aec2a4-1c53-4840-95d3-cf4f78a41337 tempest-CinderUnicodeTest-583245689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-5ce3f341-5849-4cbd-b9bd-f70e73bd9dc8 1073741824" returned: 0 in 0.570s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 12:01:18 devstack sudo[106462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756 Nov 06 12:01:18 devstack sudo[106462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 12:01:18 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-32aec2a4-1c53-4840-95d3-cf4f78a41337 tempest-CinderUnicodeTest-583245689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-5ce3f341-5849-4cbd-b9bd-f70e73bd9dc8 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 12:01:18 devstack sudo[106464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-5ce3f341-5849-4cbd-b9bd-f70e73bd9dc8 Nov 06 12:01:18 devstack sudo[106464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 12:01:18 devstack sudo[106461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e79a5b27-9ce5-4c98-8f6d-a0c78610bc1a_3is4ph63 Nov 06 12:01:18 devstack sudo[106461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 12:01:18 devstack sudo[106464]: pam_unix(sudo:session): session closed for user root Nov 06 12:01:18 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-32aec2a4-1c53-4840-95d3-cf4f78a41337 tempest-CinderUnicodeTest-583245689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-5ce3f341-5849-4cbd-b9bd-f70e73bd9dc8" returned: 0 in 0.277s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 12:01:18 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-32aec2a4-1c53-4840-95d3-cf4f78a41337 tempest-CinderUnicodeTest-583245689 None] <== create_volume: return (907ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f'} {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 12:01:18 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-32aec2a4-1c53-4840-95d3-cf4f78a41337 tempest-CinderUnicodeTest-583245689 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.911s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 12:01:18 devstack sudo[106462]: pam_unix(sudo:session): session closed for user root Nov 06 12:01:18 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-1f7d24a2-f3a5-4579-a552-771d6ab092c1 tempest-CreateVolumesFromSnapshotTest-801883145 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.201s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 12:01:18 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-450205db-fb7d-4564-86ca-b1686ae290d6 tempest-VolumeDependencyTests-892718679 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756" returned: 0 in 0.362s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 12:01:18 devstack cinder-volume[87116]: DEBUG cinder.manager [None req-450205db-fb7d-4564-86ca-b1686ae290d6 tempest-VolumeDependencyTests-892718679 None] Notifying Schedulers of capabilities ... {{(pid=87116) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 12:01:18 devstack sudo[106461]: pam_unix(sudo:session): session closed for user root Nov 06 12:01:18 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-32aec2a4-1c53-4840-95d3-cf4f78a41337 tempest-CinderUnicodeTest-583245689 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (debda51a-0637-474d-8f3f-576da3b507e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5ce3f341-5849-4cbd-b9bd-f70e73bd9dc8', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 12:01:18 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-32aec2a4-1c53-4840-95d3-cf4f78a41337 tempest-CinderUnicodeTest-583245689 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d6d10897-595f-4eb5-8bb6-c5d210e9268f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 12:01:18 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-1f7d24a2-f3a5-4579-a552-771d6ab092c1 tempest-CreateVolumesFromSnapshotTest-801883145 None] Creating offline snapshot e9b6ee5c-b169-4d4b-986e-afdc4113ede4 of volume ba43e453-c830-434c-a0b8-19ccbac97763 {{(pid=87116) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 06 12:01:18 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-450205db-fb7d-4564-86ca-b1686ae290d6 tempest-VolumeDependencyTests-892718679 None] Deleted volume successfully. Nov 06 12:01:18 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-f78b830e-5975-42d4-aadf-da4b18b4c16d tempest-VolumeImageDependencyTests-1267764821 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e79a5b27-9ce5-4c98-8f6d-a0c78610bc1a_3is4ph63" returned: 1 in 0.444s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 12:01:18 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-f78b830e-5975-42d4-aadf-da4b18b4c16d tempest-VolumeImageDependencyTests-1267764821 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_e79a5b27-9ce5-4c98-8f6d-a0c78610bc1a_3is4ph63' failed. Not Retrying. {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 06 12:01:18 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[61d0c93a-f7a8-4a87-b86a-81429112b5c7]: (4, 'raw') {{(pid=88420) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 12:01:18 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-f78b830e-5975-42d4-aadf-da4b18b4c16d tempest-VolumeImageDependencyTests-1267764821 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e79a5b27-9ce5-4c98-8f6d-a0c78610bc1a_cmvgbirudevstack@QuobyteHD {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 12:01:19 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c00cfa1-1a3e-4b54-ae32-7b408ba343ad]: (4, 'qcow2') {{(pid=88420) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 12:01:19 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-1f7d24a2-f3a5-4579-a552-771d6ab092c1 tempest-CreateVolumesFromSnapshotTest-801883145 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-ba43e453-c830-434c-a0b8-19ccbac97763 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 12:01:19 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-32aec2a4-1c53-4840-95d3-cf4f78a41337 tempest-CinderUnicodeTest-583245689 None] Volume volume-5ce3f341-5849-4cbd-b9bd-f70e73bd9dc8 (5ce3f341-5849-4cbd-b9bd-f70e73bd9dc8): created successfully Nov 06 12:01:19 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-32aec2a4-1c53-4840-95d3-cf4f78a41337 tempest-CinderUnicodeTest-583245689 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d6d10897-595f-4eb5-8bb6-c5d210e9268f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 12:01:19 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-32aec2a4-1c53-4840-95d3-cf4f78a41337 tempest-CinderUnicodeTest-583245689 None] Flow 'volume_create_manager' (59278a8b-15f9-48dd-9f99-9893366d31a7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 12:01:19 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-32aec2a4-1c53-4840-95d3-cf4f78a41337 tempest-CinderUnicodeTest-583245689 None] Created volume successfully. Nov 06 12:01:19 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-450205db-fb7d-4564-86ca-b1686ae290d6 tempest-VolumeDependencyTests-892718679 None] Lock "cinder-049c7a65-bffc-4f08-b308-0998e46e4fed-delete_volume" released by "delete_volume" :: held 1.681s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 12:01:19 devstack sudo[106472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e79a5b27-9ce5-4c98-8f6d-a0c78610bc1a_cmvgbirudevstack@QuobyteHD Nov 06 12:01:19 devstack sudo[106472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 12:01:19 devstack sudo[106473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-ba43e453-c830-434c-a0b8-19ccbac97763 Nov 06 12:01:19 devstack sudo[106473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 12:01:19 devstack sudo[106472]: pam_unix(sudo:session): session closed for user root Nov 06 12:01:19 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-f78b830e-5975-42d4-aadf-da4b18b4c16d tempest-VolumeImageDependencyTests-1267764821 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_e79a5b27-9ce5-4c98-8f6d-a0c78610bc1a_cmvgbirudevstack@QuobyteHD" returned: 0 in 0.383s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 12:01:19 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-f78b830e-5975-42d4-aadf-da4b18b4c16d tempest-VolumeImageDependencyTests-1267764821 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e79a5b27-9ce5-4c98-8f6d-a0c78610bc1a_cmvgbirudevstack@QuobyteHD {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 12:01:19 devstack sudo[106473]: pam_unix(sudo:session): session closed for user root Nov 06 12:01:19 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-1f7d24a2-f3a5-4579-a552-771d6ab092c1 tempest-CreateVolumesFromSnapshotTest-801883145 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-ba43e453-c830-434c-a0b8-19ccbac97763" returned: 0 in 0.478s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 12:01:19 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-1f7d24a2-f3a5-4579-a552-771d6ab092c1 tempest-CreateVolumesFromSnapshotTest-801883145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-ba43e453-c830-434c-a0b8-19ccbac97763,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-ba43e453-c830-434c-a0b8-19ccbac97763.e9b6ee5c-b169-4d4b-986e-afdc4113ede4 1G {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 12:01:19 devstack sudo[106480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e79a5b27-9ce5-4c98-8f6d-a0c78610bc1a_cmvgbirudevstack@QuobyteHD Nov 06 12:01:19 devstack sudo[106480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 12:01:19 devstack sudo[106483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-ba43e453-c830-434c-a0b8-19ccbac97763,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-ba43e453-c830-434c-a0b8-19ccbac97763.e9b6ee5c-b169-4d4b-986e-afdc4113ede4 1G Nov 06 12:01:19 devstack sudo[106483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 12:01:19 devstack sudo[106480]: pam_unix(sudo:session): session closed for user root Nov 06 12:01:19 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-f78b830e-5975-42d4-aadf-da4b18b4c16d tempest-VolumeImageDependencyTests-1267764821 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e79a5b27-9ce5-4c98-8f6d-a0c78610bc1a_cmvgbirudevstack@QuobyteHD" returned: 1 in 0.474s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 12:01:19 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-f78b830e-5975-42d4-aadf-da4b18b4c16d tempest-VolumeImageDependencyTests-1267764821 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_e79a5b27-9ce5-4c98-8f6d-a0c78610bc1a_cmvgbirudevstack@QuobyteHD' failed. Not Retrying. {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 06 12:01:19 devstack cinder-volume[87116]: DEBUG cinder.image.image_utils [None req-f78b830e-5975-42d4-aadf-da4b18b4c16d tempest-VolumeImageDependencyTests-1267764821 None] e79a5b27-9ce5-4c98-8f6d-a0c78610bc1a was raw, converting to qcow2 {{(pid=87116) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Nov 06 12:01:19 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-f78b830e-5975-42d4-aadf-da4b18b4c16d tempest-VolumeImageDependencyTests-1267764821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_e79a5b27-9ce5-4c98-8f6d-a0c78610bc1a_cmvgbirudevstack@QuobyteHD /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-e731f3f1-a321-4803-a5e8-0ee2d57e8508 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 12:01:19 devstack sudo[106492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_e79a5b27-9ce5-4c98-8f6d-a0c78610bc1a_cmvgbirudevstack@QuobyteHD /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-e731f3f1-a321-4803-a5e8-0ee2d57e8508 Nov 06 12:01:19 devstack sudo[106492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 12:01:20 devstack sudo[106483]: pam_unix(sudo:session): session closed for user root Nov 06 12:01:20 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-1f7d24a2-f3a5-4579-a552-771d6ab092c1 tempest-CreateVolumesFromSnapshotTest-801883145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-ba43e453-c830-434c-a0b8-19ccbac97763,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-ba43e453-c830-434c-a0b8-19ccbac97763.e9b6ee5c-b169-4d4b-986e-afdc4113ede4 1G" returned: 0 in 0.636s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 12:01:20 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-1f7d24a2-f3a5-4579-a552-771d6ab092c1 tempest-CreateVolumesFromSnapshotTest-801883145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ba43e453-c830-434c-a0b8-19ccbac97763 -F qcow2 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-ba43e453-c830-434c-a0b8-19ccbac97763.e9b6ee5c-b169-4d4b-986e-afdc4113ede4 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 12:01:20 devstack sudo[106495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ba43e453-c830-434c-a0b8-19ccbac97763 -F qcow2 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-ba43e453-c830-434c-a0b8-19ccbac97763.e9b6ee5c-b169-4d4b-986e-afdc4113ede4 Nov 06 12:01:20 devstack sudo[106495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 12:01:20 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-a1745b3a-4edd-4f0e-ad3b-abc9358208dc tempest-CinderUnicodeTest-583245689 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 12:01:20 devstack sudo[106495]: pam_unix(sudo:session): session closed for user root Nov 06 12:01:20 devstack sudo[106492]: pam_unix(sudo:session): session closed for user root Nov 06 12:01:20 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-1f7d24a2-f3a5-4579-a552-771d6ab092c1 tempest-CreateVolumesFromSnapshotTest-801883145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ba43e453-c830-434c-a0b8-19ccbac97763 -F qcow2 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-ba43e453-c830-434c-a0b8-19ccbac97763.e9b6ee5c-b169-4d4b-986e-afdc4113ede4" returned: 0 in 0.407s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 12:01:20 devstack cinder-volume[87116]: WARNING cinder.volume.drivers.remotefs [None req-1f7d24a2-f3a5-4579-a552-771d6ab092c1 tempest-CreateVolumesFromSnapshotTest-801883145 None] /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-ba43e453-c830-434c-a0b8-19ccbac97763.e9b6ee5c-b169-4d4b-986e-afdc4113ede4 is being set with open permissions: ugo+rw Nov 06 12:01:20 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-1f7d24a2-f3a5-4579-a552-771d6ab092c1 tempest-CreateVolumesFromSnapshotTest-801883145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-ba43e453-c830-434c-a0b8-19ccbac97763.e9b6ee5c-b169-4d4b-986e-afdc4113ede4 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 12:01:20 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-f78b830e-5975-42d4-aadf-da4b18b4c16d tempest-VolumeImageDependencyTests-1267764821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_e79a5b27-9ce5-4c98-8f6d-a0c78610bc1a_cmvgbirudevstack@QuobyteHD /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-e731f3f1-a321-4803-a5e8-0ee2d57e8508" returned: 0 in 0.684s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 12:01:20 devstack cinder-volume[87116]: DEBUG cinder.image.image_utils [None req-f78b830e-5975-42d4-aadf-da4b18b4c16d tempest-VolumeImageDependencyTests-1267764821 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_e79a5b27-9ce5-4c98-8f6d-a0c78610bc1a_cmvgbirudevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-e731f3f1-a321-4803-a5e8-0ee2d57e8508 {{(pid=87116) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 06 12:01:20 devstack cinder-volume[87116]: INFO cinder.image.image_utils [None req-f78b830e-5975-42d4-aadf-da4b18b4c16d tempest-VolumeImageDependencyTests-1267764821 None] Converted 0.00 MB image at 0.00 MB/s Nov 06 12:01:20 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-f78b830e-5975-42d4-aadf-da4b18b4c16d tempest-VolumeImageDependencyTests-1267764821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-e731f3f1-a321-4803-a5e8-0ee2d57e8508 1G {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 12:01:20 devstack sudo[106504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-ba43e453-c830-434c-a0b8-19ccbac97763.e9b6ee5c-b169-4d4b-986e-afdc4113ede4 Nov 06 12:01:20 devstack sudo[106504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 12:01:20 devstack sudo[106505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-e731f3f1-a321-4803-a5e8-0ee2d57e8508 1G Nov 06 12:01:20 devstack sudo[106505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 12:01:20 devstack sudo[106504]: pam_unix(sudo:session): session closed for user root Nov 06 12:01:20 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-1f7d24a2-f3a5-4579-a552-771d6ab092c1 tempest-CreateVolumesFromSnapshotTest-801883145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-ba43e453-c830-434c-a0b8-19ccbac97763.e9b6ee5c-b169-4d4b-986e-afdc4113ede4" returned: 0 in 0.277s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 12:01:20 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-1f7d24a2-f3a5-4579-a552-771d6ab092c1 tempest-CreateVolumesFromSnapshotTest-801883145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-ba43e453-c830-434c-a0b8-19ccbac97763.info {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 12:01:20 devstack sudo[106512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-ba43e453-c830-434c-a0b8-19ccbac97763.info Nov 06 12:01:20 devstack sudo[106512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 12:01:20 devstack sudo[106505]: pam_unix(sudo:session): session closed for user root Nov 06 12:01:20 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-f78b830e-5975-42d4-aadf-da4b18b4c16d tempest-VolumeImageDependencyTests-1267764821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-e731f3f1-a321-4803-a5e8-0ee2d57e8508 1G" returned: 0 in 0.426s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 12:01:20 devstack cinder-volume[87116]: DEBUG cinder.volume.volume_utils [None req-f78b830e-5975-42d4-aadf-da4b18b4c16d tempest-VolumeImageDependencyTests-1267764821 None] Downloaded image e79a5b27-9ce5-4c98-8f6d-a0c78610bc1a ((None, [{'url': 'file:///opt/stack/data/glance/images/e79a5b27-9ce5-4c98-8f6d-a0c78610bc1a', 'metadata': {}}])) to volume e731f3f1-a321-4803-a5e8-0ee2d57e8508 successfully. {{(pid=87116) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Nov 06 12:01:20 devstack cinder-volume[87116]: DEBUG cinder.image.image_utils [None req-f78b830e-5975-42d4-aadf-da4b18b4c16d tempest-VolumeImageDependencyTests-1267764821 None] Temporary image e79a5b27-9ce5-4c98-8f6d-a0c78610bc1a for user f75394d660c94433962dcec4711ca6a0 is deleted. {{(pid=87116) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Nov 06 12:01:20 devstack cinder-volume[87116]: DEBUG cinder.volume.volume_utils [None req-f78b830e-5975-42d4-aadf-da4b18b4c16d tempest-VolumeImageDependencyTests-1267764821 None] Marking volume e731f3f1-a321-4803-a5e8-0ee2d57e8508 as bootable. {{(pid=87116) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Nov 06 12:01:21 devstack cinder-volume[87116]: DEBUG cinder.volume.flows.manager.create_volume [None req-f78b830e-5975-42d4-aadf-da4b18b4c16d tempest-VolumeImageDependencyTests-1267764821 None] Copying metadata from image e79a5b27-9ce5-4c98-8f6d-a0c78610bc1a to e731f3f1-a321-4803-a5e8-0ee2d57e8508. {{(pid=87116) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Nov 06 12:01:21 devstack cinder-volume[87116]: DEBUG cinder.volume.flows.manager.create_volume [None req-f78b830e-5975-42d4-aadf-da4b18b4c16d tempest-VolumeImageDependencyTests-1267764821 None] Creating volume glance metadata for volume e731f3f1-a321-4803-a5e8-0ee2d57e8508 backed by image e79a5b27-9ce5-4c98-8f6d-a0c78610bc1a with: {'image_id': 'e79a5b27-9ce5-4c98-8f6d-a0c78610bc1a', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': 'e4fca07bc4fb8f037bf2c1dc1fe93a66', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87116) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Nov 06 12:01:21 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-f78b830e-5975-42d4-aadf-da4b18b4c16d tempest-VolumeImageDependencyTests-1267764821 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cedb3138-cb6e-4610-ba05-7ce5b5fe0bf6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e731f3f1-a321-4803-a5e8-0ee2d57e8508', 'volume_size': 1, 'image_id': 'e79a5b27-9ce5-4c98-8f6d-a0c78610bc1a', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/e79a5b27-9ce5-4c98-8f6d-a0c78610bc1a', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'e4fca07bc4fb8f037bf2c1dc1fe93a66', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '4e4b0f1a3bce4dfe80671f0b0f109f48', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '936fe97240d2eba03b1f1f8dd95f52cd72e626691d94e6606afcaee9c1d3a037fc31521618b2b572b194332275bda1995bbd8c62a0ba9c1f393362f014ff5dc5', 'id': 'e79a5b27-9ce5-4c98-8f6d-a0c78610bc1a', 'created_at': datetime.datetime(2026, 11, 6, 11, 1, 10, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 6, 11, 1, 12, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/e79a5b27-9ce5-4c98-8f6d-a0c78610bc1a/file', 'properties': {}}, 'image_service': }' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 12:01:21 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-f78b830e-5975-42d4-aadf-da4b18b4c16d tempest-VolumeImageDependencyTests-1267764821 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4b006fe8-5ef9-4b10-bb57-3e4e5b6b5a34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 12:01:21 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-f78b830e-5975-42d4-aadf-da4b18b4c16d tempest-VolumeImageDependencyTests-1267764821 None] Volume volume-e731f3f1-a321-4803-a5e8-0ee2d57e8508 (e731f3f1-a321-4803-a5e8-0ee2d57e8508): created successfully Nov 06 12:01:21 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-f78b830e-5975-42d4-aadf-da4b18b4c16d tempest-VolumeImageDependencyTests-1267764821 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4b006fe8-5ef9-4b10-bb57-3e4e5b6b5a34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 12:01:21 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-f78b830e-5975-42d4-aadf-da4b18b4c16d tempest-VolumeImageDependencyTests-1267764821 None] Flow 'volume_create_manager' (aa9dbf4f-5f75-4232-94b7-32fe7a04cc7b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 12:01:21 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-1f7d24a2-f3a5-4579-a552-771d6ab092c1 tempest-CreateVolumesFromSnapshotTest-801883145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-ba43e453-c830-434c-a0b8-19ccbac97763.info" returned: 0 in 0.332s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 12:01:21 devstack cinder-volume[87116]: WARNING cinder.volume.drivers.remotefs [None req-1f7d24a2-f3a5-4579-a552-771d6ab092c1 tempest-CreateVolumesFromSnapshotTest-801883145 None] /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-ba43e453-c830-434c-a0b8-19ccbac97763.info is being set with open permissions: ugo+rw Nov 06 12:01:21 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-1f7d24a2-f3a5-4579-a552-771d6ab092c1 tempest-CreateVolumesFromSnapshotTest-801883145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-ba43e453-c830-434c-a0b8-19ccbac97763.info {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 12:01:21 devstack sudo[106512]: pam_unix(sudo:session): session closed for user root Nov 06 12:01:21 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-f78b830e-5975-42d4-aadf-da4b18b4c16d tempest-VolumeImageDependencyTests-1267764821 None] Created volume successfully. Nov 06 12:01:21 devstack sudo[106516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-ba43e453-c830-434c-a0b8-19ccbac97763.info Nov 06 12:01:21 devstack sudo[106516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 12:01:21 devstack sudo[106516]: pam_unix(sudo:session): session closed for user root Nov 06 12:01:21 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-1f7d24a2-f3a5-4579-a552-771d6ab092c1 tempest-CreateVolumesFromSnapshotTest-801883145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-ba43e453-c830-434c-a0b8-19ccbac97763.info" returned: 0 in 0.255s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 12:01:21 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-1f7d24a2-f3a5-4579-a552-771d6ab092c1 tempest-CreateVolumesFromSnapshotTest-801883145 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.562s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 12:01:21 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-a1745b3a-4edd-4f0e-ad3b-abc9358208dc tempest-CinderUnicodeTest-583245689 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.263s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 12:01:21 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-a1745b3a-4edd-4f0e-ad3b-abc9358208dc tempest-CinderUnicodeTest-583245689 None] Creating offline snapshot 697456b0-4ee7-4ef4-af9c-176247d8af7c of volume 5ce3f341-5849-4cbd-b9bd-f70e73bd9dc8 {{(pid=87116) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 06 12:01:21 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-1f7d24a2-f3a5-4579-a552-771d6ab092c1 tempest-CreateVolumesFromSnapshotTest-801883145 None] Create snapshot completed successfully Nov 06 12:01:21 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[728c93ea-30e0-474e-9ee7-538b1847c413]: (4, 'qcow2') {{(pid=88420) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 12:01:21 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-a1745b3a-4edd-4f0e-ad3b-abc9358208dc tempest-CinderUnicodeTest-583245689 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-5ce3f341-5849-4cbd-b9bd-f70e73bd9dc8 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 12:01:21 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-3d0359a0-a230-4e48-b0e9-1f0ed7dcc27a tempest-VolumeImageDependencyTests-1267764821 None] Acquiring lock "cinder-e731f3f1-a321-4803-a5e8-0ee2d57e8508-delete_volume" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 12:01:21 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-3d0359a0-a230-4e48-b0e9-1f0ed7dcc27a tempest-VolumeImageDependencyTests-1267764821 None] Lock "cinder-e731f3f1-a321-4803-a5e8-0ee2d57e8508-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 12:01:21 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-3d0359a0-a230-4e48-b0e9-1f0ed7dcc27a tempest-VolumeImageDependencyTests-1267764821 None] Acquiring lock "cinder-quobyte-e731f3f1-a321-4803-a5e8-0ee2d57e8508" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 12:01:21 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-3d0359a0-a230-4e48-b0e9-1f0ed7dcc27a tempest-VolumeImageDependencyTests-1267764821 None] Lock "cinder-quobyte-e731f3f1-a321-4803-a5e8-0ee2d57e8508" acquired by "delete_volume" :: waited 0.017s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 12:01:21 devstack sudo[106519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-5ce3f341-5849-4cbd-b9bd-f70e73bd9dc8 Nov 06 12:01:21 devstack sudo[106519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 12:01:21 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cd6501a-ce02-49ed-878c-bbb62f1f3a0c]: (4, 'qcow2') {{(pid=88420) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 12:01:21 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-3d0359a0-a230-4e48-b0e9-1f0ed7dcc27a tempest-VolumeImageDependencyTests-1267764821 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-e731f3f1-a321-4803-a5e8-0ee2d57e8508 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 12:01:21 devstack sudo[106523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-e731f3f1-a321-4803-a5e8-0ee2d57e8508 Nov 06 12:01:21 devstack sudo[106523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 12:01:21 devstack sudo[106519]: pam_unix(sudo:session): session closed for user root Nov 06 12:01:21 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-a1745b3a-4edd-4f0e-ad3b-abc9358208dc tempest-CinderUnicodeTest-583245689 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-5ce3f341-5849-4cbd-b9bd-f70e73bd9dc8" returned: 0 in 0.437s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 12:01:21 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-a1745b3a-4edd-4f0e-ad3b-abc9358208dc tempest-CinderUnicodeTest-583245689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-5ce3f341-5849-4cbd-b9bd-f70e73bd9dc8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-5ce3f341-5849-4cbd-b9bd-f70e73bd9dc8.697456b0-4ee7-4ef4-af9c-176247d8af7c 1G {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 12:01:22 devstack sudo[106528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-5ce3f341-5849-4cbd-b9bd-f70e73bd9dc8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-5ce3f341-5849-4cbd-b9bd-f70e73bd9dc8.697456b0-4ee7-4ef4-af9c-176247d8af7c 1G Nov 06 12:01:22 devstack sudo[106528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 12:01:22 devstack sudo[106523]: pam_unix(sudo:session): session closed for user root Nov 06 12:01:22 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-3d0359a0-a230-4e48-b0e9-1f0ed7dcc27a tempest-VolumeImageDependencyTests-1267764821 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-e731f3f1-a321-4803-a5e8-0ee2d57e8508" returned: 0 in 0.502s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 12:01:22 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-3d0359a0-a230-4e48-b0e9-1f0ed7dcc27a tempest-VolumeImageDependencyTests-1267764821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-e731f3f1-a321-4803-a5e8-0ee2d57e8508 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 12:01:22 devstack sudo[106534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-e731f3f1-a321-4803-a5e8-0ee2d57e8508 Nov 06 12:01:22 devstack sudo[106534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 12:01:22 devstack sudo[106534]: pam_unix(sudo:session): session closed for user root Nov 06 12:01:22 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-3d0359a0-a230-4e48-b0e9-1f0ed7dcc27a tempest-VolumeImageDependencyTests-1267764821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-e731f3f1-a321-4803-a5e8-0ee2d57e8508" returned: 0 in 0.369s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 12:01:22 devstack sudo[106528]: pam_unix(sudo:session): session closed for user root Nov 06 12:01:22 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-a1745b3a-4edd-4f0e-ad3b-abc9358208dc tempest-CinderUnicodeTest-583245689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-5ce3f341-5849-4cbd-b9bd-f70e73bd9dc8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-5ce3f341-5849-4cbd-b9bd-f70e73bd9dc8.697456b0-4ee7-4ef4-af9c-176247d8af7c 1G" returned: 0 in 0.629s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 12:01:22 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-a1745b3a-4edd-4f0e-ad3b-abc9358208dc tempest-CinderUnicodeTest-583245689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5ce3f341-5849-4cbd-b9bd-f70e73bd9dc8 -F qcow2 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-5ce3f341-5849-4cbd-b9bd-f70e73bd9dc8.697456b0-4ee7-4ef4-af9c-176247d8af7c {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 12:01:22 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-3d0359a0-a230-4e48-b0e9-1f0ed7dcc27a tempest-VolumeImageDependencyTests-1267764821 None] Lock "cinder-quobyte-e731f3f1-a321-4803-a5e8-0ee2d57e8508" released by "delete_volume" :: held 0.967s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 12:01:22 devstack sudo[106540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5ce3f341-5849-4cbd-b9bd-f70e73bd9dc8 -F qcow2 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-5ce3f341-5849-4cbd-b9bd-f70e73bd9dc8.697456b0-4ee7-4ef4-af9c-176247d8af7c Nov 06 12:01:22 devstack sudo[106540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 12:01:22 devstack cinder-volume[87116]: DEBUG cinder.volume.flows.manager.create_volume [None req-f2f7c9de-7239-425d-ae32-199ddd70650d tempest-CreateVolumesFromSnapshotTest-801883145 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87116) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 12:01:22 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-f2f7c9de-7239-425d-ae32-199ddd70650d tempest-CreateVolumesFromSnapshotTest-801883145 None] Flow 'volume_create_manager' (829cc40c-5346-4efc-bde4-140aa9a47a36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 12:01:22 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-f2f7c9de-7239-425d-ae32-199ddd70650d tempest-CreateVolumesFromSnapshotTest-801883145 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8c9b5278-a8b3-49df-be71-44b5d648535a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 12:01:22 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-f2f7c9de-7239-425d-ae32-199ddd70650d tempest-CreateVolumesFromSnapshotTest-801883145 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8c9b5278-a8b3-49df-be71-44b5d648535a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T11:01:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1716394072',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b4161cde-e732-4565-bcf3-93e4c2263394,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a5da2dc9692147e395382c9fbf06e8f1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T11:01:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T11:01:23Z,use_quota=True,user_id='5c9cccda78c7474b980ee674d31be245',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(34d3b144-d9b7-480a-a2e3-01e45f3d54c1),volume_type_id=34d3b144-d9b7-480a-a2e3-01e45f3d54c1)' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 12:01:22 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-f2f7c9de-7239-425d-ae32-199ddd70650d tempest-CreateVolumesFromSnapshotTest-801883145 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c9d04a59-4220-43ef-b2ad-bd887aebb91f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 12:01:22 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-f2f7c9de-7239-425d-ae32-199ddd70650d tempest-CreateVolumesFromSnapshotTest-801883145 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c9d04a59-4220-43ef-b2ad-bd887aebb91f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 12:01:22 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-f2f7c9de-7239-425d-ae32-199ddd70650d tempest-CreateVolumesFromSnapshotTest-801883145 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dfef7476-1062-49e8-ab97-32b6b2f44c3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 12:01:22 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-f2f7c9de-7239-425d-ae32-199ddd70650d tempest-CreateVolumesFromSnapshotTest-801883145 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dfef7476-1062-49e8-ab97-32b6b2f44c3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b4161cde-e732-4565-bcf3-93e4c2263394', 'volume_name': 'volume-b4161cde-e732-4565-bcf3-93e4c2263394', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 12:01:22 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-f2f7c9de-7239-425d-ae32-199ddd70650d tempest-CreateVolumesFromSnapshotTest-801883145 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7673e35b-b663-4250-a29c-cdc648f1e2dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 12:01:22 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-f2f7c9de-7239-425d-ae32-199ddd70650d tempest-CreateVolumesFromSnapshotTest-801883145 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7673e35b-b663-4250-a29c-cdc648f1e2dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 12:01:22 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-f2f7c9de-7239-425d-ae32-199ddd70650d tempest-CreateVolumesFromSnapshotTest-801883145 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (67b02d98-1241-4a30-b91a-8521158aeb85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 12:01:22 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-f2f7c9de-7239-425d-ae32-199ddd70650d tempest-CreateVolumesFromSnapshotTest-801883145 None] Volume b4161cde-e732-4565-bcf3-93e4c2263394: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b4161cde-e732-4565-bcf3-93e4c2263394', 'volume_size': 1} Nov 06 12:01:22 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-f2f7c9de-7239-425d-ae32-199ddd70650d tempest-CreateVolumesFromSnapshotTest-801883145 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 12:01:22 devstack cinder-volume[87116]: DEBUG cinder.quota [None req-3d0359a0-a230-4e48-b0e9-1f0ed7dcc27a tempest-VolumeImageDependencyTests-1267764821 None] Created reservations ['9aebe73e-aeab-4d0b-8aaa-0f36aa67938e', 'f0f40ba8-39d6-4b34-8bfe-3b48e79d65e5', '00fdebc9-db2a-428e-b90f-2409d435b299', '47dd737a-2f94-4545-837c-c6f206272dc1'] {{(pid=87116) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 12:01:22 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-3d0359a0-a230-4e48-b0e9-1f0ed7dcc27a tempest-VolumeImageDependencyTests-1267764821 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 12:01:22 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-3d0359a0-a230-4e48-b0e9-1f0ed7dcc27a tempest-VolumeImageDependencyTests-1267764821 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 12:01:22 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-3d0359a0-a230-4e48-b0e9-1f0ed7dcc27a tempest-VolumeImageDependencyTests-1267764821 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 12:01:22 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-3d0359a0-a230-4e48-b0e9-1f0ed7dcc27a tempest-VolumeImageDependencyTests-1267764821 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 12:01:22 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-3d0359a0-a230-4e48-b0e9-1f0ed7dcc27a tempest-VolumeImageDependencyTests-1267764821 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 12:01:22 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-3d0359a0-a230-4e48-b0e9-1f0ed7dcc27a tempest-VolumeImageDependencyTests-1267764821 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 12:01:22 devstack sudo[106543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756 Nov 06 12:01:22 devstack sudo[106543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 12:01:23 devstack cinder-volume[87116]: DEBUG cinder.volume.flows.manager.create_volume [None req-c6eb478b-51c9-4cce-aa19-661c7f4c7098 tempest-CreateVolumesFromSnapshotTest-801883145 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87116) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 12:01:23 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-c6eb478b-51c9-4cce-aa19-661c7f4c7098 tempest-CreateVolumesFromSnapshotTest-801883145 None] Flow 'volume_create_manager' (54bc55a8-955c-4bdc-8503-3621b3fb31e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 12:01:23 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-c6eb478b-51c9-4cce-aa19-661c7f4c7098 tempest-CreateVolumesFromSnapshotTest-801883145 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (875de16f-f750-4189-a93e-7b375b857af7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 12:01:23 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-c6eb478b-51c9-4cce-aa19-661c7f4c7098 tempest-CreateVolumesFromSnapshotTest-801883145 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (875de16f-f750-4189-a93e-7b375b857af7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T11:01:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-640389324',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ab9358c6-88df-4fcb-b940-9625bf001525,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a5da2dc9692147e395382c9fbf06e8f1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T11:01:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T11:01:23Z,use_quota=True,user_id='5c9cccda78c7474b980ee674d31be245',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(34d3b144-d9b7-480a-a2e3-01e45f3d54c1),volume_type_id=34d3b144-d9b7-480a-a2e3-01e45f3d54c1)' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 12:01:23 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-c6eb478b-51c9-4cce-aa19-661c7f4c7098 tempest-CreateVolumesFromSnapshotTest-801883145 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (30a225c7-5a52-44ed-b00a-bba6c5a48b41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 12:01:23 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-c6eb478b-51c9-4cce-aa19-661c7f4c7098 tempest-CreateVolumesFromSnapshotTest-801883145 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (30a225c7-5a52-44ed-b00a-bba6c5a48b41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 12:01:23 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-c6eb478b-51c9-4cce-aa19-661c7f4c7098 tempest-CreateVolumesFromSnapshotTest-801883145 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1f8a2e3d-b9b2-4225-a0a7-5cfe2b766dc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 12:01:23 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-c6eb478b-51c9-4cce-aa19-661c7f4c7098 tempest-CreateVolumesFromSnapshotTest-801883145 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1f8a2e3d-b9b2-4225-a0a7-5cfe2b766dc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ab9358c6-88df-4fcb-b940-9625bf001525', 'volume_name': 'volume-ab9358c6-88df-4fcb-b940-9625bf001525', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 12:01:23 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-c6eb478b-51c9-4cce-aa19-661c7f4c7098 tempest-CreateVolumesFromSnapshotTest-801883145 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f6a2c6c2-b0b2-454f-a6d8-ef77aecc55a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 12:01:23 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-c6eb478b-51c9-4cce-aa19-661c7f4c7098 tempest-CreateVolumesFromSnapshotTest-801883145 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f6a2c6c2-b0b2-454f-a6d8-ef77aecc55a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 12:01:23 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-c6eb478b-51c9-4cce-aa19-661c7f4c7098 tempest-CreateVolumesFromSnapshotTest-801883145 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8fdbb55a-f528-4400-aa82-9f9d4947e67b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 12:01:23 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-c6eb478b-51c9-4cce-aa19-661c7f4c7098 tempest-CreateVolumesFromSnapshotTest-801883145 None] Volume ab9358c6-88df-4fcb-b940-9625bf001525: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ab9358c6-88df-4fcb-b940-9625bf001525', 'volume_size': 1} Nov 06 12:01:23 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-c6eb478b-51c9-4cce-aa19-661c7f4c7098 tempest-CreateVolumesFromSnapshotTest-801883145 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 12:01:23 devstack sudo[106540]: pam_unix(sudo:session): session closed for user root Nov 06 12:01:23 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-a1745b3a-4edd-4f0e-ad3b-abc9358208dc tempest-CinderUnicodeTest-583245689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5ce3f341-5849-4cbd-b9bd-f70e73bd9dc8 -F qcow2 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-5ce3f341-5849-4cbd-b9bd-f70e73bd9dc8.697456b0-4ee7-4ef4-af9c-176247d8af7c" returned: 0 in 0.640s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 12:01:23 devstack cinder-volume[87116]: WARNING cinder.volume.drivers.remotefs [None req-a1745b3a-4edd-4f0e-ad3b-abc9358208dc tempest-CinderUnicodeTest-583245689 None] /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-5ce3f341-5849-4cbd-b9bd-f70e73bd9dc8.697456b0-4ee7-4ef4-af9c-176247d8af7c is being set with open permissions: ugo+rw Nov 06 12:01:23 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-a1745b3a-4edd-4f0e-ad3b-abc9358208dc tempest-CinderUnicodeTest-583245689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-5ce3f341-5849-4cbd-b9bd-f70e73bd9dc8.697456b0-4ee7-4ef4-af9c-176247d8af7c {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 12:01:23 devstack sudo[106548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-5ce3f341-5849-4cbd-b9bd-f70e73bd9dc8.697456b0-4ee7-4ef4-af9c-176247d8af7c Nov 06 12:01:23 devstack sudo[106548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 12:01:23 devstack cinder-volume[87116]: DEBUG cinder.volume.flows.manager.create_volume [None req-5aee26a9-34bf-4eab-920b-5fcdd58dcde7 tempest-ProjectReaderTests-377170324 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87116) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 12:01:23 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-5aee26a9-34bf-4eab-920b-5fcdd58dcde7 tempest-ProjectReaderTests-377170324 None] Flow 'volume_create_manager' (3ddc7c5c-61ad-4e55-9a45-f5f3bab7f986) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 12:01:23 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-5aee26a9-34bf-4eab-920b-5fcdd58dcde7 tempest-ProjectReaderTests-377170324 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (78a6243c-8912-487c-8da0-05e92e7fbffc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 12:01:23 devstack sudo[106543]: pam_unix(sudo:session): session closed for user root Nov 06 12:01:23 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-5aee26a9-34bf-4eab-920b-5fcdd58dcde7 tempest-ProjectReaderTests-377170324 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (78a6243c-8912-487c-8da0-05e92e7fbffc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T11:01:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1778840868',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=395aa496-f7e7-4996-894b-f677d62e3f59,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='865d378d37cd42ed98432cd1ce1e41be',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T11:01:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T11:01:23Z,use_quota=True,user_id='8acc7287c82b436186731f24c32b21ce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(34d3b144-d9b7-480a-a2e3-01e45f3d54c1),volume_type_id=34d3b144-d9b7-480a-a2e3-01e45f3d54c1)' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 12:01:23 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-5aee26a9-34bf-4eab-920b-5fcdd58dcde7 tempest-ProjectReaderTests-377170324 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (288837a0-e1ce-491b-8eb9-15a237456bdd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 12:01:23 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-5aee26a9-34bf-4eab-920b-5fcdd58dcde7 tempest-ProjectReaderTests-377170324 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (288837a0-e1ce-491b-8eb9-15a237456bdd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 12:01:23 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-5aee26a9-34bf-4eab-920b-5fcdd58dcde7 tempest-ProjectReaderTests-377170324 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f8a1f55a-2496-451e-b155-f50de9219130) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 12:01:23 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-5aee26a9-34bf-4eab-920b-5fcdd58dcde7 tempest-ProjectReaderTests-377170324 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f8a1f55a-2496-451e-b155-f50de9219130) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '395aa496-f7e7-4996-894b-f677d62e3f59', 'volume_name': 'volume-395aa496-f7e7-4996-894b-f677d62e3f59', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 12:01:23 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-5aee26a9-34bf-4eab-920b-5fcdd58dcde7 tempest-ProjectReaderTests-377170324 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7d107f50-f175-4a47-b881-cf0cd38f42d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 12:01:23 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-5aee26a9-34bf-4eab-920b-5fcdd58dcde7 tempest-ProjectReaderTests-377170324 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7d107f50-f175-4a47-b881-cf0cd38f42d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 12:01:23 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-5aee26a9-34bf-4eab-920b-5fcdd58dcde7 tempest-ProjectReaderTests-377170324 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d7207378-fe4c-4c1a-afe9-33ed395e9c77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 12:01:23 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-5aee26a9-34bf-4eab-920b-5fcdd58dcde7 tempest-ProjectReaderTests-377170324 None] Volume 395aa496-f7e7-4996-894b-f677d62e3f59: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-395aa496-f7e7-4996-894b-f677d62e3f59', 'volume_size': 1} Nov 06 12:01:23 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-5aee26a9-34bf-4eab-920b-5fcdd58dcde7 tempest-ProjectReaderTests-377170324 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 12:01:23 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-3d0359a0-a230-4e48-b0e9-1f0ed7dcc27a tempest-VolumeImageDependencyTests-1267764821 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756" returned: 0 in 0.492s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 12:01:23 devstack cinder-volume[87116]: DEBUG cinder.manager [None req-3d0359a0-a230-4e48-b0e9-1f0ed7dcc27a tempest-VolumeImageDependencyTests-1267764821 None] Notifying Schedulers of capabilities ... {{(pid=87116) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 12:01:23 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-3d0359a0-a230-4e48-b0e9-1f0ed7dcc27a tempest-VolumeImageDependencyTests-1267764821 None] Deleted volume successfully. Nov 06 12:01:23 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-3d0359a0-a230-4e48-b0e9-1f0ed7dcc27a tempest-VolumeImageDependencyTests-1267764821 None] Lock "cinder-e731f3f1-a321-4803-a5e8-0ee2d57e8508-delete_volume" released by "delete_volume" :: held 1.868s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 12:01:23 devstack cinder-volume[87116]: DEBUG cinder.volume.flows.manager.create_volume [None req-9b22917f-d8e6-4a60-afd1-1756f49f0b23 tempest-CreateVolumesFromSnapshotTest-801883145 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87116) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 12:01:23 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-9b22917f-d8e6-4a60-afd1-1756f49f0b23 tempest-CreateVolumesFromSnapshotTest-801883145 None] Flow 'volume_create_manager' (3b581381-52cb-409b-83d9-26d8f12f55cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 12:01:23 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-9b22917f-d8e6-4a60-afd1-1756f49f0b23 tempest-CreateVolumesFromSnapshotTest-801883145 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eb223465-e017-4642-bb3c-56cd84150877) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 12:01:23 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-9b22917f-d8e6-4a60-afd1-1756f49f0b23 tempest-CreateVolumesFromSnapshotTest-801883145 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eb223465-e017-4642-bb3c-56cd84150877) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T11:01:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2122570896',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fdfbb11a-7479-49a0-b0df-60bbd0bd9416,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a5da2dc9692147e395382c9fbf06e8f1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T11:01:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T11:01:23Z,use_quota=True,user_id='5c9cccda78c7474b980ee674d31be245',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(34d3b144-d9b7-480a-a2e3-01e45f3d54c1),volume_type_id=34d3b144-d9b7-480a-a2e3-01e45f3d54c1)' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 12:01:23 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-9b22917f-d8e6-4a60-afd1-1756f49f0b23 tempest-CreateVolumesFromSnapshotTest-801883145 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (098da0a4-8f0c-47d0-b591-268ee0e82332) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 12:01:23 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-9b22917f-d8e6-4a60-afd1-1756f49f0b23 tempest-CreateVolumesFromSnapshotTest-801883145 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (098da0a4-8f0c-47d0-b591-268ee0e82332) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 12:01:23 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-9b22917f-d8e6-4a60-afd1-1756f49f0b23 tempest-CreateVolumesFromSnapshotTest-801883145 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6dd34831-4967-4441-bfed-9f31087a52a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 12:01:23 devstack sudo[106548]: pam_unix(sudo:session): session closed for user root Nov 06 12:01:23 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-9b22917f-d8e6-4a60-afd1-1756f49f0b23 tempest-CreateVolumesFromSnapshotTest-801883145 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6dd34831-4967-4441-bfed-9f31087a52a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fdfbb11a-7479-49a0-b0df-60bbd0bd9416', 'volume_name': 'volume-fdfbb11a-7479-49a0-b0df-60bbd0bd9416', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 12:01:23 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-9b22917f-d8e6-4a60-afd1-1756f49f0b23 tempest-CreateVolumesFromSnapshotTest-801883145 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fde0b0b0-e84d-4463-a153-ec708b37522f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 12:01:23 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-9b22917f-d8e6-4a60-afd1-1756f49f0b23 tempest-CreateVolumesFromSnapshotTest-801883145 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fde0b0b0-e84d-4463-a153-ec708b37522f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 12:01:23 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-9b22917f-d8e6-4a60-afd1-1756f49f0b23 tempest-CreateVolumesFromSnapshotTest-801883145 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (adbbca0b-254e-4054-a066-74edcace968c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 12:01:23 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-9b22917f-d8e6-4a60-afd1-1756f49f0b23 tempest-CreateVolumesFromSnapshotTest-801883145 None] Volume fdfbb11a-7479-49a0-b0df-60bbd0bd9416: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fdfbb11a-7479-49a0-b0df-60bbd0bd9416', 'volume_size': 1} Nov 06 12:01:23 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-9b22917f-d8e6-4a60-afd1-1756f49f0b23 tempest-CreateVolumesFromSnapshotTest-801883145 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 12:01:23 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-a1745b3a-4edd-4f0e-ad3b-abc9358208dc tempest-CinderUnicodeTest-583245689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-5ce3f341-5849-4cbd-b9bd-f70e73bd9dc8.697456b0-4ee7-4ef4-af9c-176247d8af7c" returned: 0 in 0.330s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 12:01:23 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-a1745b3a-4edd-4f0e-ad3b-abc9358208dc tempest-CinderUnicodeTest-583245689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-5ce3f341-5849-4cbd-b9bd-f70e73bd9dc8.info {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 12:01:23 devstack sudo[106552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-5ce3f341-5849-4cbd-b9bd-f70e73bd9dc8.info Nov 06 12:01:23 devstack sudo[106552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 12:01:23 devstack sudo[106552]: pam_unix(sudo:session): session closed for user root Nov 06 12:01:23 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-a1745b3a-4edd-4f0e-ad3b-abc9358208dc tempest-CinderUnicodeTest-583245689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-5ce3f341-5849-4cbd-b9bd-f70e73bd9dc8.info" returned: 0 in 0.294s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 12:01:23 devstack cinder-volume[87116]: WARNING cinder.volume.drivers.remotefs [None req-a1745b3a-4edd-4f0e-ad3b-abc9358208dc tempest-CinderUnicodeTest-583245689 None] /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-5ce3f341-5849-4cbd-b9bd-f70e73bd9dc8.info is being set with open permissions: ugo+rw Nov 06 12:01:23 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-a1745b3a-4edd-4f0e-ad3b-abc9358208dc tempest-CinderUnicodeTest-583245689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-5ce3f341-5849-4cbd-b9bd-f70e73bd9dc8.info {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 12:01:23 devstack cinder-volume[87116]: DEBUG cinder.volume.flows.manager.create_volume [None req-d28c9b79-a723-4c09-b85f-27fafcd104e3 tempest-CreateVolumesFromSnapshotTest-801883145 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87116) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 12:01:23 devstack sudo[106555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-5ce3f341-5849-4cbd-b9bd-f70e73bd9dc8.info Nov 06 12:01:23 devstack sudo[106555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 12:01:23 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-d28c9b79-a723-4c09-b85f-27fafcd104e3 tempest-CreateVolumesFromSnapshotTest-801883145 None] Flow 'volume_create_manager' (8b0d8c98-bde0-4790-8a78-7fdec6740178) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 12:01:24 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-d28c9b79-a723-4c09-b85f-27fafcd104e3 tempest-CreateVolumesFromSnapshotTest-801883145 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (02b4d220-b307-49a6-b087-03aa2e7c1f97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 12:01:24 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-d28c9b79-a723-4c09-b85f-27fafcd104e3 tempest-CreateVolumesFromSnapshotTest-801883145 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (02b4d220-b307-49a6-b087-03aa2e7c1f97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T11:01:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1479737550',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c4dc4f35-9840-4fa5-8aef-73fd29a622ef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a5da2dc9692147e395382c9fbf06e8f1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T11:01:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T11:01:24Z,use_quota=True,user_id='5c9cccda78c7474b980ee674d31be245',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(34d3b144-d9b7-480a-a2e3-01e45f3d54c1),volume_type_id=34d3b144-d9b7-480a-a2e3-01e45f3d54c1)' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 12:01:24 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-d28c9b79-a723-4c09-b85f-27fafcd104e3 tempest-CreateVolumesFromSnapshotTest-801883145 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9f8202ac-d98a-4080-9d69-9051377f5f76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 12:01:24 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-d28c9b79-a723-4c09-b85f-27fafcd104e3 tempest-CreateVolumesFromSnapshotTest-801883145 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9f8202ac-d98a-4080-9d69-9051377f5f76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 12:01:24 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-d28c9b79-a723-4c09-b85f-27fafcd104e3 tempest-CreateVolumesFromSnapshotTest-801883145 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (426448dd-fbaa-4ca7-899b-43c891dda1dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 12:01:24 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-d28c9b79-a723-4c09-b85f-27fafcd104e3 tempest-CreateVolumesFromSnapshotTest-801883145 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (426448dd-fbaa-4ca7-899b-43c891dda1dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c4dc4f35-9840-4fa5-8aef-73fd29a622ef', 'volume_name': 'volume-c4dc4f35-9840-4fa5-8aef-73fd29a622ef', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 12:01:24 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-d28c9b79-a723-4c09-b85f-27fafcd104e3 tempest-CreateVolumesFromSnapshotTest-801883145 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (89e1ba43-18f6-4be7-b138-0c095e061286) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 12:01:24 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-d28c9b79-a723-4c09-b85f-27fafcd104e3 tempest-CreateVolumesFromSnapshotTest-801883145 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (89e1ba43-18f6-4be7-b138-0c095e061286) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 12:01:24 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-d28c9b79-a723-4c09-b85f-27fafcd104e3 tempest-CreateVolumesFromSnapshotTest-801883145 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (47aa72c3-cb3f-4320-8663-c6368f23dbb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 12:01:24 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-d28c9b79-a723-4c09-b85f-27fafcd104e3 tempest-CreateVolumesFromSnapshotTest-801883145 None] Volume c4dc4f35-9840-4fa5-8aef-73fd29a622ef: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c4dc4f35-9840-4fa5-8aef-73fd29a622ef', 'volume_size': 1} Nov 06 12:01:24 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-d28c9b79-a723-4c09-b85f-27fafcd104e3 tempest-CreateVolumesFromSnapshotTest-801883145 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 12:01:24 devstack sudo[106555]: pam_unix(sudo:session): session closed for user root Nov 06 12:01:24 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-a1745b3a-4edd-4f0e-ad3b-abc9358208dc tempest-CinderUnicodeTest-583245689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-5ce3f341-5849-4cbd-b9bd-f70e73bd9dc8.info" returned: 0 in 0.359s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 12:01:24 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-a1745b3a-4edd-4f0e-ad3b-abc9358208dc tempest-CinderUnicodeTest-583245689 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.818s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 12:01:24 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-f2f7c9de-7239-425d-ae32-199ddd70650d tempest-CreateVolumesFromSnapshotTest-801883145 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.527s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 12:01:24 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-f2f7c9de-7239-425d-ae32-199ddd70650d tempest-CreateVolumesFromSnapshotTest-801883145 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T11:01:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1716394072',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b4161cde-e732-4565-bcf3-93e4c2263394,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a5da2dc9692147e395382c9fbf06e8f1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T11:01:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T11:01:23Z,use_quota=True,user_id='5c9cccda78c7474b980ee674d31be245',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(34d3b144-d9b7-480a-a2e3-01e45f3d54c1),volume_type_id=34d3b144-d9b7-480a-a2e3-01e45f3d54c1)}" {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 12:01:24 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-f2f7c9de-7239-425d-ae32-199ddd70650d tempest-CreateVolumesFromSnapshotTest-801883145 None] Creating volume b4161cde-e732-4565-bcf3-93e4c2263394 {{(pid=87116) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 12:01:24 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-f2f7c9de-7239-425d-ae32-199ddd70650d tempest-CreateVolumesFromSnapshotTest-801883145 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 12:01:24 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-f2f7c9de-7239-425d-ae32-199ddd70650d tempest-CreateVolumesFromSnapshotTest-801883145 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 12:01:24 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-f2f7c9de-7239-425d-ae32-199ddd70650d tempest-CreateVolumesFromSnapshotTest-801883145 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 12:01:24 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-f2f7c9de-7239-425d-ae32-199ddd70650d tempest-CreateVolumesFromSnapshotTest-801883145 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 12:01:24 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-f2f7c9de-7239-425d-ae32-199ddd70650d tempest-CreateVolumesFromSnapshotTest-801883145 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 12:01:24 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-f2f7c9de-7239-425d-ae32-199ddd70650d tempest-CreateVolumesFromSnapshotTest-801883145 None] Selected osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f as target Quobyte volume. {{(pid=87116) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 12:01:24 devstack cinder-volume[87116]: INFO cinder.volume.drivers.remotefs [None req-f2f7c9de-7239-425d-ae32-199ddd70650d tempest-CreateVolumesFromSnapshotTest-801883145 None] casted to osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f Nov 06 12:01:24 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-f2f7c9de-7239-425d-ae32-199ddd70650d tempest-CreateVolumesFromSnapshotTest-801883145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-b4161cde-e732-4565-bcf3-93e4c2263394 1073741824 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 12:01:24 devstack sudo[106558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-b4161cde-e732-4565-bcf3-93e4c2263394 1073741824 Nov 06 12:01:24 devstack sudo[106558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 12:01:24 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-a1745b3a-4edd-4f0e-ad3b-abc9358208dc tempest-CinderUnicodeTest-583245689 None] Create snapshot completed successfully Nov 06 12:01:24 devstack cinder-volume[87116]: DEBUG cinder.volume.flows.manager.create_volume [None req-41653b7a-5ed6-4e2e-b89a-dde7f6261b77 tempest-CreateVolumesFromSnapshotTest-801883145 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87116) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 12:01:24 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-41653b7a-5ed6-4e2e-b89a-dde7f6261b77 tempest-CreateVolumesFromSnapshotTest-801883145 None] Flow 'volume_create_manager' (c60c08df-4223-4049-b916-5d32c03e3e03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 12:01:24 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-41653b7a-5ed6-4e2e-b89a-dde7f6261b77 tempest-CreateVolumesFromSnapshotTest-801883145 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (14a11c53-2224-41c1-9e20-2357e61733f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 12:01:24 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-41653b7a-5ed6-4e2e-b89a-dde7f6261b77 tempest-CreateVolumesFromSnapshotTest-801883145 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (14a11c53-2224-41c1-9e20-2357e61733f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T11:01:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1530187108',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cdab018a-fe8f-4a78-8f29-e8283a874be1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a5da2dc9692147e395382c9fbf06e8f1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T11:01:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T11:01:24Z,use_quota=True,user_id='5c9cccda78c7474b980ee674d31be245',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(34d3b144-d9b7-480a-a2e3-01e45f3d54c1),volume_type_id=34d3b144-d9b7-480a-a2e3-01e45f3d54c1)' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 12:01:24 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-41653b7a-5ed6-4e2e-b89a-dde7f6261b77 tempest-CreateVolumesFromSnapshotTest-801883145 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (220f82b6-6951-4b6d-b6fa-35a5c5659902) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 12:01:24 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-41653b7a-5ed6-4e2e-b89a-dde7f6261b77 tempest-CreateVolumesFromSnapshotTest-801883145 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (220f82b6-6951-4b6d-b6fa-35a5c5659902) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 12:01:24 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-41653b7a-5ed6-4e2e-b89a-dde7f6261b77 tempest-CreateVolumesFromSnapshotTest-801883145 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (758d1a25-7ad7-4155-9103-e7675a52069a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 12:01:24 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-41653b7a-5ed6-4e2e-b89a-dde7f6261b77 tempest-CreateVolumesFromSnapshotTest-801883145 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (758d1a25-7ad7-4155-9103-e7675a52069a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cdab018a-fe8f-4a78-8f29-e8283a874be1', 'volume_name': 'volume-cdab018a-fe8f-4a78-8f29-e8283a874be1', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 12:01:24 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-41653b7a-5ed6-4e2e-b89a-dde7f6261b77 tempest-CreateVolumesFromSnapshotTest-801883145 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0e3cee0a-19d0-465d-afe4-c9ea0c7c7d85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 12:01:24 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-41653b7a-5ed6-4e2e-b89a-dde7f6261b77 tempest-CreateVolumesFromSnapshotTest-801883145 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0e3cee0a-19d0-465d-afe4-c9ea0c7c7d85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 12:01:24 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-41653b7a-5ed6-4e2e-b89a-dde7f6261b77 tempest-CreateVolumesFromSnapshotTest-801883145 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (70424f63-4dc2-4420-be2b-aee0ec75e061) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 12:01:24 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-41653b7a-5ed6-4e2e-b89a-dde7f6261b77 tempest-CreateVolumesFromSnapshotTest-801883145 None] Volume cdab018a-fe8f-4a78-8f29-e8283a874be1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cdab018a-fe8f-4a78-8f29-e8283a874be1', 'volume_size': 1} Nov 06 12:01:24 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-41653b7a-5ed6-4e2e-b89a-dde7f6261b77 tempest-CreateVolumesFromSnapshotTest-801883145 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 12:01:24 devstack sudo[106558]: pam_unix(sudo:session): session closed for user root Nov 06 12:01:24 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-f2f7c9de-7239-425d-ae32-199ddd70650d tempest-CreateVolumesFromSnapshotTest-801883145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-b4161cde-e732-4565-bcf3-93e4c2263394 1073741824" returned: 0 in 0.492s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 12:01:24 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-f2f7c9de-7239-425d-ae32-199ddd70650d tempest-CreateVolumesFromSnapshotTest-801883145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-b4161cde-e732-4565-bcf3-93e4c2263394 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 12:01:24 devstack sudo[106565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-b4161cde-e732-4565-bcf3-93e4c2263394 Nov 06 12:01:24 devstack sudo[106565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 12:01:25 devstack sudo[106565]: pam_unix(sudo:session): session closed for user root Nov 06 12:01:25 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-f2f7c9de-7239-425d-ae32-199ddd70650d tempest-CreateVolumesFromSnapshotTest-801883145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-b4161cde-e732-4565-bcf3-93e4c2263394" returned: 0 in 0.279s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 12:01:25 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-f2f7c9de-7239-425d-ae32-199ddd70650d tempest-CreateVolumesFromSnapshotTest-801883145 None] <== create_volume: return (825ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f'} {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 12:01:25 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-f2f7c9de-7239-425d-ae32-199ddd70650d tempest-CreateVolumesFromSnapshotTest-801883145 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.828s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 12:01:25 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-c6eb478b-51c9-4cce-aa19-661c7f4c7098 tempest-CreateVolumesFromSnapshotTest-801883145 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.895s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 12:01:25 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-c6eb478b-51c9-4cce-aa19-661c7f4c7098 tempest-CreateVolumesFromSnapshotTest-801883145 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T11:01:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-640389324',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ab9358c6-88df-4fcb-b940-9625bf001525,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a5da2dc9692147e395382c9fbf06e8f1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T11:01:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T11:01:23Z,use_quota=True,user_id='5c9cccda78c7474b980ee674d31be245',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(34d3b144-d9b7-480a-a2e3-01e45f3d54c1),volume_type_id=34d3b144-d9b7-480a-a2e3-01e45f3d54c1)}" {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 12:01:25 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-c6eb478b-51c9-4cce-aa19-661c7f4c7098 tempest-CreateVolumesFromSnapshotTest-801883145 None] Creating volume ab9358c6-88df-4fcb-b940-9625bf001525 {{(pid=87116) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 12:01:25 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-c6eb478b-51c9-4cce-aa19-661c7f4c7098 tempest-CreateVolumesFromSnapshotTest-801883145 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 12:01:25 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-c6eb478b-51c9-4cce-aa19-661c7f4c7098 tempest-CreateVolumesFromSnapshotTest-801883145 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 12:01:25 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-c6eb478b-51c9-4cce-aa19-661c7f4c7098 tempest-CreateVolumesFromSnapshotTest-801883145 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 12:01:25 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-c6eb478b-51c9-4cce-aa19-661c7f4c7098 tempest-CreateVolumesFromSnapshotTest-801883145 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 12:01:25 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-c6eb478b-51c9-4cce-aa19-661c7f4c7098 tempest-CreateVolumesFromSnapshotTest-801883145 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 12:01:25 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-c6eb478b-51c9-4cce-aa19-661c7f4c7098 tempest-CreateVolumesFromSnapshotTest-801883145 None] Selected osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f as target Quobyte volume. {{(pid=87116) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 12:01:25 devstack cinder-volume[87116]: INFO cinder.volume.drivers.remotefs [None req-c6eb478b-51c9-4cce-aa19-661c7f4c7098 tempest-CreateVolumesFromSnapshotTest-801883145 None] casted to osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f Nov 06 12:01:25 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-c6eb478b-51c9-4cce-aa19-661c7f4c7098 tempest-CreateVolumesFromSnapshotTest-801883145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-ab9358c6-88df-4fcb-b940-9625bf001525 1073741824 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 12:01:25 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-f2f7c9de-7239-425d-ae32-199ddd70650d tempest-CreateVolumesFromSnapshotTest-801883145 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (67b02d98-1241-4a30-b91a-8521158aeb85) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b4161cde-e732-4565-bcf3-93e4c2263394', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 12:01:25 devstack sudo[106568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-ab9358c6-88df-4fcb-b940-9625bf001525 1073741824 Nov 06 12:01:25 devstack sudo[106568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 12:01:25 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-f2f7c9de-7239-425d-ae32-199ddd70650d tempest-CreateVolumesFromSnapshotTest-801883145 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bd158a77-e262-4e3b-b068-e4fb3dd8da75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 12:01:25 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-f2f7c9de-7239-425d-ae32-199ddd70650d tempest-CreateVolumesFromSnapshotTest-801883145 None] Volume volume-b4161cde-e732-4565-bcf3-93e4c2263394 (b4161cde-e732-4565-bcf3-93e4c2263394): created successfully Nov 06 12:01:25 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-f2f7c9de-7239-425d-ae32-199ddd70650d tempest-CreateVolumesFromSnapshotTest-801883145 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bd158a77-e262-4e3b-b068-e4fb3dd8da75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 12:01:25 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-f2f7c9de-7239-425d-ae32-199ddd70650d tempest-CreateVolumesFromSnapshotTest-801883145 None] Flow 'volume_create_manager' (829cc40c-5346-4efc-bde4-140aa9a47a36) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 12:01:25 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-f2f7c9de-7239-425d-ae32-199ddd70650d tempest-CreateVolumesFromSnapshotTest-801883145 None] Created volume successfully. Nov 06 12:01:25 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-11f828bc-ce26-4c1c-a5ff-eff786a932b1 tempest-CinderUnicodeTest-583245689 None] Acquiring lock "cinder-697456b0-4ee7-4ef4-af9c-176247d8af7c-delete_snapshot" by "delete_snapshot" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 12:01:25 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-11f828bc-ce26-4c1c-a5ff-eff786a932b1 tempest-CinderUnicodeTest-583245689 None] Lock "cinder-697456b0-4ee7-4ef4-af9c-176247d8af7c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 12:01:25 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-11f828bc-ce26-4c1c-a5ff-eff786a932b1 tempest-CinderUnicodeTest-583245689 None] Acquiring lock "cinder-quobyte-5ce3f341-5849-4cbd-b9bd-f70e73bd9dc8" by "delete_snapshot" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 12:01:25 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-11f828bc-ce26-4c1c-a5ff-eff786a932b1 tempest-CinderUnicodeTest-583245689 None] Lock "cinder-quobyte-5ce3f341-5849-4cbd-b9bd-f70e73bd9dc8" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 12:01:25 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-11f828bc-ce26-4c1c-a5ff-eff786a932b1 tempest-CinderUnicodeTest-583245689 None] Acquiring lock "cinder-quobyte-697456b0-4ee7-4ef4-af9c-176247d8af7c" by "_delete_snapshot" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 12:01:25 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-11f828bc-ce26-4c1c-a5ff-eff786a932b1 tempest-CinderUnicodeTest-583245689 None] Lock "cinder-quobyte-697456b0-4ee7-4ef4-af9c-176247d8af7c" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 12:01:25 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-11f828bc-ce26-4c1c-a5ff-eff786a932b1 tempest-CinderUnicodeTest-583245689 None] Deleting offline snapshot 697456b0-4ee7-4ef4-af9c-176247d8af7c of volume 5ce3f341-5849-4cbd-b9bd-f70e73bd9dc8 {{(pid=87116) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 06 12:01:25 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-11f828bc-ce26-4c1c-a5ff-eff786a932b1 tempest-CinderUnicodeTest-583245689 None] snapshot_file for this snap is: volume-5ce3f341-5849-4cbd-b9bd-f70e73bd9dc8.697456b0-4ee7-4ef4-af9c-176247d8af7c {{(pid=87116) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 06 12:01:25 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fcf0218-6457-438f-b4de-b3d40ab3aa5f]: (4, 'qcow2') {{(pid=88420) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 12:01:25 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-11f828bc-ce26-4c1c-a5ff-eff786a932b1 tempest-CinderUnicodeTest-583245689 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-5ce3f341-5849-4cbd-b9bd-f70e73bd9dc8.697456b0-4ee7-4ef4-af9c-176247d8af7c {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 12:01:25 devstack sudo[106568]: pam_unix(sudo:session): session closed for user root Nov 06 12:01:25 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-c6eb478b-51c9-4cce-aa19-661c7f4c7098 tempest-CreateVolumesFromSnapshotTest-801883145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-ab9358c6-88df-4fcb-b940-9625bf001525 1073741824" returned: 0 in 0.544s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 12:01:25 devstack sudo[106574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-5ce3f341-5849-4cbd-b9bd-f70e73bd9dc8.697456b0-4ee7-4ef4-af9c-176247d8af7c Nov 06 12:01:25 devstack sudo[106574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 12:01:25 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-c6eb478b-51c9-4cce-aa19-661c7f4c7098 tempest-CreateVolumesFromSnapshotTest-801883145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-ab9358c6-88df-4fcb-b940-9625bf001525 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 12:01:25 devstack sudo[106576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-ab9358c6-88df-4fcb-b940-9625bf001525 Nov 06 12:01:25 devstack sudo[106576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 12:01:26 devstack sudo[106574]: pam_unix(sudo:session): session closed for user root Nov 06 12:01:26 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-11f828bc-ce26-4c1c-a5ff-eff786a932b1 tempest-CinderUnicodeTest-583245689 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-5ce3f341-5849-4cbd-b9bd-f70e73bd9dc8.697456b0-4ee7-4ef4-af9c-176247d8af7c" returned: 0 in 0.438s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 12:01:26 devstack sudo[106576]: pam_unix(sudo:session): session closed for user root Nov 06 12:01:26 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-11f828bc-ce26-4c1c-a5ff-eff786a932b1 tempest-CinderUnicodeTest-583245689 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5ce3f341-5849-4cbd-b9bd-f70e73bd9dc8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87116) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 12:01:26 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-c6eb478b-51c9-4cce-aa19-661c7f4c7098 tempest-CreateVolumesFromSnapshotTest-801883145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-ab9358c6-88df-4fcb-b940-9625bf001525" returned: 0 in 0.336s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 12:01:26 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-c6eb478b-51c9-4cce-aa19-661c7f4c7098 tempest-CreateVolumesFromSnapshotTest-801883145 None] <== create_volume: return (930ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f'} {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 12:01:26 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-c6eb478b-51c9-4cce-aa19-661c7f4c7098 tempest-CreateVolumesFromSnapshotTest-801883145 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.934s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 12:01:26 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-5aee26a9-34bf-4eab-920b-5fcdd58dcde7 tempest-ProjectReaderTests-377170324 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.658s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 12:01:26 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-5aee26a9-34bf-4eab-920b-5fcdd58dcde7 tempest-ProjectReaderTests-377170324 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T11:01:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1778840868',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=395aa496-f7e7-4996-894b-f677d62e3f59,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='865d378d37cd42ed98432cd1ce1e41be',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T11:01:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T11:01:23Z,use_quota=True,user_id='8acc7287c82b436186731f24c32b21ce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(34d3b144-d9b7-480a-a2e3-01e45f3d54c1),volume_type_id=34d3b144-d9b7-480a-a2e3-01e45f3d54c1)}" {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 12:01:26 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-5aee26a9-34bf-4eab-920b-5fcdd58dcde7 tempest-ProjectReaderTests-377170324 None] Creating volume 395aa496-f7e7-4996-894b-f677d62e3f59 {{(pid=87116) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 12:01:26 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-5aee26a9-34bf-4eab-920b-5fcdd58dcde7 tempest-ProjectReaderTests-377170324 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 12:01:26 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-5aee26a9-34bf-4eab-920b-5fcdd58dcde7 tempest-ProjectReaderTests-377170324 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 12:01:26 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-5aee26a9-34bf-4eab-920b-5fcdd58dcde7 tempest-ProjectReaderTests-377170324 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 12:01:26 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-5aee26a9-34bf-4eab-920b-5fcdd58dcde7 tempest-ProjectReaderTests-377170324 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 12:01:26 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-5aee26a9-34bf-4eab-920b-5fcdd58dcde7 tempest-ProjectReaderTests-377170324 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 12:01:26 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-5aee26a9-34bf-4eab-920b-5fcdd58dcde7 tempest-ProjectReaderTests-377170324 None] Selected osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f as target Quobyte volume. {{(pid=87116) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 12:01:26 devstack cinder-volume[87116]: INFO cinder.volume.drivers.remotefs [None req-5aee26a9-34bf-4eab-920b-5fcdd58dcde7 tempest-ProjectReaderTests-377170324 None] casted to osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f Nov 06 12:01:26 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-5aee26a9-34bf-4eab-920b-5fcdd58dcde7 tempest-ProjectReaderTests-377170324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-395aa496-f7e7-4996-894b-f677d62e3f59 1073741824 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 12:01:26 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[53004806-5be5-477c-b9a4-dcdb08f43f36]: (4, 'qcow2') {{(pid=88420) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 12:01:26 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-11f828bc-ce26-4c1c-a5ff-eff786a932b1 tempest-CinderUnicodeTest-583245689 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-5ce3f341-5849-4cbd-b9bd-f70e73bd9dc8 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 12:01:26 devstack sudo[106582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-395aa496-f7e7-4996-894b-f677d62e3f59 1073741824 Nov 06 12:01:26 devstack sudo[106582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 12:01:26 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-c6eb478b-51c9-4cce-aa19-661c7f4c7098 tempest-CreateVolumesFromSnapshotTest-801883145 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8fdbb55a-f528-4400-aa82-9f9d4947e67b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ab9358c6-88df-4fcb-b940-9625bf001525', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 12:01:26 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-c6eb478b-51c9-4cce-aa19-661c7f4c7098 tempest-CreateVolumesFromSnapshotTest-801883145 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9691dcaa-5654-4027-99c8-4d81cbb2a71d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 12:01:26 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-c6eb478b-51c9-4cce-aa19-661c7f4c7098 tempest-CreateVolumesFromSnapshotTest-801883145 None] Volume volume-ab9358c6-88df-4fcb-b940-9625bf001525 (ab9358c6-88df-4fcb-b940-9625bf001525): created successfully Nov 06 12:01:26 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-c6eb478b-51c9-4cce-aa19-661c7f4c7098 tempest-CreateVolumesFromSnapshotTest-801883145 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9691dcaa-5654-4027-99c8-4d81cbb2a71d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 12:01:26 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-c6eb478b-51c9-4cce-aa19-661c7f4c7098 tempest-CreateVolumesFromSnapshotTest-801883145 None] Flow 'volume_create_manager' (54bc55a8-955c-4bdc-8503-3621b3fb31e0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 12:01:26 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-c6eb478b-51c9-4cce-aa19-661c7f4c7098 tempest-CreateVolumesFromSnapshotTest-801883145 None] Created volume successfully. Nov 06 12:01:26 devstack sudo[106583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-5ce3f341-5849-4cbd-b9bd-f70e73bd9dc8 Nov 06 12:01:26 devstack sudo[106583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 12:01:26 devstack sudo[106583]: pam_unix(sudo:session): session closed for user root Nov 06 12:01:26 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-11f828bc-ce26-4c1c-a5ff-eff786a932b1 tempest-CinderUnicodeTest-583245689 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-5ce3f341-5849-4cbd-b9bd-f70e73bd9dc8" returned: 0 in 0.447s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 12:01:26 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-11f828bc-ce26-4c1c-a5ff-eff786a932b1 tempest-CinderUnicodeTest-583245689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-5ce3f341-5849-4cbd-b9bd-f70e73bd9dc8.697456b0-4ee7-4ef4-af9c-176247d8af7c {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 12:01:26 devstack sudo[106594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-5ce3f341-5849-4cbd-b9bd-f70e73bd9dc8.697456b0-4ee7-4ef4-af9c-176247d8af7c Nov 06 12:01:26 devstack sudo[106594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 12:01:26 devstack sudo[106582]: pam_unix(sudo:session): session closed for user root Nov 06 12:01:26 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-5aee26a9-34bf-4eab-920b-5fcdd58dcde7 tempest-ProjectReaderTests-377170324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-395aa496-f7e7-4996-894b-f677d62e3f59 1073741824" returned: 0 in 0.514s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 12:01:26 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-5aee26a9-34bf-4eab-920b-5fcdd58dcde7 tempest-ProjectReaderTests-377170324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-395aa496-f7e7-4996-894b-f677d62e3f59 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 12:01:26 devstack sudo[106596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-395aa496-f7e7-4996-894b-f677d62e3f59 Nov 06 12:01:26 devstack sudo[106596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 12:01:26 devstack sudo[106596]: pam_unix(sudo:session): session closed for user root Nov 06 12:01:26 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-5aee26a9-34bf-4eab-920b-5fcdd58dcde7 tempest-ProjectReaderTests-377170324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-395aa496-f7e7-4996-894b-f677d62e3f59" returned: 0 in 0.270s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 12:01:26 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-5aee26a9-34bf-4eab-920b-5fcdd58dcde7 tempest-ProjectReaderTests-377170324 None] <== create_volume: return (828ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f'} {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 12:01:26 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-5aee26a9-34bf-4eab-920b-5fcdd58dcde7 tempest-ProjectReaderTests-377170324 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.832s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 12:01:26 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-9b22917f-d8e6-4a60-afd1-1756f49f0b23 tempest-CreateVolumesFromSnapshotTest-801883145 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.324s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 12:01:26 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-9b22917f-d8e6-4a60-afd1-1756f49f0b23 tempest-CreateVolumesFromSnapshotTest-801883145 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T11:01:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2122570896',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fdfbb11a-7479-49a0-b0df-60bbd0bd9416,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a5da2dc9692147e395382c9fbf06e8f1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T11:01:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T11:01:23Z,use_quota=True,user_id='5c9cccda78c7474b980ee674d31be245',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(34d3b144-d9b7-480a-a2e3-01e45f3d54c1),volume_type_id=34d3b144-d9b7-480a-a2e3-01e45f3d54c1)}" {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 12:01:26 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-9b22917f-d8e6-4a60-afd1-1756f49f0b23 tempest-CreateVolumesFromSnapshotTest-801883145 None] Creating volume fdfbb11a-7479-49a0-b0df-60bbd0bd9416 {{(pid=87116) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 12:01:26 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-9b22917f-d8e6-4a60-afd1-1756f49f0b23 tempest-CreateVolumesFromSnapshotTest-801883145 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 12:01:26 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-9b22917f-d8e6-4a60-afd1-1756f49f0b23 tempest-CreateVolumesFromSnapshotTest-801883145 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 12:01:26 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-9b22917f-d8e6-4a60-afd1-1756f49f0b23 tempest-CreateVolumesFromSnapshotTest-801883145 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 12:01:26 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-9b22917f-d8e6-4a60-afd1-1756f49f0b23 tempest-CreateVolumesFromSnapshotTest-801883145 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 12:01:26 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-9b22917f-d8e6-4a60-afd1-1756f49f0b23 tempest-CreateVolumesFromSnapshotTest-801883145 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 12:01:26 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-9b22917f-d8e6-4a60-afd1-1756f49f0b23 tempest-CreateVolumesFromSnapshotTest-801883145 None] Selected osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f as target Quobyte volume. {{(pid=87116) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 12:01:26 devstack cinder-volume[87116]: INFO cinder.volume.drivers.remotefs [None req-9b22917f-d8e6-4a60-afd1-1756f49f0b23 tempest-CreateVolumesFromSnapshotTest-801883145 None] casted to osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f Nov 06 12:01:26 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-9b22917f-d8e6-4a60-afd1-1756f49f0b23 tempest-CreateVolumesFromSnapshotTest-801883145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-fdfbb11a-7479-49a0-b0df-60bbd0bd9416 1073741824 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 12:01:26 devstack sudo[106594]: pam_unix(sudo:session): session closed for user root Nov 06 12:01:26 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-11f828bc-ce26-4c1c-a5ff-eff786a932b1 tempest-CinderUnicodeTest-583245689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-5ce3f341-5849-4cbd-b9bd-f70e73bd9dc8.697456b0-4ee7-4ef4-af9c-176247d8af7c" returned: 0 in 0.393s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 12:01:26 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-11f828bc-ce26-4c1c-a5ff-eff786a932b1 tempest-CinderUnicodeTest-583245689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-5ce3f341-5849-4cbd-b9bd-f70e73bd9dc8.697456b0-4ee7-4ef4-af9c-176247d8af7c {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 12:01:26 devstack sudo[106602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-fdfbb11a-7479-49a0-b0df-60bbd0bd9416 1073741824 Nov 06 12:01:26 devstack sudo[106602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 12:01:26 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-5aee26a9-34bf-4eab-920b-5fcdd58dcde7 tempest-ProjectReaderTests-377170324 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d7207378-fe4c-4c1a-afe9-33ed395e9c77) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-395aa496-f7e7-4996-894b-f677d62e3f59', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 12:01:26 devstack sudo[106604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-5ce3f341-5849-4cbd-b9bd-f70e73bd9dc8.697456b0-4ee7-4ef4-af9c-176247d8af7c Nov 06 12:01:26 devstack sudo[106604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 12:01:26 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-5aee26a9-34bf-4eab-920b-5fcdd58dcde7 tempest-ProjectReaderTests-377170324 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (adc57ff4-b572-4f16-989e-e707da37a5a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 12:01:27 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-5aee26a9-34bf-4eab-920b-5fcdd58dcde7 tempest-ProjectReaderTests-377170324 None] Volume volume-395aa496-f7e7-4996-894b-f677d62e3f59 (395aa496-f7e7-4996-894b-f677d62e3f59): created successfully Nov 06 12:01:27 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-5aee26a9-34bf-4eab-920b-5fcdd58dcde7 tempest-ProjectReaderTests-377170324 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (adc57ff4-b572-4f16-989e-e707da37a5a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 12:01:27 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-5aee26a9-34bf-4eab-920b-5fcdd58dcde7 tempest-ProjectReaderTests-377170324 None] Flow 'volume_create_manager' (3ddc7c5c-61ad-4e55-9a45-f5f3bab7f986) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 12:01:27 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-5aee26a9-34bf-4eab-920b-5fcdd58dcde7 tempest-ProjectReaderTests-377170324 None] Created volume successfully. Nov 06 12:01:27 devstack sudo[106604]: pam_unix(sudo:session): session closed for user root Nov 06 12:01:27 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-11f828bc-ce26-4c1c-a5ff-eff786a932b1 tempest-CinderUnicodeTest-583245689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-5ce3f341-5849-4cbd-b9bd-f70e73bd9dc8.697456b0-4ee7-4ef4-af9c-176247d8af7c" returned: 0 in 0.265s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 12:01:27 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-11f828bc-ce26-4c1c-a5ff-eff786a932b1 tempest-CinderUnicodeTest-583245689 None] Lock "cinder-quobyte-697456b0-4ee7-4ef4-af9c-176247d8af7c" released by "_delete_snapshot" :: held 1.706s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 12:01:27 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-11f828bc-ce26-4c1c-a5ff-eff786a932b1 tempest-CinderUnicodeTest-583245689 None] Lock "cinder-quobyte-5ce3f341-5849-4cbd-b9bd-f70e73bd9dc8" released by "delete_snapshot" :: held 1.737s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 12:01:27 devstack cinder-volume[87116]: DEBUG cinder.quota [None req-11f828bc-ce26-4c1c-a5ff-eff786a932b1 tempest-CinderUnicodeTest-583245689 None] Created reservations ['906d3e24-f0e4-44a3-99d6-ca3c4ded8b52', 'a7251777-6585-4249-8ce7-8442c79bb5c3', '65f232b4-46cc-473b-b65f-a4e304ddf1f7', '1823b1aa-129c-4fd1-b3b1-e966bc4e223e'] {{(pid=87116) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 12:01:27 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-11f828bc-ce26-4c1c-a5ff-eff786a932b1 tempest-CinderUnicodeTest-583245689 None] Delete snapshot completed successfully. Nov 06 12:01:27 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-11f828bc-ce26-4c1c-a5ff-eff786a932b1 tempest-CinderUnicodeTest-583245689 None] Lock "cinder-697456b0-4ee7-4ef4-af9c-176247d8af7c-delete_snapshot" released by "delete_snapshot" :: held 1.913s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 12:01:27 devstack sudo[106602]: pam_unix(sudo:session): session closed for user root Nov 06 12:01:27 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-9b22917f-d8e6-4a60-afd1-1756f49f0b23 tempest-CreateVolumesFromSnapshotTest-801883145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-fdfbb11a-7479-49a0-b0df-60bbd0bd9416 1073741824" returned: 0 in 0.555s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 12:01:27 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-9b22917f-d8e6-4a60-afd1-1756f49f0b23 tempest-CreateVolumesFromSnapshotTest-801883145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-fdfbb11a-7479-49a0-b0df-60bbd0bd9416 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 12:01:27 devstack sudo[106611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-fdfbb11a-7479-49a0-b0df-60bbd0bd9416 Nov 06 12:01:27 devstack sudo[106611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 12:01:27 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-8afd9ee9-0a76-49ca-b8e1-8b3ea72fb04e tempest-CinderUnicodeTest-583245689 None] Acquiring lock "cinder-5ce3f341-5849-4cbd-b9bd-f70e73bd9dc8-delete_volume" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 12:01:27 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-12753246-6d6d-4964-9aa2-7257da56b078 tempest-ProjectReaderTests-377170324 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 12:01:27 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-8afd9ee9-0a76-49ca-b8e1-8b3ea72fb04e tempest-CinderUnicodeTest-583245689 None] Lock "cinder-5ce3f341-5849-4cbd-b9bd-f70e73bd9dc8-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 12:01:27 devstack sudo[106611]: pam_unix(sudo:session): session closed for user root Nov 06 12:01:27 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-9b22917f-d8e6-4a60-afd1-1756f49f0b23 tempest-CreateVolumesFromSnapshotTest-801883145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-fdfbb11a-7479-49a0-b0df-60bbd0bd9416" returned: 0 in 0.338s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 12:01:27 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-9b22917f-d8e6-4a60-afd1-1756f49f0b23 tempest-CreateVolumesFromSnapshotTest-801883145 None] <== create_volume: return (962ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f'} {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 12:01:27 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-9b22917f-d8e6-4a60-afd1-1756f49f0b23 tempest-CreateVolumesFromSnapshotTest-801883145 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.967s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 12:01:27 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-d28c9b79-a723-4c09-b85f-27fafcd104e3 tempest-CreateVolumesFromSnapshotTest-801883145 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.811s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 12:01:27 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-d28c9b79-a723-4c09-b85f-27fafcd104e3 tempest-CreateVolumesFromSnapshotTest-801883145 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T11:01:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1479737550',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c4dc4f35-9840-4fa5-8aef-73fd29a622ef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a5da2dc9692147e395382c9fbf06e8f1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T11:01:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T11:01:24Z,use_quota=True,user_id='5c9cccda78c7474b980ee674d31be245',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(34d3b144-d9b7-480a-a2e3-01e45f3d54c1),volume_type_id=34d3b144-d9b7-480a-a2e3-01e45f3d54c1)}" {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 12:01:27 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-d28c9b79-a723-4c09-b85f-27fafcd104e3 tempest-CreateVolumesFromSnapshotTest-801883145 None] Creating volume c4dc4f35-9840-4fa5-8aef-73fd29a622ef {{(pid=87116) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 12:01:27 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-d28c9b79-a723-4c09-b85f-27fafcd104e3 tempest-CreateVolumesFromSnapshotTest-801883145 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 12:01:27 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-d28c9b79-a723-4c09-b85f-27fafcd104e3 tempest-CreateVolumesFromSnapshotTest-801883145 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 12:01:27 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-d28c9b79-a723-4c09-b85f-27fafcd104e3 tempest-CreateVolumesFromSnapshotTest-801883145 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 12:01:27 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-d28c9b79-a723-4c09-b85f-27fafcd104e3 tempest-CreateVolumesFromSnapshotTest-801883145 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 12:01:27 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-d28c9b79-a723-4c09-b85f-27fafcd104e3 tempest-CreateVolumesFromSnapshotTest-801883145 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 12:01:27 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-d28c9b79-a723-4c09-b85f-27fafcd104e3 tempest-CreateVolumesFromSnapshotTest-801883145 None] Selected osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f as target Quobyte volume. {{(pid=87116) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 12:01:27 devstack cinder-volume[87116]: INFO cinder.volume.drivers.remotefs [None req-d28c9b79-a723-4c09-b85f-27fafcd104e3 tempest-CreateVolumesFromSnapshotTest-801883145 None] casted to osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f Nov 06 12:01:27 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-d28c9b79-a723-4c09-b85f-27fafcd104e3 tempest-CreateVolumesFromSnapshotTest-801883145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-c4dc4f35-9840-4fa5-8aef-73fd29a622ef 1073741824 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 12:01:27 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-8afd9ee9-0a76-49ca-b8e1-8b3ea72fb04e tempest-CinderUnicodeTest-583245689 None] Acquiring lock "cinder-quobyte-5ce3f341-5849-4cbd-b9bd-f70e73bd9dc8" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 12:01:27 devstack sudo[106614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-c4dc4f35-9840-4fa5-8aef-73fd29a622ef 1073741824 Nov 06 12:01:27 devstack sudo[106614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 12:01:27 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-9b22917f-d8e6-4a60-afd1-1756f49f0b23 tempest-CreateVolumesFromSnapshotTest-801883145 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (adbbca0b-254e-4054-a066-74edcace968c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fdfbb11a-7479-49a0-b0df-60bbd0bd9416', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 12:01:27 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-9b22917f-d8e6-4a60-afd1-1756f49f0b23 tempest-CreateVolumesFromSnapshotTest-801883145 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec94e0a1-67df-4320-9cfc-88750df5ed51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 12:01:27 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-8afd9ee9-0a76-49ca-b8e1-8b3ea72fb04e tempest-CinderUnicodeTest-583245689 None] Lock "cinder-quobyte-5ce3f341-5849-4cbd-b9bd-f70e73bd9dc8" acquired by "delete_volume" :: waited 0.033s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 12:01:27 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-9b22917f-d8e6-4a60-afd1-1756f49f0b23 tempest-CreateVolumesFromSnapshotTest-801883145 None] Volume volume-fdfbb11a-7479-49a0-b0df-60bbd0bd9416 (fdfbb11a-7479-49a0-b0df-60bbd0bd9416): created successfully Nov 06 12:01:27 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-9b22917f-d8e6-4a60-afd1-1756f49f0b23 tempest-CreateVolumesFromSnapshotTest-801883145 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec94e0a1-67df-4320-9cfc-88750df5ed51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 12:01:27 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-9b22917f-d8e6-4a60-afd1-1756f49f0b23 tempest-CreateVolumesFromSnapshotTest-801883145 None] Flow 'volume_create_manager' (3b581381-52cb-409b-83d9-26d8f12f55cb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 12:01:27 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f1ee7fe-aab1-4527-933f-99abb497f445]: (4, 'qcow2') {{(pid=88420) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 12:01:27 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-8afd9ee9-0a76-49ca-b8e1-8b3ea72fb04e tempest-CinderUnicodeTest-583245689 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-5ce3f341-5849-4cbd-b9bd-f70e73bd9dc8 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 12:01:28 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-9b22917f-d8e6-4a60-afd1-1756f49f0b23 tempest-CreateVolumesFromSnapshotTest-801883145 None] Created volume successfully. Nov 06 12:01:28 devstack sudo[106616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-5ce3f341-5849-4cbd-b9bd-f70e73bd9dc8 Nov 06 12:01:28 devstack sudo[106616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 12:01:28 devstack sudo[106614]: pam_unix(sudo:session): session closed for user root Nov 06 12:01:28 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-d28c9b79-a723-4c09-b85f-27fafcd104e3 tempest-CreateVolumesFromSnapshotTest-801883145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-c4dc4f35-9840-4fa5-8aef-73fd29a622ef 1073741824" returned: 0 in 0.505s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 12:01:28 devstack sudo[106616]: pam_unix(sudo:session): session closed for user root Nov 06 12:01:28 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-8afd9ee9-0a76-49ca-b8e1-8b3ea72fb04e tempest-CinderUnicodeTest-583245689 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-5ce3f341-5849-4cbd-b9bd-f70e73bd9dc8" returned: 0 in 0.421s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 12:01:28 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-8afd9ee9-0a76-49ca-b8e1-8b3ea72fb04e tempest-CinderUnicodeTest-583245689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-5ce3f341-5849-4cbd-b9bd-f70e73bd9dc8 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 12:01:28 devstack sudo[106625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-5ce3f341-5849-4cbd-b9bd-f70e73bd9dc8 Nov 06 12:01:28 devstack sudo[106625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 12:01:28 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-d28c9b79-a723-4c09-b85f-27fafcd104e3 tempest-CreateVolumesFromSnapshotTest-801883145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-c4dc4f35-9840-4fa5-8aef-73fd29a622ef {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 12:01:28 devstack sudo[106627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-c4dc4f35-9840-4fa5-8aef-73fd29a622ef Nov 06 12:01:28 devstack sudo[106627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 12:01:28 devstack sudo[106625]: pam_unix(sudo:session): session closed for user root Nov 06 12:01:28 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-8afd9ee9-0a76-49ca-b8e1-8b3ea72fb04e tempest-CinderUnicodeTest-583245689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-5ce3f341-5849-4cbd-b9bd-f70e73bd9dc8" returned: 0 in 0.277s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 12:01:28 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-8afd9ee9-0a76-49ca-b8e1-8b3ea72fb04e tempest-CinderUnicodeTest-583245689 None] Lock "cinder-quobyte-5ce3f341-5849-4cbd-b9bd-f70e73bd9dc8" released by "delete_volume" :: held 0.785s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 12:01:28 devstack sudo[106627]: pam_unix(sudo:session): session closed for user root Nov 06 12:01:28 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-d28c9b79-a723-4c09-b85f-27fafcd104e3 tempest-CreateVolumesFromSnapshotTest-801883145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-c4dc4f35-9840-4fa5-8aef-73fd29a622ef" returned: 0 in 0.294s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 12:01:28 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-d28c9b79-a723-4c09-b85f-27fafcd104e3 tempest-CreateVolumesFromSnapshotTest-801883145 None] <== create_volume: return (860ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f'} {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 12:01:28 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-d28c9b79-a723-4c09-b85f-27fafcd104e3 tempest-CreateVolumesFromSnapshotTest-801883145 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.863s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 12:01:28 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-41653b7a-5ed6-4e2e-b89a-dde7f6261b77 tempest-CreateVolumesFromSnapshotTest-801883145 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.268s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 12:01:28 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-41653b7a-5ed6-4e2e-b89a-dde7f6261b77 tempest-CreateVolumesFromSnapshotTest-801883145 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T11:01:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1530187108',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cdab018a-fe8f-4a78-8f29-e8283a874be1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a5da2dc9692147e395382c9fbf06e8f1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T11:01:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T11:01:24Z,use_quota=True,user_id='5c9cccda78c7474b980ee674d31be245',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(34d3b144-d9b7-480a-a2e3-01e45f3d54c1),volume_type_id=34d3b144-d9b7-480a-a2e3-01e45f3d54c1)}" {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 12:01:28 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-41653b7a-5ed6-4e2e-b89a-dde7f6261b77 tempest-CreateVolumesFromSnapshotTest-801883145 None] Creating volume cdab018a-fe8f-4a78-8f29-e8283a874be1 {{(pid=87116) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 12:01:28 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-41653b7a-5ed6-4e2e-b89a-dde7f6261b77 tempest-CreateVolumesFromSnapshotTest-801883145 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 12:01:28 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-41653b7a-5ed6-4e2e-b89a-dde7f6261b77 tempest-CreateVolumesFromSnapshotTest-801883145 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 12:01:28 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-41653b7a-5ed6-4e2e-b89a-dde7f6261b77 tempest-CreateVolumesFromSnapshotTest-801883145 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 12:01:28 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-41653b7a-5ed6-4e2e-b89a-dde7f6261b77 tempest-CreateVolumesFromSnapshotTest-801883145 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 12:01:28 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-41653b7a-5ed6-4e2e-b89a-dde7f6261b77 tempest-CreateVolumesFromSnapshotTest-801883145 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 12:01:28 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-41653b7a-5ed6-4e2e-b89a-dde7f6261b77 tempest-CreateVolumesFromSnapshotTest-801883145 None] Selected osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f as target Quobyte volume. {{(pid=87116) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 12:01:28 devstack cinder-volume[87116]: INFO cinder.volume.drivers.remotefs [None req-41653b7a-5ed6-4e2e-b89a-dde7f6261b77 tempest-CreateVolumesFromSnapshotTest-801883145 None] casted to osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f Nov 06 12:01:28 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-41653b7a-5ed6-4e2e-b89a-dde7f6261b77 tempest-CreateVolumesFromSnapshotTest-801883145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-cdab018a-fe8f-4a78-8f29-e8283a874be1 1073741824 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 12:01:28 devstack sudo[106631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-cdab018a-fe8f-4a78-8f29-e8283a874be1 1073741824 Nov 06 12:01:28 devstack sudo[106631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 12:01:28 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-d28c9b79-a723-4c09-b85f-27fafcd104e3 tempest-CreateVolumesFromSnapshotTest-801883145 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (47aa72c3-cb3f-4320-8663-c6368f23dbb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c4dc4f35-9840-4fa5-8aef-73fd29a622ef', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 12:01:28 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-d28c9b79-a723-4c09-b85f-27fafcd104e3 tempest-CreateVolumesFromSnapshotTest-801883145 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8bfbd627-d2a6-4a68-898a-99ad3e5750df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 12:01:28 devstack cinder-volume[87116]: DEBUG cinder.quota [None req-8afd9ee9-0a76-49ca-b8e1-8b3ea72fb04e tempest-CinderUnicodeTest-583245689 None] Created reservations ['e2b078ee-1c3a-4668-b961-b0ffc26f6690', 'bee6de33-c023-42b8-b5e4-5c70fb3c311e', '3d2bc4e5-6596-4f0e-9a3d-862b6e979c66', 'd5a135a8-1019-4068-b4f3-94ec261c5d8f'] {{(pid=87116) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 12:01:28 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-d28c9b79-a723-4c09-b85f-27fafcd104e3 tempest-CreateVolumesFromSnapshotTest-801883145 None] Volume volume-c4dc4f35-9840-4fa5-8aef-73fd29a622ef (c4dc4f35-9840-4fa5-8aef-73fd29a622ef): created successfully Nov 06 12:01:28 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-d28c9b79-a723-4c09-b85f-27fafcd104e3 tempest-CreateVolumesFromSnapshotTest-801883145 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8bfbd627-d2a6-4a68-898a-99ad3e5750df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 12:01:28 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-d28c9b79-a723-4c09-b85f-27fafcd104e3 tempest-CreateVolumesFromSnapshotTest-801883145 None] Flow 'volume_create_manager' (8b0d8c98-bde0-4790-8a78-7fdec6740178) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 12:01:28 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-d28c9b79-a723-4c09-b85f-27fafcd104e3 tempest-CreateVolumesFromSnapshotTest-801883145 None] Created volume successfully. Nov 06 12:01:28 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-8afd9ee9-0a76-49ca-b8e1-8b3ea72fb04e tempest-CinderUnicodeTest-583245689 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 12:01:28 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-8afd9ee9-0a76-49ca-b8e1-8b3ea72fb04e tempest-CinderUnicodeTest-583245689 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 12:01:28 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-8afd9ee9-0a76-49ca-b8e1-8b3ea72fb04e tempest-CinderUnicodeTest-583245689 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 12:01:28 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-8afd9ee9-0a76-49ca-b8e1-8b3ea72fb04e tempest-CinderUnicodeTest-583245689 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 12:01:28 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-8afd9ee9-0a76-49ca-b8e1-8b3ea72fb04e tempest-CinderUnicodeTest-583245689 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 12:01:28 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-8afd9ee9-0a76-49ca-b8e1-8b3ea72fb04e tempest-CinderUnicodeTest-583245689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 12:01:28 devstack sudo[106633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756 Nov 06 12:01:28 devstack sudo[106633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 12:01:29 devstack sudo[106633]: pam_unix(sudo:session): session closed for user root Nov 06 12:01:29 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-8afd9ee9-0a76-49ca-b8e1-8b3ea72fb04e tempest-CinderUnicodeTest-583245689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756" returned: 0 in 0.277s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 12:01:29 devstack cinder-volume[87116]: DEBUG cinder.manager [None req-8afd9ee9-0a76-49ca-b8e1-8b3ea72fb04e tempest-CinderUnicodeTest-583245689 None] Notifying Schedulers of capabilities ... {{(pid=87116) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 12:01:29 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-8afd9ee9-0a76-49ca-b8e1-8b3ea72fb04e tempest-CinderUnicodeTest-583245689 None] Deleted volume successfully. Nov 06 12:01:29 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-8afd9ee9-0a76-49ca-b8e1-8b3ea72fb04e tempest-CinderUnicodeTest-583245689 None] Lock "cinder-5ce3f341-5849-4cbd-b9bd-f70e73bd9dc8-delete_volume" released by "delete_volume" :: held 1.496s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 12:01:29 devstack sudo[106631]: pam_unix(sudo:session): session closed for user root Nov 06 12:01:29 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-41653b7a-5ed6-4e2e-b89a-dde7f6261b77 tempest-CreateVolumesFromSnapshotTest-801883145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-cdab018a-fe8f-4a78-8f29-e8283a874be1 1073741824" returned: 0 in 0.531s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 12:01:29 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-41653b7a-5ed6-4e2e-b89a-dde7f6261b77 tempest-CreateVolumesFromSnapshotTest-801883145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-cdab018a-fe8f-4a78-8f29-e8283a874be1 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 12:01:29 devstack sudo[106639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-cdab018a-fe8f-4a78-8f29-e8283a874be1 Nov 06 12:01:29 devstack sudo[106639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 12:01:29 devstack sudo[106639]: pam_unix(sudo:session): session closed for user root Nov 06 12:01:29 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-41653b7a-5ed6-4e2e-b89a-dde7f6261b77 tempest-CreateVolumesFromSnapshotTest-801883145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-cdab018a-fe8f-4a78-8f29-e8283a874be1" returned: 0 in 0.245s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 12:01:29 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-41653b7a-5ed6-4e2e-b89a-dde7f6261b77 tempest-CreateVolumesFromSnapshotTest-801883145 None] <== create_volume: return (823ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f'} {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 12:01:29 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-41653b7a-5ed6-4e2e-b89a-dde7f6261b77 tempest-CreateVolumesFromSnapshotTest-801883145 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.826s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 12:01:29 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-12753246-6d6d-4964-9aa2-7257da56b078 tempest-ProjectReaderTests-377170324 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.836s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 12:01:29 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-41653b7a-5ed6-4e2e-b89a-dde7f6261b77 tempest-CreateVolumesFromSnapshotTest-801883145 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (70424f63-4dc2-4420-be2b-aee0ec75e061) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cdab018a-fe8f-4a78-8f29-e8283a874be1', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 12:01:29 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-41653b7a-5ed6-4e2e-b89a-dde7f6261b77 tempest-CreateVolumesFromSnapshotTest-801883145 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c2d0943f-a3c5-4761-bc67-cb439f8af974) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 12:01:29 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-12753246-6d6d-4964-9aa2-7257da56b078 tempest-ProjectReaderTests-377170324 None] Creating offline snapshot 3319bbee-7245-4a62-8e8d-77505b768619 of volume 395aa496-f7e7-4996-894b-f677d62e3f59 {{(pid=87116) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 06 12:01:29 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-41653b7a-5ed6-4e2e-b89a-dde7f6261b77 tempest-CreateVolumesFromSnapshotTest-801883145 None] Volume volume-cdab018a-fe8f-4a78-8f29-e8283a874be1 (cdab018a-fe8f-4a78-8f29-e8283a874be1): created successfully Nov 06 12:01:29 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-41653b7a-5ed6-4e2e-b89a-dde7f6261b77 tempest-CreateVolumesFromSnapshotTest-801883145 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c2d0943f-a3c5-4761-bc67-cb439f8af974) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 12:01:29 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-41653b7a-5ed6-4e2e-b89a-dde7f6261b77 tempest-CreateVolumesFromSnapshotTest-801883145 None] Flow 'volume_create_manager' (c60c08df-4223-4049-b916-5d32c03e3e03) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 12:01:29 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[a64705ff-7d3d-48de-a33e-4c3babece69e]: (4, 'qcow2') {{(pid=88420) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 12:01:29 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-12753246-6d6d-4964-9aa2-7257da56b078 tempest-ProjectReaderTests-377170324 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-395aa496-f7e7-4996-894b-f677d62e3f59 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 12:01:29 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-41653b7a-5ed6-4e2e-b89a-dde7f6261b77 tempest-CreateVolumesFromSnapshotTest-801883145 None] Created volume successfully. Nov 06 12:01:29 devstack sudo[106642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-395aa496-f7e7-4996-894b-f677d62e3f59 Nov 06 12:01:29 devstack sudo[106642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 12:01:29 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-bec8192b-b81b-47f1-ad1b-be7dfd712553 tempest-CreateVolumesFromSnapshotTest-801883145 None] Acquiring lock "cinder-cdab018a-fe8f-4a78-8f29-e8283a874be1-delete_volume" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 12:01:30 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-bec8192b-b81b-47f1-ad1b-be7dfd712553 tempest-CreateVolumesFromSnapshotTest-801883145 None] Lock "cinder-cdab018a-fe8f-4a78-8f29-e8283a874be1-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 12:01:30 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-bec8192b-b81b-47f1-ad1b-be7dfd712553 tempest-CreateVolumesFromSnapshotTest-801883145 None] Acquiring lock "cinder-quobyte-cdab018a-fe8f-4a78-8f29-e8283a874be1" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 12:01:30 devstack sudo[106642]: pam_unix(sudo:session): session closed for user root Nov 06 12:01:30 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-bec8192b-b81b-47f1-ad1b-be7dfd712553 tempest-CreateVolumesFromSnapshotTest-801883145 None] Lock "cinder-quobyte-cdab018a-fe8f-4a78-8f29-e8283a874be1" acquired by "delete_volume" :: waited 0.037s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 12:01:30 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-dbdaf025-2e7f-4075-8159-71b32575b35d tempest-CinderUnicodeTest-583245689 None] Acquiring lock "cinder-cb76fde7-36cf-4cce-be38-02d5e488e85d-delete_volume" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 12:01:30 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-12753246-6d6d-4964-9aa2-7257da56b078 tempest-ProjectReaderTests-377170324 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-395aa496-f7e7-4996-894b-f677d62e3f59" returned: 0 in 0.500s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 12:01:30 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-12753246-6d6d-4964-9aa2-7257da56b078 tempest-ProjectReaderTests-377170324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-395aa496-f7e7-4996-894b-f677d62e3f59,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-395aa496-f7e7-4996-894b-f677d62e3f59.3319bbee-7245-4a62-8e8d-77505b768619 1G {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 12:01:30 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[6efc8d18-3a07-4f35-bdfb-d548aa6ea892]: (4, 'qcow2') {{(pid=88420) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 12:01:30 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-bec8192b-b81b-47f1-ad1b-be7dfd712553 tempest-CreateVolumesFromSnapshotTest-801883145 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-cdab018a-fe8f-4a78-8f29-e8283a874be1 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 12:01:30 devstack sudo[106647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-395aa496-f7e7-4996-894b-f677d62e3f59,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-395aa496-f7e7-4996-894b-f677d62e3f59.3319bbee-7245-4a62-8e8d-77505b768619 1G Nov 06 12:01:30 devstack sudo[106647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 12:01:30 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-dbdaf025-2e7f-4075-8159-71b32575b35d tempest-CinderUnicodeTest-583245689 None] Lock "cinder-cb76fde7-36cf-4cce-be38-02d5e488e85d-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 12:01:30 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-dbdaf025-2e7f-4075-8159-71b32575b35d tempest-CinderUnicodeTest-583245689 None] Acquiring lock "cinder-quobyte-cb76fde7-36cf-4cce-be38-02d5e488e85d" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 12:01:30 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-dbdaf025-2e7f-4075-8159-71b32575b35d tempest-CinderUnicodeTest-583245689 None] Lock "cinder-quobyte-cb76fde7-36cf-4cce-be38-02d5e488e85d" acquired by "delete_volume" :: waited 0.015s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 12:01:30 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0b4bace-2e4b-459f-8bd3-cec5157c5908]: (4, 'qcow2') {{(pid=88420) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 12:01:30 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-dbdaf025-2e7f-4075-8159-71b32575b35d tempest-CinderUnicodeTest-583245689 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-cb76fde7-36cf-4cce-be38-02d5e488e85d {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 12:01:30 devstack sudo[106648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-cdab018a-fe8f-4a78-8f29-e8283a874be1 Nov 06 12:01:30 devstack sudo[106648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 12:01:30 devstack sudo[106650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-cb76fde7-36cf-4cce-be38-02d5e488e85d Nov 06 12:01:30 devstack sudo[106650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 12:01:30 devstack sudo[106647]: pam_unix(sudo:session): session closed for user root Nov 06 12:01:30 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-12753246-6d6d-4964-9aa2-7257da56b078 tempest-ProjectReaderTests-377170324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-395aa496-f7e7-4996-894b-f677d62e3f59,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-395aa496-f7e7-4996-894b-f677d62e3f59.3319bbee-7245-4a62-8e8d-77505b768619 1G" returned: 0 in 0.505s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 12:01:30 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-12753246-6d6d-4964-9aa2-7257da56b078 tempest-ProjectReaderTests-377170324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-395aa496-f7e7-4996-894b-f677d62e3f59 -F qcow2 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-395aa496-f7e7-4996-894b-f677d62e3f59.3319bbee-7245-4a62-8e8d-77505b768619 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 12:01:30 devstack sudo[106663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-395aa496-f7e7-4996-894b-f677d62e3f59 -F qcow2 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-395aa496-f7e7-4996-894b-f677d62e3f59.3319bbee-7245-4a62-8e8d-77505b768619 Nov 06 12:01:30 devstack sudo[106663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 12:01:30 devstack sudo[106648]: pam_unix(sudo:session): session closed for user root Nov 06 12:01:30 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-bec8192b-b81b-47f1-ad1b-be7dfd712553 tempest-CreateVolumesFromSnapshotTest-801883145 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-cdab018a-fe8f-4a78-8f29-e8283a874be1" returned: 0 in 0.533s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 12:01:30 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-bec8192b-b81b-47f1-ad1b-be7dfd712553 tempest-CreateVolumesFromSnapshotTest-801883145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-cdab018a-fe8f-4a78-8f29-e8283a874be1 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 12:01:30 devstack sudo[106666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-cdab018a-fe8f-4a78-8f29-e8283a874be1 Nov 06 12:01:30 devstack sudo[106666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 12:01:30 devstack sudo[106650]: pam_unix(sudo:session): session closed for user root Nov 06 12:01:30 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-dbdaf025-2e7f-4075-8159-71b32575b35d tempest-CinderUnicodeTest-583245689 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-cb76fde7-36cf-4cce-be38-02d5e488e85d" returned: 0 in 0.460s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 12:01:30 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-dbdaf025-2e7f-4075-8159-71b32575b35d tempest-CinderUnicodeTest-583245689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-cb76fde7-36cf-4cce-be38-02d5e488e85d {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 12:01:30 devstack sudo[106668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-cb76fde7-36cf-4cce-be38-02d5e488e85d Nov 06 12:01:30 devstack sudo[106668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 12:01:31 devstack sudo[106666]: pam_unix(sudo:session): session closed for user root Nov 06 12:01:31 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-bec8192b-b81b-47f1-ad1b-be7dfd712553 tempest-CreateVolumesFromSnapshotTest-801883145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-cdab018a-fe8f-4a78-8f29-e8283a874be1" returned: 0 in 0.312s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 12:01:31 devstack sudo[106663]: pam_unix(sudo:session): session closed for user root Nov 06 12:01:31 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-12753246-6d6d-4964-9aa2-7257da56b078 tempest-ProjectReaderTests-377170324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-395aa496-f7e7-4996-894b-f677d62e3f59 -F qcow2 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-395aa496-f7e7-4996-894b-f677d62e3f59.3319bbee-7245-4a62-8e8d-77505b768619" returned: 0 in 0.380s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 12:01:31 devstack cinder-volume[87116]: WARNING cinder.volume.drivers.remotefs [None req-12753246-6d6d-4964-9aa2-7257da56b078 tempest-ProjectReaderTests-377170324 None] /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-395aa496-f7e7-4996-894b-f677d62e3f59.3319bbee-7245-4a62-8e8d-77505b768619 is being set with open permissions: ugo+rw Nov 06 12:01:31 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-12753246-6d6d-4964-9aa2-7257da56b078 tempest-ProjectReaderTests-377170324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-395aa496-f7e7-4996-894b-f677d62e3f59.3319bbee-7245-4a62-8e8d-77505b768619 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 12:01:31 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-bec8192b-b81b-47f1-ad1b-be7dfd712553 tempest-CreateVolumesFromSnapshotTest-801883145 None] Lock "cinder-quobyte-cdab018a-fe8f-4a78-8f29-e8283a874be1" released by "delete_volume" :: held 0.930s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 12:01:31 devstack sudo[106676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-395aa496-f7e7-4996-894b-f677d62e3f59.3319bbee-7245-4a62-8e8d-77505b768619 Nov 06 12:01:31 devstack sudo[106676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 12:01:31 devstack sudo[106668]: pam_unix(sudo:session): session closed for user root Nov 06 12:01:31 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-dbdaf025-2e7f-4075-8159-71b32575b35d tempest-CinderUnicodeTest-583245689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-cb76fde7-36cf-4cce-be38-02d5e488e85d" returned: 0 in 0.373s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 12:01:31 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-dbdaf025-2e7f-4075-8159-71b32575b35d tempest-CinderUnicodeTest-583245689 None] Lock "cinder-quobyte-cb76fde7-36cf-4cce-be38-02d5e488e85d" released by "delete_volume" :: held 0.907s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 12:01:31 devstack cinder-volume[87116]: DEBUG cinder.quota [None req-bec8192b-b81b-47f1-ad1b-be7dfd712553 tempest-CreateVolumesFromSnapshotTest-801883145 None] Created reservations ['93a44531-a757-454c-b410-2c517c7502d8', '3e84e14a-9071-4889-87f1-7b99c8b260bf', '23b00c95-f56d-434f-8ae0-a604569e6ee3', '26b4519f-91f1-4b24-8281-53255cbdd873'] {{(pid=87116) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 12:01:31 devstack cinder-volume[87116]: DEBUG cinder.quota [None req-dbdaf025-2e7f-4075-8159-71b32575b35d tempest-CinderUnicodeTest-583245689 None] Created reservations ['59bc8877-54dd-4236-add3-127702e1e781', 'f5f359a5-2cc9-4261-ba89-eb9cc4004c44', '80403e1d-2010-413f-b75d-63db00a6e1d2', 'dae89dd1-69bd-41b1-97db-e2b08228d448'] {{(pid=87116) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 12:01:31 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-bec8192b-b81b-47f1-ad1b-be7dfd712553 tempest-CreateVolumesFromSnapshotTest-801883145 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 12:01:31 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-bec8192b-b81b-47f1-ad1b-be7dfd712553 tempest-CreateVolumesFromSnapshotTest-801883145 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 12:01:31 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-bec8192b-b81b-47f1-ad1b-be7dfd712553 tempest-CreateVolumesFromSnapshotTest-801883145 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 12:01:31 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-bec8192b-b81b-47f1-ad1b-be7dfd712553 tempest-CreateVolumesFromSnapshotTest-801883145 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 12:01:31 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-bec8192b-b81b-47f1-ad1b-be7dfd712553 tempest-CreateVolumesFromSnapshotTest-801883145 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 12:01:31 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-bec8192b-b81b-47f1-ad1b-be7dfd712553 tempest-CreateVolumesFromSnapshotTest-801883145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 12:01:31 devstack sudo[106679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756 Nov 06 12:01:31 devstack sudo[106679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 12:01:31 devstack sudo[106676]: pam_unix(sudo:session): session closed for user root Nov 06 12:01:31 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-12753246-6d6d-4964-9aa2-7257da56b078 tempest-ProjectReaderTests-377170324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-395aa496-f7e7-4996-894b-f677d62e3f59.3319bbee-7245-4a62-8e8d-77505b768619" returned: 0 in 0.315s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 12:01:31 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-dbdaf025-2e7f-4075-8159-71b32575b35d tempest-CinderUnicodeTest-583245689 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 12:01:31 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-dbdaf025-2e7f-4075-8159-71b32575b35d tempest-CinderUnicodeTest-583245689 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 12:01:31 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-dbdaf025-2e7f-4075-8159-71b32575b35d tempest-CinderUnicodeTest-583245689 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 12:01:31 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-dbdaf025-2e7f-4075-8159-71b32575b35d tempest-CinderUnicodeTest-583245689 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 12:01:31 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-dbdaf025-2e7f-4075-8159-71b32575b35d tempest-CinderUnicodeTest-583245689 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 12:01:31 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-dbdaf025-2e7f-4075-8159-71b32575b35d tempest-CinderUnicodeTest-583245689 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 12:01:31 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-12753246-6d6d-4964-9aa2-7257da56b078 tempest-ProjectReaderTests-377170324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-395aa496-f7e7-4996-894b-f677d62e3f59.info {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 12:01:31 devstack sudo[106681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756 Nov 06 12:01:31 devstack sudo[106681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 12:01:31 devstack sudo[106683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-395aa496-f7e7-4996-894b-f677d62e3f59.info Nov 06 12:01:31 devstack sudo[106683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 12:01:31 devstack sudo[106679]: pam_unix(sudo:session): session closed for user root Nov 06 12:01:31 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-bec8192b-b81b-47f1-ad1b-be7dfd712553 tempest-CreateVolumesFromSnapshotTest-801883145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756" returned: 0 in 0.288s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 12:01:31 devstack cinder-volume[87116]: DEBUG cinder.manager [None req-bec8192b-b81b-47f1-ad1b-be7dfd712553 tempest-CreateVolumesFromSnapshotTest-801883145 None] Notifying Schedulers of capabilities ... {{(pid=87116) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 12:01:31 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-bec8192b-b81b-47f1-ad1b-be7dfd712553 tempest-CreateVolumesFromSnapshotTest-801883145 None] Deleted volume successfully. Nov 06 12:01:31 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-bec8192b-b81b-47f1-ad1b-be7dfd712553 tempest-CreateVolumesFromSnapshotTest-801883145 None] Lock "cinder-cdab018a-fe8f-4a78-8f29-e8283a874be1-delete_volume" released by "delete_volume" :: held 1.617s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 12:01:31 devstack sudo[106681]: pam_unix(sudo:session): session closed for user root Nov 06 12:01:31 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-dbdaf025-2e7f-4075-8159-71b32575b35d tempest-CinderUnicodeTest-583245689 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756" returned: 0 in 0.307s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 12:01:31 devstack cinder-volume[87116]: DEBUG cinder.manager [None req-dbdaf025-2e7f-4075-8159-71b32575b35d tempest-CinderUnicodeTest-583245689 None] Notifying Schedulers of capabilities ... {{(pid=87116) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 12:01:31 devstack sudo[106683]: pam_unix(sudo:session): session closed for user root Nov 06 12:01:31 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-12753246-6d6d-4964-9aa2-7257da56b078 tempest-ProjectReaderTests-377170324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-395aa496-f7e7-4996-894b-f677d62e3f59.info" returned: 0 in 0.288s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 12:01:31 devstack cinder-volume[87116]: WARNING cinder.volume.drivers.remotefs [None req-12753246-6d6d-4964-9aa2-7257da56b078 tempest-ProjectReaderTests-377170324 None] /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-395aa496-f7e7-4996-894b-f677d62e3f59.info is being set with open permissions: ugo+rw Nov 06 12:01:31 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-12753246-6d6d-4964-9aa2-7257da56b078 tempest-ProjectReaderTests-377170324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-395aa496-f7e7-4996-894b-f677d62e3f59.info {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 12:01:31 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-dbdaf025-2e7f-4075-8159-71b32575b35d tempest-CinderUnicodeTest-583245689 None] Deleted volume successfully. Nov 06 12:01:31 devstack sudo[106688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-395aa496-f7e7-4996-894b-f677d62e3f59.info Nov 06 12:01:31 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-dbdaf025-2e7f-4075-8159-71b32575b35d tempest-CinderUnicodeTest-583245689 None] Lock "cinder-cb76fde7-36cf-4cce-be38-02d5e488e85d-delete_volume" released by "delete_volume" :: held 1.538s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 12:01:31 devstack sudo[106688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 12:01:31 devstack sudo[106688]: pam_unix(sudo:session): session closed for user root Nov 06 12:01:31 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-12753246-6d6d-4964-9aa2-7257da56b078 tempest-ProjectReaderTests-377170324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-395aa496-f7e7-4996-894b-f677d62e3f59.info" returned: 0 in 0.259s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 12:01:31 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-12753246-6d6d-4964-9aa2-7257da56b078 tempest-ProjectReaderTests-377170324 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.383s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 12:01:31 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-12753246-6d6d-4964-9aa2-7257da56b078 tempest-ProjectReaderTests-377170324 None] Create snapshot completed successfully Nov 06 12:01:32 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-37e69c7c-d00a-4428-8572-b0cdaccecdeb tempest-CreateVolumesFromSnapshotTest-801883145 None] Acquiring lock "cinder-c4dc4f35-9840-4fa5-8aef-73fd29a622ef-delete_volume" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 12:01:32 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-37e69c7c-d00a-4428-8572-b0cdaccecdeb tempest-CreateVolumesFromSnapshotTest-801883145 None] Lock "cinder-c4dc4f35-9840-4fa5-8aef-73fd29a622ef-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 12:01:32 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-37e69c7c-d00a-4428-8572-b0cdaccecdeb tempest-CreateVolumesFromSnapshotTest-801883145 None] Acquiring lock "cinder-quobyte-c4dc4f35-9840-4fa5-8aef-73fd29a622ef" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 12:01:32 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-37e69c7c-d00a-4428-8572-b0cdaccecdeb tempest-CreateVolumesFromSnapshotTest-801883145 None] Lock "cinder-quobyte-c4dc4f35-9840-4fa5-8aef-73fd29a622ef" acquired by "delete_volume" :: waited 0.025s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 12:01:32 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[2845c6a9-ab88-429e-8921-f2fb2e4391af]: (4, 'qcow2') {{(pid=88420) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 12:01:32 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-37e69c7c-d00a-4428-8572-b0cdaccecdeb tempest-CreateVolumesFromSnapshotTest-801883145 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-c4dc4f35-9840-4fa5-8aef-73fd29a622ef {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 12:01:32 devstack sudo[106691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-c4dc4f35-9840-4fa5-8aef-73fd29a622ef Nov 06 12:01:32 devstack sudo[106691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 12:01:32 devstack sudo[106691]: pam_unix(sudo:session): session closed for user root Nov 06 12:01:32 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-37e69c7c-d00a-4428-8572-b0cdaccecdeb tempest-CreateVolumesFromSnapshotTest-801883145 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-c4dc4f35-9840-4fa5-8aef-73fd29a622ef" returned: 0 in 0.391s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 12:01:32 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-37e69c7c-d00a-4428-8572-b0cdaccecdeb tempest-CreateVolumesFromSnapshotTest-801883145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-c4dc4f35-9840-4fa5-8aef-73fd29a622ef {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 12:01:32 devstack sudo[106696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-c4dc4f35-9840-4fa5-8aef-73fd29a622ef Nov 06 12:01:32 devstack sudo[106696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 12:01:33 devstack sudo[106696]: pam_unix(sudo:session): session closed for user root Nov 06 12:01:33 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-37e69c7c-d00a-4428-8572-b0cdaccecdeb tempest-CreateVolumesFromSnapshotTest-801883145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-c4dc4f35-9840-4fa5-8aef-73fd29a622ef" returned: 0 in 0.321s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 12:01:33 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-37e69c7c-d00a-4428-8572-b0cdaccecdeb tempest-CreateVolumesFromSnapshotTest-801883145 None] Lock "cinder-quobyte-c4dc4f35-9840-4fa5-8aef-73fd29a622ef" released by "delete_volume" :: held 0.762s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 12:01:33 devstack cinder-volume[87116]: DEBUG cinder.quota [None req-37e69c7c-d00a-4428-8572-b0cdaccecdeb tempest-CreateVolumesFromSnapshotTest-801883145 None] Created reservations ['e5f0fefe-4cb9-4f96-b584-16f579d8241a', '0dbfff21-f4e5-4fbf-b506-1fdb02eac60d', 'e977740c-d4f4-4fc1-b7f1-362d545137fb', '009e3c0f-f8fe-4ef2-852b-b88333060303'] {{(pid=87116) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 12:01:33 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-6cd1c865-3e2e-4f9d-bbed-d779f515c5ff tempest-ProjectReaderTests-377170324 None] Acquiring lock "cinder-3319bbee-7245-4a62-8e8d-77505b768619-delete_snapshot" by "delete_snapshot" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 12:01:33 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-6cd1c865-3e2e-4f9d-bbed-d779f515c5ff tempest-ProjectReaderTests-377170324 None] Lock "cinder-3319bbee-7245-4a62-8e8d-77505b768619-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 12:01:33 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-6cd1c865-3e2e-4f9d-bbed-d779f515c5ff tempest-ProjectReaderTests-377170324 None] Acquiring lock "cinder-quobyte-395aa496-f7e7-4996-894b-f677d62e3f59" by "delete_snapshot" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 12:01:33 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-37e69c7c-d00a-4428-8572-b0cdaccecdeb tempest-CreateVolumesFromSnapshotTest-801883145 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 12:01:33 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-37e69c7c-d00a-4428-8572-b0cdaccecdeb tempest-CreateVolumesFromSnapshotTest-801883145 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 12:01:33 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-37e69c7c-d00a-4428-8572-b0cdaccecdeb tempest-CreateVolumesFromSnapshotTest-801883145 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 12:01:33 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-37e69c7c-d00a-4428-8572-b0cdaccecdeb tempest-CreateVolumesFromSnapshotTest-801883145 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 12:01:33 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-37e69c7c-d00a-4428-8572-b0cdaccecdeb tempest-CreateVolumesFromSnapshotTest-801883145 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 12:01:33 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-37e69c7c-d00a-4428-8572-b0cdaccecdeb tempest-CreateVolumesFromSnapshotTest-801883145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 12:01:33 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-6cd1c865-3e2e-4f9d-bbed-d779f515c5ff tempest-ProjectReaderTests-377170324 None] Lock "cinder-quobyte-395aa496-f7e7-4996-894b-f677d62e3f59" acquired by "delete_snapshot" :: waited 0.052s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 12:01:33 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-6cd1c865-3e2e-4f9d-bbed-d779f515c5ff tempest-ProjectReaderTests-377170324 None] Acquiring lock "cinder-quobyte-3319bbee-7245-4a62-8e8d-77505b768619" by "_delete_snapshot" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 12:01:33 devstack sudo[106700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756 Nov 06 12:01:33 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-6cd1c865-3e2e-4f9d-bbed-d779f515c5ff tempest-ProjectReaderTests-377170324 None] Lock "cinder-quobyte-3319bbee-7245-4a62-8e8d-77505b768619" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 12:01:33 devstack sudo[106700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 12:01:33 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-6cd1c865-3e2e-4f9d-bbed-d779f515c5ff tempest-ProjectReaderTests-377170324 None] Deleting offline snapshot 3319bbee-7245-4a62-8e8d-77505b768619 of volume 395aa496-f7e7-4996-894b-f677d62e3f59 {{(pid=87116) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 06 12:01:33 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-6cd1c865-3e2e-4f9d-bbed-d779f515c5ff tempest-ProjectReaderTests-377170324 None] snapshot_file for this snap is: volume-395aa496-f7e7-4996-894b-f677d62e3f59.3319bbee-7245-4a62-8e8d-77505b768619 {{(pid=87116) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 06 12:01:33 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[57679511-afaa-4549-9e2b-6bd7eba403a5]: (4, 'qcow2') {{(pid=88420) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 12:01:33 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-6cd1c865-3e2e-4f9d-bbed-d779f515c5ff tempest-ProjectReaderTests-377170324 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-395aa496-f7e7-4996-894b-f677d62e3f59.3319bbee-7245-4a62-8e8d-77505b768619 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 12:01:33 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-46468d71-17a5-4de4-a457-623b8e063a30 tempest-CreateVolumesFromSnapshotTest-801883145 None] Acquiring lock "cinder-fdfbb11a-7479-49a0-b0df-60bbd0bd9416-delete_volume" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 12:01:33 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-46468d71-17a5-4de4-a457-623b8e063a30 tempest-CreateVolumesFromSnapshotTest-801883145 None] Lock "cinder-fdfbb11a-7479-49a0-b0df-60bbd0bd9416-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 12:01:33 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-46468d71-17a5-4de4-a457-623b8e063a30 tempest-CreateVolumesFromSnapshotTest-801883145 None] Acquiring lock "cinder-quobyte-fdfbb11a-7479-49a0-b0df-60bbd0bd9416" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 12:01:33 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-46468d71-17a5-4de4-a457-623b8e063a30 tempest-CreateVolumesFromSnapshotTest-801883145 None] Lock "cinder-quobyte-fdfbb11a-7479-49a0-b0df-60bbd0bd9416" acquired by "delete_volume" :: waited 0.040s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 12:01:33 devstack sudo[106702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-395aa496-f7e7-4996-894b-f677d62e3f59.3319bbee-7245-4a62-8e8d-77505b768619 Nov 06 12:01:33 devstack sudo[106702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 12:01:33 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[c246af1c-1af7-49e4-8d15-d51a383dfb41]: (4, 'qcow2') {{(pid=88420) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 12:01:33 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-46468d71-17a5-4de4-a457-623b8e063a30 tempest-CreateVolumesFromSnapshotTest-801883145 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-fdfbb11a-7479-49a0-b0df-60bbd0bd9416 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 12:01:33 devstack sudo[106700]: pam_unix(sudo:session): session closed for user root Nov 06 12:01:33 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-37e69c7c-d00a-4428-8572-b0cdaccecdeb tempest-CreateVolumesFromSnapshotTest-801883145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756" returned: 0 in 0.456s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 12:01:33 devstack cinder-volume[87116]: DEBUG cinder.manager [None req-37e69c7c-d00a-4428-8572-b0cdaccecdeb tempest-CreateVolumesFromSnapshotTest-801883145 None] Notifying Schedulers of capabilities ... {{(pid=87116) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 12:01:33 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-37e69c7c-d00a-4428-8572-b0cdaccecdeb tempest-CreateVolumesFromSnapshotTest-801883145 None] Deleted volume successfully. Nov 06 12:01:33 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-37e69c7c-d00a-4428-8572-b0cdaccecdeb tempest-CreateVolumesFromSnapshotTest-801883145 None] Lock "cinder-c4dc4f35-9840-4fa5-8aef-73fd29a622ef-delete_volume" released by "delete_volume" :: held 1.545s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 12:01:33 devstack sudo[106705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-fdfbb11a-7479-49a0-b0df-60bbd0bd9416 Nov 06 12:01:33 devstack sudo[106705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 12:01:34 devstack sudo[106702]: pam_unix(sudo:session): session closed for user root Nov 06 12:01:34 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-6cd1c865-3e2e-4f9d-bbed-d779f515c5ff tempest-ProjectReaderTests-377170324 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-395aa496-f7e7-4996-894b-f677d62e3f59.3319bbee-7245-4a62-8e8d-77505b768619" returned: 0 in 0.629s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 12:01:34 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-6cd1c865-3e2e-4f9d-bbed-d779f515c5ff tempest-ProjectReaderTests-377170324 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-395aa496-f7e7-4996-894b-f677d62e3f59(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87116) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 12:01:34 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[edf343e0-6577-415f-8400-e37059a621f1]: (4, 'qcow2') {{(pid=88420) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 12:01:34 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-6cd1c865-3e2e-4f9d-bbed-d779f515c5ff tempest-ProjectReaderTests-377170324 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-395aa496-f7e7-4996-894b-f677d62e3f59 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 12:01:34 devstack sudo[106705]: pam_unix(sudo:session): session closed for user root Nov 06 12:01:34 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-46468d71-17a5-4de4-a457-623b8e063a30 tempest-CreateVolumesFromSnapshotTest-801883145 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-fdfbb11a-7479-49a0-b0df-60bbd0bd9416" returned: 0 in 0.468s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 12:01:34 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-46468d71-17a5-4de4-a457-623b8e063a30 tempest-CreateVolumesFromSnapshotTest-801883145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-fdfbb11a-7479-49a0-b0df-60bbd0bd9416 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 12:01:34 devstack sudo[106715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-fdfbb11a-7479-49a0-b0df-60bbd0bd9416 Nov 06 12:01:34 devstack sudo[106715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 12:01:34 devstack sudo[106714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-395aa496-f7e7-4996-894b-f677d62e3f59 Nov 06 12:01:34 devstack sudo[106714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 12:01:34 devstack sudo[106715]: pam_unix(sudo:session): session closed for user root Nov 06 12:01:34 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-46468d71-17a5-4de4-a457-623b8e063a30 tempest-CreateVolumesFromSnapshotTest-801883145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-fdfbb11a-7479-49a0-b0df-60bbd0bd9416" returned: 0 in 0.314s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 12:01:34 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-46468d71-17a5-4de4-a457-623b8e063a30 tempest-CreateVolumesFromSnapshotTest-801883145 None] Lock "cinder-quobyte-fdfbb11a-7479-49a0-b0df-60bbd0bd9416" released by "delete_volume" :: held 0.874s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 12:01:34 devstack cinder-volume[87116]: DEBUG cinder.quota [None req-46468d71-17a5-4de4-a457-623b8e063a30 tempest-CreateVolumesFromSnapshotTest-801883145 None] Created reservations ['471fd150-d777-42ce-9ee2-6fea819270ea', 'a357555f-d579-4f17-93fa-c0818720759d', '7932e961-33ba-445c-8f52-426a4015b6e9', 'a9d02b36-ad39-4e38-9902-4113f7aba799'] {{(pid=87116) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 12:01:34 devstack sudo[106714]: pam_unix(sudo:session): session closed for user root Nov 06 12:01:34 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-6cd1c865-3e2e-4f9d-bbed-d779f515c5ff tempest-ProjectReaderTests-377170324 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-395aa496-f7e7-4996-894b-f677d62e3f59" returned: 0 in 0.458s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 12:01:34 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-6cd1c865-3e2e-4f9d-bbed-d779f515c5ff tempest-ProjectReaderTests-377170324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-395aa496-f7e7-4996-894b-f677d62e3f59.3319bbee-7245-4a62-8e8d-77505b768619 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 12:01:34 devstack sudo[106723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-395aa496-f7e7-4996-894b-f677d62e3f59.3319bbee-7245-4a62-8e8d-77505b768619 Nov 06 12:01:34 devstack sudo[106723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 12:01:34 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-46468d71-17a5-4de4-a457-623b8e063a30 tempest-CreateVolumesFromSnapshotTest-801883145 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 12:01:34 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-46468d71-17a5-4de4-a457-623b8e063a30 tempest-CreateVolumesFromSnapshotTest-801883145 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 12:01:34 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-46468d71-17a5-4de4-a457-623b8e063a30 tempest-CreateVolumesFromSnapshotTest-801883145 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 12:01:34 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-46468d71-17a5-4de4-a457-623b8e063a30 tempest-CreateVolumesFromSnapshotTest-801883145 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 12:01:34 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-46468d71-17a5-4de4-a457-623b8e063a30 tempest-CreateVolumesFromSnapshotTest-801883145 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 12:01:34 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-46468d71-17a5-4de4-a457-623b8e063a30 tempest-CreateVolumesFromSnapshotTest-801883145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 12:01:34 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-35b394de-988c-4e6d-a56a-fd5512161041 tempest-CreateVolumesFromSnapshotTest-801883145 None] Acquiring lock "cinder-ab9358c6-88df-4fcb-b940-9625bf001525-delete_volume" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 12:01:34 devstack sudo[106725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756 Nov 06 12:01:34 devstack sudo[106725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 12:01:34 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-35b394de-988c-4e6d-a56a-fd5512161041 tempest-CreateVolumesFromSnapshotTest-801883145 None] Lock "cinder-ab9358c6-88df-4fcb-b940-9625bf001525-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 12:01:34 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-35b394de-988c-4e6d-a56a-fd5512161041 tempest-CreateVolumesFromSnapshotTest-801883145 None] Acquiring lock "cinder-quobyte-ab9358c6-88df-4fcb-b940-9625bf001525" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 12:01:34 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-35b394de-988c-4e6d-a56a-fd5512161041 tempest-CreateVolumesFromSnapshotTest-801883145 None] Lock "cinder-quobyte-ab9358c6-88df-4fcb-b940-9625bf001525" acquired by "delete_volume" :: waited 0.034s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 12:01:34 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d881c47-8b7b-46ab-888b-4f7bd85d84b9]: (4, 'qcow2') {{(pid=88420) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 12:01:34 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-35b394de-988c-4e6d-a56a-fd5512161041 tempest-CreateVolumesFromSnapshotTest-801883145 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-ab9358c6-88df-4fcb-b940-9625bf001525 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 12:01:35 devstack sudo[106725]: pam_unix(sudo:session): session closed for user root Nov 06 12:01:35 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-46468d71-17a5-4de4-a457-623b8e063a30 tempest-CreateVolumesFromSnapshotTest-801883145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756" returned: 0 in 0.379s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 12:01:35 devstack cinder-volume[87116]: DEBUG cinder.manager [None req-46468d71-17a5-4de4-a457-623b8e063a30 tempest-CreateVolumesFromSnapshotTest-801883145 None] Notifying Schedulers of capabilities ... {{(pid=87116) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 12:01:35 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-46468d71-17a5-4de4-a457-623b8e063a30 tempest-CreateVolumesFromSnapshotTest-801883145 None] Deleted volume successfully. Nov 06 12:01:35 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-46468d71-17a5-4de4-a457-623b8e063a30 tempest-CreateVolumesFromSnapshotTest-801883145 None] Lock "cinder-fdfbb11a-7479-49a0-b0df-60bbd0bd9416-delete_volume" released by "delete_volume" :: held 1.602s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 12:01:35 devstack sudo[106728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-ab9358c6-88df-4fcb-b940-9625bf001525 Nov 06 12:01:35 devstack sudo[106728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 12:01:35 devstack sudo[106723]: pam_unix(sudo:session): session closed for user root Nov 06 12:01:35 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-6cd1c865-3e2e-4f9d-bbed-d779f515c5ff tempest-ProjectReaderTests-377170324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-395aa496-f7e7-4996-894b-f677d62e3f59.3319bbee-7245-4a62-8e8d-77505b768619" returned: 0 in 0.607s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 12:01:35 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-6cd1c865-3e2e-4f9d-bbed-d779f515c5ff tempest-ProjectReaderTests-377170324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-395aa496-f7e7-4996-894b-f677d62e3f59.3319bbee-7245-4a62-8e8d-77505b768619 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 12:01:35 devstack sudo[106733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-395aa496-f7e7-4996-894b-f677d62e3f59.3319bbee-7245-4a62-8e8d-77505b768619 Nov 06 12:01:35 devstack sudo[106733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 12:01:35 devstack sudo[106728]: pam_unix(sudo:session): session closed for user root Nov 06 12:01:35 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-35b394de-988c-4e6d-a56a-fd5512161041 tempest-CreateVolumesFromSnapshotTest-801883145 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-ab9358c6-88df-4fcb-b940-9625bf001525" returned: 0 in 0.499s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 12:01:35 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-35b394de-988c-4e6d-a56a-fd5512161041 tempest-CreateVolumesFromSnapshotTest-801883145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-ab9358c6-88df-4fcb-b940-9625bf001525 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 12:01:35 devstack sudo[106733]: pam_unix(sudo:session): session closed for user root Nov 06 12:01:35 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-6cd1c865-3e2e-4f9d-bbed-d779f515c5ff tempest-ProjectReaderTests-377170324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-395aa496-f7e7-4996-894b-f677d62e3f59.3319bbee-7245-4a62-8e8d-77505b768619" returned: 0 in 0.296s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 12:01:35 devstack sudo[106740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-ab9358c6-88df-4fcb-b940-9625bf001525 Nov 06 12:01:35 devstack sudo[106740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 12:01:35 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-6cd1c865-3e2e-4f9d-bbed-d779f515c5ff tempest-ProjectReaderTests-377170324 None] Lock "cinder-quobyte-3319bbee-7245-4a62-8e8d-77505b768619" released by "_delete_snapshot" :: held 2.137s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 12:01:35 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-6cd1c865-3e2e-4f9d-bbed-d779f515c5ff tempest-ProjectReaderTests-377170324 None] Lock "cinder-quobyte-395aa496-f7e7-4996-894b-f677d62e3f59" released by "delete_snapshot" :: held 2.177s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 12:01:35 devstack cinder-volume[87116]: DEBUG cinder.quota [None req-6cd1c865-3e2e-4f9d-bbed-d779f515c5ff tempest-ProjectReaderTests-377170324 None] Created reservations ['99b2dedd-42a3-4582-b81f-5cd37e4ab1d1', '04da36cb-20e7-4ce9-82ed-e4626f84b00a', '155ce2e4-9aad-4fab-bac3-ef8e39cbc22c', '415216f5-e0be-4d96-970e-52e073532546'] {{(pid=87116) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 12:01:35 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-6cd1c865-3e2e-4f9d-bbed-d779f515c5ff tempest-ProjectReaderTests-377170324 None] Delete snapshot completed successfully. Nov 06 12:01:35 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-6cd1c865-3e2e-4f9d-bbed-d779f515c5ff tempest-ProjectReaderTests-377170324 None] Lock "cinder-3319bbee-7245-4a62-8e8d-77505b768619-delete_snapshot" released by "delete_snapshot" :: held 2.402s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 12:01:35 devstack sudo[106740]: pam_unix(sudo:session): session closed for user root Nov 06 12:01:35 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-35b394de-988c-4e6d-a56a-fd5512161041 tempest-CreateVolumesFromSnapshotTest-801883145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-ab9358c6-88df-4fcb-b940-9625bf001525" returned: 0 in 0.371s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 12:01:35 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-35b394de-988c-4e6d-a56a-fd5512161041 tempest-CreateVolumesFromSnapshotTest-801883145 None] Lock "cinder-quobyte-ab9358c6-88df-4fcb-b940-9625bf001525" released by "delete_volume" :: held 0.949s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 12:01:35 devstack cinder-volume[87116]: DEBUG cinder.quota [None req-35b394de-988c-4e6d-a56a-fd5512161041 tempest-CreateVolumesFromSnapshotTest-801883145 None] Created reservations ['af17a379-204d-4c71-9243-9662125ccd79', '043d3273-b83c-48a5-996b-7f79abc8d1d7', '92502c5d-305c-44e6-b747-aacb38bbbafc', '44718c35-f0fc-4807-bac4-bb702c900a33'] {{(pid=87116) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 12:01:36 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-35b394de-988c-4e6d-a56a-fd5512161041 tempest-CreateVolumesFromSnapshotTest-801883145 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 12:01:36 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-35b394de-988c-4e6d-a56a-fd5512161041 tempest-CreateVolumesFromSnapshotTest-801883145 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 12:01:36 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-35b394de-988c-4e6d-a56a-fd5512161041 tempest-CreateVolumesFromSnapshotTest-801883145 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 12:01:36 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-35b394de-988c-4e6d-a56a-fd5512161041 tempest-CreateVolumesFromSnapshotTest-801883145 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 12:01:36 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-35b394de-988c-4e6d-a56a-fd5512161041 tempest-CreateVolumesFromSnapshotTest-801883145 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 12:01:36 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-35b394de-988c-4e6d-a56a-fd5512161041 tempest-CreateVolumesFromSnapshotTest-801883145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 12:01:36 devstack sudo[106743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756 Nov 06 12:01:36 devstack sudo[106743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 12:01:36 devstack sudo[106743]: pam_unix(sudo:session): session closed for user root Nov 06 12:01:36 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-35b394de-988c-4e6d-a56a-fd5512161041 tempest-CreateVolumesFromSnapshotTest-801883145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756" returned: 0 in 0.292s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 12:01:36 devstack cinder-volume[87116]: DEBUG cinder.manager [None req-35b394de-988c-4e6d-a56a-fd5512161041 tempest-CreateVolumesFromSnapshotTest-801883145 None] Notifying Schedulers of capabilities ... {{(pid=87116) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 12:01:36 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-35b394de-988c-4e6d-a56a-fd5512161041 tempest-CreateVolumesFromSnapshotTest-801883145 None] Deleted volume successfully. Nov 06 12:01:36 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-35b394de-988c-4e6d-a56a-fd5512161041 tempest-CreateVolumesFromSnapshotTest-801883145 None] Lock "cinder-ab9358c6-88df-4fcb-b940-9625bf001525-delete_volume" released by "delete_volume" :: held 1.608s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 12:01:36 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-48deb81e-57de-49ce-b0a1-7b6231650f0c tempest-ProjectReaderTests-377170324 None] Acquiring lock "cinder-395aa496-f7e7-4996-894b-f677d62e3f59-delete_volume" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 12:01:36 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-48deb81e-57de-49ce-b0a1-7b6231650f0c tempest-ProjectReaderTests-377170324 None] Lock "cinder-395aa496-f7e7-4996-894b-f677d62e3f59-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 12:01:36 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-48deb81e-57de-49ce-b0a1-7b6231650f0c tempest-ProjectReaderTests-377170324 None] Acquiring lock "cinder-quobyte-395aa496-f7e7-4996-894b-f677d62e3f59" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 12:01:36 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-389aec7e-4b39-4c6c-8f62-4660decce7be tempest-ProjectAdminTests-1673281079 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.401268005371, 'free_capacity_gb': 1773.401268005371, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87116) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Nov 06 12:01:36 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-48deb81e-57de-49ce-b0a1-7b6231650f0c tempest-ProjectReaderTests-377170324 None] Lock "cinder-quobyte-395aa496-f7e7-4996-894b-f677d62e3f59" acquired by "delete_volume" :: waited 0.017s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 12:01:36 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[18f08688-c5c8-4b2d-9453-51efb6a7b87a]: (4, 'qcow2') {{(pid=88420) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 12:01:36 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-48deb81e-57de-49ce-b0a1-7b6231650f0c tempest-ProjectReaderTests-377170324 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-395aa496-f7e7-4996-894b-f677d62e3f59 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 12:01:36 devstack sudo[106746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-395aa496-f7e7-4996-894b-f677d62e3f59 Nov 06 12:01:36 devstack sudo[106746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 12:01:37 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-189f03aa-e5be-45fa-b131-efed1aff9441 tempest-CreateVolumesFromSnapshotTest-801883145 None] Acquiring lock "cinder-b4161cde-e732-4565-bcf3-93e4c2263394-delete_volume" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 12:01:37 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-189f03aa-e5be-45fa-b131-efed1aff9441 tempest-CreateVolumesFromSnapshotTest-801883145 None] Lock "cinder-b4161cde-e732-4565-bcf3-93e4c2263394-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 12:01:37 devstack sudo[106746]: pam_unix(sudo:session): session closed for user root Nov 06 12:01:37 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-48deb81e-57de-49ce-b0a1-7b6231650f0c tempest-ProjectReaderTests-377170324 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-395aa496-f7e7-4996-894b-f677d62e3f59" returned: 0 in 0.468s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 12:01:37 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-189f03aa-e5be-45fa-b131-efed1aff9441 tempest-CreateVolumesFromSnapshotTest-801883145 None] Acquiring lock "cinder-quobyte-b4161cde-e732-4565-bcf3-93e4c2263394" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 12:01:37 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-48deb81e-57de-49ce-b0a1-7b6231650f0c tempest-ProjectReaderTests-377170324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-395aa496-f7e7-4996-894b-f677d62e3f59 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 12:01:37 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-189f03aa-e5be-45fa-b131-efed1aff9441 tempest-CreateVolumesFromSnapshotTest-801883145 None] Lock "cinder-quobyte-b4161cde-e732-4565-bcf3-93e4c2263394" acquired by "delete_volume" :: waited 0.033s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 12:01:37 devstack sudo[106752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-395aa496-f7e7-4996-894b-f677d62e3f59 Nov 06 12:01:37 devstack sudo[106752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 12:01:37 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e62e3e8-ddda-4468-b612-baf40f134558]: (4, 'qcow2') {{(pid=88420) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 12:01:37 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-189f03aa-e5be-45fa-b131-efed1aff9441 tempest-CreateVolumesFromSnapshotTest-801883145 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-b4161cde-e732-4565-bcf3-93e4c2263394 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 12:01:37 devstack sudo[106754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-b4161cde-e732-4565-bcf3-93e4c2263394 Nov 06 12:01:37 devstack sudo[106754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 12:01:37 devstack sudo[106752]: pam_unix(sudo:session): session closed for user root Nov 06 12:01:37 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-48deb81e-57de-49ce-b0a1-7b6231650f0c tempest-ProjectReaderTests-377170324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-395aa496-f7e7-4996-894b-f677d62e3f59" returned: 0 in 0.299s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 12:01:37 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-48deb81e-57de-49ce-b0a1-7b6231650f0c tempest-ProjectReaderTests-377170324 None] Lock "cinder-quobyte-395aa496-f7e7-4996-894b-f677d62e3f59" released by "delete_volume" :: held 0.861s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 12:01:37 devstack cinder-volume[87116]: DEBUG cinder.quota [None req-48deb81e-57de-49ce-b0a1-7b6231650f0c tempest-ProjectReaderTests-377170324 None] Created reservations ['eb31c6b9-f472-4aca-ac82-c8dec615fe19', '81001f6a-26a9-4d3b-8868-229e16e0fdde', '4c29ac26-a749-4163-a470-83ddb23ad7d7', '0700d8f9-7a87-4ea3-b2da-afd30e1485f1'] {{(pid=87116) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 12:01:37 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-48deb81e-57de-49ce-b0a1-7b6231650f0c tempest-ProjectReaderTests-377170324 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 12:01:37 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-48deb81e-57de-49ce-b0a1-7b6231650f0c tempest-ProjectReaderTests-377170324 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 12:01:37 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-48deb81e-57de-49ce-b0a1-7b6231650f0c tempest-ProjectReaderTests-377170324 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 12:01:37 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-48deb81e-57de-49ce-b0a1-7b6231650f0c tempest-ProjectReaderTests-377170324 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 12:01:37 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-48deb81e-57de-49ce-b0a1-7b6231650f0c tempest-ProjectReaderTests-377170324 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 12:01:37 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-48deb81e-57de-49ce-b0a1-7b6231650f0c tempest-ProjectReaderTests-377170324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 12:01:37 devstack sudo[106760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756 Nov 06 12:01:37 devstack sudo[106760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 12:01:37 devstack sudo[106754]: pam_unix(sudo:session): session closed for user root Nov 06 12:01:37 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-189f03aa-e5be-45fa-b131-efed1aff9441 tempest-CreateVolumesFromSnapshotTest-801883145 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-b4161cde-e732-4565-bcf3-93e4c2263394" returned: 0 in 0.520s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 12:01:37 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-189f03aa-e5be-45fa-b131-efed1aff9441 tempest-CreateVolumesFromSnapshotTest-801883145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-b4161cde-e732-4565-bcf3-93e4c2263394 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 12:01:37 devstack sudo[106762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-b4161cde-e732-4565-bcf3-93e4c2263394 Nov 06 12:01:37 devstack sudo[106762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 12:01:38 devstack sudo[106760]: pam_unix(sudo:session): session closed for user root Nov 06 12:01:38 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-48deb81e-57de-49ce-b0a1-7b6231650f0c tempest-ProjectReaderTests-377170324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756" returned: 0 in 0.403s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 12:01:38 devstack cinder-volume[87116]: DEBUG cinder.manager [None req-48deb81e-57de-49ce-b0a1-7b6231650f0c tempest-ProjectReaderTests-377170324 None] Notifying Schedulers of capabilities ... {{(pid=87116) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 12:01:38 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-48deb81e-57de-49ce-b0a1-7b6231650f0c tempest-ProjectReaderTests-377170324 None] Deleted volume successfully. Nov 06 12:01:38 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-48deb81e-57de-49ce-b0a1-7b6231650f0c tempest-ProjectReaderTests-377170324 None] Lock "cinder-395aa496-f7e7-4996-894b-f677d62e3f59-delete_volume" released by "delete_volume" :: held 1.559s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 12:01:38 devstack sudo[106762]: pam_unix(sudo:session): session closed for user root Nov 06 12:01:38 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-189f03aa-e5be-45fa-b131-efed1aff9441 tempest-CreateVolumesFromSnapshotTest-801883145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-b4161cde-e732-4565-bcf3-93e4c2263394" returned: 0 in 0.390s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 12:01:38 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-189f03aa-e5be-45fa-b131-efed1aff9441 tempest-CreateVolumesFromSnapshotTest-801883145 None] Lock "cinder-quobyte-b4161cde-e732-4565-bcf3-93e4c2263394" released by "delete_volume" :: held 0.973s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 12:01:38 devstack cinder-volume[87116]: DEBUG cinder.quota [None req-189f03aa-e5be-45fa-b131-efed1aff9441 tempest-CreateVolumesFromSnapshotTest-801883145 None] Created reservations ['97192abc-c3b5-4a8e-8b8c-86987bdf4d0a', '87dd8cd8-574c-44d1-a40f-5b2fcde4ca56', '18eb5483-1381-43f6-9c89-15a21367bff3', '063f1ff2-a920-4e93-b441-9471fb7db1d5'] {{(pid=87116) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 12:01:38 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-189f03aa-e5be-45fa-b131-efed1aff9441 tempest-CreateVolumesFromSnapshotTest-801883145 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 12:01:38 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-189f03aa-e5be-45fa-b131-efed1aff9441 tempest-CreateVolumesFromSnapshotTest-801883145 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 12:01:38 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-189f03aa-e5be-45fa-b131-efed1aff9441 tempest-CreateVolumesFromSnapshotTest-801883145 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 12:01:38 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-189f03aa-e5be-45fa-b131-efed1aff9441 tempest-CreateVolumesFromSnapshotTest-801883145 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 12:01:38 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-189f03aa-e5be-45fa-b131-efed1aff9441 tempest-CreateVolumesFromSnapshotTest-801883145 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 12:01:38 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-189f03aa-e5be-45fa-b131-efed1aff9441 tempest-CreateVolumesFromSnapshotTest-801883145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 12:01:38 devstack sudo[106782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756 Nov 06 12:01:38 devstack sudo[106782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 12:01:38 devstack cinder-volume[87116]: DEBUG cinder.volume.flows.manager.create_volume [None req-f26cf718-d00b-452d-af1e-2fb004194136 tempest-ProjectReaderTests-377170324 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87116) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 12:01:38 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-f26cf718-d00b-452d-af1e-2fb004194136 tempest-ProjectReaderTests-377170324 None] Flow 'volume_create_manager' (393bb419-481b-454c-8ffc-de8148c24037) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 12:01:38 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-f26cf718-d00b-452d-af1e-2fb004194136 tempest-ProjectReaderTests-377170324 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b4937dcf-08b9-480f-992b-f729ea80581a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 12:01:38 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-f26cf718-d00b-452d-af1e-2fb004194136 tempest-ProjectReaderTests-377170324 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b4937dcf-08b9-480f-992b-f729ea80581a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T11:01:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1618332818',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=89054249-304c-44c2-ac99-960263ecf900,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='865d378d37cd42ed98432cd1ce1e41be',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T11:01:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T11:01:39Z,use_quota=True,user_id='8acc7287c82b436186731f24c32b21ce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(34d3b144-d9b7-480a-a2e3-01e45f3d54c1),volume_type_id=34d3b144-d9b7-480a-a2e3-01e45f3d54c1)' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 12:01:38 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-f26cf718-d00b-452d-af1e-2fb004194136 tempest-ProjectReaderTests-377170324 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bae3c35c-1469-4b29-bd4e-280c17b0f77f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 12:01:38 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-f26cf718-d00b-452d-af1e-2fb004194136 tempest-ProjectReaderTests-377170324 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bae3c35c-1469-4b29-bd4e-280c17b0f77f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 12:01:38 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-f26cf718-d00b-452d-af1e-2fb004194136 tempest-ProjectReaderTests-377170324 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d29041f5-be98-4312-b0a2-e5535ada8a78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 12:01:38 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-f26cf718-d00b-452d-af1e-2fb004194136 tempest-ProjectReaderTests-377170324 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d29041f5-be98-4312-b0a2-e5535ada8a78) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '89054249-304c-44c2-ac99-960263ecf900', 'volume_name': 'volume-89054249-304c-44c2-ac99-960263ecf900', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 12:01:38 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-f26cf718-d00b-452d-af1e-2fb004194136 tempest-ProjectReaderTests-377170324 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1b0e16a7-a20a-4376-abb2-075db1db1922) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 12:01:38 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-f26cf718-d00b-452d-af1e-2fb004194136 tempest-ProjectReaderTests-377170324 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1b0e16a7-a20a-4376-abb2-075db1db1922) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 12:01:38 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-f26cf718-d00b-452d-af1e-2fb004194136 tempest-ProjectReaderTests-377170324 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0a5ba17a-1341-4ee0-b453-4b5a68d50e3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 12:01:38 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-f26cf718-d00b-452d-af1e-2fb004194136 tempest-ProjectReaderTests-377170324 None] Volume 89054249-304c-44c2-ac99-960263ecf900: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-89054249-304c-44c2-ac99-960263ecf900', 'volume_size': 1} Nov 06 12:01:38 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-f26cf718-d00b-452d-af1e-2fb004194136 tempest-ProjectReaderTests-377170324 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 12:01:38 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-f26cf718-d00b-452d-af1e-2fb004194136 tempest-ProjectReaderTests-377170324 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 12:01:38 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-f26cf718-d00b-452d-af1e-2fb004194136 tempest-ProjectReaderTests-377170324 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T11:01:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1618332818',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=89054249-304c-44c2-ac99-960263ecf900,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='865d378d37cd42ed98432cd1ce1e41be',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T11:01:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T11:01:39Z,use_quota=True,user_id='8acc7287c82b436186731f24c32b21ce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(34d3b144-d9b7-480a-a2e3-01e45f3d54c1),volume_type_id=34d3b144-d9b7-480a-a2e3-01e45f3d54c1)}" {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 12:01:38 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-f26cf718-d00b-452d-af1e-2fb004194136 tempest-ProjectReaderTests-377170324 None] Creating volume 89054249-304c-44c2-ac99-960263ecf900 {{(pid=87116) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 12:01:38 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-f26cf718-d00b-452d-af1e-2fb004194136 tempest-ProjectReaderTests-377170324 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 12:01:38 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-f26cf718-d00b-452d-af1e-2fb004194136 tempest-ProjectReaderTests-377170324 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 12:01:38 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-f26cf718-d00b-452d-af1e-2fb004194136 tempest-ProjectReaderTests-377170324 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 12:01:38 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-f26cf718-d00b-452d-af1e-2fb004194136 tempest-ProjectReaderTests-377170324 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 12:01:38 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-f26cf718-d00b-452d-af1e-2fb004194136 tempest-ProjectReaderTests-377170324 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 12:01:38 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-f26cf718-d00b-452d-af1e-2fb004194136 tempest-ProjectReaderTests-377170324 None] Selected osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f as target Quobyte volume. {{(pid=87116) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 12:01:38 devstack cinder-volume[87116]: INFO cinder.volume.drivers.remotefs [None req-f26cf718-d00b-452d-af1e-2fb004194136 tempest-ProjectReaderTests-377170324 None] casted to osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f Nov 06 12:01:38 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-f26cf718-d00b-452d-af1e-2fb004194136 tempest-ProjectReaderTests-377170324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-89054249-304c-44c2-ac99-960263ecf900 1073741824 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 12:01:38 devstack sudo[106782]: pam_unix(sudo:session): session closed for user root Nov 06 12:01:38 devstack sudo[106809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-89054249-304c-44c2-ac99-960263ecf900 1073741824 Nov 06 12:01:38 devstack sudo[106809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 12:01:38 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-189f03aa-e5be-45fa-b131-efed1aff9441 tempest-CreateVolumesFromSnapshotTest-801883145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756" returned: 0 in 0.467s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 12:01:38 devstack cinder-volume[87116]: DEBUG cinder.manager [None req-189f03aa-e5be-45fa-b131-efed1aff9441 tempest-CreateVolumesFromSnapshotTest-801883145 None] Notifying Schedulers of capabilities ... {{(pid=87116) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 12:01:38 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-189f03aa-e5be-45fa-b131-efed1aff9441 tempest-CreateVolumesFromSnapshotTest-801883145 None] Deleted volume successfully. Nov 06 12:01:38 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-189f03aa-e5be-45fa-b131-efed1aff9441 tempest-CreateVolumesFromSnapshotTest-801883145 None] Lock "cinder-b4161cde-e732-4565-bcf3-93e4c2263394-delete_volume" released by "delete_volume" :: held 1.779s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 12:01:39 devstack sudo[106809]: pam_unix(sudo:session): session closed for user root Nov 06 12:01:39 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-f26cf718-d00b-452d-af1e-2fb004194136 tempest-ProjectReaderTests-377170324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-89054249-304c-44c2-ac99-960263ecf900 1073741824" returned: 0 in 0.570s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 12:01:39 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-33d545d5-cf67-438a-b24e-37fa3473c6bc tempest-CreateVolumesFromSnapshotTest-801883145 None] Acquiring lock "cinder-e9b6ee5c-b169-4d4b-986e-afdc4113ede4-delete_snapshot" by "delete_snapshot" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 12:01:39 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-33d545d5-cf67-438a-b24e-37fa3473c6bc tempest-CreateVolumesFromSnapshotTest-801883145 None] Lock "cinder-e9b6ee5c-b169-4d4b-986e-afdc4113ede4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 12:01:39 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-33d545d5-cf67-438a-b24e-37fa3473c6bc tempest-CreateVolumesFromSnapshotTest-801883145 None] Acquiring lock "cinder-quobyte-ba43e453-c830-434c-a0b8-19ccbac97763" by "delete_snapshot" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 12:01:39 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-33d545d5-cf67-438a-b24e-37fa3473c6bc tempest-CreateVolumesFromSnapshotTest-801883145 None] Lock "cinder-quobyte-ba43e453-c830-434c-a0b8-19ccbac97763" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 12:01:39 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-33d545d5-cf67-438a-b24e-37fa3473c6bc tempest-CreateVolumesFromSnapshotTest-801883145 None] Acquiring lock "cinder-quobyte-e9b6ee5c-b169-4d4b-986e-afdc4113ede4" by "_delete_snapshot" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 12:01:39 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-f26cf718-d00b-452d-af1e-2fb004194136 tempest-ProjectReaderTests-377170324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-89054249-304c-44c2-ac99-960263ecf900 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 12:01:39 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-33d545d5-cf67-438a-b24e-37fa3473c6bc tempest-CreateVolumesFromSnapshotTest-801883145 None] Lock "cinder-quobyte-e9b6ee5c-b169-4d4b-986e-afdc4113ede4" acquired by "_delete_snapshot" :: waited 0.030s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 12:01:39 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-33d545d5-cf67-438a-b24e-37fa3473c6bc tempest-CreateVolumesFromSnapshotTest-801883145 None] Deleting offline snapshot e9b6ee5c-b169-4d4b-986e-afdc4113ede4 of volume ba43e453-c830-434c-a0b8-19ccbac97763 {{(pid=87116) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 06 12:01:39 devstack sudo[106817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-89054249-304c-44c2-ac99-960263ecf900 Nov 06 12:01:39 devstack sudo[106817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 12:01:39 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-33d545d5-cf67-438a-b24e-37fa3473c6bc tempest-CreateVolumesFromSnapshotTest-801883145 None] snapshot_file for this snap is: volume-ba43e453-c830-434c-a0b8-19ccbac97763.e9b6ee5c-b169-4d4b-986e-afdc4113ede4 {{(pid=87116) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 06 12:01:39 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2f435f5-c7c6-4329-9850-59841b1eb367]: (4, 'qcow2') {{(pid=88420) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 12:01:39 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-33d545d5-cf67-438a-b24e-37fa3473c6bc tempest-CreateVolumesFromSnapshotTest-801883145 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-ba43e453-c830-434c-a0b8-19ccbac97763.e9b6ee5c-b169-4d4b-986e-afdc4113ede4 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 12:01:39 devstack sudo[106819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-ba43e453-c830-434c-a0b8-19ccbac97763.e9b6ee5c-b169-4d4b-986e-afdc4113ede4 Nov 06 12:01:39 devstack sudo[106819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 12:01:39 devstack sudo[106817]: pam_unix(sudo:session): session closed for user root Nov 06 12:01:39 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-f26cf718-d00b-452d-af1e-2fb004194136 tempest-ProjectReaderTests-377170324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-89054249-304c-44c2-ac99-960263ecf900" returned: 0 in 0.323s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 12:01:39 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-f26cf718-d00b-452d-af1e-2fb004194136 tempest-ProjectReaderTests-377170324 None] <== create_volume: return (988ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f'} {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 12:01:39 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-f26cf718-d00b-452d-af1e-2fb004194136 tempest-ProjectReaderTests-377170324 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.994s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 12:01:39 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-f26cf718-d00b-452d-af1e-2fb004194136 tempest-ProjectReaderTests-377170324 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0a5ba17a-1341-4ee0-b453-4b5a68d50e3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-89054249-304c-44c2-ac99-960263ecf900', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 12:01:39 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-f26cf718-d00b-452d-af1e-2fb004194136 tempest-ProjectReaderTests-377170324 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (85fbcb3e-fe03-4f72-8064-645c290f1bab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 12:01:39 devstack cinder-volume[87116]: DEBUG oslo_service.periodic_task [None req-4fab4816-ec2b-4b19-b2ff-8548f2084354 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87116) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 12:01:39 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-4fab4816-ec2b-4b19-b2ff-8548f2084354 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 12:01:39 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-4fab4816-ec2b-4b19-b2ff-8548f2084354 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 12:01:39 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-4fab4816-ec2b-4b19-b2ff-8548f2084354 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 12:01:39 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-4fab4816-ec2b-4b19-b2ff-8548f2084354 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 12:01:39 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-4fab4816-ec2b-4b19-b2ff-8548f2084354 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 12:01:39 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-4fab4816-ec2b-4b19-b2ff-8548f2084354 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 12:01:39 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-f26cf718-d00b-452d-af1e-2fb004194136 tempest-ProjectReaderTests-377170324 None] Volume volume-89054249-304c-44c2-ac99-960263ecf900 (89054249-304c-44c2-ac99-960263ecf900): created successfully Nov 06 12:01:39 devstack sudo[106822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756 Nov 06 12:01:39 devstack sudo[106822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 12:01:39 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-f26cf718-d00b-452d-af1e-2fb004194136 tempest-ProjectReaderTests-377170324 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (85fbcb3e-fe03-4f72-8064-645c290f1bab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 12:01:39 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-f26cf718-d00b-452d-af1e-2fb004194136 tempest-ProjectReaderTests-377170324 None] Flow 'volume_create_manager' (393bb419-481b-454c-8ffc-de8148c24037) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 12:01:39 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-f26cf718-d00b-452d-af1e-2fb004194136 tempest-ProjectReaderTests-377170324 None] Created volume successfully. Nov 06 12:01:40 devstack sudo[106819]: pam_unix(sudo:session): session closed for user root Nov 06 12:01:40 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-33d545d5-cf67-438a-b24e-37fa3473c6bc tempest-CreateVolumesFromSnapshotTest-801883145 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-ba43e453-c830-434c-a0b8-19ccbac97763.e9b6ee5c-b169-4d4b-986e-afdc4113ede4" returned: 0 in 0.534s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 12:01:40 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-33d545d5-cf67-438a-b24e-37fa3473c6bc tempest-CreateVolumesFromSnapshotTest-801883145 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ba43e453-c830-434c-a0b8-19ccbac97763(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87116) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 12:01:40 devstack cinder-volume[87116]: DEBUG cinder.volume.flows.manager.create_volume [None req-072f4bb4-462a-4f7b-a22b-0a2bc61568df tempest-ProjectReaderTests-583148448 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87116) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 12:01:40 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-072f4bb4-462a-4f7b-a22b-0a2bc61568df tempest-ProjectReaderTests-583148448 None] Flow 'volume_create_manager' (832ba2f8-ceb2-4624-a6a7-7c996fdbb029) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 12:01:40 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-072f4bb4-462a-4f7b-a22b-0a2bc61568df tempest-ProjectReaderTests-583148448 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c25a476c-af1d-4a33-bb61-4cfdd2886455) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 12:01:40 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7bf6ba2-ca4b-495f-be04-86bf7c576ded]: (4, 'qcow2') {{(pid=88420) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 12:01:40 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-33d545d5-cf67-438a-b24e-37fa3473c6bc tempest-CreateVolumesFromSnapshotTest-801883145 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-ba43e453-c830-434c-a0b8-19ccbac97763 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 12:01:40 devstack sudo[106822]: pam_unix(sudo:session): session closed for user root Nov 06 12:01:40 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-072f4bb4-462a-4f7b-a22b-0a2bc61568df tempest-ProjectReaderTests-583148448 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c25a476c-af1d-4a33-bb61-4cfdd2886455) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T11:01:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1750991313',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9f454280-19f6-47e8-99dc-6b30fae67104,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0007b193c9894c8196b6fcd1b29f459e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T11:01:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T11:01:40Z,use_quota=True,user_id='a26e50f557ff470fa56dec9cb7f64c87',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(34d3b144-d9b7-480a-a2e3-01e45f3d54c1),volume_type_id=34d3b144-d9b7-480a-a2e3-01e45f3d54c1)' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 12:01:40 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-072f4bb4-462a-4f7b-a22b-0a2bc61568df tempest-ProjectReaderTests-583148448 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fa6f5949-d8ed-42bb-a687-bc5ee1d67528) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 12:01:40 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-072f4bb4-462a-4f7b-a22b-0a2bc61568df tempest-ProjectReaderTests-583148448 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fa6f5949-d8ed-42bb-a687-bc5ee1d67528) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 12:01:40 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-072f4bb4-462a-4f7b-a22b-0a2bc61568df tempest-ProjectReaderTests-583148448 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b0b1c2de-238f-4cde-b671-2a52e235dbf8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 12:01:40 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-072f4bb4-462a-4f7b-a22b-0a2bc61568df tempest-ProjectReaderTests-583148448 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b0b1c2de-238f-4cde-b671-2a52e235dbf8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9f454280-19f6-47e8-99dc-6b30fae67104', 'volume_name': 'volume-9f454280-19f6-47e8-99dc-6b30fae67104', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 12:01:40 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-072f4bb4-462a-4f7b-a22b-0a2bc61568df tempest-ProjectReaderTests-583148448 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (956d7227-0de2-4c88-ab6a-5c9b3fb006a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 12:01:40 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-072f4bb4-462a-4f7b-a22b-0a2bc61568df tempest-ProjectReaderTests-583148448 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (956d7227-0de2-4c88-ab6a-5c9b3fb006a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 12:01:40 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-072f4bb4-462a-4f7b-a22b-0a2bc61568df tempest-ProjectReaderTests-583148448 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3e2bb019-0ebc-4b55-abb0-7ef82e9daf49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 12:01:40 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-072f4bb4-462a-4f7b-a22b-0a2bc61568df tempest-ProjectReaderTests-583148448 None] Volume 9f454280-19f6-47e8-99dc-6b30fae67104: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9f454280-19f6-47e8-99dc-6b30fae67104', 'volume_size': 1} Nov 06 12:01:40 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-072f4bb4-462a-4f7b-a22b-0a2bc61568df tempest-ProjectReaderTests-583148448 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 12:01:40 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-072f4bb4-462a-4f7b-a22b-0a2bc61568df tempest-ProjectReaderTests-583148448 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 12:01:40 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-072f4bb4-462a-4f7b-a22b-0a2bc61568df tempest-ProjectReaderTests-583148448 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T11:01:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1750991313',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9f454280-19f6-47e8-99dc-6b30fae67104,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0007b193c9894c8196b6fcd1b29f459e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T11:01:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T11:01:40Z,use_quota=True,user_id='a26e50f557ff470fa56dec9cb7f64c87',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(34d3b144-d9b7-480a-a2e3-01e45f3d54c1),volume_type_id=34d3b144-d9b7-480a-a2e3-01e45f3d54c1)}" {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 12:01:40 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-072f4bb4-462a-4f7b-a22b-0a2bc61568df tempest-ProjectReaderTests-583148448 None] Creating volume 9f454280-19f6-47e8-99dc-6b30fae67104 {{(pid=87116) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 12:01:40 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-072f4bb4-462a-4f7b-a22b-0a2bc61568df tempest-ProjectReaderTests-583148448 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 12:01:40 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-072f4bb4-462a-4f7b-a22b-0a2bc61568df tempest-ProjectReaderTests-583148448 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 12:01:40 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-072f4bb4-462a-4f7b-a22b-0a2bc61568df tempest-ProjectReaderTests-583148448 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 12:01:40 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-072f4bb4-462a-4f7b-a22b-0a2bc61568df tempest-ProjectReaderTests-583148448 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 12:01:40 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-072f4bb4-462a-4f7b-a22b-0a2bc61568df tempest-ProjectReaderTests-583148448 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 12:01:40 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-072f4bb4-462a-4f7b-a22b-0a2bc61568df tempest-ProjectReaderTests-583148448 None] Selected osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f as target Quobyte volume. {{(pid=87116) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 12:01:40 devstack cinder-volume[87116]: INFO cinder.volume.drivers.remotefs [None req-072f4bb4-462a-4f7b-a22b-0a2bc61568df tempest-ProjectReaderTests-583148448 None] casted to osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f Nov 06 12:01:40 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-072f4bb4-462a-4f7b-a22b-0a2bc61568df tempest-ProjectReaderTests-583148448 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-9f454280-19f6-47e8-99dc-6b30fae67104 1073741824 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 12:01:40 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-4fab4816-ec2b-4b19-b2ff-8548f2084354 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756" returned: 0 in 0.383s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 12:01:40 devstack cinder-volume[87116]: DEBUG cinder.manager [None req-4fab4816-ec2b-4b19-b2ff-8548f2084354 None None] Notifying Schedulers of capabilities ... {{(pid=87116) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 12:01:40 devstack cinder-volume[87116]: DEBUG oslo_service.periodic_task [None req-4fab4816-ec2b-4b19-b2ff-8548f2084354 None None] Running periodic task VolumeManager._thread_info {{(pid=87116) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 12:01:40 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-4fab4816-ec2b-4b19-b2ff-8548f2084354 None None] thread count: 28 {{(pid=87116) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 06 12:01:40 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-4fab4816-ec2b-4b19-b2ff-8548f2084354 None None] thread info: [<_MainThread(MainThread, started 131399520669824)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87116) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 06 12:01:40 devstack sudo[106830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-9f454280-19f6-47e8-99dc-6b30fae67104 1073741824 Nov 06 12:01:40 devstack sudo[106830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 12:01:40 devstack sudo[106828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-ba43e453-c830-434c-a0b8-19ccbac97763 Nov 06 12:01:40 devstack sudo[106828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 12:01:40 devstack sudo[106828]: pam_unix(sudo:session): session closed for user root Nov 06 12:01:40 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-33d545d5-cf67-438a-b24e-37fa3473c6bc tempest-CreateVolumesFromSnapshotTest-801883145 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-ba43e453-c830-434c-a0b8-19ccbac97763" returned: 0 in 0.407s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 12:01:40 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-33d545d5-cf67-438a-b24e-37fa3473c6bc tempest-CreateVolumesFromSnapshotTest-801883145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-ba43e453-c830-434c-a0b8-19ccbac97763.e9b6ee5c-b169-4d4b-986e-afdc4113ede4 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 12:01:40 devstack sudo[106839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-ba43e453-c830-434c-a0b8-19ccbac97763.e9b6ee5c-b169-4d4b-986e-afdc4113ede4 Nov 06 12:01:40 devstack sudo[106839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 12:01:40 devstack sudo[106830]: pam_unix(sudo:session): session closed for user root Nov 06 12:01:40 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-072f4bb4-462a-4f7b-a22b-0a2bc61568df tempest-ProjectReaderTests-583148448 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-9f454280-19f6-47e8-99dc-6b30fae67104 1073741824" returned: 0 in 0.589s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 12:01:40 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-072f4bb4-462a-4f7b-a22b-0a2bc61568df tempest-ProjectReaderTests-583148448 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-9f454280-19f6-47e8-99dc-6b30fae67104 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 12:01:40 devstack sudo[106841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-9f454280-19f6-47e8-99dc-6b30fae67104 Nov 06 12:01:40 devstack sudo[106841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 12:01:40 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-1628bddc-0b3b-478b-9ead-c539bd86e3a7 tempest-ProjectReaderTests-377170324 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 12:01:41 devstack sudo[106839]: pam_unix(sudo:session): session closed for user root Nov 06 12:01:41 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-33d545d5-cf67-438a-b24e-37fa3473c6bc tempest-CreateVolumesFromSnapshotTest-801883145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-ba43e453-c830-434c-a0b8-19ccbac97763.e9b6ee5c-b169-4d4b-986e-afdc4113ede4" returned: 0 in 0.536s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 12:01:41 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-33d545d5-cf67-438a-b24e-37fa3473c6bc tempest-CreateVolumesFromSnapshotTest-801883145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-ba43e453-c830-434c-a0b8-19ccbac97763.e9b6ee5c-b169-4d4b-986e-afdc4113ede4 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 12:01:41 devstack sudo[106846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-ba43e453-c830-434c-a0b8-19ccbac97763.e9b6ee5c-b169-4d4b-986e-afdc4113ede4 Nov 06 12:01:41 devstack sudo[106846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 12:01:41 devstack sudo[106841]: pam_unix(sudo:session): session closed for user root Nov 06 12:01:41 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-072f4bb4-462a-4f7b-a22b-0a2bc61568df tempest-ProjectReaderTests-583148448 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-9f454280-19f6-47e8-99dc-6b30fae67104" returned: 0 in 0.305s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 12:01:41 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-072f4bb4-462a-4f7b-a22b-0a2bc61568df tempest-ProjectReaderTests-583148448 None] <== create_volume: return (970ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f'} {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 12:01:41 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-072f4bb4-462a-4f7b-a22b-0a2bc61568df tempest-ProjectReaderTests-583148448 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.973s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 12:01:41 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-1628bddc-0b3b-478b-9ead-c539bd86e3a7 tempest-ProjectReaderTests-377170324 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.229s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 12:01:41 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-1628bddc-0b3b-478b-9ead-c539bd86e3a7 tempest-ProjectReaderTests-377170324 None] Creating offline snapshot a88b1c48-c843-47c4-a850-72267bb4bab1 of volume 89054249-304c-44c2-ac99-960263ecf900 {{(pid=87116) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 06 12:01:41 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-072f4bb4-462a-4f7b-a22b-0a2bc61568df tempest-ProjectReaderTests-583148448 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3e2bb019-0ebc-4b55-abb0-7ef82e9daf49) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9f454280-19f6-47e8-99dc-6b30fae67104', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 12:01:41 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-072f4bb4-462a-4f7b-a22b-0a2bc61568df tempest-ProjectReaderTests-583148448 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (67f87438-1df5-45d5-9885-f722c1f64d1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 12:01:41 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a73da7d-c475-4e05-898d-8a0af215df03]: (4, 'qcow2') {{(pid=88420) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 12:01:41 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-1628bddc-0b3b-478b-9ead-c539bd86e3a7 tempest-ProjectReaderTests-377170324 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-89054249-304c-44c2-ac99-960263ecf900 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 12:01:41 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-072f4bb4-462a-4f7b-a22b-0a2bc61568df tempest-ProjectReaderTests-583148448 None] Volume volume-9f454280-19f6-47e8-99dc-6b30fae67104 (9f454280-19f6-47e8-99dc-6b30fae67104): created successfully Nov 06 12:01:41 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-072f4bb4-462a-4f7b-a22b-0a2bc61568df tempest-ProjectReaderTests-583148448 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (67f87438-1df5-45d5-9885-f722c1f64d1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 12:01:41 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-072f4bb4-462a-4f7b-a22b-0a2bc61568df tempest-ProjectReaderTests-583148448 None] Flow 'volume_create_manager' (832ba2f8-ceb2-4624-a6a7-7c996fdbb029) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 12:01:41 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-072f4bb4-462a-4f7b-a22b-0a2bc61568df tempest-ProjectReaderTests-583148448 None] Created volume successfully. Nov 06 12:01:41 devstack sudo[106849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-89054249-304c-44c2-ac99-960263ecf900 Nov 06 12:01:41 devstack sudo[106849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 12:01:41 devstack sudo[106846]: pam_unix(sudo:session): session closed for user root Nov 06 12:01:41 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-33d545d5-cf67-438a-b24e-37fa3473c6bc tempest-CreateVolumesFromSnapshotTest-801883145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-ba43e453-c830-434c-a0b8-19ccbac97763.e9b6ee5c-b169-4d4b-986e-afdc4113ede4" returned: 0 in 0.316s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 12:01:41 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-33d545d5-cf67-438a-b24e-37fa3473c6bc tempest-CreateVolumesFromSnapshotTest-801883145 None] Lock "cinder-quobyte-e9b6ee5c-b169-4d4b-986e-afdc4113ede4" released by "_delete_snapshot" :: held 1.970s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 12:01:41 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-33d545d5-cf67-438a-b24e-37fa3473c6bc tempest-CreateVolumesFromSnapshotTest-801883145 None] Lock "cinder-quobyte-ba43e453-c830-434c-a0b8-19ccbac97763" released by "delete_snapshot" :: held 2.008s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 12:01:41 devstack cinder-volume[87116]: DEBUG cinder.quota [None req-33d545d5-cf67-438a-b24e-37fa3473c6bc tempest-CreateVolumesFromSnapshotTest-801883145 None] Created reservations ['d443fcf6-5f9b-4c2a-9082-ada3251f0517', '2c09c54a-0ac5-4e54-8b95-18e4dcd0a658', '8fc9a942-1baf-4c64-a89c-8b341b5cb608', '8bd9230e-4aba-4605-95f4-517e2c5aaf9b'] {{(pid=87116) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 12:01:41 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-33d545d5-cf67-438a-b24e-37fa3473c6bc tempest-CreateVolumesFromSnapshotTest-801883145 None] Delete snapshot completed successfully. Nov 06 12:01:41 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-33d545d5-cf67-438a-b24e-37fa3473c6bc tempest-CreateVolumesFromSnapshotTest-801883145 None] Lock "cinder-e9b6ee5c-b169-4d4b-986e-afdc4113ede4-delete_snapshot" released by "delete_snapshot" :: held 2.148s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 12:01:41 devstack sudo[106849]: pam_unix(sudo:session): session closed for user root Nov 06 12:01:41 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-1628bddc-0b3b-478b-9ead-c539bd86e3a7 tempest-ProjectReaderTests-377170324 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-89054249-304c-44c2-ac99-960263ecf900" returned: 0 in 0.383s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 12:01:41 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-1628bddc-0b3b-478b-9ead-c539bd86e3a7 tempest-ProjectReaderTests-377170324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-89054249-304c-44c2-ac99-960263ecf900,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-89054249-304c-44c2-ac99-960263ecf900.a88b1c48-c843-47c4-a850-72267bb4bab1 1G {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 12:01:41 devstack sudo[106855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-89054249-304c-44c2-ac99-960263ecf900,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-89054249-304c-44c2-ac99-960263ecf900.a88b1c48-c843-47c4-a850-72267bb4bab1 1G Nov 06 12:01:41 devstack sudo[106855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 12:01:41 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-8f396a6a-bbc9-4654-9108-29adab59c7e3 tempest-CreateVolumesFromSnapshotTest-801883145 None] Acquiring lock "cinder-ba43e453-c830-434c-a0b8-19ccbac97763-delete_volume" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 12:01:41 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-8f396a6a-bbc9-4654-9108-29adab59c7e3 tempest-CreateVolumesFromSnapshotTest-801883145 None] Lock "cinder-ba43e453-c830-434c-a0b8-19ccbac97763-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 12:01:41 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-8f396a6a-bbc9-4654-9108-29adab59c7e3 tempest-CreateVolumesFromSnapshotTest-801883145 None] Acquiring lock "cinder-quobyte-ba43e453-c830-434c-a0b8-19ccbac97763" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 12:01:41 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-8f396a6a-bbc9-4654-9108-29adab59c7e3 tempest-CreateVolumesFromSnapshotTest-801883145 None] Lock "cinder-quobyte-ba43e453-c830-434c-a0b8-19ccbac97763" acquired by "delete_volume" :: waited 0.013s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 12:01:41 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f49188f-a994-422f-bedf-7f252b1a61bd]: (4, 'qcow2') {{(pid=88420) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 12:01:41 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-8f396a6a-bbc9-4654-9108-29adab59c7e3 tempest-CreateVolumesFromSnapshotTest-801883145 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-ba43e453-c830-434c-a0b8-19ccbac97763 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 12:01:41 devstack sudo[106857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-ba43e453-c830-434c-a0b8-19ccbac97763 Nov 06 12:01:41 devstack sudo[106857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 12:01:42 devstack sudo[106855]: pam_unix(sudo:session): session closed for user root Nov 06 12:01:42 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-1628bddc-0b3b-478b-9ead-c539bd86e3a7 tempest-ProjectReaderTests-377170324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-89054249-304c-44c2-ac99-960263ecf900,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-89054249-304c-44c2-ac99-960263ecf900.a88b1c48-c843-47c4-a850-72267bb4bab1 1G" returned: 0 in 0.474s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 12:01:42 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-1628bddc-0b3b-478b-9ead-c539bd86e3a7 tempest-ProjectReaderTests-377170324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-89054249-304c-44c2-ac99-960263ecf900 -F qcow2 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-89054249-304c-44c2-ac99-960263ecf900.a88b1c48-c843-47c4-a850-72267bb4bab1 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 12:01:42 devstack sudo[106863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-89054249-304c-44c2-ac99-960263ecf900 -F qcow2 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-89054249-304c-44c2-ac99-960263ecf900.a88b1c48-c843-47c4-a850-72267bb4bab1 Nov 06 12:01:42 devstack sudo[106863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 12:01:42 devstack sudo[106857]: pam_unix(sudo:session): session closed for user root Nov 06 12:01:42 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-8f396a6a-bbc9-4654-9108-29adab59c7e3 tempest-CreateVolumesFromSnapshotTest-801883145 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-ba43e453-c830-434c-a0b8-19ccbac97763" returned: 0 in 0.418s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 12:01:42 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-8f396a6a-bbc9-4654-9108-29adab59c7e3 tempest-CreateVolumesFromSnapshotTest-801883145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-ba43e453-c830-434c-a0b8-19ccbac97763 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 12:01:42 devstack sudo[106868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-ba43e453-c830-434c-a0b8-19ccbac97763 Nov 06 12:01:42 devstack sudo[106868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 12:01:42 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-c656983b-f94e-48cc-aca5-0f058b91d3a8 tempest-ProjectReaderTests-583148448 None] Acquiring lock "cinder-9f454280-19f6-47e8-99dc-6b30fae67104-delete_volume" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 12:01:42 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-c656983b-f94e-48cc-aca5-0f058b91d3a8 tempest-ProjectReaderTests-583148448 None] Lock "cinder-9f454280-19f6-47e8-99dc-6b30fae67104-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 12:01:42 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-c656983b-f94e-48cc-aca5-0f058b91d3a8 tempest-ProjectReaderTests-583148448 None] Acquiring lock "cinder-quobyte-9f454280-19f6-47e8-99dc-6b30fae67104" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 12:01:42 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-c656983b-f94e-48cc-aca5-0f058b91d3a8 tempest-ProjectReaderTests-583148448 None] Lock "cinder-quobyte-9f454280-19f6-47e8-99dc-6b30fae67104" acquired by "delete_volume" :: waited 0.017s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 12:01:42 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[78dd63cb-cdf6-472b-81dd-3b54c85a35d4]: (4, 'qcow2') {{(pid=88420) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 12:01:42 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-c656983b-f94e-48cc-aca5-0f058b91d3a8 tempest-ProjectReaderTests-583148448 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-9f454280-19f6-47e8-99dc-6b30fae67104 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 12:01:42 devstack sudo[106863]: pam_unix(sudo:session): session closed for user root Nov 06 12:01:42 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-1628bddc-0b3b-478b-9ead-c539bd86e3a7 tempest-ProjectReaderTests-377170324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-89054249-304c-44c2-ac99-960263ecf900 -F qcow2 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-89054249-304c-44c2-ac99-960263ecf900.a88b1c48-c843-47c4-a850-72267bb4bab1" returned: 0 in 0.366s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 12:01:42 devstack cinder-volume[87116]: WARNING cinder.volume.drivers.remotefs [None req-1628bddc-0b3b-478b-9ead-c539bd86e3a7 tempest-ProjectReaderTests-377170324 None] /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-89054249-304c-44c2-ac99-960263ecf900.a88b1c48-c843-47c4-a850-72267bb4bab1 is being set with open permissions: ugo+rw Nov 06 12:01:42 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-1628bddc-0b3b-478b-9ead-c539bd86e3a7 tempest-ProjectReaderTests-377170324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-89054249-304c-44c2-ac99-960263ecf900.a88b1c48-c843-47c4-a850-72267bb4bab1 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 12:01:42 devstack sudo[106875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-89054249-304c-44c2-ac99-960263ecf900.a88b1c48-c843-47c4-a850-72267bb4bab1 Nov 06 12:01:42 devstack sudo[106875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 12:01:42 devstack sudo[106868]: pam_unix(sudo:session): session closed for user root Nov 06 12:01:42 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-8f396a6a-bbc9-4654-9108-29adab59c7e3 tempest-CreateVolumesFromSnapshotTest-801883145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-ba43e453-c830-434c-a0b8-19ccbac97763" returned: 0 in 0.347s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 12:01:42 devstack sudo[106874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-9f454280-19f6-47e8-99dc-6b30fae67104 Nov 06 12:01:42 devstack sudo[106874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 12:01:42 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-8f396a6a-bbc9-4654-9108-29adab59c7e3 tempest-CreateVolumesFromSnapshotTest-801883145 None] Lock "cinder-quobyte-ba43e453-c830-434c-a0b8-19ccbac97763" released by "delete_volume" :: held 0.833s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 12:01:42 devstack cinder-volume[87116]: DEBUG dbcounter [-] [87116] Writing DB stats cinder:UPDATE=292,cinder:SELECT=216,cinder:INSERT=84,cinder:DELETE=23 {{(pid=87116) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 12:01:42 devstack cinder-volume[87116]: DEBUG cinder.quota [None req-8f396a6a-bbc9-4654-9108-29adab59c7e3 tempest-CreateVolumesFromSnapshotTest-801883145 None] Created reservations ['82b99dd3-4053-4aef-9d23-2615d6618773', '58ffc771-45b5-4b07-ae60-277b4a245c35', 'e39f6fc4-ec81-4bf3-8baa-0284d4181668', '64ea0608-89d4-4f45-afc8-0d1b76244e23'] {{(pid=87116) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 12:01:42 devstack sudo[106875]: pam_unix(sudo:session): session closed for user root Nov 06 12:01:42 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-1628bddc-0b3b-478b-9ead-c539bd86e3a7 tempest-ProjectReaderTests-377170324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-89054249-304c-44c2-ac99-960263ecf900.a88b1c48-c843-47c4-a850-72267bb4bab1" returned: 0 in 0.289s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 12:01:42 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-8f396a6a-bbc9-4654-9108-29adab59c7e3 tempest-CreateVolumesFromSnapshotTest-801883145 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 12:01:42 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-8f396a6a-bbc9-4654-9108-29adab59c7e3 tempest-CreateVolumesFromSnapshotTest-801883145 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 12:01:42 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-8f396a6a-bbc9-4654-9108-29adab59c7e3 tempest-CreateVolumesFromSnapshotTest-801883145 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 12:01:42 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-8f396a6a-bbc9-4654-9108-29adab59c7e3 tempest-CreateVolumesFromSnapshotTest-801883145 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 12:01:42 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-8f396a6a-bbc9-4654-9108-29adab59c7e3 tempest-CreateVolumesFromSnapshotTest-801883145 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 12:01:42 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-8f396a6a-bbc9-4654-9108-29adab59c7e3 tempest-CreateVolumesFromSnapshotTest-801883145 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 12:01:42 devstack sudo[106880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756 Nov 06 12:01:42 devstack sudo[106880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 12:01:42 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-1628bddc-0b3b-478b-9ead-c539bd86e3a7 tempest-ProjectReaderTests-377170324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-89054249-304c-44c2-ac99-960263ecf900.info {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 12:01:42 devstack sudo[106885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-89054249-304c-44c2-ac99-960263ecf900.info Nov 06 12:01:42 devstack sudo[106885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 12:01:43 devstack sudo[106874]: pam_unix(sudo:session): session closed for user root Nov 06 12:01:43 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-c656983b-f94e-48cc-aca5-0f058b91d3a8 tempest-ProjectReaderTests-583148448 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-9f454280-19f6-47e8-99dc-6b30fae67104" returned: 0 in 0.545s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 12:01:43 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-c656983b-f94e-48cc-aca5-0f058b91d3a8 tempest-ProjectReaderTests-583148448 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-9f454280-19f6-47e8-99dc-6b30fae67104 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 12:01:43 devstack sudo[106888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-9f454280-19f6-47e8-99dc-6b30fae67104 Nov 06 12:01:43 devstack sudo[106888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 12:01:43 devstack sudo[106880]: pam_unix(sudo:session): session closed for user root Nov 06 12:01:43 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-8f396a6a-bbc9-4654-9108-29adab59c7e3 tempest-CreateVolumesFromSnapshotTest-801883145 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756" returned: 0 in 0.385s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 12:01:43 devstack cinder-volume[87116]: DEBUG cinder.manager [None req-8f396a6a-bbc9-4654-9108-29adab59c7e3 tempest-CreateVolumesFromSnapshotTest-801883145 None] Notifying Schedulers of capabilities ... {{(pid=87116) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 12:01:43 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-8f396a6a-bbc9-4654-9108-29adab59c7e3 tempest-CreateVolumesFromSnapshotTest-801883145 None] Deleted volume successfully. Nov 06 12:01:43 devstack cinder-volume[87116]: DEBUG dbcounter [-] [87116] Writing DB stats cinder:SELECT=226,cinder:UPDATE=306,cinder:INSERT=77,cinder:DELETE=31 {{(pid=87116) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 12:01:43 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-8f396a6a-bbc9-4654-9108-29adab59c7e3 tempest-CreateVolumesFromSnapshotTest-801883145 None] Lock "cinder-ba43e453-c830-434c-a0b8-19ccbac97763-delete_volume" released by "delete_volume" :: held 1.531s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 12:01:43 devstack sudo[106885]: pam_unix(sudo:session): session closed for user root Nov 06 12:01:43 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-1628bddc-0b3b-478b-9ead-c539bd86e3a7 tempest-ProjectReaderTests-377170324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-89054249-304c-44c2-ac99-960263ecf900.info" returned: 0 in 0.387s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 12:01:43 devstack cinder-volume[87116]: WARNING cinder.volume.drivers.remotefs [None req-1628bddc-0b3b-478b-9ead-c539bd86e3a7 tempest-ProjectReaderTests-377170324 None] /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-89054249-304c-44c2-ac99-960263ecf900.info is being set with open permissions: ugo+rw Nov 06 12:01:43 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-1628bddc-0b3b-478b-9ead-c539bd86e3a7 tempest-ProjectReaderTests-377170324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-89054249-304c-44c2-ac99-960263ecf900.info {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 12:01:43 devstack sudo[106892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-89054249-304c-44c2-ac99-960263ecf900.info Nov 06 12:01:43 devstack sudo[106892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 12:01:43 devstack sudo[106888]: pam_unix(sudo:session): session closed for user root Nov 06 12:01:43 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-c656983b-f94e-48cc-aca5-0f058b91d3a8 tempest-ProjectReaderTests-583148448 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-9f454280-19f6-47e8-99dc-6b30fae67104" returned: 0 in 0.417s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 12:01:43 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-c656983b-f94e-48cc-aca5-0f058b91d3a8 tempest-ProjectReaderTests-583148448 None] Lock "cinder-quobyte-9f454280-19f6-47e8-99dc-6b30fae67104" released by "delete_volume" :: held 1.025s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 12:01:43 devstack cinder-volume[87116]: DEBUG cinder.quota [None req-c656983b-f94e-48cc-aca5-0f058b91d3a8 tempest-ProjectReaderTests-583148448 None] Created reservations ['a928cb6b-eec4-49f1-bc45-5199bbedbdef', '23fcae23-73b1-4622-8d46-6facb47f9422', 'd55dcd41-9e60-4edd-8839-649377dc5133', '2067c77b-3500-4b46-9879-af23a5540a86'] {{(pid=87116) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 12:01:43 devstack sudo[106892]: pam_unix(sudo:session): session closed for user root Nov 06 12:01:43 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-1628bddc-0b3b-478b-9ead-c539bd86e3a7 tempest-ProjectReaderTests-377170324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-89054249-304c-44c2-ac99-960263ecf900.info" returned: 0 in 0.352s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 12:01:43 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-1628bddc-0b3b-478b-9ead-c539bd86e3a7 tempest-ProjectReaderTests-377170324 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.427s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 12:01:43 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-c656983b-f94e-48cc-aca5-0f058b91d3a8 tempest-ProjectReaderTests-583148448 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 12:01:43 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-c656983b-f94e-48cc-aca5-0f058b91d3a8 tempest-ProjectReaderTests-583148448 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 12:01:43 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-c656983b-f94e-48cc-aca5-0f058b91d3a8 tempest-ProjectReaderTests-583148448 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 12:01:43 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-c656983b-f94e-48cc-aca5-0f058b91d3a8 tempest-ProjectReaderTests-583148448 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 12:01:43 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-c656983b-f94e-48cc-aca5-0f058b91d3a8 tempest-ProjectReaderTests-583148448 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 12:01:43 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-c656983b-f94e-48cc-aca5-0f058b91d3a8 tempest-ProjectReaderTests-583148448 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 12:01:43 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-1628bddc-0b3b-478b-9ead-c539bd86e3a7 tempest-ProjectReaderTests-377170324 None] Create snapshot completed successfully Nov 06 12:01:43 devstack sudo[106896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756 Nov 06 12:01:43 devstack sudo[106896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 12:01:43 devstack sudo[106896]: pam_unix(sudo:session): session closed for user root Nov 06 12:01:43 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-c656983b-f94e-48cc-aca5-0f058b91d3a8 tempest-ProjectReaderTests-583148448 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756" returned: 0 in 0.277s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 12:01:43 devstack cinder-volume[87116]: DEBUG cinder.manager [None req-c656983b-f94e-48cc-aca5-0f058b91d3a8 tempest-ProjectReaderTests-583148448 None] Notifying Schedulers of capabilities ... {{(pid=87116) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 12:01:43 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-c656983b-f94e-48cc-aca5-0f058b91d3a8 tempest-ProjectReaderTests-583148448 None] Deleted volume successfully. Nov 06 12:01:43 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-c656983b-f94e-48cc-aca5-0f058b91d3a8 tempest-ProjectReaderTests-583148448 None] Lock "cinder-9f454280-19f6-47e8-99dc-6b30fae67104-delete_volume" released by "delete_volume" :: held 1.607s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 12:01:44 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-03b5772c-bd8f-4238-b1c8-4b9e9d16a5bc tempest-ProjectReaderTests-377170324 None] Acquiring lock "cinder-a88b1c48-c843-47c4-a850-72267bb4bab1-delete_snapshot" by "delete_snapshot" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 12:01:44 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-03b5772c-bd8f-4238-b1c8-4b9e9d16a5bc tempest-ProjectReaderTests-377170324 None] Lock "cinder-a88b1c48-c843-47c4-a850-72267bb4bab1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 12:01:44 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-03b5772c-bd8f-4238-b1c8-4b9e9d16a5bc tempest-ProjectReaderTests-377170324 None] Acquiring lock "cinder-quobyte-89054249-304c-44c2-ac99-960263ecf900" by "delete_snapshot" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 12:01:44 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-03b5772c-bd8f-4238-b1c8-4b9e9d16a5bc tempest-ProjectReaderTests-377170324 None] Lock "cinder-quobyte-89054249-304c-44c2-ac99-960263ecf900" acquired by "delete_snapshot" :: waited 0.032s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 12:01:44 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-03b5772c-bd8f-4238-b1c8-4b9e9d16a5bc tempest-ProjectReaderTests-377170324 None] Acquiring lock "cinder-quobyte-a88b1c48-c843-47c4-a850-72267bb4bab1" by "_delete_snapshot" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 12:01:44 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-03b5772c-bd8f-4238-b1c8-4b9e9d16a5bc tempest-ProjectReaderTests-377170324 None] Lock "cinder-quobyte-a88b1c48-c843-47c4-a850-72267bb4bab1" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 12:01:44 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-03b5772c-bd8f-4238-b1c8-4b9e9d16a5bc tempest-ProjectReaderTests-377170324 None] Deleting offline snapshot a88b1c48-c843-47c4-a850-72267bb4bab1 of volume 89054249-304c-44c2-ac99-960263ecf900 {{(pid=87116) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 06 12:01:44 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-03b5772c-bd8f-4238-b1c8-4b9e9d16a5bc tempest-ProjectReaderTests-377170324 None] snapshot_file for this snap is: volume-89054249-304c-44c2-ac99-960263ecf900.a88b1c48-c843-47c4-a850-72267bb4bab1 {{(pid=87116) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 06 12:01:44 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b19d08d-960b-4e22-98ed-8d5f5e9bfef6]: (4, 'qcow2') {{(pid=88420) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 12:01:44 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-03b5772c-bd8f-4238-b1c8-4b9e9d16a5bc tempest-ProjectReaderTests-377170324 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-89054249-304c-44c2-ac99-960263ecf900.a88b1c48-c843-47c4-a850-72267bb4bab1 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 12:01:44 devstack sudo[106899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-89054249-304c-44c2-ac99-960263ecf900.a88b1c48-c843-47c4-a850-72267bb4bab1 Nov 06 12:01:44 devstack sudo[106899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 12:01:44 devstack sudo[106899]: pam_unix(sudo:session): session closed for user root Nov 06 12:01:44 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-03b5772c-bd8f-4238-b1c8-4b9e9d16a5bc tempest-ProjectReaderTests-377170324 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-89054249-304c-44c2-ac99-960263ecf900.a88b1c48-c843-47c4-a850-72267bb4bab1" returned: 0 in 0.409s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 12:01:44 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-03b5772c-bd8f-4238-b1c8-4b9e9d16a5bc tempest-ProjectReaderTests-377170324 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-89054249-304c-44c2-ac99-960263ecf900(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87116) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 12:01:44 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd275bfc-4065-4497-bdd7-53324915b153]: (4, 'qcow2') {{(pid=88420) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 12:01:44 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-03b5772c-bd8f-4238-b1c8-4b9e9d16a5bc tempest-ProjectReaderTests-377170324 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-89054249-304c-44c2-ac99-960263ecf900 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 12:01:44 devstack sudo[106906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-89054249-304c-44c2-ac99-960263ecf900 Nov 06 12:01:44 devstack sudo[106906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 12:01:45 devstack sudo[106906]: pam_unix(sudo:session): session closed for user root Nov 06 12:01:45 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-03b5772c-bd8f-4238-b1c8-4b9e9d16a5bc tempest-ProjectReaderTests-377170324 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-89054249-304c-44c2-ac99-960263ecf900" returned: 0 in 0.546s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 12:01:45 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-03b5772c-bd8f-4238-b1c8-4b9e9d16a5bc tempest-ProjectReaderTests-377170324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-89054249-304c-44c2-ac99-960263ecf900.a88b1c48-c843-47c4-a850-72267bb4bab1 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 12:01:45 devstack sudo[106911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-89054249-304c-44c2-ac99-960263ecf900.a88b1c48-c843-47c4-a850-72267bb4bab1 Nov 06 12:01:45 devstack sudo[106911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 12:01:45 devstack cinder-volume[87116]: DEBUG cinder.volume.flows.manager.create_volume [None req-a059c780-6687-4620-b86f-2e11832bff3c tempest-ProjectReaderTests-583148448 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87116) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 12:01:45 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-a059c780-6687-4620-b86f-2e11832bff3c tempest-ProjectReaderTests-583148448 None] Flow 'volume_create_manager' (cd520949-6a78-4a3b-927b-02fd1292b471) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 12:01:45 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-a059c780-6687-4620-b86f-2e11832bff3c tempest-ProjectReaderTests-583148448 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (56d5069b-05e4-4f87-8051-123ad7da6d04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 12:01:45 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-a059c780-6687-4620-b86f-2e11832bff3c tempest-ProjectReaderTests-583148448 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (56d5069b-05e4-4f87-8051-123ad7da6d04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T11:01:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-583946662',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2c07086a-4655-46f6-87b9-f370fa6db3d4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0007b193c9894c8196b6fcd1b29f459e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T11:01:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T11:01:45Z,use_quota=True,user_id='a26e50f557ff470fa56dec9cb7f64c87',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(34d3b144-d9b7-480a-a2e3-01e45f3d54c1),volume_type_id=34d3b144-d9b7-480a-a2e3-01e45f3d54c1)' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 12:01:45 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-a059c780-6687-4620-b86f-2e11832bff3c tempest-ProjectReaderTests-583148448 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c095e7c9-151e-4c78-9576-dcad6964beb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 12:01:45 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-a059c780-6687-4620-b86f-2e11832bff3c tempest-ProjectReaderTests-583148448 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c095e7c9-151e-4c78-9576-dcad6964beb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 12:01:45 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-a059c780-6687-4620-b86f-2e11832bff3c tempest-ProjectReaderTests-583148448 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dc9acab1-521b-4135-b4ee-04f7e36034c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 12:01:45 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-a059c780-6687-4620-b86f-2e11832bff3c tempest-ProjectReaderTests-583148448 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dc9acab1-521b-4135-b4ee-04f7e36034c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2c07086a-4655-46f6-87b9-f370fa6db3d4', 'volume_name': 'volume-2c07086a-4655-46f6-87b9-f370fa6db3d4', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 12:01:45 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-a059c780-6687-4620-b86f-2e11832bff3c tempest-ProjectReaderTests-583148448 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9bc2fea5-2649-4c27-b59f-dc6f8fd823f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 12:01:45 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-a059c780-6687-4620-b86f-2e11832bff3c tempest-ProjectReaderTests-583148448 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9bc2fea5-2649-4c27-b59f-dc6f8fd823f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 12:01:45 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-a059c780-6687-4620-b86f-2e11832bff3c tempest-ProjectReaderTests-583148448 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8b8fbf36-baf6-4816-9d11-0713af5dc3af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 12:01:45 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-a059c780-6687-4620-b86f-2e11832bff3c tempest-ProjectReaderTests-583148448 None] Volume 2c07086a-4655-46f6-87b9-f370fa6db3d4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2c07086a-4655-46f6-87b9-f370fa6db3d4', 'volume_size': 1} Nov 06 12:01:45 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-a059c780-6687-4620-b86f-2e11832bff3c tempest-ProjectReaderTests-583148448 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 12:01:45 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-a059c780-6687-4620-b86f-2e11832bff3c tempest-ProjectReaderTests-583148448 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 12:01:45 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-a059c780-6687-4620-b86f-2e11832bff3c tempest-ProjectReaderTests-583148448 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T11:01:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-583946662',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2c07086a-4655-46f6-87b9-f370fa6db3d4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0007b193c9894c8196b6fcd1b29f459e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T11:01:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T11:01:45Z,use_quota=True,user_id='a26e50f557ff470fa56dec9cb7f64c87',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(34d3b144-d9b7-480a-a2e3-01e45f3d54c1),volume_type_id=34d3b144-d9b7-480a-a2e3-01e45f3d54c1)}" {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 12:01:45 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-a059c780-6687-4620-b86f-2e11832bff3c tempest-ProjectReaderTests-583148448 None] Creating volume 2c07086a-4655-46f6-87b9-f370fa6db3d4 {{(pid=87116) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 12:01:45 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-a059c780-6687-4620-b86f-2e11832bff3c tempest-ProjectReaderTests-583148448 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 12:01:45 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-a059c780-6687-4620-b86f-2e11832bff3c tempest-ProjectReaderTests-583148448 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 12:01:45 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-a059c780-6687-4620-b86f-2e11832bff3c tempest-ProjectReaderTests-583148448 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 12:01:45 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-a059c780-6687-4620-b86f-2e11832bff3c tempest-ProjectReaderTests-583148448 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 12:01:45 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-a059c780-6687-4620-b86f-2e11832bff3c tempest-ProjectReaderTests-583148448 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 12:01:45 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-a059c780-6687-4620-b86f-2e11832bff3c tempest-ProjectReaderTests-583148448 None] Selected osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f as target Quobyte volume. {{(pid=87116) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 12:01:45 devstack cinder-volume[87116]: INFO cinder.volume.drivers.remotefs [None req-a059c780-6687-4620-b86f-2e11832bff3c tempest-ProjectReaderTests-583148448 None] casted to osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f Nov 06 12:01:45 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-a059c780-6687-4620-b86f-2e11832bff3c tempest-ProjectReaderTests-583148448 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-2c07086a-4655-46f6-87b9-f370fa6db3d4 1073741824 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 12:01:45 devstack sudo[106913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-2c07086a-4655-46f6-87b9-f370fa6db3d4 1073741824 Nov 06 12:01:45 devstack sudo[106913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 12:01:45 devstack sudo[106911]: pam_unix(sudo:session): session closed for user root Nov 06 12:01:45 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-03b5772c-bd8f-4238-b1c8-4b9e9d16a5bc tempest-ProjectReaderTests-377170324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-89054249-304c-44c2-ac99-960263ecf900.a88b1c48-c843-47c4-a850-72267bb4bab1" returned: 0 in 0.424s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 12:01:45 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-03b5772c-bd8f-4238-b1c8-4b9e9d16a5bc tempest-ProjectReaderTests-377170324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-89054249-304c-44c2-ac99-960263ecf900.a88b1c48-c843-47c4-a850-72267bb4bab1 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 12:01:45 devstack sudo[106918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-89054249-304c-44c2-ac99-960263ecf900.a88b1c48-c843-47c4-a850-72267bb4bab1 Nov 06 12:01:45 devstack sudo[106918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 12:01:45 devstack sudo[106918]: pam_unix(sudo:session): session closed for user root Nov 06 12:01:45 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-03b5772c-bd8f-4238-b1c8-4b9e9d16a5bc tempest-ProjectReaderTests-377170324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-89054249-304c-44c2-ac99-960263ecf900.a88b1c48-c843-47c4-a850-72267bb4bab1" returned: 0 in 0.279s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 12:01:45 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-03b5772c-bd8f-4238-b1c8-4b9e9d16a5bc tempest-ProjectReaderTests-377170324 None] Lock "cinder-quobyte-a88b1c48-c843-47c4-a850-72267bb4bab1" released by "_delete_snapshot" :: held 1.808s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 12:01:45 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-03b5772c-bd8f-4238-b1c8-4b9e9d16a5bc tempest-ProjectReaderTests-377170324 None] Lock "cinder-quobyte-89054249-304c-44c2-ac99-960263ecf900" released by "delete_snapshot" :: held 1.837s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 12:01:46 devstack sudo[106913]: pam_unix(sudo:session): session closed for user root Nov 06 12:01:46 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-a059c780-6687-4620-b86f-2e11832bff3c tempest-ProjectReaderTests-583148448 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-2c07086a-4655-46f6-87b9-f370fa6db3d4 1073741824" returned: 0 in 0.562s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 12:01:46 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-a059c780-6687-4620-b86f-2e11832bff3c tempest-ProjectReaderTests-583148448 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-2c07086a-4655-46f6-87b9-f370fa6db3d4 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 12:01:46 devstack cinder-volume[87116]: DEBUG cinder.quota [None req-03b5772c-bd8f-4238-b1c8-4b9e9d16a5bc tempest-ProjectReaderTests-377170324 None] Created reservations ['a4cc8241-598f-4e37-a205-eaf95dfb9182', 'ebd51d7a-6dff-45c5-9ef9-c53c932b42a4', '90234498-3c4b-40a4-832c-637925374b0e', '262a4c09-d4ad-4ccf-9017-64a97b0d040c'] {{(pid=87116) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 12:01:46 devstack sudo[106925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-2c07086a-4655-46f6-87b9-f370fa6db3d4 Nov 06 12:01:46 devstack sudo[106925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 12:01:46 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-03b5772c-bd8f-4238-b1c8-4b9e9d16a5bc tempest-ProjectReaderTests-377170324 None] Delete snapshot completed successfully. Nov 06 12:01:46 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-03b5772c-bd8f-4238-b1c8-4b9e9d16a5bc tempest-ProjectReaderTests-377170324 None] Lock "cinder-a88b1c48-c843-47c4-a850-72267bb4bab1-delete_snapshot" released by "delete_snapshot" :: held 2.050s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 12:01:46 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-5e21dab1-2408-4df3-869a-706e5b4ae85a tempest-ProjectReaderTests-377170324 None] Acquiring lock "cinder-89054249-304c-44c2-ac99-960263ecf900-delete_volume" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 12:01:46 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-5e21dab1-2408-4df3-869a-706e5b4ae85a tempest-ProjectReaderTests-377170324 None] Lock "cinder-89054249-304c-44c2-ac99-960263ecf900-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 12:01:46 devstack sudo[106925]: pam_unix(sudo:session): session closed for user root Nov 06 12:01:46 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-5e21dab1-2408-4df3-869a-706e5b4ae85a tempest-ProjectReaderTests-377170324 None] Acquiring lock "cinder-quobyte-89054249-304c-44c2-ac99-960263ecf900" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 12:01:46 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-a059c780-6687-4620-b86f-2e11832bff3c tempest-ProjectReaderTests-583148448 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-2c07086a-4655-46f6-87b9-f370fa6db3d4" returned: 0 in 0.297s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 12:01:46 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-a059c780-6687-4620-b86f-2e11832bff3c tempest-ProjectReaderTests-583148448 None] <== create_volume: return (940ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f'} {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 12:01:46 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-a059c780-6687-4620-b86f-2e11832bff3c tempest-ProjectReaderTests-583148448 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.944s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 12:01:46 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-a059c780-6687-4620-b86f-2e11832bff3c tempest-ProjectReaderTests-583148448 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8b8fbf36-baf6-4816-9d11-0713af5dc3af) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2c07086a-4655-46f6-87b9-f370fa6db3d4', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 12:01:46 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-a059c780-6687-4620-b86f-2e11832bff3c tempest-ProjectReaderTests-583148448 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d05361d1-deb8-482b-b34d-f533cd4075ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 12:01:46 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-5e21dab1-2408-4df3-869a-706e5b4ae85a tempest-ProjectReaderTests-377170324 None] Lock "cinder-quobyte-89054249-304c-44c2-ac99-960263ecf900" acquired by "delete_volume" :: waited 0.051s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 12:01:46 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-a059c780-6687-4620-b86f-2e11832bff3c tempest-ProjectReaderTests-583148448 None] Volume volume-2c07086a-4655-46f6-87b9-f370fa6db3d4 (2c07086a-4655-46f6-87b9-f370fa6db3d4): created successfully Nov 06 12:01:46 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-a059c780-6687-4620-b86f-2e11832bff3c tempest-ProjectReaderTests-583148448 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d05361d1-deb8-482b-b34d-f533cd4075ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 12:01:46 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-a059c780-6687-4620-b86f-2e11832bff3c tempest-ProjectReaderTests-583148448 None] Flow 'volume_create_manager' (cd520949-6a78-4a3b-927b-02fd1292b471) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 12:01:46 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2455587-6f6c-4740-bf25-84dcf792ec8d]: (4, 'qcow2') {{(pid=88420) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 12:01:46 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-5e21dab1-2408-4df3-869a-706e5b4ae85a tempest-ProjectReaderTests-377170324 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-89054249-304c-44c2-ac99-960263ecf900 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 12:01:46 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-a059c780-6687-4620-b86f-2e11832bff3c tempest-ProjectReaderTests-583148448 None] Created volume successfully. Nov 06 12:01:46 devstack sudo[106928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-89054249-304c-44c2-ac99-960263ecf900 Nov 06 12:01:46 devstack sudo[106928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 12:01:46 devstack sudo[106928]: pam_unix(sudo:session): session closed for user root Nov 06 12:01:46 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-5e21dab1-2408-4df3-869a-706e5b4ae85a tempest-ProjectReaderTests-377170324 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-89054249-304c-44c2-ac99-960263ecf900" returned: 0 in 0.431s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 12:01:46 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-5e21dab1-2408-4df3-869a-706e5b4ae85a tempest-ProjectReaderTests-377170324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-89054249-304c-44c2-ac99-960263ecf900 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 12:01:46 devstack sudo[106933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-89054249-304c-44c2-ac99-960263ecf900 Nov 06 12:01:46 devstack sudo[106933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 12:01:47 devstack sudo[106933]: pam_unix(sudo:session): session closed for user root Nov 06 12:01:47 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-5e21dab1-2408-4df3-869a-706e5b4ae85a tempest-ProjectReaderTests-377170324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-89054249-304c-44c2-ac99-960263ecf900" returned: 0 in 0.288s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 12:01:47 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-5e21dab1-2408-4df3-869a-706e5b4ae85a tempest-ProjectReaderTests-377170324 None] Lock "cinder-quobyte-89054249-304c-44c2-ac99-960263ecf900" released by "delete_volume" :: held 0.817s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 12:01:47 devstack cinder-volume[87116]: DEBUG cinder.quota [None req-5e21dab1-2408-4df3-869a-706e5b4ae85a tempest-ProjectReaderTests-377170324 None] Created reservations ['8552a9f8-7af8-4aa9-81a4-7d5bb2045ae0', '533e8588-19d9-46e1-982e-0f126173b37d', '8c96e982-30e9-4567-ab8c-211c10a69566', '0220e980-2f7a-4c45-9588-e5a44e9aaf12'] {{(pid=87116) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 12:01:47 devstack cinder-volume[87116]: DEBUG cinder.volume.flows.manager.create_volume [None req-008ebc11-47f6-4624-80cc-d156148f3b0e tempest-ProjectMemberTests-2097190340 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87116) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 12:01:47 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-008ebc11-47f6-4624-80cc-d156148f3b0e tempest-ProjectMemberTests-2097190340 None] Flow 'volume_create_manager' (ff1c8cc4-ed56-4949-a5df-07459897f48b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 12:01:47 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-008ebc11-47f6-4624-80cc-d156148f3b0e tempest-ProjectMemberTests-2097190340 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (37e7f743-821a-40d2-9186-e9a0b1a8543f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 12:01:47 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-1d5ee2df-b7ff-47c1-b290-a56dd9e9cf88 tempest-ProjectReaderTests-583148448 None] Acquiring lock "cinder-2c07086a-4655-46f6-87b9-f370fa6db3d4-delete_volume" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 12:01:47 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-008ebc11-47f6-4624-80cc-d156148f3b0e tempest-ProjectMemberTests-2097190340 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (37e7f743-821a-40d2-9186-e9a0b1a8543f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T11:01:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-976509536',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=17c1164f-dde8-4842-98a6-2d691e9f128c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='49c53ee964024de5ae12252eba82ea98',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T11:01:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T11:01:47Z,use_quota=True,user_id='eec80b5d986049c1b9691925283475b7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(34d3b144-d9b7-480a-a2e3-01e45f3d54c1),volume_type_id=34d3b144-d9b7-480a-a2e3-01e45f3d54c1)' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 12:01:47 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-008ebc11-47f6-4624-80cc-d156148f3b0e tempest-ProjectMemberTests-2097190340 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9991c0c4-2f37-4868-a921-959b4c59f952) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 12:01:47 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-008ebc11-47f6-4624-80cc-d156148f3b0e tempest-ProjectMemberTests-2097190340 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9991c0c4-2f37-4868-a921-959b4c59f952) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 12:01:47 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-008ebc11-47f6-4624-80cc-d156148f3b0e tempest-ProjectMemberTests-2097190340 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (defd845c-595a-4ab1-9ed0-705adf3b3021) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 12:01:47 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-008ebc11-47f6-4624-80cc-d156148f3b0e tempest-ProjectMemberTests-2097190340 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (defd845c-595a-4ab1-9ed0-705adf3b3021) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '17c1164f-dde8-4842-98a6-2d691e9f128c', 'volume_name': 'volume-17c1164f-dde8-4842-98a6-2d691e9f128c', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 12:01:47 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-008ebc11-47f6-4624-80cc-d156148f3b0e tempest-ProjectMemberTests-2097190340 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (14a59ddc-0353-4e3f-a25b-fe7cb69b6a11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 12:01:47 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-008ebc11-47f6-4624-80cc-d156148f3b0e tempest-ProjectMemberTests-2097190340 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (14a59ddc-0353-4e3f-a25b-fe7cb69b6a11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 12:01:47 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-008ebc11-47f6-4624-80cc-d156148f3b0e tempest-ProjectMemberTests-2097190340 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0cbd10ed-018e-41bf-b33c-bd9618d8f3c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 12:01:47 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-008ebc11-47f6-4624-80cc-d156148f3b0e tempest-ProjectMemberTests-2097190340 None] Volume 17c1164f-dde8-4842-98a6-2d691e9f128c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-17c1164f-dde8-4842-98a6-2d691e9f128c', 'volume_size': 1} Nov 06 12:01:47 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-008ebc11-47f6-4624-80cc-d156148f3b0e tempest-ProjectMemberTests-2097190340 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 12:01:47 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-008ebc11-47f6-4624-80cc-d156148f3b0e tempest-ProjectMemberTests-2097190340 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 12:01:47 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-008ebc11-47f6-4624-80cc-d156148f3b0e tempest-ProjectMemberTests-2097190340 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T11:01:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-976509536',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=17c1164f-dde8-4842-98a6-2d691e9f128c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='49c53ee964024de5ae12252eba82ea98',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T11:01:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T11:01:47Z,use_quota=True,user_id='eec80b5d986049c1b9691925283475b7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(34d3b144-d9b7-480a-a2e3-01e45f3d54c1),volume_type_id=34d3b144-d9b7-480a-a2e3-01e45f3d54c1)}" {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 12:01:47 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-008ebc11-47f6-4624-80cc-d156148f3b0e tempest-ProjectMemberTests-2097190340 None] Creating volume 17c1164f-dde8-4842-98a6-2d691e9f128c {{(pid=87116) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 12:01:47 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-008ebc11-47f6-4624-80cc-d156148f3b0e tempest-ProjectMemberTests-2097190340 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 12:01:47 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-008ebc11-47f6-4624-80cc-d156148f3b0e tempest-ProjectMemberTests-2097190340 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 12:01:47 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-008ebc11-47f6-4624-80cc-d156148f3b0e tempest-ProjectMemberTests-2097190340 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 12:01:47 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-008ebc11-47f6-4624-80cc-d156148f3b0e tempest-ProjectMemberTests-2097190340 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 12:01:47 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-008ebc11-47f6-4624-80cc-d156148f3b0e tempest-ProjectMemberTests-2097190340 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 12:01:47 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-008ebc11-47f6-4624-80cc-d156148f3b0e tempest-ProjectMemberTests-2097190340 None] Selected osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f as target Quobyte volume. {{(pid=87116) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 12:01:47 devstack cinder-volume[87116]: INFO cinder.volume.drivers.remotefs [None req-008ebc11-47f6-4624-80cc-d156148f3b0e tempest-ProjectMemberTests-2097190340 None] casted to osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f Nov 06 12:01:47 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-008ebc11-47f6-4624-80cc-d156148f3b0e tempest-ProjectMemberTests-2097190340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-17c1164f-dde8-4842-98a6-2d691e9f128c 1073741824 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 12:01:47 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-1d5ee2df-b7ff-47c1-b290-a56dd9e9cf88 tempest-ProjectReaderTests-583148448 None] Lock "cinder-2c07086a-4655-46f6-87b9-f370fa6db3d4-delete_volume" acquired by "delete_volume" :: waited 0.106s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 12:01:47 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-5e21dab1-2408-4df3-869a-706e5b4ae85a tempest-ProjectReaderTests-377170324 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 12:01:47 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-5e21dab1-2408-4df3-869a-706e5b4ae85a tempest-ProjectReaderTests-377170324 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 12:01:47 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-5e21dab1-2408-4df3-869a-706e5b4ae85a tempest-ProjectReaderTests-377170324 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 12:01:47 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-5e21dab1-2408-4df3-869a-706e5b4ae85a tempest-ProjectReaderTests-377170324 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 12:01:47 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-5e21dab1-2408-4df3-869a-706e5b4ae85a tempest-ProjectReaderTests-377170324 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 12:01:47 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-5e21dab1-2408-4df3-869a-706e5b4ae85a tempest-ProjectReaderTests-377170324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 12:01:47 devstack sudo[106936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-17c1164f-dde8-4842-98a6-2d691e9f128c 1073741824 Nov 06 12:01:47 devstack sudo[106936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 12:01:47 devstack sudo[106938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756 Nov 06 12:01:47 devstack sudo[106938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 12:01:47 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-1d5ee2df-b7ff-47c1-b290-a56dd9e9cf88 tempest-ProjectReaderTests-583148448 None] Acquiring lock "cinder-quobyte-2c07086a-4655-46f6-87b9-f370fa6db3d4" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 12:01:47 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-1d5ee2df-b7ff-47c1-b290-a56dd9e9cf88 tempest-ProjectReaderTests-583148448 None] Lock "cinder-quobyte-2c07086a-4655-46f6-87b9-f370fa6db3d4" acquired by "delete_volume" :: waited 0.020s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 12:01:47 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[48854192-a4cd-4827-ae53-ab4cc0b32f1e]: (4, 'qcow2') {{(pid=88420) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 12:01:47 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-1d5ee2df-b7ff-47c1-b290-a56dd9e9cf88 tempest-ProjectReaderTests-583148448 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-2c07086a-4655-46f6-87b9-f370fa6db3d4 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 12:01:47 devstack sudo[106940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-2c07086a-4655-46f6-87b9-f370fa6db3d4 Nov 06 12:01:47 devstack sudo[106940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 12:01:47 devstack sudo[106938]: pam_unix(sudo:session): session closed for user root Nov 06 12:01:47 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-5e21dab1-2408-4df3-869a-706e5b4ae85a tempest-ProjectReaderTests-377170324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756" returned: 0 in 0.407s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 12:01:47 devstack cinder-volume[87116]: DEBUG cinder.manager [None req-5e21dab1-2408-4df3-869a-706e5b4ae85a tempest-ProjectReaderTests-377170324 None] Notifying Schedulers of capabilities ... {{(pid=87116) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 12:01:47 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-5e21dab1-2408-4df3-869a-706e5b4ae85a tempest-ProjectReaderTests-377170324 None] Deleted volume successfully. Nov 06 12:01:47 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-5e21dab1-2408-4df3-869a-706e5b4ae85a tempest-ProjectReaderTests-377170324 None] Lock "cinder-89054249-304c-44c2-ac99-960263ecf900-delete_volume" released by "delete_volume" :: held 1.662s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 12:01:48 devstack sudo[106936]: pam_unix(sudo:session): session closed for user root Nov 06 12:01:48 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-008ebc11-47f6-4624-80cc-d156148f3b0e tempest-ProjectMemberTests-2097190340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-17c1164f-dde8-4842-98a6-2d691e9f128c 1073741824" returned: 0 in 0.689s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 12:01:48 devstack sudo[106940]: pam_unix(sudo:session): session closed for user root Nov 06 12:01:48 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-1d5ee2df-b7ff-47c1-b290-a56dd9e9cf88 tempest-ProjectReaderTests-583148448 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-2c07086a-4655-46f6-87b9-f370fa6db3d4" returned: 0 in 0.556s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 12:01:48 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-1d5ee2df-b7ff-47c1-b290-a56dd9e9cf88 tempest-ProjectReaderTests-583148448 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-2c07086a-4655-46f6-87b9-f370fa6db3d4 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 12:01:48 devstack sudo[106950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-2c07086a-4655-46f6-87b9-f370fa6db3d4 Nov 06 12:01:48 devstack sudo[106950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 12:01:48 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-008ebc11-47f6-4624-80cc-d156148f3b0e tempest-ProjectMemberTests-2097190340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-17c1164f-dde8-4842-98a6-2d691e9f128c {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 12:01:48 devstack sudo[106952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-17c1164f-dde8-4842-98a6-2d691e9f128c Nov 06 12:01:48 devstack sudo[106952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 12:01:48 devstack cinder-volume[87116]: DEBUG cinder.volume.flows.manager.create_volume [None req-bdb4440b-02f9-4ec9-bd16-740e211ef83a tempest-ProjectReaderTests-377170324 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87116) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 12:01:48 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-bdb4440b-02f9-4ec9-bd16-740e211ef83a tempest-ProjectReaderTests-377170324 None] Flow 'volume_create_manager' (2fa83b43-3710-4e64-bc93-19d0974a5ce9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 12:01:48 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-bdb4440b-02f9-4ec9-bd16-740e211ef83a tempest-ProjectReaderTests-377170324 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (827b18e3-35e4-4d50-9571-339218ec36f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 12:01:48 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-bdb4440b-02f9-4ec9-bd16-740e211ef83a tempest-ProjectReaderTests-377170324 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (827b18e3-35e4-4d50-9571-339218ec36f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T11:01:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1487752030',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=da2bf8a4-2082-4f7c-a3b3-f28b3cc3843f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='865d378d37cd42ed98432cd1ce1e41be',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T11:01:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T11:01:48Z,use_quota=True,user_id='8acc7287c82b436186731f24c32b21ce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(34d3b144-d9b7-480a-a2e3-01e45f3d54c1),volume_type_id=34d3b144-d9b7-480a-a2e3-01e45f3d54c1)' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 12:01:48 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-bdb4440b-02f9-4ec9-bd16-740e211ef83a tempest-ProjectReaderTests-377170324 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3d0bb132-f1aa-4ba6-ba58-ca6acdc2eaa1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 12:01:48 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-bdb4440b-02f9-4ec9-bd16-740e211ef83a tempest-ProjectReaderTests-377170324 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3d0bb132-f1aa-4ba6-ba58-ca6acdc2eaa1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 12:01:48 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-bdb4440b-02f9-4ec9-bd16-740e211ef83a tempest-ProjectReaderTests-377170324 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b29885ff-f732-4a41-917f-cd10d6b4d95a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 12:01:48 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-bdb4440b-02f9-4ec9-bd16-740e211ef83a tempest-ProjectReaderTests-377170324 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b29885ff-f732-4a41-917f-cd10d6b4d95a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'da2bf8a4-2082-4f7c-a3b3-f28b3cc3843f', 'volume_name': 'volume-da2bf8a4-2082-4f7c-a3b3-f28b3cc3843f', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 12:01:48 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-bdb4440b-02f9-4ec9-bd16-740e211ef83a tempest-ProjectReaderTests-377170324 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1b9f538b-ebb0-4b0b-9c8f-64574ce24070) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 12:01:48 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-bdb4440b-02f9-4ec9-bd16-740e211ef83a tempest-ProjectReaderTests-377170324 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1b9f538b-ebb0-4b0b-9c8f-64574ce24070) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 12:01:48 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-bdb4440b-02f9-4ec9-bd16-740e211ef83a tempest-ProjectReaderTests-377170324 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a388b31b-9a80-462d-a3ff-6f1756d278db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 12:01:48 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-bdb4440b-02f9-4ec9-bd16-740e211ef83a tempest-ProjectReaderTests-377170324 None] Volume da2bf8a4-2082-4f7c-a3b3-f28b3cc3843f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-da2bf8a4-2082-4f7c-a3b3-f28b3cc3843f', 'volume_size': 1} Nov 06 12:01:48 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-bdb4440b-02f9-4ec9-bd16-740e211ef83a tempest-ProjectReaderTests-377170324 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 12:01:48 devstack sudo[106950]: pam_unix(sudo:session): session closed for user root Nov 06 12:01:48 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-1d5ee2df-b7ff-47c1-b290-a56dd9e9cf88 tempest-ProjectReaderTests-583148448 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-2c07086a-4655-46f6-87b9-f370fa6db3d4" returned: 0 in 0.287s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 12:01:48 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-1d5ee2df-b7ff-47c1-b290-a56dd9e9cf88 tempest-ProjectReaderTests-583148448 None] Lock "cinder-quobyte-2c07086a-4655-46f6-87b9-f370fa6db3d4" released by "delete_volume" :: held 0.915s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 12:01:48 devstack sudo[106952]: pam_unix(sudo:session): session closed for user root Nov 06 12:01:48 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-008ebc11-47f6-4624-80cc-d156148f3b0e tempest-ProjectMemberTests-2097190340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-17c1164f-dde8-4842-98a6-2d691e9f128c" returned: 0 in 0.318s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 12:01:48 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-008ebc11-47f6-4624-80cc-d156148f3b0e tempest-ProjectMemberTests-2097190340 None] <== create_volume: return (1087ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f'} {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 12:01:48 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-008ebc11-47f6-4624-80cc-d156148f3b0e tempest-ProjectMemberTests-2097190340 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.090s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 12:01:48 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-bdb4440b-02f9-4ec9-bd16-740e211ef83a tempest-ProjectReaderTests-377170324 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.153s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 12:01:48 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-bdb4440b-02f9-4ec9-bd16-740e211ef83a tempest-ProjectReaderTests-377170324 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T11:01:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1487752030',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=da2bf8a4-2082-4f7c-a3b3-f28b3cc3843f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='865d378d37cd42ed98432cd1ce1e41be',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T11:01:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T11:01:48Z,use_quota=True,user_id='8acc7287c82b436186731f24c32b21ce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(34d3b144-d9b7-480a-a2e3-01e45f3d54c1),volume_type_id=34d3b144-d9b7-480a-a2e3-01e45f3d54c1)}" {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 12:01:48 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-bdb4440b-02f9-4ec9-bd16-740e211ef83a tempest-ProjectReaderTests-377170324 None] Creating volume da2bf8a4-2082-4f7c-a3b3-f28b3cc3843f {{(pid=87116) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 12:01:48 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-bdb4440b-02f9-4ec9-bd16-740e211ef83a tempest-ProjectReaderTests-377170324 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 12:01:48 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-bdb4440b-02f9-4ec9-bd16-740e211ef83a tempest-ProjectReaderTests-377170324 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 12:01:48 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-bdb4440b-02f9-4ec9-bd16-740e211ef83a tempest-ProjectReaderTests-377170324 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 12:01:48 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-bdb4440b-02f9-4ec9-bd16-740e211ef83a tempest-ProjectReaderTests-377170324 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 12:01:48 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-bdb4440b-02f9-4ec9-bd16-740e211ef83a tempest-ProjectReaderTests-377170324 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 12:01:48 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-bdb4440b-02f9-4ec9-bd16-740e211ef83a tempest-ProjectReaderTests-377170324 None] Selected osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f as target Quobyte volume. {{(pid=87116) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 12:01:48 devstack cinder-volume[87116]: INFO cinder.volume.drivers.remotefs [None req-bdb4440b-02f9-4ec9-bd16-740e211ef83a tempest-ProjectReaderTests-377170324 None] casted to osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f Nov 06 12:01:48 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-bdb4440b-02f9-4ec9-bd16-740e211ef83a tempest-ProjectReaderTests-377170324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-da2bf8a4-2082-4f7c-a3b3-f28b3cc3843f 1073741824 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 12:01:48 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-008ebc11-47f6-4624-80cc-d156148f3b0e tempest-ProjectMemberTests-2097190340 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0cbd10ed-018e-41bf-b33c-bd9618d8f3c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-17c1164f-dde8-4842-98a6-2d691e9f128c', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 12:01:48 devstack sudo[106956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-da2bf8a4-2082-4f7c-a3b3-f28b3cc3843f 1073741824 Nov 06 12:01:48 devstack sudo[106956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 12:01:48 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-008ebc11-47f6-4624-80cc-d156148f3b0e tempest-ProjectMemberTests-2097190340 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0e0a4ced-476c-4af4-b0da-34b7ec0eef83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 12:01:48 devstack cinder-volume[87116]: DEBUG cinder.quota [None req-1d5ee2df-b7ff-47c1-b290-a56dd9e9cf88 tempest-ProjectReaderTests-583148448 None] Created reservations ['6bc708ee-4cb4-44d9-8148-6f3fa0af1b2e', '9303afdf-2351-4f6a-849a-728d806bca45', '2f3329b8-0e5e-4da0-9255-39c892532fda', 'ab96f4fe-b097-42ba-a78d-7abc046117d8'] {{(pid=87116) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 12:01:48 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-008ebc11-47f6-4624-80cc-d156148f3b0e tempest-ProjectMemberTests-2097190340 None] Volume volume-17c1164f-dde8-4842-98a6-2d691e9f128c (17c1164f-dde8-4842-98a6-2d691e9f128c): created successfully Nov 06 12:01:48 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-008ebc11-47f6-4624-80cc-d156148f3b0e tempest-ProjectMemberTests-2097190340 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0e0a4ced-476c-4af4-b0da-34b7ec0eef83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 12:01:48 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-008ebc11-47f6-4624-80cc-d156148f3b0e tempest-ProjectMemberTests-2097190340 None] Flow 'volume_create_manager' (ff1c8cc4-ed56-4949-a5df-07459897f48b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 12:01:48 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-008ebc11-47f6-4624-80cc-d156148f3b0e tempest-ProjectMemberTests-2097190340 None] Created volume successfully. Nov 06 12:01:48 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-1d5ee2df-b7ff-47c1-b290-a56dd9e9cf88 tempest-ProjectReaderTests-583148448 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 12:01:48 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-1d5ee2df-b7ff-47c1-b290-a56dd9e9cf88 tempest-ProjectReaderTests-583148448 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 12:01:48 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-1d5ee2df-b7ff-47c1-b290-a56dd9e9cf88 tempest-ProjectReaderTests-583148448 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 12:01:48 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-1d5ee2df-b7ff-47c1-b290-a56dd9e9cf88 tempest-ProjectReaderTests-583148448 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 12:01:48 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-1d5ee2df-b7ff-47c1-b290-a56dd9e9cf88 tempest-ProjectReaderTests-583148448 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 12:01:48 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-1d5ee2df-b7ff-47c1-b290-a56dd9e9cf88 tempest-ProjectReaderTests-583148448 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 12:01:48 devstack sudo[106958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756 Nov 06 12:01:48 devstack sudo[106958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 12:01:49 devstack sudo[106958]: pam_unix(sudo:session): session closed for user root Nov 06 12:01:49 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-1d5ee2df-b7ff-47c1-b290-a56dd9e9cf88 tempest-ProjectReaderTests-583148448 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756" returned: 0 in 0.283s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 12:01:49 devstack cinder-volume[87116]: DEBUG cinder.manager [None req-1d5ee2df-b7ff-47c1-b290-a56dd9e9cf88 tempest-ProjectReaderTests-583148448 None] Notifying Schedulers of capabilities ... {{(pid=87116) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 12:01:49 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-1d5ee2df-b7ff-47c1-b290-a56dd9e9cf88 tempest-ProjectReaderTests-583148448 None] Deleted volume successfully. Nov 06 12:01:49 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-1d5ee2df-b7ff-47c1-b290-a56dd9e9cf88 tempest-ProjectReaderTests-583148448 None] Lock "cinder-2c07086a-4655-46f6-87b9-f370fa6db3d4-delete_volume" released by "delete_volume" :: held 1.529s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 12:01:49 devstack sudo[106956]: pam_unix(sudo:session): session closed for user root Nov 06 12:01:49 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-bdb4440b-02f9-4ec9-bd16-740e211ef83a tempest-ProjectReaderTests-377170324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-da2bf8a4-2082-4f7c-a3b3-f28b3cc3843f 1073741824" returned: 0 in 0.501s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 12:01:49 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-bdb4440b-02f9-4ec9-bd16-740e211ef83a tempest-ProjectReaderTests-377170324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-da2bf8a4-2082-4f7c-a3b3-f28b3cc3843f {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 12:01:49 devstack sudo[106964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-da2bf8a4-2082-4f7c-a3b3-f28b3cc3843f Nov 06 12:01:49 devstack sudo[106964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 12:01:49 devstack sudo[106964]: pam_unix(sudo:session): session closed for user root Nov 06 12:01:49 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-bdb4440b-02f9-4ec9-bd16-740e211ef83a tempest-ProjectReaderTests-377170324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-da2bf8a4-2082-4f7c-a3b3-f28b3cc3843f" returned: 0 in 0.258s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 12:01:49 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-bdb4440b-02f9-4ec9-bd16-740e211ef83a tempest-ProjectReaderTests-377170324 None] <== create_volume: return (809ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f'} {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 12:01:49 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-bdb4440b-02f9-4ec9-bd16-740e211ef83a tempest-ProjectReaderTests-377170324 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.813s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 12:01:49 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-bdb4440b-02f9-4ec9-bd16-740e211ef83a tempest-ProjectReaderTests-377170324 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a388b31b-9a80-462d-a3ff-6f1756d278db) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-da2bf8a4-2082-4f7c-a3b3-f28b3cc3843f', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 12:01:49 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-bdb4440b-02f9-4ec9-bd16-740e211ef83a tempest-ProjectReaderTests-377170324 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cef448d6-5118-40fa-afe9-cd34bd4fffc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 12:01:49 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-bdb4440b-02f9-4ec9-bd16-740e211ef83a tempest-ProjectReaderTests-377170324 None] Volume volume-da2bf8a4-2082-4f7c-a3b3-f28b3cc3843f (da2bf8a4-2082-4f7c-a3b3-f28b3cc3843f): created successfully Nov 06 12:01:49 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-bdb4440b-02f9-4ec9-bd16-740e211ef83a tempest-ProjectReaderTests-377170324 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cef448d6-5118-40fa-afe9-cd34bd4fffc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 12:01:49 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-bdb4440b-02f9-4ec9-bd16-740e211ef83a tempest-ProjectReaderTests-377170324 None] Flow 'volume_create_manager' (2fa83b43-3710-4e64-bc93-19d0974a5ce9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 12:01:49 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-bdb4440b-02f9-4ec9-bd16-740e211ef83a tempest-ProjectReaderTests-377170324 None] Created volume successfully. Nov 06 12:01:49 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-709b7686-8e53-49c6-ba97-0ed462370d6b tempest-ProjectMemberTests-2097190340 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 12:01:49 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-709b7686-8e53-49c6-ba97-0ed462370d6b tempest-ProjectMemberTests-2097190340 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 12:01:49 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-709b7686-8e53-49c6-ba97-0ed462370d6b tempest-ProjectMemberTests-2097190340 None] Creating offline snapshot 9ac84089-2efb-4253-b4e5-b8a68ecfd6b7 of volume 17c1164f-dde8-4842-98a6-2d691e9f128c {{(pid=87116) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 06 12:01:49 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8f2c1a9-b240-479e-92d1-472b1fab1d8f]: (4, 'qcow2') {{(pid=88420) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 12:01:49 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-709b7686-8e53-49c6-ba97-0ed462370d6b tempest-ProjectMemberTests-2097190340 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-17c1164f-dde8-4842-98a6-2d691e9f128c {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 12:01:50 devstack sudo[106967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-17c1164f-dde8-4842-98a6-2d691e9f128c Nov 06 12:01:50 devstack sudo[106967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 12:01:50 devstack sudo[106967]: pam_unix(sudo:session): session closed for user root Nov 06 12:01:50 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-709b7686-8e53-49c6-ba97-0ed462370d6b tempest-ProjectMemberTests-2097190340 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-17c1164f-dde8-4842-98a6-2d691e9f128c" returned: 0 in 0.524s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 12:01:50 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-709b7686-8e53-49c6-ba97-0ed462370d6b tempest-ProjectMemberTests-2097190340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-17c1164f-dde8-4842-98a6-2d691e9f128c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-17c1164f-dde8-4842-98a6-2d691e9f128c.9ac84089-2efb-4253-b4e5-b8a68ecfd6b7 1G {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 12:01:50 devstack sudo[106972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-17c1164f-dde8-4842-98a6-2d691e9f128c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-17c1164f-dde8-4842-98a6-2d691e9f128c.9ac84089-2efb-4253-b4e5-b8a68ecfd6b7 1G Nov 06 12:01:50 devstack sudo[106972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 12:01:50 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-dd92e9fb-2362-4b92-877c-0f20f29ae7c9 tempest-ProjectReaderTests-377170324 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 12:01:51 devstack sudo[106972]: pam_unix(sudo:session): session closed for user root Nov 06 12:01:51 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-709b7686-8e53-49c6-ba97-0ed462370d6b tempest-ProjectMemberTests-2097190340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-17c1164f-dde8-4842-98a6-2d691e9f128c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-17c1164f-dde8-4842-98a6-2d691e9f128c.9ac84089-2efb-4253-b4e5-b8a68ecfd6b7 1G" returned: 0 in 0.592s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 12:01:51 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-709b7686-8e53-49c6-ba97-0ed462370d6b tempest-ProjectMemberTests-2097190340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-17c1164f-dde8-4842-98a6-2d691e9f128c -F qcow2 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-17c1164f-dde8-4842-98a6-2d691e9f128c.9ac84089-2efb-4253-b4e5-b8a68ecfd6b7 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 12:01:51 devstack sudo[106978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-17c1164f-dde8-4842-98a6-2d691e9f128c -F qcow2 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-17c1164f-dde8-4842-98a6-2d691e9f128c.9ac84089-2efb-4253-b4e5-b8a68ecfd6b7 Nov 06 12:01:51 devstack sudo[106978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 12:01:51 devstack sudo[106978]: pam_unix(sudo:session): session closed for user root Nov 06 12:01:51 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-709b7686-8e53-49c6-ba97-0ed462370d6b tempest-ProjectMemberTests-2097190340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-17c1164f-dde8-4842-98a6-2d691e9f128c -F qcow2 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-17c1164f-dde8-4842-98a6-2d691e9f128c.9ac84089-2efb-4253-b4e5-b8a68ecfd6b7" returned: 0 in 0.383s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 12:01:51 devstack cinder-volume[87116]: WARNING cinder.volume.drivers.remotefs [None req-709b7686-8e53-49c6-ba97-0ed462370d6b tempest-ProjectMemberTests-2097190340 None] /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-17c1164f-dde8-4842-98a6-2d691e9f128c.9ac84089-2efb-4253-b4e5-b8a68ecfd6b7 is being set with open permissions: ugo+rw Nov 06 12:01:51 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-709b7686-8e53-49c6-ba97-0ed462370d6b tempest-ProjectMemberTests-2097190340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-17c1164f-dde8-4842-98a6-2d691e9f128c.9ac84089-2efb-4253-b4e5-b8a68ecfd6b7 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 12:01:51 devstack sudo[106983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-17c1164f-dde8-4842-98a6-2d691e9f128c.9ac84089-2efb-4253-b4e5-b8a68ecfd6b7 Nov 06 12:01:51 devstack sudo[106983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 12:01:51 devstack sudo[106983]: pam_unix(sudo:session): session closed for user root Nov 06 12:01:51 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-709b7686-8e53-49c6-ba97-0ed462370d6b tempest-ProjectMemberTests-2097190340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-17c1164f-dde8-4842-98a6-2d691e9f128c.9ac84089-2efb-4253-b4e5-b8a68ecfd6b7" returned: 0 in 0.292s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 12:01:51 devstack cinder-volume[87116]: DEBUG cinder.volume.flows.manager.create_volume [None req-4667b137-ebf9-4fc7-9fa5-75fc01c8c59a tempest-ProjectReaderTests-96541340 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87116) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 12:01:51 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-4667b137-ebf9-4fc7-9fa5-75fc01c8c59a tempest-ProjectReaderTests-96541340 None] Flow 'volume_create_manager' (45f9fc66-e4b6-4b37-bd4d-e0c966e969f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 12:01:51 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-4667b137-ebf9-4fc7-9fa5-75fc01c8c59a tempest-ProjectReaderTests-96541340 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6de56522-25c9-4b0a-a14e-ed685d72ca4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 12:01:51 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-709b7686-8e53-49c6-ba97-0ed462370d6b tempest-ProjectMemberTests-2097190340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-17c1164f-dde8-4842-98a6-2d691e9f128c.info {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 12:01:51 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-4667b137-ebf9-4fc7-9fa5-75fc01c8c59a tempest-ProjectReaderTests-96541340 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6de56522-25c9-4b0a-a14e-ed685d72ca4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T11:01:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-700619932',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=15ef06b2-a269-49e0-a8b7-eb696534eede,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d62bdaafe8274594bead62a9698c27e1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T11:01:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T11:01:52Z,use_quota=True,user_id='a4d2d4b5e6a5421f9af1c5ce03eb2789',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(34d3b144-d9b7-480a-a2e3-01e45f3d54c1),volume_type_id=34d3b144-d9b7-480a-a2e3-01e45f3d54c1)' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 12:01:51 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-4667b137-ebf9-4fc7-9fa5-75fc01c8c59a tempest-ProjectReaderTests-96541340 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9e6b09fd-cd74-46e3-9d54-db82a776a11c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 12:01:51 devstack sudo[106986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-17c1164f-dde8-4842-98a6-2d691e9f128c.info Nov 06 12:01:51 devstack sudo[106986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 12:01:51 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-4667b137-ebf9-4fc7-9fa5-75fc01c8c59a tempest-ProjectReaderTests-96541340 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9e6b09fd-cd74-46e3-9d54-db82a776a11c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 12:01:51 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-4667b137-ebf9-4fc7-9fa5-75fc01c8c59a tempest-ProjectReaderTests-96541340 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (75b84dec-1b3c-4e83-b6d4-33a7806668a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 12:01:51 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-4667b137-ebf9-4fc7-9fa5-75fc01c8c59a tempest-ProjectReaderTests-96541340 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (75b84dec-1b3c-4e83-b6d4-33a7806668a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '15ef06b2-a269-49e0-a8b7-eb696534eede', 'volume_name': 'volume-15ef06b2-a269-49e0-a8b7-eb696534eede', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 12:01:51 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-4667b137-ebf9-4fc7-9fa5-75fc01c8c59a tempest-ProjectReaderTests-96541340 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6770ce96-049e-48cc-8a22-6457d703769d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 12:01:51 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-4667b137-ebf9-4fc7-9fa5-75fc01c8c59a tempest-ProjectReaderTests-96541340 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6770ce96-049e-48cc-8a22-6457d703769d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 12:01:51 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-4667b137-ebf9-4fc7-9fa5-75fc01c8c59a tempest-ProjectReaderTests-96541340 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de7c4241-2903-4f7b-b15b-c621d33e497e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 12:01:51 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-4667b137-ebf9-4fc7-9fa5-75fc01c8c59a tempest-ProjectReaderTests-96541340 None] Volume 15ef06b2-a269-49e0-a8b7-eb696534eede: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-15ef06b2-a269-49e0-a8b7-eb696534eede', 'volume_size': 1} Nov 06 12:01:51 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-4667b137-ebf9-4fc7-9fa5-75fc01c8c59a tempest-ProjectReaderTests-96541340 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 12:01:52 devstack sudo[106986]: pam_unix(sudo:session): session closed for user root Nov 06 12:01:52 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-709b7686-8e53-49c6-ba97-0ed462370d6b tempest-ProjectMemberTests-2097190340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-17c1164f-dde8-4842-98a6-2d691e9f128c.info" returned: 0 in 0.292s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 12:01:52 devstack cinder-volume[87116]: WARNING cinder.volume.drivers.remotefs [None req-709b7686-8e53-49c6-ba97-0ed462370d6b tempest-ProjectMemberTests-2097190340 None] /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-17c1164f-dde8-4842-98a6-2d691e9f128c.info is being set with open permissions: ugo+rw Nov 06 12:01:52 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-709b7686-8e53-49c6-ba97-0ed462370d6b tempest-ProjectMemberTests-2097190340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-17c1164f-dde8-4842-98a6-2d691e9f128c.info {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 12:01:52 devstack sudo[106989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-17c1164f-dde8-4842-98a6-2d691e9f128c.info Nov 06 12:01:52 devstack sudo[106989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 12:01:52 devstack sudo[106989]: pam_unix(sudo:session): session closed for user root Nov 06 12:01:52 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-709b7686-8e53-49c6-ba97-0ed462370d6b tempest-ProjectMemberTests-2097190340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-17c1164f-dde8-4842-98a6-2d691e9f128c.info" returned: 0 in 0.234s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 12:01:52 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-709b7686-8e53-49c6-ba97-0ed462370d6b tempest-ProjectMemberTests-2097190340 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.472s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 12:01:52 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-dd92e9fb-2362-4b92-877c-0f20f29ae7c9 tempest-ProjectReaderTests-377170324 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.782s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 12:01:52 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-dd92e9fb-2362-4b92-877c-0f20f29ae7c9 tempest-ProjectReaderTests-377170324 None] Creating offline snapshot cb8418ef-4524-46bf-9229-9f3ad92e7403 of volume da2bf8a4-2082-4f7c-a3b3-f28b3cc3843f {{(pid=87116) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 06 12:01:52 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-709b7686-8e53-49c6-ba97-0ed462370d6b tempest-ProjectMemberTests-2097190340 None] Create snapshot completed successfully Nov 06 12:01:52 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[f12526cb-52af-4794-aa40-bc5b2624c0cb]: (4, 'qcow2') {{(pid=88420) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 12:01:52 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-dd92e9fb-2362-4b92-877c-0f20f29ae7c9 tempest-ProjectReaderTests-377170324 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-da2bf8a4-2082-4f7c-a3b3-f28b3cc3843f {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 12:01:52 devstack sudo[106992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-da2bf8a4-2082-4f7c-a3b3-f28b3cc3843f Nov 06 12:01:52 devstack sudo[106992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 12:01:52 devstack sudo[106992]: pam_unix(sudo:session): session closed for user root Nov 06 12:01:52 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-dd92e9fb-2362-4b92-877c-0f20f29ae7c9 tempest-ProjectReaderTests-377170324 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-da2bf8a4-2082-4f7c-a3b3-f28b3cc3843f" returned: 0 in 0.382s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 12:01:52 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-dd92e9fb-2362-4b92-877c-0f20f29ae7c9 tempest-ProjectReaderTests-377170324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-da2bf8a4-2082-4f7c-a3b3-f28b3cc3843f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-da2bf8a4-2082-4f7c-a3b3-f28b3cc3843f.cb8418ef-4524-46bf-9229-9f3ad92e7403 1G {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 12:01:52 devstack sudo[106997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-da2bf8a4-2082-4f7c-a3b3-f28b3cc3843f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-da2bf8a4-2082-4f7c-a3b3-f28b3cc3843f.cb8418ef-4524-46bf-9229-9f3ad92e7403 1G Nov 06 12:01:52 devstack sudo[106997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 12:01:53 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-832bcf62-c81e-4d72-9cd1-d0efc83a1896 tempest-ProjectMemberTests-2097190340 None] Acquiring lock "cinder-9ac84089-2efb-4253-b4e5-b8a68ecfd6b7-delete_snapshot" by "delete_snapshot" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 12:01:53 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-832bcf62-c81e-4d72-9cd1-d0efc83a1896 tempest-ProjectMemberTests-2097190340 None] Lock "cinder-9ac84089-2efb-4253-b4e5-b8a68ecfd6b7-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 12:01:53 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-832bcf62-c81e-4d72-9cd1-d0efc83a1896 tempest-ProjectMemberTests-2097190340 None] Acquiring lock "cinder-quobyte-17c1164f-dde8-4842-98a6-2d691e9f128c" by "delete_snapshot" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 12:01:53 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-832bcf62-c81e-4d72-9cd1-d0efc83a1896 tempest-ProjectMemberTests-2097190340 None] Lock "cinder-quobyte-17c1164f-dde8-4842-98a6-2d691e9f128c" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 12:01:53 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-832bcf62-c81e-4d72-9cd1-d0efc83a1896 tempest-ProjectMemberTests-2097190340 None] Acquiring lock "cinder-quobyte-9ac84089-2efb-4253-b4e5-b8a68ecfd6b7" by "_delete_snapshot" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 12:01:53 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-832bcf62-c81e-4d72-9cd1-d0efc83a1896 tempest-ProjectMemberTests-2097190340 None] Lock "cinder-quobyte-9ac84089-2efb-4253-b4e5-b8a68ecfd6b7" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 12:01:53 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-832bcf62-c81e-4d72-9cd1-d0efc83a1896 tempest-ProjectMemberTests-2097190340 None] Deleting offline snapshot 9ac84089-2efb-4253-b4e5-b8a68ecfd6b7 of volume 17c1164f-dde8-4842-98a6-2d691e9f128c {{(pid=87116) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 06 12:01:53 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-832bcf62-c81e-4d72-9cd1-d0efc83a1896 tempest-ProjectMemberTests-2097190340 None] snapshot_file for this snap is: volume-17c1164f-dde8-4842-98a6-2d691e9f128c.9ac84089-2efb-4253-b4e5-b8a68ecfd6b7 {{(pid=87116) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 06 12:01:53 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[8306c54b-9eb6-4cd2-a240-7ac2fdea30f3]: (4, 'qcow2') {{(pid=88420) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 12:01:53 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-832bcf62-c81e-4d72-9cd1-d0efc83a1896 tempest-ProjectMemberTests-2097190340 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-17c1164f-dde8-4842-98a6-2d691e9f128c.9ac84089-2efb-4253-b4e5-b8a68ecfd6b7 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 12:01:53 devstack sudo[106997]: pam_unix(sudo:session): session closed for user root Nov 06 12:01:53 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-dd92e9fb-2362-4b92-877c-0f20f29ae7c9 tempest-ProjectReaderTests-377170324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-da2bf8a4-2082-4f7c-a3b3-f28b3cc3843f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-da2bf8a4-2082-4f7c-a3b3-f28b3cc3843f.cb8418ef-4524-46bf-9229-9f3ad92e7403 1G" returned: 0 in 0.440s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 12:01:53 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-dd92e9fb-2362-4b92-877c-0f20f29ae7c9 tempest-ProjectReaderTests-377170324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-da2bf8a4-2082-4f7c-a3b3-f28b3cc3843f -F qcow2 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-da2bf8a4-2082-4f7c-a3b3-f28b3cc3843f.cb8418ef-4524-46bf-9229-9f3ad92e7403 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 12:01:53 devstack sudo[107004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-da2bf8a4-2082-4f7c-a3b3-f28b3cc3843f -F qcow2 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-da2bf8a4-2082-4f7c-a3b3-f28b3cc3843f.cb8418ef-4524-46bf-9229-9f3ad92e7403 Nov 06 12:01:53 devstack sudo[107004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 12:01:53 devstack sudo[107003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-17c1164f-dde8-4842-98a6-2d691e9f128c.9ac84089-2efb-4253-b4e5-b8a68ecfd6b7 Nov 06 12:01:53 devstack sudo[107003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 12:01:53 devstack sudo[107003]: pam_unix(sudo:session): session closed for user root Nov 06 12:01:53 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-832bcf62-c81e-4d72-9cd1-d0efc83a1896 tempest-ProjectMemberTests-2097190340 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-17c1164f-dde8-4842-98a6-2d691e9f128c.9ac84089-2efb-4253-b4e5-b8a68ecfd6b7" returned: 0 in 0.367s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 12:01:53 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-832bcf62-c81e-4d72-9cd1-d0efc83a1896 tempest-ProjectMemberTests-2097190340 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-17c1164f-dde8-4842-98a6-2d691e9f128c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87116) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 12:01:53 devstack sudo[107004]: pam_unix(sudo:session): session closed for user root Nov 06 12:01:53 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-dd92e9fb-2362-4b92-877c-0f20f29ae7c9 tempest-ProjectReaderTests-377170324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-da2bf8a4-2082-4f7c-a3b3-f28b3cc3843f -F qcow2 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-da2bf8a4-2082-4f7c-a3b3-f28b3cc3843f.cb8418ef-4524-46bf-9229-9f3ad92e7403" returned: 0 in 0.314s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 12:01:53 devstack cinder-volume[87116]: WARNING cinder.volume.drivers.remotefs [None req-dd92e9fb-2362-4b92-877c-0f20f29ae7c9 tempest-ProjectReaderTests-377170324 None] /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-da2bf8a4-2082-4f7c-a3b3-f28b3cc3843f.cb8418ef-4524-46bf-9229-9f3ad92e7403 is being set with open permissions: ugo+rw Nov 06 12:01:53 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-dd92e9fb-2362-4b92-877c-0f20f29ae7c9 tempest-ProjectReaderTests-377170324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-da2bf8a4-2082-4f7c-a3b3-f28b3cc3843f.cb8418ef-4524-46bf-9229-9f3ad92e7403 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 12:01:53 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[07d0f9a4-0548-42ec-bda9-4358505a275e]: (4, 'qcow2') {{(pid=88420) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 12:01:53 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-832bcf62-c81e-4d72-9cd1-d0efc83a1896 tempest-ProjectMemberTests-2097190340 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-17c1164f-dde8-4842-98a6-2d691e9f128c {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 12:01:53 devstack sudo[107016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-da2bf8a4-2082-4f7c-a3b3-f28b3cc3843f.cb8418ef-4524-46bf-9229-9f3ad92e7403 Nov 06 12:01:53 devstack sudo[107016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 12:01:53 devstack sudo[107017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-17c1164f-dde8-4842-98a6-2d691e9f128c Nov 06 12:01:53 devstack sudo[107017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 12:01:53 devstack sudo[107016]: pam_unix(sudo:session): session closed for user root Nov 06 12:01:53 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-dd92e9fb-2362-4b92-877c-0f20f29ae7c9 tempest-ProjectReaderTests-377170324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-da2bf8a4-2082-4f7c-a3b3-f28b3cc3843f.cb8418ef-4524-46bf-9229-9f3ad92e7403" returned: 0 in 0.275s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 12:01:53 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-dd92e9fb-2362-4b92-877c-0f20f29ae7c9 tempest-ProjectReaderTests-377170324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-da2bf8a4-2082-4f7c-a3b3-f28b3cc3843f.info {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 12:01:53 devstack sudo[107021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-da2bf8a4-2082-4f7c-a3b3-f28b3cc3843f.info Nov 06 12:01:53 devstack sudo[107021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 12:01:53 devstack sudo[107017]: pam_unix(sudo:session): session closed for user root Nov 06 12:01:54 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-832bcf62-c81e-4d72-9cd1-d0efc83a1896 tempest-ProjectMemberTests-2097190340 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-17c1164f-dde8-4842-98a6-2d691e9f128c" returned: 0 in 0.390s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 12:01:54 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-832bcf62-c81e-4d72-9cd1-d0efc83a1896 tempest-ProjectMemberTests-2097190340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-17c1164f-dde8-4842-98a6-2d691e9f128c.9ac84089-2efb-4253-b4e5-b8a68ecfd6b7 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 12:01:54 devstack sudo[107026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-17c1164f-dde8-4842-98a6-2d691e9f128c.9ac84089-2efb-4253-b4e5-b8a68ecfd6b7 Nov 06 12:01:54 devstack sudo[107026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 12:01:54 devstack sudo[107021]: pam_unix(sudo:session): session closed for user root Nov 06 12:01:54 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-dd92e9fb-2362-4b92-877c-0f20f29ae7c9 tempest-ProjectReaderTests-377170324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-da2bf8a4-2082-4f7c-a3b3-f28b3cc3843f.info" returned: 0 in 0.262s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 12:01:54 devstack cinder-volume[87116]: WARNING cinder.volume.drivers.remotefs [None req-dd92e9fb-2362-4b92-877c-0f20f29ae7c9 tempest-ProjectReaderTests-377170324 None] /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-da2bf8a4-2082-4f7c-a3b3-f28b3cc3843f.info is being set with open permissions: ugo+rw Nov 06 12:01:54 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-dd92e9fb-2362-4b92-877c-0f20f29ae7c9 tempest-ProjectReaderTests-377170324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-da2bf8a4-2082-4f7c-a3b3-f28b3cc3843f.info {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 12:01:54 devstack sudo[107029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-da2bf8a4-2082-4f7c-a3b3-f28b3cc3843f.info Nov 06 12:01:54 devstack sudo[107029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 12:01:54 devstack sudo[107026]: pam_unix(sudo:session): session closed for user root Nov 06 12:01:54 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-832bcf62-c81e-4d72-9cd1-d0efc83a1896 tempest-ProjectMemberTests-2097190340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-17c1164f-dde8-4842-98a6-2d691e9f128c.9ac84089-2efb-4253-b4e5-b8a68ecfd6b7" returned: 0 in 0.371s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 12:01:54 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-832bcf62-c81e-4d72-9cd1-d0efc83a1896 tempest-ProjectMemberTests-2097190340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-17c1164f-dde8-4842-98a6-2d691e9f128c.9ac84089-2efb-4253-b4e5-b8a68ecfd6b7 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 12:01:54 devstack sudo[107035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-17c1164f-dde8-4842-98a6-2d691e9f128c.9ac84089-2efb-4253-b4e5-b8a68ecfd6b7 Nov 06 12:01:54 devstack sudo[107035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 12:01:54 devstack sudo[107029]: pam_unix(sudo:session): session closed for user root Nov 06 12:01:54 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-dd92e9fb-2362-4b92-877c-0f20f29ae7c9 tempest-ProjectReaderTests-377170324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-da2bf8a4-2082-4f7c-a3b3-f28b3cc3843f.info" returned: 0 in 0.253s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 12:01:54 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-dd92e9fb-2362-4b92-877c-0f20f29ae7c9 tempest-ProjectReaderTests-377170324 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.040s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 12:01:54 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-4667b137-ebf9-4fc7-9fa5-75fc01c8c59a tempest-ProjectReaderTests-96541340 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.521s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 12:01:54 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-4667b137-ebf9-4fc7-9fa5-75fc01c8c59a tempest-ProjectReaderTests-96541340 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T11:01:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-700619932',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=15ef06b2-a269-49e0-a8b7-eb696534eede,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d62bdaafe8274594bead62a9698c27e1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T11:01:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T11:01:52Z,use_quota=True,user_id='a4d2d4b5e6a5421f9af1c5ce03eb2789',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(34d3b144-d9b7-480a-a2e3-01e45f3d54c1),volume_type_id=34d3b144-d9b7-480a-a2e3-01e45f3d54c1)}" {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 12:01:54 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-4667b137-ebf9-4fc7-9fa5-75fc01c8c59a tempest-ProjectReaderTests-96541340 None] Creating volume 15ef06b2-a269-49e0-a8b7-eb696534eede {{(pid=87116) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 12:01:54 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-4667b137-ebf9-4fc7-9fa5-75fc01c8c59a tempest-ProjectReaderTests-96541340 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 12:01:54 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-4667b137-ebf9-4fc7-9fa5-75fc01c8c59a tempest-ProjectReaderTests-96541340 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 12:01:54 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-4667b137-ebf9-4fc7-9fa5-75fc01c8c59a tempest-ProjectReaderTests-96541340 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 12:01:54 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-4667b137-ebf9-4fc7-9fa5-75fc01c8c59a tempest-ProjectReaderTests-96541340 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 12:01:54 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-4667b137-ebf9-4fc7-9fa5-75fc01c8c59a tempest-ProjectReaderTests-96541340 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 12:01:54 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-4667b137-ebf9-4fc7-9fa5-75fc01c8c59a tempest-ProjectReaderTests-96541340 None] Selected osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f as target Quobyte volume. {{(pid=87116) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 12:01:54 devstack cinder-volume[87116]: INFO cinder.volume.drivers.remotefs [None req-4667b137-ebf9-4fc7-9fa5-75fc01c8c59a tempest-ProjectReaderTests-96541340 None] casted to osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f Nov 06 12:01:54 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-4667b137-ebf9-4fc7-9fa5-75fc01c8c59a tempest-ProjectReaderTests-96541340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-15ef06b2-a269-49e0-a8b7-eb696534eede 1073741824 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 12:01:54 devstack sudo[107037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-15ef06b2-a269-49e0-a8b7-eb696534eede 1073741824 Nov 06 12:01:54 devstack sudo[107037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 12:01:54 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-dd92e9fb-2362-4b92-877c-0f20f29ae7c9 tempest-ProjectReaderTests-377170324 None] Create snapshot completed successfully Nov 06 12:01:54 devstack sudo[107035]: pam_unix(sudo:session): session closed for user root Nov 06 12:01:54 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-832bcf62-c81e-4d72-9cd1-d0efc83a1896 tempest-ProjectMemberTests-2097190340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-17c1164f-dde8-4842-98a6-2d691e9f128c.9ac84089-2efb-4253-b4e5-b8a68ecfd6b7" returned: 0 in 0.276s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 12:01:54 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-832bcf62-c81e-4d72-9cd1-d0efc83a1896 tempest-ProjectMemberTests-2097190340 None] Lock "cinder-quobyte-9ac84089-2efb-4253-b4e5-b8a68ecfd6b7" released by "_delete_snapshot" :: held 1.536s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 12:01:54 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-832bcf62-c81e-4d72-9cd1-d0efc83a1896 tempest-ProjectMemberTests-2097190340 None] Lock "cinder-quobyte-17c1164f-dde8-4842-98a6-2d691e9f128c" released by "delete_snapshot" :: held 1.560s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 12:01:54 devstack cinder-volume[87116]: DEBUG cinder.quota [None req-832bcf62-c81e-4d72-9cd1-d0efc83a1896 tempest-ProjectMemberTests-2097190340 None] Created reservations ['a13d62c9-c474-45f9-afce-15c9393f0ee4', '248487d5-64b2-4b08-97f5-cc03f6fdd30d', 'fb0f4752-f348-4d93-bf6b-e63974f43deb', '6a70a156-6d50-4e54-829a-527cd36cc274'] {{(pid=87116) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 12:01:54 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-2232b849-5095-4078-9b43-3403b2d0e0df tempest-ProjectReaderTests-377170324 None] Acquiring lock "cinder-cb8418ef-4524-46bf-9229-9f3ad92e7403-delete_snapshot" by "delete_snapshot" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 12:01:54 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-2232b849-5095-4078-9b43-3403b2d0e0df tempest-ProjectReaderTests-377170324 None] Lock "cinder-cb8418ef-4524-46bf-9229-9f3ad92e7403-delete_snapshot" acquired by "delete_snapshot" :: waited 0.040s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 12:01:54 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-2232b849-5095-4078-9b43-3403b2d0e0df tempest-ProjectReaderTests-377170324 None] Acquiring lock "cinder-quobyte-da2bf8a4-2082-4f7c-a3b3-f28b3cc3843f" by "delete_snapshot" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 12:01:54 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-832bcf62-c81e-4d72-9cd1-d0efc83a1896 tempest-ProjectMemberTests-2097190340 None] Delete snapshot completed successfully. Nov 06 12:01:54 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-2232b849-5095-4078-9b43-3403b2d0e0df tempest-ProjectReaderTests-377170324 None] Lock "cinder-quobyte-da2bf8a4-2082-4f7c-a3b3-f28b3cc3843f" acquired by "delete_snapshot" :: waited 0.028s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 12:01:54 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-2232b849-5095-4078-9b43-3403b2d0e0df tempest-ProjectReaderTests-377170324 None] Acquiring lock "cinder-quobyte-cb8418ef-4524-46bf-9229-9f3ad92e7403" by "_delete_snapshot" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 12:01:54 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-832bcf62-c81e-4d72-9cd1-d0efc83a1896 tempest-ProjectMemberTests-2097190340 None] Lock "cinder-9ac84089-2efb-4253-b4e5-b8a68ecfd6b7-delete_snapshot" released by "delete_snapshot" :: held 1.779s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 12:01:54 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-2232b849-5095-4078-9b43-3403b2d0e0df tempest-ProjectReaderTests-377170324 None] Lock "cinder-quobyte-cb8418ef-4524-46bf-9229-9f3ad92e7403" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 12:01:54 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-2232b849-5095-4078-9b43-3403b2d0e0df tempest-ProjectReaderTests-377170324 None] Deleting offline snapshot cb8418ef-4524-46bf-9229-9f3ad92e7403 of volume da2bf8a4-2082-4f7c-a3b3-f28b3cc3843f {{(pid=87116) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 06 12:01:54 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-2232b849-5095-4078-9b43-3403b2d0e0df tempest-ProjectReaderTests-377170324 None] snapshot_file for this snap is: volume-da2bf8a4-2082-4f7c-a3b3-f28b3cc3843f.cb8418ef-4524-46bf-9229-9f3ad92e7403 {{(pid=87116) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 06 12:01:54 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f4a5bef-160a-486c-a107-22051db58e2b]: (4, 'qcow2') {{(pid=88420) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 12:01:54 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-2232b849-5095-4078-9b43-3403b2d0e0df tempest-ProjectReaderTests-377170324 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-da2bf8a4-2082-4f7c-a3b3-f28b3cc3843f.cb8418ef-4524-46bf-9229-9f3ad92e7403 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 12:01:55 devstack sudo[107037]: pam_unix(sudo:session): session closed for user root Nov 06 12:01:55 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-4667b137-ebf9-4fc7-9fa5-75fc01c8c59a tempest-ProjectReaderTests-96541340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-15ef06b2-a269-49e0-a8b7-eb696534eede 1073741824" returned: 0 in 0.574s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 12:01:55 devstack sudo[107043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-da2bf8a4-2082-4f7c-a3b3-f28b3cc3843f.cb8418ef-4524-46bf-9229-9f3ad92e7403 Nov 06 12:01:55 devstack sudo[107043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 12:01:55 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-4667b137-ebf9-4fc7-9fa5-75fc01c8c59a tempest-ProjectReaderTests-96541340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-15ef06b2-a269-49e0-a8b7-eb696534eede {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 12:01:55 devstack sudo[107046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-15ef06b2-a269-49e0-a8b7-eb696534eede Nov 06 12:01:55 devstack sudo[107046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 12:01:55 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-aab2bb7f-53ea-4e99-98d6-4de241ea5fa4 tempest-ProjectMemberTests-2097190340 None] Acquiring lock "cinder-17c1164f-dde8-4842-98a6-2d691e9f128c-delete_volume" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 12:01:55 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-aab2bb7f-53ea-4e99-98d6-4de241ea5fa4 tempest-ProjectMemberTests-2097190340 None] Lock "cinder-17c1164f-dde8-4842-98a6-2d691e9f128c-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 12:01:55 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-aab2bb7f-53ea-4e99-98d6-4de241ea5fa4 tempest-ProjectMemberTests-2097190340 None] Acquiring lock "cinder-quobyte-17c1164f-dde8-4842-98a6-2d691e9f128c" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 12:01:55 devstack sudo[107046]: pam_unix(sudo:session): session closed for user root Nov 06 12:01:55 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-aab2bb7f-53ea-4e99-98d6-4de241ea5fa4 tempest-ProjectMemberTests-2097190340 None] Lock "cinder-quobyte-17c1164f-dde8-4842-98a6-2d691e9f128c" acquired by "delete_volume" :: waited 0.018s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 12:01:55 devstack sudo[107043]: pam_unix(sudo:session): session closed for user root Nov 06 12:01:55 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-2232b849-5095-4078-9b43-3403b2d0e0df tempest-ProjectReaderTests-377170324 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-da2bf8a4-2082-4f7c-a3b3-f28b3cc3843f.cb8418ef-4524-46bf-9229-9f3ad92e7403" returned: 0 in 0.444s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 12:01:55 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-4667b137-ebf9-4fc7-9fa5-75fc01c8c59a tempest-ProjectReaderTests-96541340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-15ef06b2-a269-49e0-a8b7-eb696534eede" returned: 0 in 0.322s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 12:01:55 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-2232b849-5095-4078-9b43-3403b2d0e0df tempest-ProjectReaderTests-377170324 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-da2bf8a4-2082-4f7c-a3b3-f28b3cc3843f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87116) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 12:01:55 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-4667b137-ebf9-4fc7-9fa5-75fc01c8c59a tempest-ProjectReaderTests-96541340 None] <== create_volume: return (964ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f'} {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 12:01:55 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-4667b137-ebf9-4fc7-9fa5-75fc01c8c59a tempest-ProjectReaderTests-96541340 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.967s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 12:01:55 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[65a6a76d-63b0-4543-be32-0b987099532a]: (4, 'qcow2') {{(pid=88420) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 12:01:55 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-aab2bb7f-53ea-4e99-98d6-4de241ea5fa4 tempest-ProjectMemberTests-2097190340 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-17c1164f-dde8-4842-98a6-2d691e9f128c {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 12:01:55 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b6ec393-57e3-4062-bfc9-77e9611378f6]: (4, 'qcow2') {{(pid=88420) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 12:01:55 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-2232b849-5095-4078-9b43-3403b2d0e0df tempest-ProjectReaderTests-377170324 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-da2bf8a4-2082-4f7c-a3b3-f28b3cc3843f {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 12:01:55 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-4667b137-ebf9-4fc7-9fa5-75fc01c8c59a tempest-ProjectReaderTests-96541340 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de7c4241-2903-4f7b-b15b-c621d33e497e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-15ef06b2-a269-49e0-a8b7-eb696534eede', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 12:01:55 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-4667b137-ebf9-4fc7-9fa5-75fc01c8c59a tempest-ProjectReaderTests-96541340 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a69614c2-737b-4806-90c7-877ee226d8e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 12:01:55 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-4667b137-ebf9-4fc7-9fa5-75fc01c8c59a tempest-ProjectReaderTests-96541340 None] Volume volume-15ef06b2-a269-49e0-a8b7-eb696534eede (15ef06b2-a269-49e0-a8b7-eb696534eede): created successfully Nov 06 12:01:55 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-4667b137-ebf9-4fc7-9fa5-75fc01c8c59a tempest-ProjectReaderTests-96541340 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a69614c2-737b-4806-90c7-877ee226d8e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 12:01:55 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-4667b137-ebf9-4fc7-9fa5-75fc01c8c59a tempest-ProjectReaderTests-96541340 None] Flow 'volume_create_manager' (45f9fc66-e4b6-4b37-bd4d-e0c966e969f9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 12:01:55 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-4667b137-ebf9-4fc7-9fa5-75fc01c8c59a tempest-ProjectReaderTests-96541340 None] Created volume successfully. Nov 06 12:01:55 devstack sudo[107053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-17c1164f-dde8-4842-98a6-2d691e9f128c Nov 06 12:01:55 devstack sudo[107053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 12:01:55 devstack sudo[107054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-da2bf8a4-2082-4f7c-a3b3-f28b3cc3843f Nov 06 12:01:55 devstack sudo[107054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 12:01:55 devstack sudo[107053]: pam_unix(sudo:session): session closed for user root Nov 06 12:01:55 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-aab2bb7f-53ea-4e99-98d6-4de241ea5fa4 tempest-ProjectMemberTests-2097190340 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-17c1164f-dde8-4842-98a6-2d691e9f128c" returned: 0 in 0.386s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 12:01:55 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-aab2bb7f-53ea-4e99-98d6-4de241ea5fa4 tempest-ProjectMemberTests-2097190340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-17c1164f-dde8-4842-98a6-2d691e9f128c {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 12:01:55 devstack sudo[107054]: pam_unix(sudo:session): session closed for user root Nov 06 12:01:55 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-2232b849-5095-4078-9b43-3403b2d0e0df tempest-ProjectReaderTests-377170324 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-da2bf8a4-2082-4f7c-a3b3-f28b3cc3843f" returned: 0 in 0.388s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 12:01:55 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-2232b849-5095-4078-9b43-3403b2d0e0df tempest-ProjectReaderTests-377170324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-da2bf8a4-2082-4f7c-a3b3-f28b3cc3843f.cb8418ef-4524-46bf-9229-9f3ad92e7403 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 12:01:55 devstack sudo[107064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-17c1164f-dde8-4842-98a6-2d691e9f128c Nov 06 12:01:55 devstack sudo[107064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 12:01:55 devstack sudo[107065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-da2bf8a4-2082-4f7c-a3b3-f28b3cc3843f.cb8418ef-4524-46bf-9229-9f3ad92e7403 Nov 06 12:01:55 devstack sudo[107065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 12:01:56 devstack sudo[107064]: pam_unix(sudo:session): session closed for user root Nov 06 12:01:56 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-aab2bb7f-53ea-4e99-98d6-4de241ea5fa4 tempest-ProjectMemberTests-2097190340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-17c1164f-dde8-4842-98a6-2d691e9f128c" returned: 0 in 0.272s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 12:01:56 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-aab2bb7f-53ea-4e99-98d6-4de241ea5fa4 tempest-ProjectMemberTests-2097190340 None] Lock "cinder-quobyte-17c1164f-dde8-4842-98a6-2d691e9f128c" released by "delete_volume" :: held 0.743s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 12:01:56 devstack cinder-volume[87116]: DEBUG cinder.quota [None req-aab2bb7f-53ea-4e99-98d6-4de241ea5fa4 tempest-ProjectMemberTests-2097190340 None] Created reservations ['d21d8f82-181a-4ba0-937a-2bc12a32df52', '3a39c132-5672-49c4-9b21-f9378f2b67a2', '2103753e-f7d3-43fa-ba16-5a204fd1c561', '878b4484-52ac-4b9e-8482-8b90d84a01d0'] {{(pid=87116) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 12:01:56 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-aab2bb7f-53ea-4e99-98d6-4de241ea5fa4 tempest-ProjectMemberTests-2097190340 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 12:01:56 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-aab2bb7f-53ea-4e99-98d6-4de241ea5fa4 tempest-ProjectMemberTests-2097190340 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 12:01:56 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-aab2bb7f-53ea-4e99-98d6-4de241ea5fa4 tempest-ProjectMemberTests-2097190340 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 12:01:56 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-aab2bb7f-53ea-4e99-98d6-4de241ea5fa4 tempest-ProjectMemberTests-2097190340 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 12:01:56 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-aab2bb7f-53ea-4e99-98d6-4de241ea5fa4 tempest-ProjectMemberTests-2097190340 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 12:01:56 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-aab2bb7f-53ea-4e99-98d6-4de241ea5fa4 tempest-ProjectMemberTests-2097190340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 12:01:56 devstack sudo[107065]: pam_unix(sudo:session): session closed for user root Nov 06 12:01:56 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-2232b849-5095-4078-9b43-3403b2d0e0df tempest-ProjectReaderTests-377170324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-da2bf8a4-2082-4f7c-a3b3-f28b3cc3843f.cb8418ef-4524-46bf-9229-9f3ad92e7403" returned: 0 in 0.442s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 12:01:56 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-2232b849-5095-4078-9b43-3403b2d0e0df tempest-ProjectReaderTests-377170324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-da2bf8a4-2082-4f7c-a3b3-f28b3cc3843f.cb8418ef-4524-46bf-9229-9f3ad92e7403 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 12:01:56 devstack sudo[107072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756 Nov 06 12:01:56 devstack sudo[107072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 12:01:56 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-4d4c8c77-690e-41fe-ac3c-240672f6f1dd tempest-ProjectReaderTests-96541340 None] Acquiring lock "cinder-15ef06b2-a269-49e0-a8b7-eb696534eede-delete_volume" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 12:01:56 devstack sudo[107074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-da2bf8a4-2082-4f7c-a3b3-f28b3cc3843f.cb8418ef-4524-46bf-9229-9f3ad92e7403 Nov 06 12:01:56 devstack sudo[107074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 12:01:56 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-4d4c8c77-690e-41fe-ac3c-240672f6f1dd tempest-ProjectReaderTests-96541340 None] Lock "cinder-15ef06b2-a269-49e0-a8b7-eb696534eede-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 12:01:56 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-4d4c8c77-690e-41fe-ac3c-240672f6f1dd tempest-ProjectReaderTests-96541340 None] Acquiring lock "cinder-quobyte-15ef06b2-a269-49e0-a8b7-eb696534eede" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 12:01:56 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-4d4c8c77-690e-41fe-ac3c-240672f6f1dd tempest-ProjectReaderTests-96541340 None] Lock "cinder-quobyte-15ef06b2-a269-49e0-a8b7-eb696534eede" acquired by "delete_volume" :: waited 0.023s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 12:01:56 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb9c2b72-2881-4027-8284-4ef9f6112a9f]: (4, 'qcow2') {{(pid=88420) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 12:01:56 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-4d4c8c77-690e-41fe-ac3c-240672f6f1dd tempest-ProjectReaderTests-96541340 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-15ef06b2-a269-49e0-a8b7-eb696534eede {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 12:01:56 devstack sudo[107072]: pam_unix(sudo:session): session closed for user root Nov 06 12:01:56 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-aab2bb7f-53ea-4e99-98d6-4de241ea5fa4 tempest-ProjectMemberTests-2097190340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756" returned: 0 in 0.312s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 12:01:56 devstack cinder-volume[87116]: DEBUG cinder.manager [None req-aab2bb7f-53ea-4e99-98d6-4de241ea5fa4 tempest-ProjectMemberTests-2097190340 None] Notifying Schedulers of capabilities ... {{(pid=87116) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 12:01:56 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-aab2bb7f-53ea-4e99-98d6-4de241ea5fa4 tempest-ProjectMemberTests-2097190340 None] Deleted volume successfully. Nov 06 12:01:56 devstack sudo[107074]: pam_unix(sudo:session): session closed for user root Nov 06 12:01:56 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-2232b849-5095-4078-9b43-3403b2d0e0df tempest-ProjectReaderTests-377170324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-da2bf8a4-2082-4f7c-a3b3-f28b3cc3843f.cb8418ef-4524-46bf-9229-9f3ad92e7403" returned: 0 in 0.320s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 12:01:56 devstack sudo[107076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-15ef06b2-a269-49e0-a8b7-eb696534eede Nov 06 12:01:56 devstack sudo[107076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 12:01:56 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-aab2bb7f-53ea-4e99-98d6-4de241ea5fa4 tempest-ProjectMemberTests-2097190340 None] Lock "cinder-17c1164f-dde8-4842-98a6-2d691e9f128c-delete_volume" released by "delete_volume" :: held 1.320s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 12:01:56 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-2232b849-5095-4078-9b43-3403b2d0e0df tempest-ProjectReaderTests-377170324 None] Lock "cinder-quobyte-cb8418ef-4524-46bf-9229-9f3ad92e7403" released by "_delete_snapshot" :: held 1.721s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 12:01:56 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-2232b849-5095-4078-9b43-3403b2d0e0df tempest-ProjectReaderTests-377170324 None] Lock "cinder-quobyte-da2bf8a4-2082-4f7c-a3b3-f28b3cc3843f" released by "delete_snapshot" :: held 1.745s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 12:01:56 devstack cinder-volume[87116]: DEBUG cinder.quota [None req-2232b849-5095-4078-9b43-3403b2d0e0df tempest-ProjectReaderTests-377170324 None] Created reservations ['8a8148f8-ef68-46d0-9d93-07b027078074', 'dd59ef03-a177-418b-9ab4-26376430841a', '487e11ab-7cc9-4747-ba31-97cea571af7d', '05f2a25c-0cd5-492b-b215-93300c5ab311'] {{(pid=87116) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 12:01:56 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-2232b849-5095-4078-9b43-3403b2d0e0df tempest-ProjectReaderTests-377170324 None] Delete snapshot completed successfully. Nov 06 12:01:56 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-2232b849-5095-4078-9b43-3403b2d0e0df tempest-ProjectReaderTests-377170324 None] Lock "cinder-cb8418ef-4524-46bf-9229-9f3ad92e7403-delete_snapshot" released by "delete_snapshot" :: held 1.909s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 12:01:56 devstack sudo[107076]: pam_unix(sudo:session): session closed for user root Nov 06 12:01:56 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-4d4c8c77-690e-41fe-ac3c-240672f6f1dd tempest-ProjectReaderTests-96541340 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-15ef06b2-a269-49e0-a8b7-eb696534eede" returned: 0 in 0.482s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 12:01:56 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-4d4c8c77-690e-41fe-ac3c-240672f6f1dd tempest-ProjectReaderTests-96541340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-15ef06b2-a269-49e0-a8b7-eb696534eede {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 12:01:56 devstack sudo[107083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-15ef06b2-a269-49e0-a8b7-eb696534eede Nov 06 12:01:56 devstack sudo[107083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 12:01:57 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-ba3fdd66-c4ba-4662-9671-87b6a5f66950 tempest-ProjectReaderTests-377170324 None] Acquiring lock "cinder-da2bf8a4-2082-4f7c-a3b3-f28b3cc3843f-delete_volume" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 12:01:57 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-ba3fdd66-c4ba-4662-9671-87b6a5f66950 tempest-ProjectReaderTests-377170324 None] Lock "cinder-da2bf8a4-2082-4f7c-a3b3-f28b3cc3843f-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 12:01:57 devstack cinder-volume[87116]: DEBUG cinder.volume.flows.manager.create_volume [None req-bd8b2cc2-88bf-43b7-82da-2d928a5298a9 tempest-ProjectMemberTests-2097190340 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87116) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 12:01:57 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-bd8b2cc2-88bf-43b7-82da-2d928a5298a9 tempest-ProjectMemberTests-2097190340 None] Flow 'volume_create_manager' (b84185ec-abbd-4ba2-8a9b-7e562f211b1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 12:01:57 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-bd8b2cc2-88bf-43b7-82da-2d928a5298a9 tempest-ProjectMemberTests-2097190340 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (36382203-9225-4638-969d-95c727b26bb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 12:01:57 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-ba3fdd66-c4ba-4662-9671-87b6a5f66950 tempest-ProjectReaderTests-377170324 None] Acquiring lock "cinder-quobyte-da2bf8a4-2082-4f7c-a3b3-f28b3cc3843f" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 12:01:57 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-bd8b2cc2-88bf-43b7-82da-2d928a5298a9 tempest-ProjectMemberTests-2097190340 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (36382203-9225-4638-969d-95c727b26bb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T11:01:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-573841649',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fc62566c-bb4b-4536-af7b-ac1be0219eca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='49c53ee964024de5ae12252eba82ea98',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T11:01:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T11:01:57Z,use_quota=True,user_id='eec80b5d986049c1b9691925283475b7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(34d3b144-d9b7-480a-a2e3-01e45f3d54c1),volume_type_id=34d3b144-d9b7-480a-a2e3-01e45f3d54c1)' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 12:01:57 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-bd8b2cc2-88bf-43b7-82da-2d928a5298a9 tempest-ProjectMemberTests-2097190340 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ba33c8ee-383b-4d7b-bf19-c5f5ca2f5a44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 12:01:57 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-bd8b2cc2-88bf-43b7-82da-2d928a5298a9 tempest-ProjectMemberTests-2097190340 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ba33c8ee-383b-4d7b-bf19-c5f5ca2f5a44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 12:01:57 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-bd8b2cc2-88bf-43b7-82da-2d928a5298a9 tempest-ProjectMemberTests-2097190340 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (48a3052a-8079-4e71-8d14-1921bbaca0f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 12:01:57 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-bd8b2cc2-88bf-43b7-82da-2d928a5298a9 tempest-ProjectMemberTests-2097190340 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (48a3052a-8079-4e71-8d14-1921bbaca0f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fc62566c-bb4b-4536-af7b-ac1be0219eca', 'volume_name': 'volume-fc62566c-bb4b-4536-af7b-ac1be0219eca', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 12:01:57 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-bd8b2cc2-88bf-43b7-82da-2d928a5298a9 tempest-ProjectMemberTests-2097190340 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f254b5a9-c49e-4d9f-b314-39859de30e52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 12:01:57 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-bd8b2cc2-88bf-43b7-82da-2d928a5298a9 tempest-ProjectMemberTests-2097190340 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f254b5a9-c49e-4d9f-b314-39859de30e52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 12:01:57 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-bd8b2cc2-88bf-43b7-82da-2d928a5298a9 tempest-ProjectMemberTests-2097190340 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ce84704f-eb31-408c-b5a6-a2666654e2fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 12:01:57 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-bd8b2cc2-88bf-43b7-82da-2d928a5298a9 tempest-ProjectMemberTests-2097190340 None] Volume fc62566c-bb4b-4536-af7b-ac1be0219eca: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fc62566c-bb4b-4536-af7b-ac1be0219eca', 'volume_size': 1} Nov 06 12:01:57 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-bd8b2cc2-88bf-43b7-82da-2d928a5298a9 tempest-ProjectMemberTests-2097190340 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 12:01:57 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-bd8b2cc2-88bf-43b7-82da-2d928a5298a9 tempest-ProjectMemberTests-2097190340 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 12:01:57 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-bd8b2cc2-88bf-43b7-82da-2d928a5298a9 tempest-ProjectMemberTests-2097190340 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T11:01:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-573841649',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fc62566c-bb4b-4536-af7b-ac1be0219eca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='49c53ee964024de5ae12252eba82ea98',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T11:01:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T11:01:57Z,use_quota=True,user_id='eec80b5d986049c1b9691925283475b7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(34d3b144-d9b7-480a-a2e3-01e45f3d54c1),volume_type_id=34d3b144-d9b7-480a-a2e3-01e45f3d54c1)}" {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 12:01:57 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-bd8b2cc2-88bf-43b7-82da-2d928a5298a9 tempest-ProjectMemberTests-2097190340 None] Creating volume fc62566c-bb4b-4536-af7b-ac1be0219eca {{(pid=87116) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 12:01:57 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-bd8b2cc2-88bf-43b7-82da-2d928a5298a9 tempest-ProjectMemberTests-2097190340 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 12:01:57 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-bd8b2cc2-88bf-43b7-82da-2d928a5298a9 tempest-ProjectMemberTests-2097190340 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 12:01:57 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-bd8b2cc2-88bf-43b7-82da-2d928a5298a9 tempest-ProjectMemberTests-2097190340 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 12:01:57 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-bd8b2cc2-88bf-43b7-82da-2d928a5298a9 tempest-ProjectMemberTests-2097190340 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 12:01:57 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-bd8b2cc2-88bf-43b7-82da-2d928a5298a9 tempest-ProjectMemberTests-2097190340 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 12:01:57 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-bd8b2cc2-88bf-43b7-82da-2d928a5298a9 tempest-ProjectMemberTests-2097190340 None] Selected osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f as target Quobyte volume. {{(pid=87116) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 12:01:57 devstack cinder-volume[87116]: INFO cinder.volume.drivers.remotefs [None req-bd8b2cc2-88bf-43b7-82da-2d928a5298a9 tempest-ProjectMemberTests-2097190340 None] casted to osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f Nov 06 12:01:57 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-bd8b2cc2-88bf-43b7-82da-2d928a5298a9 tempest-ProjectMemberTests-2097190340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-fc62566c-bb4b-4536-af7b-ac1be0219eca 1073741824 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 12:01:57 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-ba3fdd66-c4ba-4662-9671-87b6a5f66950 tempest-ProjectReaderTests-377170324 None] Lock "cinder-quobyte-da2bf8a4-2082-4f7c-a3b3-f28b3cc3843f" acquired by "delete_volume" :: waited 0.094s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 12:01:57 devstack sudo[107083]: pam_unix(sudo:session): session closed for user root Nov 06 12:01:57 devstack sudo[107086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-fc62566c-bb4b-4536-af7b-ac1be0219eca 1073741824 Nov 06 12:01:57 devstack sudo[107086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 12:01:57 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-4d4c8c77-690e-41fe-ac3c-240672f6f1dd tempest-ProjectReaderTests-96541340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-15ef06b2-a269-49e0-a8b7-eb696534eede" returned: 0 in 0.359s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 12:01:57 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-4d4c8c77-690e-41fe-ac3c-240672f6f1dd tempest-ProjectReaderTests-96541340 None] Lock "cinder-quobyte-15ef06b2-a269-49e0-a8b7-eb696534eede" released by "delete_volume" :: held 0.905s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 12:01:57 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3ba571a-8353-4d49-998c-413129a6a30c]: (4, 'qcow2') {{(pid=88420) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 12:01:57 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-ba3fdd66-c4ba-4662-9671-87b6a5f66950 tempest-ProjectReaderTests-377170324 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-da2bf8a4-2082-4f7c-a3b3-f28b3cc3843f {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 12:01:57 devstack cinder-volume[87116]: DEBUG cinder.quota [None req-4d4c8c77-690e-41fe-ac3c-240672f6f1dd tempest-ProjectReaderTests-96541340 None] Created reservations ['e5cb8a5a-9dba-4204-ae7b-56d29df1ba7a', '97f8f2ac-a45b-4001-b4ea-cd9407aa3c58', '1bd0e817-290f-489e-a5bf-537d9e9c5c6f', 'd5405162-254e-456d-a83a-6fc7ab7e13f7'] {{(pid=87116) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 12:01:57 devstack sudo[107088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-da2bf8a4-2082-4f7c-a3b3-f28b3cc3843f Nov 06 12:01:57 devstack sudo[107088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 12:01:57 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-4d4c8c77-690e-41fe-ac3c-240672f6f1dd tempest-ProjectReaderTests-96541340 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 12:01:57 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-4d4c8c77-690e-41fe-ac3c-240672f6f1dd tempest-ProjectReaderTests-96541340 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 12:01:57 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-4d4c8c77-690e-41fe-ac3c-240672f6f1dd tempest-ProjectReaderTests-96541340 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 12:01:57 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-4d4c8c77-690e-41fe-ac3c-240672f6f1dd tempest-ProjectReaderTests-96541340 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 12:01:57 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-4d4c8c77-690e-41fe-ac3c-240672f6f1dd tempest-ProjectReaderTests-96541340 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 12:01:57 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-4d4c8c77-690e-41fe-ac3c-240672f6f1dd tempest-ProjectReaderTests-96541340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 12:01:57 devstack sudo[107090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756 Nov 06 12:01:57 devstack sudo[107090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 12:01:57 devstack sudo[107088]: pam_unix(sudo:session): session closed for user root Nov 06 12:01:57 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-ba3fdd66-c4ba-4662-9671-87b6a5f66950 tempest-ProjectReaderTests-377170324 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-da2bf8a4-2082-4f7c-a3b3-f28b3cc3843f" returned: 0 in 0.430s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 12:01:57 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-ba3fdd66-c4ba-4662-9671-87b6a5f66950 tempest-ProjectReaderTests-377170324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-da2bf8a4-2082-4f7c-a3b3-f28b3cc3843f {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 12:01:57 devstack sudo[107099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-da2bf8a4-2082-4f7c-a3b3-f28b3cc3843f Nov 06 12:01:57 devstack sudo[107099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 12:01:57 devstack sudo[107086]: pam_unix(sudo:session): session closed for user root Nov 06 12:01:57 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-bd8b2cc2-88bf-43b7-82da-2d928a5298a9 tempest-ProjectMemberTests-2097190340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-fc62566c-bb4b-4536-af7b-ac1be0219eca 1073741824" returned: 0 in 0.557s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 12:01:57 devstack sudo[107090]: pam_unix(sudo:session): session closed for user root Nov 06 12:01:57 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-4d4c8c77-690e-41fe-ac3c-240672f6f1dd tempest-ProjectReaderTests-96541340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756" returned: 0 in 0.337s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 12:01:57 devstack cinder-volume[87116]: DEBUG cinder.manager [None req-4d4c8c77-690e-41fe-ac3c-240672f6f1dd tempest-ProjectReaderTests-96541340 None] Notifying Schedulers of capabilities ... {{(pid=87116) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 12:01:57 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-4d4c8c77-690e-41fe-ac3c-240672f6f1dd tempest-ProjectReaderTests-96541340 None] Deleted volume successfully. Nov 06 12:01:57 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-bd8b2cc2-88bf-43b7-82da-2d928a5298a9 tempest-ProjectMemberTests-2097190340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-fc62566c-bb4b-4536-af7b-ac1be0219eca {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 12:01:57 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-4d4c8c77-690e-41fe-ac3c-240672f6f1dd tempest-ProjectReaderTests-96541340 None] Lock "cinder-15ef06b2-a269-49e0-a8b7-eb696534eede-delete_volume" released by "delete_volume" :: held 1.532s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 12:01:57 devstack sudo[107102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-fc62566c-bb4b-4536-af7b-ac1be0219eca Nov 06 12:01:57 devstack sudo[107102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 12:01:58 devstack sudo[107099]: pam_unix(sudo:session): session closed for user root Nov 06 12:01:58 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-ba3fdd66-c4ba-4662-9671-87b6a5f66950 tempest-ProjectReaderTests-377170324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-da2bf8a4-2082-4f7c-a3b3-f28b3cc3843f" returned: 0 in 0.303s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 12:01:58 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-ba3fdd66-c4ba-4662-9671-87b6a5f66950 tempest-ProjectReaderTests-377170324 None] Lock "cinder-quobyte-da2bf8a4-2082-4f7c-a3b3-f28b3cc3843f" released by "delete_volume" :: held 0.820s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 12:01:58 devstack cinder-volume[87116]: DEBUG cinder.volume.flows.manager.create_volume [None req-5744d827-aad7-49f7-a741-d5e6c842738e tempest-ProjectReaderTests-96541340 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87116) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 12:01:58 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-5744d827-aad7-49f7-a741-d5e6c842738e tempest-ProjectReaderTests-96541340 None] Flow 'volume_create_manager' (04b30777-e17e-40d9-b4cf-5bc8ea2700a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 12:01:58 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-5744d827-aad7-49f7-a741-d5e6c842738e tempest-ProjectReaderTests-96541340 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (874568b7-60ad-4e2d-9bdb-87dea7fa663a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 12:01:58 devstack sudo[107102]: pam_unix(sudo:session): session closed for user root Nov 06 12:01:58 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-5744d827-aad7-49f7-a741-d5e6c842738e tempest-ProjectReaderTests-96541340 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (874568b7-60ad-4e2d-9bdb-87dea7fa663a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T11:01:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-229968165',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=45f1d44e-d9c2-424f-bf90-df1fc5ac6270,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d62bdaafe8274594bead62a9698c27e1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T11:01:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T11:01:58Z,use_quota=True,user_id='a4d2d4b5e6a5421f9af1c5ce03eb2789',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(34d3b144-d9b7-480a-a2e3-01e45f3d54c1),volume_type_id=34d3b144-d9b7-480a-a2e3-01e45f3d54c1)' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 12:01:58 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-5744d827-aad7-49f7-a741-d5e6c842738e tempest-ProjectReaderTests-96541340 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1a2f9fa2-73ef-431b-8319-83afa5510ff8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 12:01:58 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-5744d827-aad7-49f7-a741-d5e6c842738e tempest-ProjectReaderTests-96541340 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1a2f9fa2-73ef-431b-8319-83afa5510ff8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 12:01:58 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-5744d827-aad7-49f7-a741-d5e6c842738e tempest-ProjectReaderTests-96541340 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cdab71f9-109a-400f-968d-e2f7133fbc1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 12:01:58 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-5744d827-aad7-49f7-a741-d5e6c842738e tempest-ProjectReaderTests-96541340 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cdab71f9-109a-400f-968d-e2f7133fbc1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '45f1d44e-d9c2-424f-bf90-df1fc5ac6270', 'volume_name': 'volume-45f1d44e-d9c2-424f-bf90-df1fc5ac6270', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 12:01:58 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-5744d827-aad7-49f7-a741-d5e6c842738e tempest-ProjectReaderTests-96541340 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd5ee0f2-a9bd-4a10-b35b-3f166369eff6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 12:01:58 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-5744d827-aad7-49f7-a741-d5e6c842738e tempest-ProjectReaderTests-96541340 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd5ee0f2-a9bd-4a10-b35b-3f166369eff6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 12:01:58 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-5744d827-aad7-49f7-a741-d5e6c842738e tempest-ProjectReaderTests-96541340 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f45afcb6-c724-416c-b8b6-3336832e8c4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 12:01:58 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-5744d827-aad7-49f7-a741-d5e6c842738e tempest-ProjectReaderTests-96541340 None] Volume 45f1d44e-d9c2-424f-bf90-df1fc5ac6270: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-45f1d44e-d9c2-424f-bf90-df1fc5ac6270', 'volume_size': 1} Nov 06 12:01:58 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-5744d827-aad7-49f7-a741-d5e6c842738e tempest-ProjectReaderTests-96541340 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 12:01:58 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-bd8b2cc2-88bf-43b7-82da-2d928a5298a9 tempest-ProjectMemberTests-2097190340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-fc62566c-bb4b-4536-af7b-ac1be0219eca" returned: 0 in 0.358s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 12:01:58 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-bd8b2cc2-88bf-43b7-82da-2d928a5298a9 tempest-ProjectMemberTests-2097190340 None] <== create_volume: return (987ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f'} {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 12:01:58 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-bd8b2cc2-88bf-43b7-82da-2d928a5298a9 tempest-ProjectMemberTests-2097190340 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.991s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 12:01:58 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-5744d827-aad7-49f7-a741-d5e6c842738e tempest-ProjectReaderTests-96541340 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.007s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 12:01:58 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-5744d827-aad7-49f7-a741-d5e6c842738e tempest-ProjectReaderTests-96541340 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T11:01:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-229968165',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=45f1d44e-d9c2-424f-bf90-df1fc5ac6270,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d62bdaafe8274594bead62a9698c27e1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T11:01:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T11:01:58Z,use_quota=True,user_id='a4d2d4b5e6a5421f9af1c5ce03eb2789',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(34d3b144-d9b7-480a-a2e3-01e45f3d54c1),volume_type_id=34d3b144-d9b7-480a-a2e3-01e45f3d54c1)}" {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 12:01:58 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-5744d827-aad7-49f7-a741-d5e6c842738e tempest-ProjectReaderTests-96541340 None] Creating volume 45f1d44e-d9c2-424f-bf90-df1fc5ac6270 {{(pid=87116) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 12:01:58 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-5744d827-aad7-49f7-a741-d5e6c842738e tempest-ProjectReaderTests-96541340 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 12:01:58 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-5744d827-aad7-49f7-a741-d5e6c842738e tempest-ProjectReaderTests-96541340 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 12:01:58 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-5744d827-aad7-49f7-a741-d5e6c842738e tempest-ProjectReaderTests-96541340 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 12:01:58 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-5744d827-aad7-49f7-a741-d5e6c842738e tempest-ProjectReaderTests-96541340 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 12:01:58 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-5744d827-aad7-49f7-a741-d5e6c842738e tempest-ProjectReaderTests-96541340 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 12:01:58 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-5744d827-aad7-49f7-a741-d5e6c842738e tempest-ProjectReaderTests-96541340 None] Selected osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f as target Quobyte volume. {{(pid=87116) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 12:01:58 devstack cinder-volume[87116]: INFO cinder.volume.drivers.remotefs [None req-5744d827-aad7-49f7-a741-d5e6c842738e tempest-ProjectReaderTests-96541340 None] casted to osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f Nov 06 12:01:58 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-5744d827-aad7-49f7-a741-d5e6c842738e tempest-ProjectReaderTests-96541340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-45f1d44e-d9c2-424f-bf90-df1fc5ac6270 1073741824 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 12:01:58 devstack sudo[107106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-45f1d44e-d9c2-424f-bf90-df1fc5ac6270 1073741824 Nov 06 12:01:58 devstack sudo[107106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 12:01:58 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-bd8b2cc2-88bf-43b7-82da-2d928a5298a9 tempest-ProjectMemberTests-2097190340 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ce84704f-eb31-408c-b5a6-a2666654e2fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fc62566c-bb4b-4536-af7b-ac1be0219eca', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 12:01:58 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-bd8b2cc2-88bf-43b7-82da-2d928a5298a9 tempest-ProjectMemberTests-2097190340 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ef3209d3-876f-46c5-b2e9-3bd50a52fd39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 12:01:58 devstack cinder-volume[87116]: DEBUG cinder.quota [None req-ba3fdd66-c4ba-4662-9671-87b6a5f66950 tempest-ProjectReaderTests-377170324 None] Created reservations ['bd8f520c-54a6-4c8c-9195-c49ad09f417b', 'c7e544bd-9390-4a30-9624-a652fb13d313', 'b13902f9-b75d-45ce-b6f4-19c3372fdba7', '8953d0b7-63c6-4625-b02a-e3bf30a9f69f'] {{(pid=87116) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 12:01:58 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-bd8b2cc2-88bf-43b7-82da-2d928a5298a9 tempest-ProjectMemberTests-2097190340 None] Volume volume-fc62566c-bb4b-4536-af7b-ac1be0219eca (fc62566c-bb4b-4536-af7b-ac1be0219eca): created successfully Nov 06 12:01:58 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-bd8b2cc2-88bf-43b7-82da-2d928a5298a9 tempest-ProjectMemberTests-2097190340 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ef3209d3-876f-46c5-b2e9-3bd50a52fd39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 12:01:58 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-bd8b2cc2-88bf-43b7-82da-2d928a5298a9 tempest-ProjectMemberTests-2097190340 None] Flow 'volume_create_manager' (b84185ec-abbd-4ba2-8a9b-7e562f211b1e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 12:01:58 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-bd8b2cc2-88bf-43b7-82da-2d928a5298a9 tempest-ProjectMemberTests-2097190340 None] Created volume successfully. Nov 06 12:01:58 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-ba3fdd66-c4ba-4662-9671-87b6a5f66950 tempest-ProjectReaderTests-377170324 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 12:01:58 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-ba3fdd66-c4ba-4662-9671-87b6a5f66950 tempest-ProjectReaderTests-377170324 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 12:01:58 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-ba3fdd66-c4ba-4662-9671-87b6a5f66950 tempest-ProjectReaderTests-377170324 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 12:01:58 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-ba3fdd66-c4ba-4662-9671-87b6a5f66950 tempest-ProjectReaderTests-377170324 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 12:01:58 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-ba3fdd66-c4ba-4662-9671-87b6a5f66950 tempest-ProjectReaderTests-377170324 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 12:01:58 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-ba3fdd66-c4ba-4662-9671-87b6a5f66950 tempest-ProjectReaderTests-377170324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 12:01:58 devstack sudo[107108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756 Nov 06 12:01:58 devstack sudo[107108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 12:01:58 devstack sudo[107108]: pam_unix(sudo:session): session closed for user root Nov 06 12:01:58 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-ba3fdd66-c4ba-4662-9671-87b6a5f66950 tempest-ProjectReaderTests-377170324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756" returned: 0 in 0.258s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 12:01:58 devstack cinder-volume[87116]: DEBUG cinder.manager [None req-ba3fdd66-c4ba-4662-9671-87b6a5f66950 tempest-ProjectReaderTests-377170324 None] Notifying Schedulers of capabilities ... {{(pid=87116) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 12:01:58 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-ba3fdd66-c4ba-4662-9671-87b6a5f66950 tempest-ProjectReaderTests-377170324 None] Deleted volume successfully. Nov 06 12:01:58 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-ba3fdd66-c4ba-4662-9671-87b6a5f66950 tempest-ProjectReaderTests-377170324 None] Lock "cinder-da2bf8a4-2082-4f7c-a3b3-f28b3cc3843f-delete_volume" released by "delete_volume" :: held 1.572s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 12:01:58 devstack sudo[107106]: pam_unix(sudo:session): session closed for user root Nov 06 12:01:58 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-5744d827-aad7-49f7-a741-d5e6c842738e tempest-ProjectReaderTests-96541340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-45f1d44e-d9c2-424f-bf90-df1fc5ac6270 1073741824" returned: 0 in 0.463s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 12:01:58 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-5744d827-aad7-49f7-a741-d5e6c842738e tempest-ProjectReaderTests-96541340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-45f1d44e-d9c2-424f-bf90-df1fc5ac6270 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 12:01:58 devstack sudo[107115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-45f1d44e-d9c2-424f-bf90-df1fc5ac6270 Nov 06 12:01:58 devstack sudo[107115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 12:01:58 devstack sudo[107115]: pam_unix(sudo:session): session closed for user root Nov 06 12:01:58 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-5744d827-aad7-49f7-a741-d5e6c842738e tempest-ProjectReaderTests-96541340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-45f1d44e-d9c2-424f-bf90-df1fc5ac6270" returned: 0 in 0.267s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 12:01:58 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-5744d827-aad7-49f7-a741-d5e6c842738e tempest-ProjectReaderTests-96541340 None] <== create_volume: return (769ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f'} {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 12:01:58 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-5744d827-aad7-49f7-a741-d5e6c842738e tempest-ProjectReaderTests-96541340 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.772s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 12:01:59 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-5744d827-aad7-49f7-a741-d5e6c842738e tempest-ProjectReaderTests-96541340 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f45afcb6-c724-416c-b8b6-3336832e8c4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-45f1d44e-d9c2-424f-bf90-df1fc5ac6270', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 12:01:59 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-5744d827-aad7-49f7-a741-d5e6c842738e tempest-ProjectReaderTests-96541340 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3443739d-8715-4d06-9db9-4a147d0332f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 12:01:59 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-5744d827-aad7-49f7-a741-d5e6c842738e tempest-ProjectReaderTests-96541340 None] Volume volume-45f1d44e-d9c2-424f-bf90-df1fc5ac6270 (45f1d44e-d9c2-424f-bf90-df1fc5ac6270): created successfully Nov 06 12:01:59 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-5744d827-aad7-49f7-a741-d5e6c842738e tempest-ProjectReaderTests-96541340 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3443739d-8715-4d06-9db9-4a147d0332f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 12:01:59 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-5744d827-aad7-49f7-a741-d5e6c842738e tempest-ProjectReaderTests-96541340 None] Flow 'volume_create_manager' (04b30777-e17e-40d9-b4cf-5bc8ea2700a0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 12:01:59 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-5744d827-aad7-49f7-a741-d5e6c842738e tempest-ProjectReaderTests-96541340 None] Created volume successfully. Nov 06 12:01:59 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-68a1eb00-039a-465a-87db-01d865368ae4 tempest-ProjectMemberTests-2097190340 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 12:01:59 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-68a1eb00-039a-465a-87db-01d865368ae4 tempest-ProjectMemberTests-2097190340 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 12:01:59 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-68a1eb00-039a-465a-87db-01d865368ae4 tempest-ProjectMemberTests-2097190340 None] Creating offline snapshot d4f82261-581d-4500-b6be-e4a0b4eddbaa of volume fc62566c-bb4b-4536-af7b-ac1be0219eca {{(pid=87116) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 06 12:01:59 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bca4db3-9d1a-4663-8fb9-f77c16f89b1b]: (4, 'qcow2') {{(pid=88420) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 12:01:59 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-68a1eb00-039a-465a-87db-01d865368ae4 tempest-ProjectMemberTests-2097190340 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-fc62566c-bb4b-4536-af7b-ac1be0219eca {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 12:01:59 devstack sudo[107118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-fc62566c-bb4b-4536-af7b-ac1be0219eca Nov 06 12:01:59 devstack sudo[107118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 12:01:59 devstack cinder-volume[87116]: DEBUG cinder.volume.flows.manager.create_volume [None req-c514fbf2-e22c-4dac-b3aa-ce8b4f52509a tempest-ProjectReaderTests-377170324 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87116) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 12:01:59 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-c514fbf2-e22c-4dac-b3aa-ce8b4f52509a tempest-ProjectReaderTests-377170324 None] Flow 'volume_create_manager' (393d82e0-b9ee-4da4-ad9e-35881a6cfa09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 12:01:59 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-c514fbf2-e22c-4dac-b3aa-ce8b4f52509a tempest-ProjectReaderTests-377170324 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a2a90bf3-89fe-4383-92ce-f896351ccba6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 12:01:59 devstack sudo[107118]: pam_unix(sudo:session): session closed for user root Nov 06 12:01:59 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-68a1eb00-039a-465a-87db-01d865368ae4 tempest-ProjectMemberTests-2097190340 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-fc62566c-bb4b-4536-af7b-ac1be0219eca" returned: 0 in 0.430s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 12:01:59 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-68a1eb00-039a-465a-87db-01d865368ae4 tempest-ProjectMemberTests-2097190340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-fc62566c-bb4b-4536-af7b-ac1be0219eca,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-fc62566c-bb4b-4536-af7b-ac1be0219eca.d4f82261-581d-4500-b6be-e4a0b4eddbaa 1G {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 12:01:59 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-c514fbf2-e22c-4dac-b3aa-ce8b4f52509a tempest-ProjectReaderTests-377170324 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a2a90bf3-89fe-4383-92ce-f896351ccba6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T11:01:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-261251564',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5414a8b4-18c0-4822-8b3c-85ce82b57453,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='865d378d37cd42ed98432cd1ce1e41be',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T11:02:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T11:02:00Z,use_quota=True,user_id='8acc7287c82b436186731f24c32b21ce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(34d3b144-d9b7-480a-a2e3-01e45f3d54c1),volume_type_id=34d3b144-d9b7-480a-a2e3-01e45f3d54c1)' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 12:01:59 devstack sudo[107123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-fc62566c-bb4b-4536-af7b-ac1be0219eca,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-fc62566c-bb4b-4536-af7b-ac1be0219eca.d4f82261-581d-4500-b6be-e4a0b4eddbaa 1G Nov 06 12:01:59 devstack sudo[107123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 12:01:59 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-c514fbf2-e22c-4dac-b3aa-ce8b4f52509a tempest-ProjectReaderTests-377170324 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (292f1aea-76c1-41d0-a7fe-64cbb3cbd5a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 12:01:59 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-c514fbf2-e22c-4dac-b3aa-ce8b4f52509a tempest-ProjectReaderTests-377170324 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (292f1aea-76c1-41d0-a7fe-64cbb3cbd5a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 12:01:59 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-c514fbf2-e22c-4dac-b3aa-ce8b4f52509a tempest-ProjectReaderTests-377170324 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d7ba349-01c8-4b0f-b35b-a2024db9f90e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 12:01:59 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-c514fbf2-e22c-4dac-b3aa-ce8b4f52509a tempest-ProjectReaderTests-377170324 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d7ba349-01c8-4b0f-b35b-a2024db9f90e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5414a8b4-18c0-4822-8b3c-85ce82b57453', 'volume_name': 'volume-5414a8b4-18c0-4822-8b3c-85ce82b57453', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 12:01:59 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-c514fbf2-e22c-4dac-b3aa-ce8b4f52509a tempest-ProjectReaderTests-377170324 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8e71f343-6bd3-4ddb-8d75-f092333c3cc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 12:01:59 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-c514fbf2-e22c-4dac-b3aa-ce8b4f52509a tempest-ProjectReaderTests-377170324 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8e71f343-6bd3-4ddb-8d75-f092333c3cc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 12:01:59 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-c514fbf2-e22c-4dac-b3aa-ce8b4f52509a tempest-ProjectReaderTests-377170324 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d8490558-7460-4c92-a048-9692c52b6040) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 12:01:59 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-c514fbf2-e22c-4dac-b3aa-ce8b4f52509a tempest-ProjectReaderTests-377170324 None] Volume 5414a8b4-18c0-4822-8b3c-85ce82b57453: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5414a8b4-18c0-4822-8b3c-85ce82b57453', 'volume_size': 1} Nov 06 12:01:59 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-c514fbf2-e22c-4dac-b3aa-ce8b4f52509a tempest-ProjectReaderTests-377170324 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 12:02:00 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-923a1de4-b7b9-4f8a-9039-dad8ea76d7c0 tempest-ProjectReaderTests-96541340 None] Acquiring lock "cinder-45f1d44e-d9c2-424f-bf90-df1fc5ac6270-delete_volume" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 12:02:00 devstack sudo[107123]: pam_unix(sudo:session): session closed for user root Nov 06 12:02:00 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-68a1eb00-039a-465a-87db-01d865368ae4 tempest-ProjectMemberTests-2097190340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-fc62566c-bb4b-4536-af7b-ac1be0219eca,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-fc62566c-bb4b-4536-af7b-ac1be0219eca.d4f82261-581d-4500-b6be-e4a0b4eddbaa 1G" returned: 0 in 0.459s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 12:02:00 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-68a1eb00-039a-465a-87db-01d865368ae4 tempest-ProjectMemberTests-2097190340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fc62566c-bb4b-4536-af7b-ac1be0219eca -F qcow2 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-fc62566c-bb4b-4536-af7b-ac1be0219eca.d4f82261-581d-4500-b6be-e4a0b4eddbaa {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 12:02:00 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-923a1de4-b7b9-4f8a-9039-dad8ea76d7c0 tempest-ProjectReaderTests-96541340 None] Lock "cinder-45f1d44e-d9c2-424f-bf90-df1fc5ac6270-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 12:02:00 devstack sudo[107129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fc62566c-bb4b-4536-af7b-ac1be0219eca -F qcow2 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-fc62566c-bb4b-4536-af7b-ac1be0219eca.d4f82261-581d-4500-b6be-e4a0b4eddbaa Nov 06 12:02:00 devstack sudo[107129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 12:02:00 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-923a1de4-b7b9-4f8a-9039-dad8ea76d7c0 tempest-ProjectReaderTests-96541340 None] Acquiring lock "cinder-quobyte-45f1d44e-d9c2-424f-bf90-df1fc5ac6270" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 12:02:00 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-923a1de4-b7b9-4f8a-9039-dad8ea76d7c0 tempest-ProjectReaderTests-96541340 None] Lock "cinder-quobyte-45f1d44e-d9c2-424f-bf90-df1fc5ac6270" acquired by "delete_volume" :: waited 0.018s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 12:02:00 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[43033dad-a79f-4820-a857-8f44639fe023]: (4, 'qcow2') {{(pid=88420) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 12:02:00 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-923a1de4-b7b9-4f8a-9039-dad8ea76d7c0 tempest-ProjectReaderTests-96541340 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-45f1d44e-d9c2-424f-bf90-df1fc5ac6270 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 12:02:00 devstack sudo[107131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-45f1d44e-d9c2-424f-bf90-df1fc5ac6270 Nov 06 12:02:00 devstack sudo[107131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 12:02:00 devstack sudo[107129]: pam_unix(sudo:session): session closed for user root Nov 06 12:02:00 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-68a1eb00-039a-465a-87db-01d865368ae4 tempest-ProjectMemberTests-2097190340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fc62566c-bb4b-4536-af7b-ac1be0219eca -F qcow2 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-fc62566c-bb4b-4536-af7b-ac1be0219eca.d4f82261-581d-4500-b6be-e4a0b4eddbaa" returned: 0 in 0.315s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 12:02:00 devstack cinder-volume[87116]: WARNING cinder.volume.drivers.remotefs [None req-68a1eb00-039a-465a-87db-01d865368ae4 tempest-ProjectMemberTests-2097190340 None] /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-fc62566c-bb4b-4536-af7b-ac1be0219eca.d4f82261-581d-4500-b6be-e4a0b4eddbaa is being set with open permissions: ugo+rw Nov 06 12:02:00 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-68a1eb00-039a-465a-87db-01d865368ae4 tempest-ProjectMemberTests-2097190340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-fc62566c-bb4b-4536-af7b-ac1be0219eca.d4f82261-581d-4500-b6be-e4a0b4eddbaa {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 12:02:00 devstack sudo[107136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-fc62566c-bb4b-4536-af7b-ac1be0219eca.d4f82261-581d-4500-b6be-e4a0b4eddbaa Nov 06 12:02:00 devstack sudo[107136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 12:02:00 devstack sudo[107131]: pam_unix(sudo:session): session closed for user root Nov 06 12:02:00 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-923a1de4-b7b9-4f8a-9039-dad8ea76d7c0 tempest-ProjectReaderTests-96541340 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-45f1d44e-d9c2-424f-bf90-df1fc5ac6270" returned: 0 in 0.398s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 12:02:00 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-923a1de4-b7b9-4f8a-9039-dad8ea76d7c0 tempest-ProjectReaderTests-96541340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-45f1d44e-d9c2-424f-bf90-df1fc5ac6270 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 12:02:00 devstack sudo[107141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-45f1d44e-d9c2-424f-bf90-df1fc5ac6270 Nov 06 12:02:00 devstack sudo[107141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 12:02:00 devstack sudo[107136]: pam_unix(sudo:session): session closed for user root Nov 06 12:02:00 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-68a1eb00-039a-465a-87db-01d865368ae4 tempest-ProjectMemberTests-2097190340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-fc62566c-bb4b-4536-af7b-ac1be0219eca.d4f82261-581d-4500-b6be-e4a0b4eddbaa" returned: 0 in 0.287s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 12:02:00 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-68a1eb00-039a-465a-87db-01d865368ae4 tempest-ProjectMemberTests-2097190340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-fc62566c-bb4b-4536-af7b-ac1be0219eca.info {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 12:02:00 devstack sudo[107144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-fc62566c-bb4b-4536-af7b-ac1be0219eca.info Nov 06 12:02:00 devstack sudo[107144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 12:02:00 devstack sudo[107141]: pam_unix(sudo:session): session closed for user root Nov 06 12:02:01 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-923a1de4-b7b9-4f8a-9039-dad8ea76d7c0 tempest-ProjectReaderTests-96541340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-45f1d44e-d9c2-424f-bf90-df1fc5ac6270" returned: 0 in 0.252s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 12:02:01 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-923a1de4-b7b9-4f8a-9039-dad8ea76d7c0 tempest-ProjectReaderTests-96541340 None] Lock "cinder-quobyte-45f1d44e-d9c2-424f-bf90-df1fc5ac6270" released by "delete_volume" :: held 0.700s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 12:02:01 devstack cinder-volume[87116]: DEBUG cinder.quota [None req-923a1de4-b7b9-4f8a-9039-dad8ea76d7c0 tempest-ProjectReaderTests-96541340 None] Created reservations ['ce34bcc9-d9d4-4696-8213-b6ee65b8b647', '04c28a92-c410-49d1-bdec-2274d8c72399', '5c8962df-d2c1-4e5b-8eff-b2cf1468d36c', '2451144f-731e-47a8-9405-3c0155c78f68'] {{(pid=87116) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 12:02:01 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-923a1de4-b7b9-4f8a-9039-dad8ea76d7c0 tempest-ProjectReaderTests-96541340 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 12:02:01 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-923a1de4-b7b9-4f8a-9039-dad8ea76d7c0 tempest-ProjectReaderTests-96541340 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 12:02:01 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-923a1de4-b7b9-4f8a-9039-dad8ea76d7c0 tempest-ProjectReaderTests-96541340 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 12:02:01 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-923a1de4-b7b9-4f8a-9039-dad8ea76d7c0 tempest-ProjectReaderTests-96541340 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 12:02:01 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-923a1de4-b7b9-4f8a-9039-dad8ea76d7c0 tempest-ProjectReaderTests-96541340 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 12:02:01 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-923a1de4-b7b9-4f8a-9039-dad8ea76d7c0 tempest-ProjectReaderTests-96541340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 12:02:01 devstack sudo[107147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756 Nov 06 12:02:01 devstack sudo[107147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 12:02:01 devstack sudo[107144]: pam_unix(sudo:session): session closed for user root Nov 06 12:02:01 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-68a1eb00-039a-465a-87db-01d865368ae4 tempest-ProjectMemberTests-2097190340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-fc62566c-bb4b-4536-af7b-ac1be0219eca.info" returned: 0 in 0.350s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 12:02:01 devstack cinder-volume[87116]: WARNING cinder.volume.drivers.remotefs [None req-68a1eb00-039a-465a-87db-01d865368ae4 tempest-ProjectMemberTests-2097190340 None] /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-fc62566c-bb4b-4536-af7b-ac1be0219eca.info is being set with open permissions: ugo+rw Nov 06 12:02:01 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-68a1eb00-039a-465a-87db-01d865368ae4 tempest-ProjectMemberTests-2097190340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-fc62566c-bb4b-4536-af7b-ac1be0219eca.info {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 12:02:01 devstack sudo[107150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-fc62566c-bb4b-4536-af7b-ac1be0219eca.info Nov 06 12:02:01 devstack sudo[107150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 12:02:01 devstack sudo[107147]: pam_unix(sudo:session): session closed for user root Nov 06 12:02:01 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-923a1de4-b7b9-4f8a-9039-dad8ea76d7c0 tempest-ProjectReaderTests-96541340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756" returned: 0 in 0.269s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 12:02:01 devstack cinder-volume[87116]: DEBUG cinder.manager [None req-923a1de4-b7b9-4f8a-9039-dad8ea76d7c0 tempest-ProjectReaderTests-96541340 None] Notifying Schedulers of capabilities ... {{(pid=87116) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 12:02:01 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-923a1de4-b7b9-4f8a-9039-dad8ea76d7c0 tempest-ProjectReaderTests-96541340 None] Deleted volume successfully. Nov 06 12:02:01 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-923a1de4-b7b9-4f8a-9039-dad8ea76d7c0 tempest-ProjectReaderTests-96541340 None] Lock "cinder-45f1d44e-d9c2-424f-bf90-df1fc5ac6270-delete_volume" released by "delete_volume" :: held 1.195s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 12:02:01 devstack sudo[107150]: pam_unix(sudo:session): session closed for user root Nov 06 12:02:01 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-68a1eb00-039a-465a-87db-01d865368ae4 tempest-ProjectMemberTests-2097190340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-fc62566c-bb4b-4536-af7b-ac1be0219eca.info" returned: 0 in 0.326s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 12:02:01 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-68a1eb00-039a-465a-87db-01d865368ae4 tempest-ProjectMemberTests-2097190340 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.259s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 12:02:01 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-c514fbf2-e22c-4dac-b3aa-ce8b4f52509a tempest-ProjectReaderTests-377170324 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.726s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 12:02:01 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-c514fbf2-e22c-4dac-b3aa-ce8b4f52509a tempest-ProjectReaderTests-377170324 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T11:01:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-261251564',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5414a8b4-18c0-4822-8b3c-85ce82b57453,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='865d378d37cd42ed98432cd1ce1e41be',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T11:02:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T11:02:00Z,use_quota=True,user_id='8acc7287c82b436186731f24c32b21ce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(34d3b144-d9b7-480a-a2e3-01e45f3d54c1),volume_type_id=34d3b144-d9b7-480a-a2e3-01e45f3d54c1)}" {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 12:02:01 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-c514fbf2-e22c-4dac-b3aa-ce8b4f52509a tempest-ProjectReaderTests-377170324 None] Creating volume 5414a8b4-18c0-4822-8b3c-85ce82b57453 {{(pid=87116) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 12:02:01 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-c514fbf2-e22c-4dac-b3aa-ce8b4f52509a tempest-ProjectReaderTests-377170324 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 12:02:01 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-c514fbf2-e22c-4dac-b3aa-ce8b4f52509a tempest-ProjectReaderTests-377170324 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 12:02:01 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-c514fbf2-e22c-4dac-b3aa-ce8b4f52509a tempest-ProjectReaderTests-377170324 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 12:02:01 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-c514fbf2-e22c-4dac-b3aa-ce8b4f52509a tempest-ProjectReaderTests-377170324 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 12:02:01 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-c514fbf2-e22c-4dac-b3aa-ce8b4f52509a tempest-ProjectReaderTests-377170324 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 12:02:01 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-c514fbf2-e22c-4dac-b3aa-ce8b4f52509a tempest-ProjectReaderTests-377170324 None] Selected osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f as target Quobyte volume. {{(pid=87116) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 12:02:01 devstack cinder-volume[87116]: INFO cinder.volume.drivers.remotefs [None req-c514fbf2-e22c-4dac-b3aa-ce8b4f52509a tempest-ProjectReaderTests-377170324 None] casted to osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f Nov 06 12:02:01 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-c514fbf2-e22c-4dac-b3aa-ce8b4f52509a tempest-ProjectReaderTests-377170324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-5414a8b4-18c0-4822-8b3c-85ce82b57453 1073741824 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 12:02:01 devstack sudo[107154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-5414a8b4-18c0-4822-8b3c-85ce82b57453 1073741824 Nov 06 12:02:01 devstack sudo[107154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 12:02:01 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-68a1eb00-039a-465a-87db-01d865368ae4 tempest-ProjectMemberTests-2097190340 None] Create snapshot completed successfully Nov 06 12:02:01 devstack cinder-volume[87116]: DEBUG cinder.volume.flows.manager.create_volume [None req-22ccab60-e743-4b17-a397-3e975f2b4177 tempest-ProjectReaderTests-96541340 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87116) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 12:02:01 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-22ccab60-e743-4b17-a397-3e975f2b4177 tempest-ProjectReaderTests-96541340 None] Flow 'volume_create_manager' (dd2889e9-f561-4e33-b021-0de217dc8158) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 12:02:01 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-22ccab60-e743-4b17-a397-3e975f2b4177 tempest-ProjectReaderTests-96541340 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a5089f35-505f-4dac-8f0b-26d6c24dfbbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 12:02:01 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-22ccab60-e743-4b17-a397-3e975f2b4177 tempest-ProjectReaderTests-96541340 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a5089f35-505f-4dac-8f0b-26d6c24dfbbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T11:02:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1742481127',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4f1504ab-37ce-4a7e-a40f-262a7de8b6d9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d62bdaafe8274594bead62a9698c27e1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T11:02:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T11:02:02Z,use_quota=True,user_id='a4d2d4b5e6a5421f9af1c5ce03eb2789',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(34d3b144-d9b7-480a-a2e3-01e45f3d54c1),volume_type_id=34d3b144-d9b7-480a-a2e3-01e45f3d54c1)' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 12:02:01 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-22ccab60-e743-4b17-a397-3e975f2b4177 tempest-ProjectReaderTests-96541340 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f3c051ee-8da5-4dd2-ad08-491d26d695f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 12:02:01 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-22ccab60-e743-4b17-a397-3e975f2b4177 tempest-ProjectReaderTests-96541340 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f3c051ee-8da5-4dd2-ad08-491d26d695f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 12:02:01 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-22ccab60-e743-4b17-a397-3e975f2b4177 tempest-ProjectReaderTests-96541340 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6cd1e7a4-616a-45d0-8adb-5beb3d2da590) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 12:02:01 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-22ccab60-e743-4b17-a397-3e975f2b4177 tempest-ProjectReaderTests-96541340 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6cd1e7a4-616a-45d0-8adb-5beb3d2da590) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4f1504ab-37ce-4a7e-a40f-262a7de8b6d9', 'volume_name': 'volume-4f1504ab-37ce-4a7e-a40f-262a7de8b6d9', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 12:02:01 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-22ccab60-e743-4b17-a397-3e975f2b4177 tempest-ProjectReaderTests-96541340 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (34a73eca-11bd-498d-b249-fc95fca518e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 12:02:01 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-22ccab60-e743-4b17-a397-3e975f2b4177 tempest-ProjectReaderTests-96541340 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (34a73eca-11bd-498d-b249-fc95fca518e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 12:02:01 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-22ccab60-e743-4b17-a397-3e975f2b4177 tempest-ProjectReaderTests-96541340 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (005ebf5e-9dcf-4e7d-95da-74a2c212294f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 12:02:01 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-22ccab60-e743-4b17-a397-3e975f2b4177 tempest-ProjectReaderTests-96541340 None] Volume 4f1504ab-37ce-4a7e-a40f-262a7de8b6d9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4f1504ab-37ce-4a7e-a40f-262a7de8b6d9', 'volume_size': 1} Nov 06 12:02:01 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-22ccab60-e743-4b17-a397-3e975f2b4177 tempest-ProjectReaderTests-96541340 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 12:02:02 devstack sudo[107154]: pam_unix(sudo:session): session closed for user root Nov 06 12:02:02 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-c514fbf2-e22c-4dac-b3aa-ce8b4f52509a tempest-ProjectReaderTests-377170324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-5414a8b4-18c0-4822-8b3c-85ce82b57453 1073741824" returned: 0 in 0.468s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 12:02:02 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-c514fbf2-e22c-4dac-b3aa-ce8b4f52509a tempest-ProjectReaderTests-377170324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-5414a8b4-18c0-4822-8b3c-85ce82b57453 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 12:02:02 devstack sudo[107159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-5414a8b4-18c0-4822-8b3c-85ce82b57453 Nov 06 12:02:02 devstack sudo[107159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 12:02:02 devstack sudo[107159]: pam_unix(sudo:session): session closed for user root Nov 06 12:02:02 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-c514fbf2-e22c-4dac-b3aa-ce8b4f52509a tempest-ProjectReaderTests-377170324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-5414a8b4-18c0-4822-8b3c-85ce82b57453" returned: 0 in 0.236s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 12:02:02 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-c514fbf2-e22c-4dac-b3aa-ce8b4f52509a tempest-ProjectReaderTests-377170324 None] <== create_volume: return (748ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f'} {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 12:02:02 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-c514fbf2-e22c-4dac-b3aa-ce8b4f52509a tempest-ProjectReaderTests-377170324 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.754s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 12:02:02 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-22ccab60-e743-4b17-a397-3e975f2b4177 tempest-ProjectReaderTests-96541340 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.338s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 12:02:02 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-22ccab60-e743-4b17-a397-3e975f2b4177 tempest-ProjectReaderTests-96541340 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T11:02:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1742481127',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4f1504ab-37ce-4a7e-a40f-262a7de8b6d9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d62bdaafe8274594bead62a9698c27e1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T11:02:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T11:02:02Z,use_quota=True,user_id='a4d2d4b5e6a5421f9af1c5ce03eb2789',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(34d3b144-d9b7-480a-a2e3-01e45f3d54c1),volume_type_id=34d3b144-d9b7-480a-a2e3-01e45f3d54c1)}" {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 12:02:02 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-22ccab60-e743-4b17-a397-3e975f2b4177 tempest-ProjectReaderTests-96541340 None] Creating volume 4f1504ab-37ce-4a7e-a40f-262a7de8b6d9 {{(pid=87116) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 12:02:02 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-22ccab60-e743-4b17-a397-3e975f2b4177 tempest-ProjectReaderTests-96541340 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 12:02:02 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-22ccab60-e743-4b17-a397-3e975f2b4177 tempest-ProjectReaderTests-96541340 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 12:02:02 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-22ccab60-e743-4b17-a397-3e975f2b4177 tempest-ProjectReaderTests-96541340 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 12:02:02 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-22ccab60-e743-4b17-a397-3e975f2b4177 tempest-ProjectReaderTests-96541340 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 12:02:02 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-22ccab60-e743-4b17-a397-3e975f2b4177 tempest-ProjectReaderTests-96541340 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 12:02:02 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-22ccab60-e743-4b17-a397-3e975f2b4177 tempest-ProjectReaderTests-96541340 None] Selected osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f as target Quobyte volume. {{(pid=87116) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 12:02:02 devstack cinder-volume[87116]: INFO cinder.volume.drivers.remotefs [None req-22ccab60-e743-4b17-a397-3e975f2b4177 tempest-ProjectReaderTests-96541340 None] casted to osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f Nov 06 12:02:02 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-22ccab60-e743-4b17-a397-3e975f2b4177 tempest-ProjectReaderTests-96541340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-4f1504ab-37ce-4a7e-a40f-262a7de8b6d9 1073741824 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 12:02:02 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-c514fbf2-e22c-4dac-b3aa-ce8b4f52509a tempest-ProjectReaderTests-377170324 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d8490558-7460-4c92-a048-9692c52b6040) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5414a8b4-18c0-4822-8b3c-85ce82b57453', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 12:02:02 devstack sudo[107162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-4f1504ab-37ce-4a7e-a40f-262a7de8b6d9 1073741824 Nov 06 12:02:02 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-c514fbf2-e22c-4dac-b3aa-ce8b4f52509a tempest-ProjectReaderTests-377170324 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (32a53d2a-0469-4d52-8b7e-0489d425a47f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 12:02:02 devstack sudo[107162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 12:02:02 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-c514fbf2-e22c-4dac-b3aa-ce8b4f52509a tempest-ProjectReaderTests-377170324 None] Volume volume-5414a8b4-18c0-4822-8b3c-85ce82b57453 (5414a8b4-18c0-4822-8b3c-85ce82b57453): created successfully Nov 06 12:02:02 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-c514fbf2-e22c-4dac-b3aa-ce8b4f52509a tempest-ProjectReaderTests-377170324 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (32a53d2a-0469-4d52-8b7e-0489d425a47f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 12:02:02 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-c514fbf2-e22c-4dac-b3aa-ce8b4f52509a tempest-ProjectReaderTests-377170324 None] Flow 'volume_create_manager' (393d82e0-b9ee-4da4-ad9e-35881a6cfa09) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 12:02:02 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-c514fbf2-e22c-4dac-b3aa-ce8b4f52509a tempest-ProjectReaderTests-377170324 None] Created volume successfully. Nov 06 12:02:02 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-734f1c37-7742-44e9-98c0-26a4979d0f85 tempest-ProjectMemberTests-2097190340 None] Acquiring lock "cinder-d4f82261-581d-4500-b6be-e4a0b4eddbaa-delete_snapshot" by "delete_snapshot" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 12:02:02 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-734f1c37-7742-44e9-98c0-26a4979d0f85 tempest-ProjectMemberTests-2097190340 None] Lock "cinder-d4f82261-581d-4500-b6be-e4a0b4eddbaa-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 12:02:02 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-734f1c37-7742-44e9-98c0-26a4979d0f85 tempest-ProjectMemberTests-2097190340 None] Acquiring lock "cinder-quobyte-fc62566c-bb4b-4536-af7b-ac1be0219eca" by "delete_snapshot" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 12:02:02 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-734f1c37-7742-44e9-98c0-26a4979d0f85 tempest-ProjectMemberTests-2097190340 None] Lock "cinder-quobyte-fc62566c-bb4b-4536-af7b-ac1be0219eca" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 12:02:02 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-734f1c37-7742-44e9-98c0-26a4979d0f85 tempest-ProjectMemberTests-2097190340 None] Acquiring lock "cinder-quobyte-d4f82261-581d-4500-b6be-e4a0b4eddbaa" by "_delete_snapshot" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 12:02:02 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-734f1c37-7742-44e9-98c0-26a4979d0f85 tempest-ProjectMemberTests-2097190340 None] Lock "cinder-quobyte-d4f82261-581d-4500-b6be-e4a0b4eddbaa" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 12:02:02 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-734f1c37-7742-44e9-98c0-26a4979d0f85 tempest-ProjectMemberTests-2097190340 None] Deleting offline snapshot d4f82261-581d-4500-b6be-e4a0b4eddbaa of volume fc62566c-bb4b-4536-af7b-ac1be0219eca {{(pid=87116) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 06 12:02:02 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-734f1c37-7742-44e9-98c0-26a4979d0f85 tempest-ProjectMemberTests-2097190340 None] snapshot_file for this snap is: volume-fc62566c-bb4b-4536-af7b-ac1be0219eca.d4f82261-581d-4500-b6be-e4a0b4eddbaa {{(pid=87116) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 06 12:02:02 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[645110e1-6b0f-4294-b20b-35ce149e9f9d]: (4, 'qcow2') {{(pid=88420) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 12:02:02 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-734f1c37-7742-44e9-98c0-26a4979d0f85 tempest-ProjectMemberTests-2097190340 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-fc62566c-bb4b-4536-af7b-ac1be0219eca.d4f82261-581d-4500-b6be-e4a0b4eddbaa {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 12:02:02 devstack sudo[107166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-fc62566c-bb4b-4536-af7b-ac1be0219eca.d4f82261-581d-4500-b6be-e4a0b4eddbaa Nov 06 12:02:02 devstack sudo[107166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 12:02:02 devstack sudo[107162]: pam_unix(sudo:session): session closed for user root Nov 06 12:02:02 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-22ccab60-e743-4b17-a397-3e975f2b4177 tempest-ProjectReaderTests-96541340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-4f1504ab-37ce-4a7e-a40f-262a7de8b6d9 1073741824" returned: 0 in 0.479s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 12:02:02 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-22ccab60-e743-4b17-a397-3e975f2b4177 tempest-ProjectReaderTests-96541340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-4f1504ab-37ce-4a7e-a40f-262a7de8b6d9 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 12:02:02 devstack sudo[107170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-4f1504ab-37ce-4a7e-a40f-262a7de8b6d9 Nov 06 12:02:02 devstack sudo[107170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 12:02:03 devstack sudo[107166]: pam_unix(sudo:session): session closed for user root Nov 06 12:02:03 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-734f1c37-7742-44e9-98c0-26a4979d0f85 tempest-ProjectMemberTests-2097190340 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-fc62566c-bb4b-4536-af7b-ac1be0219eca.d4f82261-581d-4500-b6be-e4a0b4eddbaa" returned: 0 in 0.441s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 12:02:03 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-734f1c37-7742-44e9-98c0-26a4979d0f85 tempest-ProjectMemberTests-2097190340 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fc62566c-bb4b-4536-af7b-ac1be0219eca(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87116) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 12:02:03 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[abaeb6d5-f8ac-4456-a0ab-8cdf184477d5]: (4, 'qcow2') {{(pid=88420) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 12:02:03 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-734f1c37-7742-44e9-98c0-26a4979d0f85 tempest-ProjectMemberTests-2097190340 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-fc62566c-bb4b-4536-af7b-ac1be0219eca {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 12:02:03 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-b97659c9-2d2c-4f90-a1d5-aedb489e5d27 tempest-ProjectReaderTests-377170324 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 12:02:03 devstack sudo[107170]: pam_unix(sudo:session): session closed for user root Nov 06 12:02:03 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-22ccab60-e743-4b17-a397-3e975f2b4177 tempest-ProjectReaderTests-96541340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-4f1504ab-37ce-4a7e-a40f-262a7de8b6d9" returned: 0 in 0.309s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 12:02:03 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-22ccab60-e743-4b17-a397-3e975f2b4177 tempest-ProjectReaderTests-96541340 None] <== create_volume: return (843ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f'} {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 12:02:03 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-22ccab60-e743-4b17-a397-3e975f2b4177 tempest-ProjectReaderTests-96541340 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.846s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 12:02:03 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-b97659c9-2d2c-4f90-a1d5-aedb489e5d27 tempest-ProjectReaderTests-377170324 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.071s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 12:02:03 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-22ccab60-e743-4b17-a397-3e975f2b4177 tempest-ProjectReaderTests-96541340 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (005ebf5e-9dcf-4e7d-95da-74a2c212294f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4f1504ab-37ce-4a7e-a40f-262a7de8b6d9', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 12:02:03 devstack sudo[107176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-fc62566c-bb4b-4536-af7b-ac1be0219eca Nov 06 12:02:03 devstack sudo[107176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 12:02:03 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-22ccab60-e743-4b17-a397-3e975f2b4177 tempest-ProjectReaderTests-96541340 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (babfecef-ae6e-44fc-8006-5aa671943d42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 12:02:03 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-b97659c9-2d2c-4f90-a1d5-aedb489e5d27 tempest-ProjectReaderTests-377170324 None] Creating offline snapshot 41d66502-23df-4c97-bdbd-7627d1b6ca0a of volume 5414a8b4-18c0-4822-8b3c-85ce82b57453 {{(pid=87116) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 06 12:02:03 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-22ccab60-e743-4b17-a397-3e975f2b4177 tempest-ProjectReaderTests-96541340 None] Volume volume-4f1504ab-37ce-4a7e-a40f-262a7de8b6d9 (4f1504ab-37ce-4a7e-a40f-262a7de8b6d9): created successfully Nov 06 12:02:03 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-22ccab60-e743-4b17-a397-3e975f2b4177 tempest-ProjectReaderTests-96541340 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (babfecef-ae6e-44fc-8006-5aa671943d42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 12:02:03 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-22ccab60-e743-4b17-a397-3e975f2b4177 tempest-ProjectReaderTests-96541340 None] Flow 'volume_create_manager' (dd2889e9-f561-4e33-b021-0de217dc8158) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 12:02:03 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[7729fed2-3a60-4a87-b789-1eda384c8e8d]: (4, 'qcow2') {{(pid=88420) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 12:02:03 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-b97659c9-2d2c-4f90-a1d5-aedb489e5d27 tempest-ProjectReaderTests-377170324 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-5414a8b4-18c0-4822-8b3c-85ce82b57453 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 12:02:03 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-22ccab60-e743-4b17-a397-3e975f2b4177 tempest-ProjectReaderTests-96541340 None] Created volume successfully. Nov 06 12:02:03 devstack sudo[107179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-5414a8b4-18c0-4822-8b3c-85ce82b57453 Nov 06 12:02:03 devstack sudo[107179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 12:02:03 devstack sudo[107176]: pam_unix(sudo:session): session closed for user root Nov 06 12:02:03 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-734f1c37-7742-44e9-98c0-26a4979d0f85 tempest-ProjectMemberTests-2097190340 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-fc62566c-bb4b-4536-af7b-ac1be0219eca" returned: 0 in 0.413s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 12:02:03 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-734f1c37-7742-44e9-98c0-26a4979d0f85 tempest-ProjectMemberTests-2097190340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-fc62566c-bb4b-4536-af7b-ac1be0219eca.d4f82261-581d-4500-b6be-e4a0b4eddbaa {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 12:02:03 devstack sudo[107186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-fc62566c-bb4b-4536-af7b-ac1be0219eca.d4f82261-581d-4500-b6be-e4a0b4eddbaa Nov 06 12:02:03 devstack sudo[107186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 12:02:03 devstack sudo[107179]: pam_unix(sudo:session): session closed for user root Nov 06 12:02:03 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-b97659c9-2d2c-4f90-a1d5-aedb489e5d27 tempest-ProjectReaderTests-377170324 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-5414a8b4-18c0-4822-8b3c-85ce82b57453" returned: 0 in 0.393s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 12:02:03 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-b97659c9-2d2c-4f90-a1d5-aedb489e5d27 tempest-ProjectReaderTests-377170324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-5414a8b4-18c0-4822-8b3c-85ce82b57453,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-5414a8b4-18c0-4822-8b3c-85ce82b57453.41d66502-23df-4c97-bdbd-7627d1b6ca0a 1G {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 12:02:03 devstack sudo[107191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-5414a8b4-18c0-4822-8b3c-85ce82b57453,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-5414a8b4-18c0-4822-8b3c-85ce82b57453.41d66502-23df-4c97-bdbd-7627d1b6ca0a 1G Nov 06 12:02:03 devstack sudo[107191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 12:02:03 devstack sudo[107186]: pam_unix(sudo:session): session closed for user root Nov 06 12:02:03 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-734f1c37-7742-44e9-98c0-26a4979d0f85 tempest-ProjectMemberTests-2097190340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-fc62566c-bb4b-4536-af7b-ac1be0219eca.d4f82261-581d-4500-b6be-e4a0b4eddbaa" returned: 0 in 0.366s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 12:02:03 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-734f1c37-7742-44e9-98c0-26a4979d0f85 tempest-ProjectMemberTests-2097190340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-fc62566c-bb4b-4536-af7b-ac1be0219eca.d4f82261-581d-4500-b6be-e4a0b4eddbaa {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 12:02:03 devstack sudo[107196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-fc62566c-bb4b-4536-af7b-ac1be0219eca.d4f82261-581d-4500-b6be-e4a0b4eddbaa Nov 06 12:02:03 devstack sudo[107196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 12:02:04 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-0c00dfb9-b6cd-4c08-a141-b529650f5323 tempest-ProjectReaderTests-96541340 None] Acquiring lock "cinder-4f1504ab-37ce-4a7e-a40f-262a7de8b6d9-delete_volume" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 12:02:04 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-0c00dfb9-b6cd-4c08-a141-b529650f5323 tempest-ProjectReaderTests-96541340 None] Lock "cinder-4f1504ab-37ce-4a7e-a40f-262a7de8b6d9-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 12:02:04 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-0c00dfb9-b6cd-4c08-a141-b529650f5323 tempest-ProjectReaderTests-96541340 None] Acquiring lock "cinder-quobyte-4f1504ab-37ce-4a7e-a40f-262a7de8b6d9" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 12:02:04 devstack sudo[107191]: pam_unix(sudo:session): session closed for user root Nov 06 12:02:04 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-0c00dfb9-b6cd-4c08-a141-b529650f5323 tempest-ProjectReaderTests-96541340 None] Lock "cinder-quobyte-4f1504ab-37ce-4a7e-a40f-262a7de8b6d9" acquired by "delete_volume" :: waited 0.016s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 12:02:04 devstack sudo[107196]: pam_unix(sudo:session): session closed for user root Nov 06 12:02:04 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-b97659c9-2d2c-4f90-a1d5-aedb489e5d27 tempest-ProjectReaderTests-377170324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-5414a8b4-18c0-4822-8b3c-85ce82b57453,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-5414a8b4-18c0-4822-8b3c-85ce82b57453.41d66502-23df-4c97-bdbd-7627d1b6ca0a 1G" returned: 0 in 0.553s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 12:02:04 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-b97659c9-2d2c-4f90-a1d5-aedb489e5d27 tempest-ProjectReaderTests-377170324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5414a8b4-18c0-4822-8b3c-85ce82b57453 -F qcow2 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-5414a8b4-18c0-4822-8b3c-85ce82b57453.41d66502-23df-4c97-bdbd-7627d1b6ca0a {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 12:02:04 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-734f1c37-7742-44e9-98c0-26a4979d0f85 tempest-ProjectMemberTests-2097190340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-fc62566c-bb4b-4536-af7b-ac1be0219eca.d4f82261-581d-4500-b6be-e4a0b4eddbaa" returned: 0 in 0.363s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 12:02:04 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[b673909b-53cb-43b9-96ed-6e2a8413fd3b]: (4, 'qcow2') {{(pid=88420) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 12:02:04 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-0c00dfb9-b6cd-4c08-a141-b529650f5323 tempest-ProjectReaderTests-96541340 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-4f1504ab-37ce-4a7e-a40f-262a7de8b6d9 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 12:02:04 devstack sudo[107204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5414a8b4-18c0-4822-8b3c-85ce82b57453 -F qcow2 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-5414a8b4-18c0-4822-8b3c-85ce82b57453.41d66502-23df-4c97-bdbd-7627d1b6ca0a Nov 06 12:02:04 devstack sudo[107204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 12:02:04 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-734f1c37-7742-44e9-98c0-26a4979d0f85 tempest-ProjectMemberTests-2097190340 None] Lock "cinder-quobyte-d4f82261-581d-4500-b6be-e4a0b4eddbaa" released by "_delete_snapshot" :: held 1.759s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 12:02:04 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-734f1c37-7742-44e9-98c0-26a4979d0f85 tempest-ProjectMemberTests-2097190340 None] Lock "cinder-quobyte-fc62566c-bb4b-4536-af7b-ac1be0219eca" released by "delete_snapshot" :: held 1.784s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 12:02:04 devstack sudo[107205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-4f1504ab-37ce-4a7e-a40f-262a7de8b6d9 Nov 06 12:02:04 devstack sudo[107205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 12:02:04 devstack cinder-volume[87116]: DEBUG cinder.quota [None req-734f1c37-7742-44e9-98c0-26a4979d0f85 tempest-ProjectMemberTests-2097190340 None] Created reservations ['fd56b4fb-8aaa-4cb5-8045-0aad193b0423', 'c0b757d7-85bb-4bcb-9211-226be5f3a7ae', '3115fcfb-6749-471a-a441-08e6ee3a5bfa', '22bc683a-cee4-4019-9905-6d380fec9b03'] {{(pid=87116) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 12:02:04 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-734f1c37-7742-44e9-98c0-26a4979d0f85 tempest-ProjectMemberTests-2097190340 None] Delete snapshot completed successfully. Nov 06 12:02:04 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-734f1c37-7742-44e9-98c0-26a4979d0f85 tempest-ProjectMemberTests-2097190340 None] Lock "cinder-d4f82261-581d-4500-b6be-e4a0b4eddbaa-delete_snapshot" released by "delete_snapshot" :: held 1.954s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 12:02:04 devstack sudo[107204]: pam_unix(sudo:session): session closed for user root Nov 06 12:02:04 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-b97659c9-2d2c-4f90-a1d5-aedb489e5d27 tempest-ProjectReaderTests-377170324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5414a8b4-18c0-4822-8b3c-85ce82b57453 -F qcow2 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-5414a8b4-18c0-4822-8b3c-85ce82b57453.41d66502-23df-4c97-bdbd-7627d1b6ca0a" returned: 0 in 0.344s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 12:02:04 devstack cinder-volume[87116]: WARNING cinder.volume.drivers.remotefs [None req-b97659c9-2d2c-4f90-a1d5-aedb489e5d27 tempest-ProjectReaderTests-377170324 None] /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-5414a8b4-18c0-4822-8b3c-85ce82b57453.41d66502-23df-4c97-bdbd-7627d1b6ca0a is being set with open permissions: ugo+rw Nov 06 12:02:04 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-b97659c9-2d2c-4f90-a1d5-aedb489e5d27 tempest-ProjectReaderTests-377170324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-5414a8b4-18c0-4822-8b3c-85ce82b57453.41d66502-23df-4c97-bdbd-7627d1b6ca0a {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 12:02:04 devstack sudo[107211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-5414a8b4-18c0-4822-8b3c-85ce82b57453.41d66502-23df-4c97-bdbd-7627d1b6ca0a Nov 06 12:02:04 devstack sudo[107211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 12:02:04 devstack sudo[107205]: pam_unix(sudo:session): session closed for user root Nov 06 12:02:04 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-0c00dfb9-b6cd-4c08-a141-b529650f5323 tempest-ProjectReaderTests-96541340 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-4f1504ab-37ce-4a7e-a40f-262a7de8b6d9" returned: 0 in 0.460s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 12:02:04 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-0c00dfb9-b6cd-4c08-a141-b529650f5323 tempest-ProjectReaderTests-96541340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-4f1504ab-37ce-4a7e-a40f-262a7de8b6d9 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 12:02:04 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-008d0593-780a-4fe9-8d26-90197f9e0f2b tempest-ProjectMemberTests-2097190340 None] Acquiring lock "cinder-fc62566c-bb4b-4536-af7b-ac1be0219eca-delete_volume" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 12:02:04 devstack sudo[107217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-4f1504ab-37ce-4a7e-a40f-262a7de8b6d9 Nov 06 12:02:04 devstack sudo[107217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 12:02:04 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-008d0593-780a-4fe9-8d26-90197f9e0f2b tempest-ProjectMemberTests-2097190340 None] Lock "cinder-fc62566c-bb4b-4536-af7b-ac1be0219eca-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 12:02:04 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-008d0593-780a-4fe9-8d26-90197f9e0f2b tempest-ProjectMemberTests-2097190340 None] Acquiring lock "cinder-quobyte-fc62566c-bb4b-4536-af7b-ac1be0219eca" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 12:02:04 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-008d0593-780a-4fe9-8d26-90197f9e0f2b tempest-ProjectMemberTests-2097190340 None] Lock "cinder-quobyte-fc62566c-bb4b-4536-af7b-ac1be0219eca" acquired by "delete_volume" :: waited 0.026s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 12:02:04 devstack sudo[107211]: pam_unix(sudo:session): session closed for user root Nov 06 12:02:04 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-b97659c9-2d2c-4f90-a1d5-aedb489e5d27 tempest-ProjectReaderTests-377170324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-5414a8b4-18c0-4822-8b3c-85ce82b57453.41d66502-23df-4c97-bdbd-7627d1b6ca0a" returned: 0 in 0.305s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 12:02:04 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb6663e9-6e54-48c2-9b55-443aa3f733c6]: (4, 'qcow2') {{(pid=88420) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 12:02:04 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-008d0593-780a-4fe9-8d26-90197f9e0f2b tempest-ProjectMemberTests-2097190340 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-fc62566c-bb4b-4536-af7b-ac1be0219eca {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 12:02:04 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-b97659c9-2d2c-4f90-a1d5-aedb489e5d27 tempest-ProjectReaderTests-377170324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-5414a8b4-18c0-4822-8b3c-85ce82b57453.info {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 12:02:04 devstack sudo[107221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-5414a8b4-18c0-4822-8b3c-85ce82b57453.info Nov 06 12:02:04 devstack sudo[107221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 12:02:05 devstack sudo[107220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-fc62566c-bb4b-4536-af7b-ac1be0219eca Nov 06 12:02:05 devstack sudo[107220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 12:02:05 devstack sudo[107217]: pam_unix(sudo:session): session closed for user root Nov 06 12:02:05 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-0c00dfb9-b6cd-4c08-a141-b529650f5323 tempest-ProjectReaderTests-96541340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-4f1504ab-37ce-4a7e-a40f-262a7de8b6d9" returned: 0 in 0.320s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 12:02:05 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-0c00dfb9-b6cd-4c08-a141-b529650f5323 tempest-ProjectReaderTests-96541340 None] Lock "cinder-quobyte-4f1504ab-37ce-4a7e-a40f-262a7de8b6d9" released by "delete_volume" :: held 0.844s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 12:02:05 devstack cinder-volume[87116]: DEBUG cinder.quota [None req-0c00dfb9-b6cd-4c08-a141-b529650f5323 tempest-ProjectReaderTests-96541340 None] Created reservations ['a0ab129f-506f-41ef-9fb7-4fda094b9403', '3a45c22c-aace-4e51-9f00-ec9e16060831', 'b49ec6f8-3df4-4a72-ad74-ced30c20a17c', '6d78812e-8c42-4a98-8a71-1aad4926f0f1'] {{(pid=87116) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 12:02:05 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-0c00dfb9-b6cd-4c08-a141-b529650f5323 tempest-ProjectReaderTests-96541340 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 12:02:05 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-0c00dfb9-b6cd-4c08-a141-b529650f5323 tempest-ProjectReaderTests-96541340 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 12:02:05 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-0c00dfb9-b6cd-4c08-a141-b529650f5323 tempest-ProjectReaderTests-96541340 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 12:02:05 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-0c00dfb9-b6cd-4c08-a141-b529650f5323 tempest-ProjectReaderTests-96541340 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 12:02:05 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-0c00dfb9-b6cd-4c08-a141-b529650f5323 tempest-ProjectReaderTests-96541340 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 12:02:05 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-0c00dfb9-b6cd-4c08-a141-b529650f5323 tempest-ProjectReaderTests-96541340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 12:02:05 devstack sudo[107221]: pam_unix(sudo:session): session closed for user root Nov 06 12:02:05 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-b97659c9-2d2c-4f90-a1d5-aedb489e5d27 tempest-ProjectReaderTests-377170324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-5414a8b4-18c0-4822-8b3c-85ce82b57453.info" returned: 0 in 0.301s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 12:02:05 devstack cinder-volume[87116]: WARNING cinder.volume.drivers.remotefs [None req-b97659c9-2d2c-4f90-a1d5-aedb489e5d27 tempest-ProjectReaderTests-377170324 None] /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-5414a8b4-18c0-4822-8b3c-85ce82b57453.info is being set with open permissions: ugo+rw Nov 06 12:02:05 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-b97659c9-2d2c-4f90-a1d5-aedb489e5d27 tempest-ProjectReaderTests-377170324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-5414a8b4-18c0-4822-8b3c-85ce82b57453.info {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 12:02:05 devstack sudo[107226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756 Nov 06 12:02:05 devstack sudo[107226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 12:02:05 devstack sudo[107228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-5414a8b4-18c0-4822-8b3c-85ce82b57453.info Nov 06 12:02:05 devstack sudo[107228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 12:02:05 devstack sudo[107220]: pam_unix(sudo:session): session closed for user root Nov 06 12:02:05 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-008d0593-780a-4fe9-8d26-90197f9e0f2b tempest-ProjectMemberTests-2097190340 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-fc62566c-bb4b-4536-af7b-ac1be0219eca" returned: 0 in 0.466s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 12:02:05 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-008d0593-780a-4fe9-8d26-90197f9e0f2b tempest-ProjectMemberTests-2097190340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-fc62566c-bb4b-4536-af7b-ac1be0219eca {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 12:02:05 devstack sudo[107234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-fc62566c-bb4b-4536-af7b-ac1be0219eca Nov 06 12:02:05 devstack sudo[107234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 12:02:05 devstack sudo[107226]: pam_unix(sudo:session): session closed for user root Nov 06 12:02:05 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-0c00dfb9-b6cd-4c08-a141-b529650f5323 tempest-ProjectReaderTests-96541340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756" returned: 0 in 0.266s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 12:02:05 devstack cinder-volume[87116]: DEBUG cinder.manager [None req-0c00dfb9-b6cd-4c08-a141-b529650f5323 tempest-ProjectReaderTests-96541340 None] Notifying Schedulers of capabilities ... {{(pid=87116) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 12:02:05 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-0c00dfb9-b6cd-4c08-a141-b529650f5323 tempest-ProjectReaderTests-96541340 None] Deleted volume successfully. Nov 06 12:02:05 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-0c00dfb9-b6cd-4c08-a141-b529650f5323 tempest-ProjectReaderTests-96541340 None] Lock "cinder-4f1504ab-37ce-4a7e-a40f-262a7de8b6d9-delete_volume" released by "delete_volume" :: held 1.348s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 12:02:05 devstack sudo[107228]: pam_unix(sudo:session): session closed for user root Nov 06 12:02:05 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-b97659c9-2d2c-4f90-a1d5-aedb489e5d27 tempest-ProjectReaderTests-377170324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-5414a8b4-18c0-4822-8b3c-85ce82b57453.info" returned: 0 in 0.328s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 12:02:05 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-b97659c9-2d2c-4f90-a1d5-aedb489e5d27 tempest-ProjectReaderTests-377170324 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.376s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 12:02:05 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-b97659c9-2d2c-4f90-a1d5-aedb489e5d27 tempest-ProjectReaderTests-377170324 None] Create snapshot completed successfully Nov 06 12:02:05 devstack sudo[107234]: pam_unix(sudo:session): session closed for user root Nov 06 12:02:05 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-008d0593-780a-4fe9-8d26-90197f9e0f2b tempest-ProjectMemberTests-2097190340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-fc62566c-bb4b-4536-af7b-ac1be0219eca" returned: 0 in 0.294s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 12:02:05 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-008d0593-780a-4fe9-8d26-90197f9e0f2b tempest-ProjectMemberTests-2097190340 None] Lock "cinder-quobyte-fc62566c-bb4b-4536-af7b-ac1be0219eca" released by "delete_volume" :: held 0.840s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 12:02:05 devstack cinder-volume[87116]: DEBUG cinder.quota [None req-008d0593-780a-4fe9-8d26-90197f9e0f2b tempest-ProjectMemberTests-2097190340 None] Created reservations ['2c4402ff-c1d7-46d9-b152-b7660f3e14d4', 'ab68e914-03ed-4572-a7c6-dcefa187b300', '045e7447-a21c-4b84-a1d0-f69289c6d2ac', 'ed03549b-7bd9-4bef-8ef1-7bcabdc43ef7'] {{(pid=87116) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 12:02:05 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-008d0593-780a-4fe9-8d26-90197f9e0f2b tempest-ProjectMemberTests-2097190340 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 12:02:05 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-008d0593-780a-4fe9-8d26-90197f9e0f2b tempest-ProjectMemberTests-2097190340 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 12:02:05 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-008d0593-780a-4fe9-8d26-90197f9e0f2b tempest-ProjectMemberTests-2097190340 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 12:02:05 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-008d0593-780a-4fe9-8d26-90197f9e0f2b tempest-ProjectMemberTests-2097190340 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 12:02:05 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-008d0593-780a-4fe9-8d26-90197f9e0f2b tempest-ProjectMemberTests-2097190340 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 12:02:05 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-008d0593-780a-4fe9-8d26-90197f9e0f2b tempest-ProjectMemberTests-2097190340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 12:02:05 devstack sudo[107239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756 Nov 06 12:02:05 devstack sudo[107239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 12:02:05 devstack cinder-volume[87116]: DEBUG cinder.volume.flows.manager.create_volume [None req-7d96bf61-2d57-4a1e-af9e-ff9140825fef tempest-ProjectReaderTests-96541340 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87116) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 12:02:05 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-7d96bf61-2d57-4a1e-af9e-ff9140825fef tempest-ProjectReaderTests-96541340 None] Flow 'volume_create_manager' (f2b164a6-7260-4bbf-acbb-e1b4739d3a45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 12:02:05 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-7d96bf61-2d57-4a1e-af9e-ff9140825fef tempest-ProjectReaderTests-96541340 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (514b0900-78f8-44c6-8665-a56e1b72c7d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 12:02:05 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-7d96bf61-2d57-4a1e-af9e-ff9140825fef tempest-ProjectReaderTests-96541340 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (514b0900-78f8-44c6-8665-a56e1b72c7d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T11:02:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-51391635',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5aefada6-f2fc-4b6a-bf44-052e1352acb0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d62bdaafe8274594bead62a9698c27e1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T11:02:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T11:02:06Z,use_quota=True,user_id='a4d2d4b5e6a5421f9af1c5ce03eb2789',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(34d3b144-d9b7-480a-a2e3-01e45f3d54c1),volume_type_id=34d3b144-d9b7-480a-a2e3-01e45f3d54c1)' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 12:02:05 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-7d96bf61-2d57-4a1e-af9e-ff9140825fef tempest-ProjectReaderTests-96541340 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (61667b7e-56e3-4603-b11d-33c254a749ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 12:02:05 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-7d96bf61-2d57-4a1e-af9e-ff9140825fef tempest-ProjectReaderTests-96541340 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (61667b7e-56e3-4603-b11d-33c254a749ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 12:02:05 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-7d96bf61-2d57-4a1e-af9e-ff9140825fef tempest-ProjectReaderTests-96541340 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (062acc01-1ee9-4ef3-bccf-6fe231b676a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 12:02:05 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-7d96bf61-2d57-4a1e-af9e-ff9140825fef tempest-ProjectReaderTests-96541340 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (062acc01-1ee9-4ef3-bccf-6fe231b676a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5aefada6-f2fc-4b6a-bf44-052e1352acb0', 'volume_name': 'volume-5aefada6-f2fc-4b6a-bf44-052e1352acb0', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 12:02:05 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-7d96bf61-2d57-4a1e-af9e-ff9140825fef tempest-ProjectReaderTests-96541340 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d6a39309-f034-4ae1-a925-f547d091922c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 12:02:05 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-7d96bf61-2d57-4a1e-af9e-ff9140825fef tempest-ProjectReaderTests-96541340 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d6a39309-f034-4ae1-a925-f547d091922c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 12:02:05 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-7d96bf61-2d57-4a1e-af9e-ff9140825fef tempest-ProjectReaderTests-96541340 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e2c47b1c-0371-4c7b-b632-920db96df8b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 12:02:05 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-7d96bf61-2d57-4a1e-af9e-ff9140825fef tempest-ProjectReaderTests-96541340 None] Volume 5aefada6-f2fc-4b6a-bf44-052e1352acb0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5aefada6-f2fc-4b6a-bf44-052e1352acb0', 'volume_size': 1} Nov 06 12:02:05 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-7d96bf61-2d57-4a1e-af9e-ff9140825fef tempest-ProjectReaderTests-96541340 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 12:02:05 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-7d96bf61-2d57-4a1e-af9e-ff9140825fef tempest-ProjectReaderTests-96541340 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 12:02:05 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-7d96bf61-2d57-4a1e-af9e-ff9140825fef tempest-ProjectReaderTests-96541340 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T11:02:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-51391635',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5aefada6-f2fc-4b6a-bf44-052e1352acb0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d62bdaafe8274594bead62a9698c27e1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T11:02:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T11:02:06Z,use_quota=True,user_id='a4d2d4b5e6a5421f9af1c5ce03eb2789',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(34d3b144-d9b7-480a-a2e3-01e45f3d54c1),volume_type_id=34d3b144-d9b7-480a-a2e3-01e45f3d54c1)}" {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 12:02:05 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-7d96bf61-2d57-4a1e-af9e-ff9140825fef tempest-ProjectReaderTests-96541340 None] Creating volume 5aefada6-f2fc-4b6a-bf44-052e1352acb0 {{(pid=87116) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 12:02:05 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-7d96bf61-2d57-4a1e-af9e-ff9140825fef tempest-ProjectReaderTests-96541340 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 12:02:05 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-7d96bf61-2d57-4a1e-af9e-ff9140825fef tempest-ProjectReaderTests-96541340 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 12:02:05 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-7d96bf61-2d57-4a1e-af9e-ff9140825fef tempest-ProjectReaderTests-96541340 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 12:02:05 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-7d96bf61-2d57-4a1e-af9e-ff9140825fef tempest-ProjectReaderTests-96541340 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 12:02:05 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-7d96bf61-2d57-4a1e-af9e-ff9140825fef tempest-ProjectReaderTests-96541340 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 12:02:05 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-7d96bf61-2d57-4a1e-af9e-ff9140825fef tempest-ProjectReaderTests-96541340 None] Selected osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f as target Quobyte volume. {{(pid=87116) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 12:02:05 devstack cinder-volume[87116]: INFO cinder.volume.drivers.remotefs [None req-7d96bf61-2d57-4a1e-af9e-ff9140825fef tempest-ProjectReaderTests-96541340 None] casted to osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f Nov 06 12:02:05 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-7d96bf61-2d57-4a1e-af9e-ff9140825fef tempest-ProjectReaderTests-96541340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-5aefada6-f2fc-4b6a-bf44-052e1352acb0 1073741824 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 12:02:05 devstack sudo[107241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-5aefada6-f2fc-4b6a-bf44-052e1352acb0 1073741824 Nov 06 12:02:06 devstack sudo[107241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 12:02:06 devstack sudo[107239]: pam_unix(sudo:session): session closed for user root Nov 06 12:02:06 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-008d0593-780a-4fe9-8d26-90197f9e0f2b tempest-ProjectMemberTests-2097190340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756" returned: 0 in 0.264s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 12:02:06 devstack cinder-volume[87116]: DEBUG cinder.manager [None req-008d0593-780a-4fe9-8d26-90197f9e0f2b tempest-ProjectMemberTests-2097190340 None] Notifying Schedulers of capabilities ... {{(pid=87116) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 12:02:06 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-008d0593-780a-4fe9-8d26-90197f9e0f2b tempest-ProjectMemberTests-2097190340 None] Deleted volume successfully. Nov 06 12:02:06 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-008d0593-780a-4fe9-8d26-90197f9e0f2b tempest-ProjectMemberTests-2097190340 None] Lock "cinder-fc62566c-bb4b-4536-af7b-ac1be0219eca-delete_volume" released by "delete_volume" :: held 1.341s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 12:02:06 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-d1b44f5b-aa10-465e-becb-ce4e50e4fc53 tempest-ProjectReaderTests-377170324 None] Acquiring lock "cinder-41d66502-23df-4c97-bdbd-7627d1b6ca0a-delete_snapshot" by "delete_snapshot" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 12:02:06 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-d1b44f5b-aa10-465e-becb-ce4e50e4fc53 tempest-ProjectReaderTests-377170324 None] Lock "cinder-41d66502-23df-4c97-bdbd-7627d1b6ca0a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 12:02:06 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-d1b44f5b-aa10-465e-becb-ce4e50e4fc53 tempest-ProjectReaderTests-377170324 None] Acquiring lock "cinder-quobyte-5414a8b4-18c0-4822-8b3c-85ce82b57453" by "delete_snapshot" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 12:02:06 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-d1b44f5b-aa10-465e-becb-ce4e50e4fc53 tempest-ProjectReaderTests-377170324 None] Lock "cinder-quobyte-5414a8b4-18c0-4822-8b3c-85ce82b57453" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 12:02:06 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-d1b44f5b-aa10-465e-becb-ce4e50e4fc53 tempest-ProjectReaderTests-377170324 None] Acquiring lock "cinder-quobyte-41d66502-23df-4c97-bdbd-7627d1b6ca0a" by "_delete_snapshot" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 12:02:06 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-d1b44f5b-aa10-465e-becb-ce4e50e4fc53 tempest-ProjectReaderTests-377170324 None] Lock "cinder-quobyte-41d66502-23df-4c97-bdbd-7627d1b6ca0a" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 12:02:06 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-d1b44f5b-aa10-465e-becb-ce4e50e4fc53 tempest-ProjectReaderTests-377170324 None] Deleting offline snapshot 41d66502-23df-4c97-bdbd-7627d1b6ca0a of volume 5414a8b4-18c0-4822-8b3c-85ce82b57453 {{(pid=87116) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 06 12:02:06 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-d1b44f5b-aa10-465e-becb-ce4e50e4fc53 tempest-ProjectReaderTests-377170324 None] snapshot_file for this snap is: volume-5414a8b4-18c0-4822-8b3c-85ce82b57453.41d66502-23df-4c97-bdbd-7627d1b6ca0a {{(pid=87116) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 06 12:02:06 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[15eb5c51-8370-4006-a2a4-482aa094b3cd]: (4, 'qcow2') {{(pid=88420) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 12:02:06 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-d1b44f5b-aa10-465e-becb-ce4e50e4fc53 tempest-ProjectReaderTests-377170324 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-5414a8b4-18c0-4822-8b3c-85ce82b57453.41d66502-23df-4c97-bdbd-7627d1b6ca0a {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 12:02:06 devstack cinder-volume[87116]: DEBUG cinder.volume.flows.manager.create_volume [None req-8e1b2b0d-20a2-4061-8666-98f42bd8facf tempest-ProjectMemberTests-2097190340 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87116) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 12:02:06 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-8e1b2b0d-20a2-4061-8666-98f42bd8facf tempest-ProjectMemberTests-2097190340 None] Flow 'volume_create_manager' (84e9ad7b-ce39-4ac1-9617-8584439d54fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 12:02:06 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-8e1b2b0d-20a2-4061-8666-98f42bd8facf tempest-ProjectMemberTests-2097190340 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0e850695-361a-409d-9e1b-0766d929c733) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 12:02:06 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-8e1b2b0d-20a2-4061-8666-98f42bd8facf tempest-ProjectMemberTests-2097190340 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0e850695-361a-409d-9e1b-0766d929c733) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T11:02:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-247916122',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4b98060f-e8e6-47c3-8359-436e8b31f27b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='49c53ee964024de5ae12252eba82ea98',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T11:02:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T11:02:06Z,use_quota=True,user_id='eec80b5d986049c1b9691925283475b7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(34d3b144-d9b7-480a-a2e3-01e45f3d54c1),volume_type_id=34d3b144-d9b7-480a-a2e3-01e45f3d54c1)' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 12:02:06 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-8e1b2b0d-20a2-4061-8666-98f42bd8facf tempest-ProjectMemberTests-2097190340 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eafa815e-5e2b-4280-975c-9172b5ce80b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 12:02:06 devstack sudo[107241]: pam_unix(sudo:session): session closed for user root Nov 06 12:02:06 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-8e1b2b0d-20a2-4061-8666-98f42bd8facf tempest-ProjectMemberTests-2097190340 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eafa815e-5e2b-4280-975c-9172b5ce80b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 12:02:06 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-8e1b2b0d-20a2-4061-8666-98f42bd8facf tempest-ProjectMemberTests-2097190340 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (83c7146b-acda-49dc-88b5-2fcb542ea336) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 12:02:06 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-8e1b2b0d-20a2-4061-8666-98f42bd8facf tempest-ProjectMemberTests-2097190340 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (83c7146b-acda-49dc-88b5-2fcb542ea336) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4b98060f-e8e6-47c3-8359-436e8b31f27b', 'volume_name': 'volume-4b98060f-e8e6-47c3-8359-436e8b31f27b', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 12:02:06 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-8e1b2b0d-20a2-4061-8666-98f42bd8facf tempest-ProjectMemberTests-2097190340 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5daef455-0b67-4e1a-9d52-b8d00d5fbe72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 12:02:06 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-8e1b2b0d-20a2-4061-8666-98f42bd8facf tempest-ProjectMemberTests-2097190340 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5daef455-0b67-4e1a-9d52-b8d00d5fbe72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 12:02:06 devstack sudo[107247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-5414a8b4-18c0-4822-8b3c-85ce82b57453.41d66502-23df-4c97-bdbd-7627d1b6ca0a Nov 06 12:02:06 devstack sudo[107247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 12:02:06 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-8e1b2b0d-20a2-4061-8666-98f42bd8facf tempest-ProjectMemberTests-2097190340 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9315bd12-b12b-4b0a-bba3-d4e1307c55e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 12:02:06 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-8e1b2b0d-20a2-4061-8666-98f42bd8facf tempest-ProjectMemberTests-2097190340 None] Volume 4b98060f-e8e6-47c3-8359-436e8b31f27b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4b98060f-e8e6-47c3-8359-436e8b31f27b', 'volume_size': 1} Nov 06 12:02:06 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-8e1b2b0d-20a2-4061-8666-98f42bd8facf tempest-ProjectMemberTests-2097190340 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 12:02:06 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-7d96bf61-2d57-4a1e-af9e-ff9140825fef tempest-ProjectReaderTests-96541340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-5aefada6-f2fc-4b6a-bf44-052e1352acb0 1073741824" returned: 0 in 0.644s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 12:02:06 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-7d96bf61-2d57-4a1e-af9e-ff9140825fef tempest-ProjectReaderTests-96541340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-5aefada6-f2fc-4b6a-bf44-052e1352acb0 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 12:02:06 devstack sudo[107249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-5aefada6-f2fc-4b6a-bf44-052e1352acb0 Nov 06 12:02:06 devstack sudo[107249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 12:02:06 devstack sudo[107247]: pam_unix(sudo:session): session closed for user root Nov 06 12:02:06 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-d1b44f5b-aa10-465e-becb-ce4e50e4fc53 tempest-ProjectReaderTests-377170324 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-5414a8b4-18c0-4822-8b3c-85ce82b57453.41d66502-23df-4c97-bdbd-7627d1b6ca0a" returned: 0 in 0.418s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 12:02:06 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-d1b44f5b-aa10-465e-becb-ce4e50e4fc53 tempest-ProjectReaderTests-377170324 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5414a8b4-18c0-4822-8b3c-85ce82b57453(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87116) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 12:02:06 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb010063-61dd-4d64-a17a-20df7d4e9010]: (4, 'qcow2') {{(pid=88420) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 12:02:06 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-d1b44f5b-aa10-465e-becb-ce4e50e4fc53 tempest-ProjectReaderTests-377170324 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-5414a8b4-18c0-4822-8b3c-85ce82b57453 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 12:02:06 devstack sudo[107249]: pam_unix(sudo:session): session closed for user root Nov 06 12:02:06 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-7d96bf61-2d57-4a1e-af9e-ff9140825fef tempest-ProjectReaderTests-96541340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-5aefada6-f2fc-4b6a-bf44-052e1352acb0" returned: 0 in 0.293s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 12:02:06 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-7d96bf61-2d57-4a1e-af9e-ff9140825fef tempest-ProjectReaderTests-96541340 None] <== create_volume: return (987ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f'} {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 12:02:06 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-7d96bf61-2d57-4a1e-af9e-ff9140825fef tempest-ProjectReaderTests-96541340 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.990s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 12:02:06 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-8e1b2b0d-20a2-4061-8666-98f42bd8facf tempest-ProjectMemberTests-2097190340 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.340s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 12:02:06 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-8e1b2b0d-20a2-4061-8666-98f42bd8facf tempest-ProjectMemberTests-2097190340 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T11:02:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-247916122',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4b98060f-e8e6-47c3-8359-436e8b31f27b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='49c53ee964024de5ae12252eba82ea98',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T11:02:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T11:02:06Z,use_quota=True,user_id='eec80b5d986049c1b9691925283475b7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(34d3b144-d9b7-480a-a2e3-01e45f3d54c1),volume_type_id=34d3b144-d9b7-480a-a2e3-01e45f3d54c1)}" {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 12:02:06 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-8e1b2b0d-20a2-4061-8666-98f42bd8facf tempest-ProjectMemberTests-2097190340 None] Creating volume 4b98060f-e8e6-47c3-8359-436e8b31f27b {{(pid=87116) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 12:02:06 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-8e1b2b0d-20a2-4061-8666-98f42bd8facf tempest-ProjectMemberTests-2097190340 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 12:02:06 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-8e1b2b0d-20a2-4061-8666-98f42bd8facf tempest-ProjectMemberTests-2097190340 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 12:02:06 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-8e1b2b0d-20a2-4061-8666-98f42bd8facf tempest-ProjectMemberTests-2097190340 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 12:02:06 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-8e1b2b0d-20a2-4061-8666-98f42bd8facf tempest-ProjectMemberTests-2097190340 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 12:02:06 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-8e1b2b0d-20a2-4061-8666-98f42bd8facf tempest-ProjectMemberTests-2097190340 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 12:02:06 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-8e1b2b0d-20a2-4061-8666-98f42bd8facf tempest-ProjectMemberTests-2097190340 None] Selected osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f as target Quobyte volume. {{(pid=87116) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 12:02:06 devstack cinder-volume[87116]: INFO cinder.volume.drivers.remotefs [None req-8e1b2b0d-20a2-4061-8666-98f42bd8facf tempest-ProjectMemberTests-2097190340 None] casted to osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f Nov 06 12:02:06 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-8e1b2b0d-20a2-4061-8666-98f42bd8facf tempest-ProjectMemberTests-2097190340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-4b98060f-e8e6-47c3-8359-436e8b31f27b 1073741824 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 12:02:06 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-7d96bf61-2d57-4a1e-af9e-ff9140825fef tempest-ProjectReaderTests-96541340 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e2c47b1c-0371-4c7b-b632-920db96df8b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5aefada6-f2fc-4b6a-bf44-052e1352acb0', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 12:02:06 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-7d96bf61-2d57-4a1e-af9e-ff9140825fef tempest-ProjectReaderTests-96541340 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (796ca0ca-b0ce-4254-a476-8a8a9bb05b6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 12:02:06 devstack sudo[107256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-4b98060f-e8e6-47c3-8359-436e8b31f27b 1073741824 Nov 06 12:02:06 devstack sudo[107256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 12:02:07 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-7d96bf61-2d57-4a1e-af9e-ff9140825fef tempest-ProjectReaderTests-96541340 None] Volume volume-5aefada6-f2fc-4b6a-bf44-052e1352acb0 (5aefada6-f2fc-4b6a-bf44-052e1352acb0): created successfully Nov 06 12:02:07 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-7d96bf61-2d57-4a1e-af9e-ff9140825fef tempest-ProjectReaderTests-96541340 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (796ca0ca-b0ce-4254-a476-8a8a9bb05b6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 12:02:07 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-7d96bf61-2d57-4a1e-af9e-ff9140825fef tempest-ProjectReaderTests-96541340 None] Flow 'volume_create_manager' (f2b164a6-7260-4bbf-acbb-e1b4739d3a45) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 12:02:07 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-7d96bf61-2d57-4a1e-af9e-ff9140825fef tempest-ProjectReaderTests-96541340 None] Created volume successfully. Nov 06 12:02:07 devstack sudo[107255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-5414a8b4-18c0-4822-8b3c-85ce82b57453 Nov 06 12:02:07 devstack sudo[107255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 12:02:07 devstack sudo[107255]: pam_unix(sudo:session): session closed for user root Nov 06 12:02:07 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-d1b44f5b-aa10-465e-becb-ce4e50e4fc53 tempest-ProjectReaderTests-377170324 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-5414a8b4-18c0-4822-8b3c-85ce82b57453" returned: 0 in 0.453s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 12:02:07 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-d1b44f5b-aa10-465e-becb-ce4e50e4fc53 tempest-ProjectReaderTests-377170324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-5414a8b4-18c0-4822-8b3c-85ce82b57453.41d66502-23df-4c97-bdbd-7627d1b6ca0a {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 12:02:07 devstack sudo[107266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-5414a8b4-18c0-4822-8b3c-85ce82b57453.41d66502-23df-4c97-bdbd-7627d1b6ca0a Nov 06 12:02:07 devstack sudo[107266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 12:02:07 devstack sudo[107256]: pam_unix(sudo:session): session closed for user root Nov 06 12:02:07 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-8e1b2b0d-20a2-4061-8666-98f42bd8facf tempest-ProjectMemberTests-2097190340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-4b98060f-e8e6-47c3-8359-436e8b31f27b 1073741824" returned: 0 in 0.531s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 12:02:07 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-8e1b2b0d-20a2-4061-8666-98f42bd8facf tempest-ProjectMemberTests-2097190340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-4b98060f-e8e6-47c3-8359-436e8b31f27b {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 12:02:07 devstack sudo[107268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-4b98060f-e8e6-47c3-8359-436e8b31f27b Nov 06 12:02:07 devstack sudo[107268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 12:02:07 devstack sudo[107266]: pam_unix(sudo:session): session closed for user root Nov 06 12:02:07 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-d1b44f5b-aa10-465e-becb-ce4e50e4fc53 tempest-ProjectReaderTests-377170324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-5414a8b4-18c0-4822-8b3c-85ce82b57453.41d66502-23df-4c97-bdbd-7627d1b6ca0a" returned: 0 in 0.378s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 12:02:07 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-d1b44f5b-aa10-465e-becb-ce4e50e4fc53 tempest-ProjectReaderTests-377170324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-5414a8b4-18c0-4822-8b3c-85ce82b57453.41d66502-23df-4c97-bdbd-7627d1b6ca0a {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 12:02:07 devstack sudo[107274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-5414a8b4-18c0-4822-8b3c-85ce82b57453.41d66502-23df-4c97-bdbd-7627d1b6ca0a Nov 06 12:02:07 devstack sudo[107274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 12:02:07 devstack sudo[107268]: pam_unix(sudo:session): session closed for user root Nov 06 12:02:07 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-8e1b2b0d-20a2-4061-8666-98f42bd8facf tempest-ProjectMemberTests-2097190340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-4b98060f-e8e6-47c3-8359-436e8b31f27b" returned: 0 in 0.297s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 12:02:07 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-8e1b2b0d-20a2-4061-8666-98f42bd8facf tempest-ProjectMemberTests-2097190340 None] <== create_volume: return (877ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f'} {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 12:02:07 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-8e1b2b0d-20a2-4061-8666-98f42bd8facf tempest-ProjectMemberTests-2097190340 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.880s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 12:02:07 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-8e1b2b0d-20a2-4061-8666-98f42bd8facf tempest-ProjectMemberTests-2097190340 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9315bd12-b12b-4b0a-bba3-d4e1307c55e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4b98060f-e8e6-47c3-8359-436e8b31f27b', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 12:02:07 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-8e1b2b0d-20a2-4061-8666-98f42bd8facf tempest-ProjectMemberTests-2097190340 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3eeb12c3-9574-44dc-9545-09bba8c8666f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 12:02:07 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-8e1b2b0d-20a2-4061-8666-98f42bd8facf tempest-ProjectMemberTests-2097190340 None] Volume volume-4b98060f-e8e6-47c3-8359-436e8b31f27b (4b98060f-e8e6-47c3-8359-436e8b31f27b): created successfully Nov 06 12:02:07 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-8e1b2b0d-20a2-4061-8666-98f42bd8facf tempest-ProjectMemberTests-2097190340 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3eeb12c3-9574-44dc-9545-09bba8c8666f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 12:02:07 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-8e1b2b0d-20a2-4061-8666-98f42bd8facf tempest-ProjectMemberTests-2097190340 None] Flow 'volume_create_manager' (84e9ad7b-ce39-4ac1-9617-8584439d54fb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 12:02:07 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-8e1b2b0d-20a2-4061-8666-98f42bd8facf tempest-ProjectMemberTests-2097190340 None] Created volume successfully. Nov 06 12:02:07 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-0ee1f03b-d4e3-4d76-8b5f-304fcaf7a476 tempest-ProjectReaderTests-96541340 None] Acquiring lock "cinder-5aefada6-f2fc-4b6a-bf44-052e1352acb0-delete_volume" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 12:02:07 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-0ee1f03b-d4e3-4d76-8b5f-304fcaf7a476 tempest-ProjectReaderTests-96541340 None] Lock "cinder-5aefada6-f2fc-4b6a-bf44-052e1352acb0-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 12:02:08 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-0ee1f03b-d4e3-4d76-8b5f-304fcaf7a476 tempest-ProjectReaderTests-96541340 None] Acquiring lock "cinder-quobyte-5aefada6-f2fc-4b6a-bf44-052e1352acb0" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 12:02:08 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-0ee1f03b-d4e3-4d76-8b5f-304fcaf7a476 tempest-ProjectReaderTests-96541340 None] Lock "cinder-quobyte-5aefada6-f2fc-4b6a-bf44-052e1352acb0" acquired by "delete_volume" :: waited 0.017s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 12:02:08 devstack sudo[107274]: pam_unix(sudo:session): session closed for user root Nov 06 12:02:08 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-d1b44f5b-aa10-465e-becb-ce4e50e4fc53 tempest-ProjectReaderTests-377170324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-5414a8b4-18c0-4822-8b3c-85ce82b57453.41d66502-23df-4c97-bdbd-7627d1b6ca0a" returned: 0 in 0.308s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 12:02:08 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[b40b4d31-69ab-4893-893c-03ec8a53ce5b]: (4, 'qcow2') {{(pid=88420) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 12:02:08 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-0ee1f03b-d4e3-4d76-8b5f-304fcaf7a476 tempest-ProjectReaderTests-96541340 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-5aefada6-f2fc-4b6a-bf44-052e1352acb0 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 12:02:08 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-d1b44f5b-aa10-465e-becb-ce4e50e4fc53 tempest-ProjectReaderTests-377170324 None] Lock "cinder-quobyte-41d66502-23df-4c97-bdbd-7627d1b6ca0a" released by "_delete_snapshot" :: held 1.702s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 12:02:08 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-d1b44f5b-aa10-465e-becb-ce4e50e4fc53 tempest-ProjectReaderTests-377170324 None] Lock "cinder-quobyte-5414a8b4-18c0-4822-8b3c-85ce82b57453" released by "delete_snapshot" :: held 1.735s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 12:02:08 devstack cinder-volume[87116]: DEBUG cinder.quota [None req-d1b44f5b-aa10-465e-becb-ce4e50e4fc53 tempest-ProjectReaderTests-377170324 None] Created reservations ['99112d07-729f-4c4b-a00f-a9a30ac02819', '367b3767-cacb-43ad-8cee-2ce43c1375ad', 'a7a69ee4-ebd1-4b69-978b-9c59fc29bf3d', 'db15f77b-2c86-4dd7-9fc9-4036bccc9ef8'] {{(pid=87116) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 12:02:08 devstack sudo[107277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-5aefada6-f2fc-4b6a-bf44-052e1352acb0 Nov 06 12:02:08 devstack sudo[107277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 12:02:08 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-d1b44f5b-aa10-465e-becb-ce4e50e4fc53 tempest-ProjectReaderTests-377170324 None] Delete snapshot completed successfully. Nov 06 12:02:08 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-d1b44f5b-aa10-465e-becb-ce4e50e4fc53 tempest-ProjectReaderTests-377170324 None] Lock "cinder-41d66502-23df-4c97-bdbd-7627d1b6ca0a-delete_snapshot" released by "delete_snapshot" :: held 1.896s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 12:02:08 devstack sudo[107277]: pam_unix(sudo:session): session closed for user root Nov 06 12:02:08 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-0ee1f03b-d4e3-4d76-8b5f-304fcaf7a476 tempest-ProjectReaderTests-96541340 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-5aefada6-f2fc-4b6a-bf44-052e1352acb0" returned: 0 in 0.425s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 12:02:08 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-0ee1f03b-d4e3-4d76-8b5f-304fcaf7a476 tempest-ProjectReaderTests-96541340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-5aefada6-f2fc-4b6a-bf44-052e1352acb0 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 12:02:08 devstack sudo[107282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-5aefada6-f2fc-4b6a-bf44-052e1352acb0 Nov 06 12:02:08 devstack sudo[107282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 12:02:08 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-df2b02a1-5a82-4ff5-b156-bf6cc08d3616 tempest-ProjectReaderTests-377170324 None] Acquiring lock "cinder-5414a8b4-18c0-4822-8b3c-85ce82b57453-delete_volume" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 12:02:08 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-df2b02a1-5a82-4ff5-b156-bf6cc08d3616 tempest-ProjectReaderTests-377170324 None] Lock "cinder-5414a8b4-18c0-4822-8b3c-85ce82b57453-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 12:02:08 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-df2b02a1-5a82-4ff5-b156-bf6cc08d3616 tempest-ProjectReaderTests-377170324 None] Acquiring lock "cinder-quobyte-5414a8b4-18c0-4822-8b3c-85ce82b57453" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 12:02:08 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-df2b02a1-5a82-4ff5-b156-bf6cc08d3616 tempest-ProjectReaderTests-377170324 None] Lock "cinder-quobyte-5414a8b4-18c0-4822-8b3c-85ce82b57453" acquired by "delete_volume" :: waited 0.025s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 12:02:08 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[91ec8f79-8058-4ff3-9bdb-bdd2cd4e863c]: (4, 'qcow2') {{(pid=88420) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 12:02:08 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-df2b02a1-5a82-4ff5-b156-bf6cc08d3616 tempest-ProjectReaderTests-377170324 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-5414a8b4-18c0-4822-8b3c-85ce82b57453 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 12:02:08 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-4a520391-a5fa-40ba-ac72-79e7abfd19a0 tempest-ProjectMemberTests-2097190340 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 12:02:08 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-4a520391-a5fa-40ba-ac72-79e7abfd19a0 tempest-ProjectMemberTests-2097190340 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 12:02:08 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-4a520391-a5fa-40ba-ac72-79e7abfd19a0 tempest-ProjectMemberTests-2097190340 None] Creating offline snapshot cbbe4a1c-ae9a-4fc0-8601-32c2ec061168 of volume 4b98060f-e8e6-47c3-8359-436e8b31f27b {{(pid=87116) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 06 12:02:08 devstack sudo[107284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-5414a8b4-18c0-4822-8b3c-85ce82b57453 Nov 06 12:02:08 devstack sudo[107284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 12:02:08 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[44190d25-ec9e-401b-bac2-df3a1650b020]: (4, 'qcow2') {{(pid=88420) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 12:02:08 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-4a520391-a5fa-40ba-ac72-79e7abfd19a0 tempest-ProjectMemberTests-2097190340 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-4b98060f-e8e6-47c3-8359-436e8b31f27b {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 12:02:08 devstack sudo[107282]: pam_unix(sudo:session): session closed for user root Nov 06 12:02:08 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-0ee1f03b-d4e3-4d76-8b5f-304fcaf7a476 tempest-ProjectReaderTests-96541340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-5aefada6-f2fc-4b6a-bf44-052e1352acb0" returned: 0 in 0.389s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 12:02:08 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-0ee1f03b-d4e3-4d76-8b5f-304fcaf7a476 tempest-ProjectReaderTests-96541340 None] Lock "cinder-quobyte-5aefada6-f2fc-4b6a-bf44-052e1352acb0" released by "delete_volume" :: held 0.882s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 12:02:08 devstack cinder-volume[87116]: DEBUG cinder.quota [None req-0ee1f03b-d4e3-4d76-8b5f-304fcaf7a476 tempest-ProjectReaderTests-96541340 None] Created reservations ['82059663-14d9-4089-ac18-ace341ab085f', 'e08ad730-6878-4456-a3cc-df978bf8886a', '4eb554e8-928d-49ab-97bc-4eabbab782b7', '71fa921d-6aab-4acc-b831-126448b788f5'] {{(pid=87116) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 12:02:09 devstack sudo[107287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-4b98060f-e8e6-47c3-8359-436e8b31f27b Nov 06 12:02:09 devstack sudo[107287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 12:02:09 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-0ee1f03b-d4e3-4d76-8b5f-304fcaf7a476 tempest-ProjectReaderTests-96541340 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 12:02:09 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-0ee1f03b-d4e3-4d76-8b5f-304fcaf7a476 tempest-ProjectReaderTests-96541340 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 12:02:09 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-0ee1f03b-d4e3-4d76-8b5f-304fcaf7a476 tempest-ProjectReaderTests-96541340 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 12:02:09 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-0ee1f03b-d4e3-4d76-8b5f-304fcaf7a476 tempest-ProjectReaderTests-96541340 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 12:02:09 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-0ee1f03b-d4e3-4d76-8b5f-304fcaf7a476 tempest-ProjectReaderTests-96541340 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 12:02:09 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-0ee1f03b-d4e3-4d76-8b5f-304fcaf7a476 tempest-ProjectReaderTests-96541340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 12:02:09 devstack sudo[107290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756 Nov 06 12:02:09 devstack sudo[107290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 12:02:09 devstack sudo[107284]: pam_unix(sudo:session): session closed for user root Nov 06 12:02:09 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-df2b02a1-5a82-4ff5-b156-bf6cc08d3616 tempest-ProjectReaderTests-377170324 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-5414a8b4-18c0-4822-8b3c-85ce82b57453" returned: 0 in 0.481s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 12:02:09 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-df2b02a1-5a82-4ff5-b156-bf6cc08d3616 tempest-ProjectReaderTests-377170324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-5414a8b4-18c0-4822-8b3c-85ce82b57453 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 12:02:09 devstack sudo[107294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-5414a8b4-18c0-4822-8b3c-85ce82b57453 Nov 06 12:02:09 devstack sudo[107294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 12:02:09 devstack sudo[107287]: pam_unix(sudo:session): session closed for user root Nov 06 12:02:09 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-4a520391-a5fa-40ba-ac72-79e7abfd19a0 tempest-ProjectMemberTests-2097190340 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-4b98060f-e8e6-47c3-8359-436e8b31f27b" returned: 0 in 0.497s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 12:02:09 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-4a520391-a5fa-40ba-ac72-79e7abfd19a0 tempest-ProjectMemberTests-2097190340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-4b98060f-e8e6-47c3-8359-436e8b31f27b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-4b98060f-e8e6-47c3-8359-436e8b31f27b.cbbe4a1c-ae9a-4fc0-8601-32c2ec061168 1G {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 12:02:09 devstack sudo[107290]: pam_unix(sudo:session): session closed for user root Nov 06 12:02:09 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-0ee1f03b-d4e3-4d76-8b5f-304fcaf7a476 tempest-ProjectReaderTests-96541340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756" returned: 0 in 0.339s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 12:02:09 devstack cinder-volume[87116]: DEBUG cinder.manager [None req-0ee1f03b-d4e3-4d76-8b5f-304fcaf7a476 tempest-ProjectReaderTests-96541340 None] Notifying Schedulers of capabilities ... {{(pid=87116) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 12:02:09 devstack sudo[107300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-4b98060f-e8e6-47c3-8359-436e8b31f27b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-4b98060f-e8e6-47c3-8359-436e8b31f27b.cbbe4a1c-ae9a-4fc0-8601-32c2ec061168 1G Nov 06 12:02:09 devstack sudo[107300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 12:02:09 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-0ee1f03b-d4e3-4d76-8b5f-304fcaf7a476 tempest-ProjectReaderTests-96541340 None] Deleted volume successfully. Nov 06 12:02:09 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-0ee1f03b-d4e3-4d76-8b5f-304fcaf7a476 tempest-ProjectReaderTests-96541340 None] Lock "cinder-5aefada6-f2fc-4b6a-bf44-052e1352acb0-delete_volume" released by "delete_volume" :: held 1.482s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 12:02:09 devstack sudo[107294]: pam_unix(sudo:session): session closed for user root Nov 06 12:02:09 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-df2b02a1-5a82-4ff5-b156-bf6cc08d3616 tempest-ProjectReaderTests-377170324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-5414a8b4-18c0-4822-8b3c-85ce82b57453" returned: 0 in 0.315s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 12:02:09 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-df2b02a1-5a82-4ff5-b156-bf6cc08d3616 tempest-ProjectReaderTests-377170324 None] Lock "cinder-quobyte-5414a8b4-18c0-4822-8b3c-85ce82b57453" released by "delete_volume" :: held 0.876s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 12:02:09 devstack cinder-volume[87116]: DEBUG cinder.quota [None req-df2b02a1-5a82-4ff5-b156-bf6cc08d3616 tempest-ProjectReaderTests-377170324 None] Created reservations ['97fe5daa-905b-4def-aa63-1a59a0a3ca09', '41d4e687-52b7-4d01-a6a4-a1a5591fdf9d', '17757aa5-fa60-4e04-b22b-30eea450cec5', '15db9dc3-f3aa-42d6-aba1-60c8df82c3e7'] {{(pid=87116) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 12:02:09 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-df2b02a1-5a82-4ff5-b156-bf6cc08d3616 tempest-ProjectReaderTests-377170324 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 12:02:09 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-df2b02a1-5a82-4ff5-b156-bf6cc08d3616 tempest-ProjectReaderTests-377170324 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 12:02:09 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-df2b02a1-5a82-4ff5-b156-bf6cc08d3616 tempest-ProjectReaderTests-377170324 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 12:02:09 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-df2b02a1-5a82-4ff5-b156-bf6cc08d3616 tempest-ProjectReaderTests-377170324 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 12:02:09 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-df2b02a1-5a82-4ff5-b156-bf6cc08d3616 tempest-ProjectReaderTests-377170324 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 12:02:09 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-df2b02a1-5a82-4ff5-b156-bf6cc08d3616 tempest-ProjectReaderTests-377170324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 12:02:09 devstack sudo[107305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756 Nov 06 12:02:09 devstack sudo[107305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 12:02:09 devstack sudo[107300]: pam_unix(sudo:session): session closed for user root Nov 06 12:02:10 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-4a520391-a5fa-40ba-ac72-79e7abfd19a0 tempest-ProjectMemberTests-2097190340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-4b98060f-e8e6-47c3-8359-436e8b31f27b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-4b98060f-e8e6-47c3-8359-436e8b31f27b.cbbe4a1c-ae9a-4fc0-8601-32c2ec061168 1G" returned: 0 in 0.613s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 12:02:10 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-4a520391-a5fa-40ba-ac72-79e7abfd19a0 tempest-ProjectMemberTests-2097190340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4b98060f-e8e6-47c3-8359-436e8b31f27b -F qcow2 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-4b98060f-e8e6-47c3-8359-436e8b31f27b.cbbe4a1c-ae9a-4fc0-8601-32c2ec061168 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 12:02:10 devstack sudo[107310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4b98060f-e8e6-47c3-8359-436e8b31f27b -F qcow2 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-4b98060f-e8e6-47c3-8359-436e8b31f27b.cbbe4a1c-ae9a-4fc0-8601-32c2ec061168 Nov 06 12:02:10 devstack sudo[107310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 12:02:10 devstack sudo[107305]: pam_unix(sudo:session): session closed for user root Nov 06 12:02:10 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-df2b02a1-5a82-4ff5-b156-bf6cc08d3616 tempest-ProjectReaderTests-377170324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756" returned: 0 in 0.390s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 12:02:10 devstack cinder-volume[87116]: DEBUG cinder.manager [None req-df2b02a1-5a82-4ff5-b156-bf6cc08d3616 tempest-ProjectReaderTests-377170324 None] Notifying Schedulers of capabilities ... {{(pid=87116) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 12:02:10 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-df2b02a1-5a82-4ff5-b156-bf6cc08d3616 tempest-ProjectReaderTests-377170324 None] Deleted volume successfully. Nov 06 12:02:10 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-df2b02a1-5a82-4ff5-b156-bf6cc08d3616 tempest-ProjectReaderTests-377170324 None] Lock "cinder-5414a8b4-18c0-4822-8b3c-85ce82b57453-delete_volume" released by "delete_volume" :: held 1.568s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 12:02:10 devstack cinder-volume[87116]: DEBUG cinder.volume.flows.manager.create_volume [None req-361b9813-9eb4-45b2-a661-946057b16712 tempest-ProjectReaderTests-377170324 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87116) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 12:02:10 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-361b9813-9eb4-45b2-a661-946057b16712 tempest-ProjectReaderTests-377170324 None] Flow 'volume_create_manager' (9e9be0c1-e80a-49e5-9578-5a1bd3ee4fd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 12:02:10 devstack sudo[107310]: pam_unix(sudo:session): session closed for user root Nov 06 12:02:10 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-361b9813-9eb4-45b2-a661-946057b16712 tempest-ProjectReaderTests-377170324 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0374a1ec-93ac-4fdd-869a-f8bbd4847884) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 12:02:10 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-4a520391-a5fa-40ba-ac72-79e7abfd19a0 tempest-ProjectMemberTests-2097190340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4b98060f-e8e6-47c3-8359-436e8b31f27b -F qcow2 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-4b98060f-e8e6-47c3-8359-436e8b31f27b.cbbe4a1c-ae9a-4fc0-8601-32c2ec061168" returned: 0 in 0.422s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 12:02:10 devstack cinder-volume[87116]: WARNING cinder.volume.drivers.remotefs [None req-4a520391-a5fa-40ba-ac72-79e7abfd19a0 tempest-ProjectMemberTests-2097190340 None] /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-4b98060f-e8e6-47c3-8359-436e8b31f27b.cbbe4a1c-ae9a-4fc0-8601-32c2ec061168 is being set with open permissions: ugo+rw Nov 06 12:02:10 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-4a520391-a5fa-40ba-ac72-79e7abfd19a0 tempest-ProjectMemberTests-2097190340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-4b98060f-e8e6-47c3-8359-436e8b31f27b.cbbe4a1c-ae9a-4fc0-8601-32c2ec061168 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 12:02:10 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-361b9813-9eb4-45b2-a661-946057b16712 tempest-ProjectReaderTests-377170324 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0374a1ec-93ac-4fdd-869a-f8bbd4847884) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T11:02:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1816714815',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ba1a2916-c4bb-4016-8167-674ae0700eed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='865d378d37cd42ed98432cd1ce1e41be',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T11:02:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T11:02:10Z,use_quota=True,user_id='8acc7287c82b436186731f24c32b21ce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(34d3b144-d9b7-480a-a2e3-01e45f3d54c1),volume_type_id=34d3b144-d9b7-480a-a2e3-01e45f3d54c1)' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 12:02:10 devstack sudo[107315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-4b98060f-e8e6-47c3-8359-436e8b31f27b.cbbe4a1c-ae9a-4fc0-8601-32c2ec061168 Nov 06 12:02:10 devstack sudo[107315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 12:02:10 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-361b9813-9eb4-45b2-a661-946057b16712 tempest-ProjectReaderTests-377170324 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (586f4a2b-c17f-40c7-8f44-54455517f872) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 12:02:10 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-361b9813-9eb4-45b2-a661-946057b16712 tempest-ProjectReaderTests-377170324 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (586f4a2b-c17f-40c7-8f44-54455517f872) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 12:02:10 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-361b9813-9eb4-45b2-a661-946057b16712 tempest-ProjectReaderTests-377170324 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7846b274-4351-49b8-a043-07369dd1f7c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 12:02:10 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-361b9813-9eb4-45b2-a661-946057b16712 tempest-ProjectReaderTests-377170324 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7846b274-4351-49b8-a043-07369dd1f7c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ba1a2916-c4bb-4016-8167-674ae0700eed', 'volume_name': 'volume-ba1a2916-c4bb-4016-8167-674ae0700eed', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 12:02:10 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-361b9813-9eb4-45b2-a661-946057b16712 tempest-ProjectReaderTests-377170324 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (434efef0-139a-43fa-b682-7567e375f7ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 12:02:10 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-361b9813-9eb4-45b2-a661-946057b16712 tempest-ProjectReaderTests-377170324 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (434efef0-139a-43fa-b682-7567e375f7ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 12:02:10 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-361b9813-9eb4-45b2-a661-946057b16712 tempest-ProjectReaderTests-377170324 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f987f4cc-8c92-4180-9a6d-65d98d75e498) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 12:02:10 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-361b9813-9eb4-45b2-a661-946057b16712 tempest-ProjectReaderTests-377170324 None] Volume ba1a2916-c4bb-4016-8167-674ae0700eed: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ba1a2916-c4bb-4016-8167-674ae0700eed', 'volume_size': 1} Nov 06 12:02:10 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-361b9813-9eb4-45b2-a661-946057b16712 tempest-ProjectReaderTests-377170324 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 12:02:10 devstack sudo[107315]: pam_unix(sudo:session): session closed for user root Nov 06 12:02:10 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-4a520391-a5fa-40ba-ac72-79e7abfd19a0 tempest-ProjectMemberTests-2097190340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-4b98060f-e8e6-47c3-8359-436e8b31f27b.cbbe4a1c-ae9a-4fc0-8601-32c2ec061168" returned: 0 in 0.295s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 12:02:10 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-4a520391-a5fa-40ba-ac72-79e7abfd19a0 tempest-ProjectMemberTests-2097190340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-4b98060f-e8e6-47c3-8359-436e8b31f27b.info {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 12:02:10 devstack sudo[107318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-4b98060f-e8e6-47c3-8359-436e8b31f27b.info Nov 06 12:02:10 devstack sudo[107318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 12:02:11 devstack sudo[107318]: pam_unix(sudo:session): session closed for user root Nov 06 12:02:11 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-4a520391-a5fa-40ba-ac72-79e7abfd19a0 tempest-ProjectMemberTests-2097190340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-4b98060f-e8e6-47c3-8359-436e8b31f27b.info" returned: 0 in 0.322s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 12:02:11 devstack cinder-volume[87116]: WARNING cinder.volume.drivers.remotefs [None req-4a520391-a5fa-40ba-ac72-79e7abfd19a0 tempest-ProjectMemberTests-2097190340 None] /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-4b98060f-e8e6-47c3-8359-436e8b31f27b.info is being set with open permissions: ugo+rw Nov 06 12:02:11 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-4a520391-a5fa-40ba-ac72-79e7abfd19a0 tempest-ProjectMemberTests-2097190340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-4b98060f-e8e6-47c3-8359-436e8b31f27b.info {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 12:02:11 devstack sudo[107321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-4b98060f-e8e6-47c3-8359-436e8b31f27b.info Nov 06 12:02:11 devstack sudo[107321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 12:02:11 devstack sudo[107321]: pam_unix(sudo:session): session closed for user root Nov 06 12:02:11 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-4a520391-a5fa-40ba-ac72-79e7abfd19a0 tempest-ProjectMemberTests-2097190340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-4b98060f-e8e6-47c3-8359-436e8b31f27b.info" returned: 0 in 0.293s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 12:02:11 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-4a520391-a5fa-40ba-ac72-79e7abfd19a0 tempest-ProjectMemberTests-2097190340 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.552s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 12:02:11 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-361b9813-9eb4-45b2-a661-946057b16712 tempest-ProjectReaderTests-377170324 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.883s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 12:02:11 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-361b9813-9eb4-45b2-a661-946057b16712 tempest-ProjectReaderTests-377170324 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T11:02:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1816714815',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ba1a2916-c4bb-4016-8167-674ae0700eed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='865d378d37cd42ed98432cd1ce1e41be',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T11:02:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T11:02:10Z,use_quota=True,user_id='8acc7287c82b436186731f24c32b21ce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(34d3b144-d9b7-480a-a2e3-01e45f3d54c1),volume_type_id=34d3b144-d9b7-480a-a2e3-01e45f3d54c1)}" {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 12:02:11 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-361b9813-9eb4-45b2-a661-946057b16712 tempest-ProjectReaderTests-377170324 None] Creating volume ba1a2916-c4bb-4016-8167-674ae0700eed {{(pid=87116) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 12:02:11 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-361b9813-9eb4-45b2-a661-946057b16712 tempest-ProjectReaderTests-377170324 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 12:02:11 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-361b9813-9eb4-45b2-a661-946057b16712 tempest-ProjectReaderTests-377170324 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 12:02:11 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-361b9813-9eb4-45b2-a661-946057b16712 tempest-ProjectReaderTests-377170324 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 12:02:11 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-361b9813-9eb4-45b2-a661-946057b16712 tempest-ProjectReaderTests-377170324 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 12:02:11 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-361b9813-9eb4-45b2-a661-946057b16712 tempest-ProjectReaderTests-377170324 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 12:02:11 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-361b9813-9eb4-45b2-a661-946057b16712 tempest-ProjectReaderTests-377170324 None] Selected osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f as target Quobyte volume. {{(pid=87116) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 12:02:11 devstack cinder-volume[87116]: INFO cinder.volume.drivers.remotefs [None req-361b9813-9eb4-45b2-a661-946057b16712 tempest-ProjectReaderTests-377170324 None] casted to osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f Nov 06 12:02:11 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-361b9813-9eb4-45b2-a661-946057b16712 tempest-ProjectReaderTests-377170324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-ba1a2916-c4bb-4016-8167-674ae0700eed 1073741824 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 12:02:11 devstack sudo[107324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-ba1a2916-c4bb-4016-8167-674ae0700eed 1073741824 Nov 06 12:02:11 devstack sudo[107324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 12:02:11 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-4a520391-a5fa-40ba-ac72-79e7abfd19a0 tempest-ProjectMemberTests-2097190340 None] Create snapshot completed successfully Nov 06 12:02:11 devstack sudo[107324]: pam_unix(sudo:session): session closed for user root Nov 06 12:02:11 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-361b9813-9eb4-45b2-a661-946057b16712 tempest-ProjectReaderTests-377170324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-ba1a2916-c4bb-4016-8167-674ae0700eed 1073741824" returned: 0 in 0.429s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 12:02:11 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-361b9813-9eb4-45b2-a661-946057b16712 tempest-ProjectReaderTests-377170324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-ba1a2916-c4bb-4016-8167-674ae0700eed {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 12:02:11 devstack sudo[107330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-ba1a2916-c4bb-4016-8167-674ae0700eed Nov 06 12:02:11 devstack sudo[107330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 12:02:12 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-4920805b-7ec4-46e9-8b11-8c86e4e0330d tempest-ProjectMemberTests-2097190340 None] Acquiring lock "cinder-cbbe4a1c-ae9a-4fc0-8601-32c2ec061168-delete_snapshot" by "delete_snapshot" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 12:02:12 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-4920805b-7ec4-46e9-8b11-8c86e4e0330d tempest-ProjectMemberTests-2097190340 None] Lock "cinder-cbbe4a1c-ae9a-4fc0-8601-32c2ec061168-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 12:02:12 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-4920805b-7ec4-46e9-8b11-8c86e4e0330d tempest-ProjectMemberTests-2097190340 None] Acquiring lock "cinder-quobyte-4b98060f-e8e6-47c3-8359-436e8b31f27b" by "delete_snapshot" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 12:02:12 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-4920805b-7ec4-46e9-8b11-8c86e4e0330d tempest-ProjectMemberTests-2097190340 None] Lock "cinder-quobyte-4b98060f-e8e6-47c3-8359-436e8b31f27b" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 12:02:12 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-4920805b-7ec4-46e9-8b11-8c86e4e0330d tempest-ProjectMemberTests-2097190340 None] Acquiring lock "cinder-quobyte-cbbe4a1c-ae9a-4fc0-8601-32c2ec061168" by "_delete_snapshot" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 12:02:12 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-4920805b-7ec4-46e9-8b11-8c86e4e0330d tempest-ProjectMemberTests-2097190340 None] Lock "cinder-quobyte-cbbe4a1c-ae9a-4fc0-8601-32c2ec061168" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 12:02:12 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-4920805b-7ec4-46e9-8b11-8c86e4e0330d tempest-ProjectMemberTests-2097190340 None] Deleting offline snapshot cbbe4a1c-ae9a-4fc0-8601-32c2ec061168 of volume 4b98060f-e8e6-47c3-8359-436e8b31f27b {{(pid=87116) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 06 12:02:12 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-4920805b-7ec4-46e9-8b11-8c86e4e0330d tempest-ProjectMemberTests-2097190340 None] snapshot_file for this snap is: volume-4b98060f-e8e6-47c3-8359-436e8b31f27b.cbbe4a1c-ae9a-4fc0-8601-32c2ec061168 {{(pid=87116) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 06 12:02:12 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0c156da-d797-4352-bf94-4b258c302588]: (4, 'qcow2') {{(pid=88420) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 12:02:12 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-4920805b-7ec4-46e9-8b11-8c86e4e0330d tempest-ProjectMemberTests-2097190340 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-4b98060f-e8e6-47c3-8359-436e8b31f27b.cbbe4a1c-ae9a-4fc0-8601-32c2ec061168 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 12:02:12 devstack sudo[107330]: pam_unix(sudo:session): session closed for user root Nov 06 12:02:12 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-361b9813-9eb4-45b2-a661-946057b16712 tempest-ProjectReaderTests-377170324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-ba1a2916-c4bb-4016-8167-674ae0700eed" returned: 0 in 0.274s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 12:02:12 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-361b9813-9eb4-45b2-a661-946057b16712 tempest-ProjectReaderTests-377170324 None] <== create_volume: return (742ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f'} {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 12:02:12 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-361b9813-9eb4-45b2-a661-946057b16712 tempest-ProjectReaderTests-377170324 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.745s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 12:02:12 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-361b9813-9eb4-45b2-a661-946057b16712 tempest-ProjectReaderTests-377170324 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f987f4cc-8c92-4180-9a6d-65d98d75e498) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ba1a2916-c4bb-4016-8167-674ae0700eed', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 12:02:12 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-361b9813-9eb4-45b2-a661-946057b16712 tempest-ProjectReaderTests-377170324 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9f6b76fd-6f81-4258-a459-b8711eedb14c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 12:02:12 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-361b9813-9eb4-45b2-a661-946057b16712 tempest-ProjectReaderTests-377170324 None] Volume volume-ba1a2916-c4bb-4016-8167-674ae0700eed (ba1a2916-c4bb-4016-8167-674ae0700eed): created successfully Nov 06 12:02:12 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-361b9813-9eb4-45b2-a661-946057b16712 tempest-ProjectReaderTests-377170324 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9f6b76fd-6f81-4258-a459-b8711eedb14c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 12:02:12 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-361b9813-9eb4-45b2-a661-946057b16712 tempest-ProjectReaderTests-377170324 None] Flow 'volume_create_manager' (9e9be0c1-e80a-49e5-9578-5a1bd3ee4fd7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 12:02:12 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-361b9813-9eb4-45b2-a661-946057b16712 tempest-ProjectReaderTests-377170324 None] Created volume successfully. Nov 06 12:02:12 devstack sudo[107333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-4b98060f-e8e6-47c3-8359-436e8b31f27b.cbbe4a1c-ae9a-4fc0-8601-32c2ec061168 Nov 06 12:02:12 devstack sudo[107333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 12:02:12 devstack sudo[107333]: pam_unix(sudo:session): session closed for user root Nov 06 12:02:12 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-4920805b-7ec4-46e9-8b11-8c86e4e0330d tempest-ProjectMemberTests-2097190340 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-4b98060f-e8e6-47c3-8359-436e8b31f27b.cbbe4a1c-ae9a-4fc0-8601-32c2ec061168" returned: 0 in 0.396s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 12:02:12 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-4920805b-7ec4-46e9-8b11-8c86e4e0330d tempest-ProjectMemberTests-2097190340 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4b98060f-e8e6-47c3-8359-436e8b31f27b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87116) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 12:02:12 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bc1de21-a3bb-4a88-9491-bb6652164ade]: (4, 'qcow2') {{(pid=88420) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 12:02:12 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-4920805b-7ec4-46e9-8b11-8c86e4e0330d tempest-ProjectMemberTests-2097190340 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-4b98060f-e8e6-47c3-8359-436e8b31f27b {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 12:02:12 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-738e8964-48a4-4e25-af8c-975e6e927af1 tempest-ProjectReaderTests-377170324 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 12:02:12 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-738e8964-48a4-4e25-af8c-975e6e927af1 tempest-ProjectReaderTests-377170324 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 12:02:12 devstack sudo[107338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-4b98060f-e8e6-47c3-8359-436e8b31f27b Nov 06 12:02:12 devstack sudo[107338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 12:02:12 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-738e8964-48a4-4e25-af8c-975e6e927af1 tempest-ProjectReaderTests-377170324 None] Creating offline snapshot 70c24240-dd37-4c9f-b4fe-53bda341cff4 of volume ba1a2916-c4bb-4016-8167-674ae0700eed {{(pid=87116) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 06 12:02:12 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[78f78c4b-f777-4e85-8cd2-d935d5328694]: (4, 'qcow2') {{(pid=88420) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 12:02:12 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-738e8964-48a4-4e25-af8c-975e6e927af1 tempest-ProjectReaderTests-377170324 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-ba1a2916-c4bb-4016-8167-674ae0700eed {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 12:02:12 devstack sudo[107340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-ba1a2916-c4bb-4016-8167-674ae0700eed Nov 06 12:02:12 devstack sudo[107340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 12:02:12 devstack sudo[107338]: pam_unix(sudo:session): session closed for user root Nov 06 12:02:12 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-4920805b-7ec4-46e9-8b11-8c86e4e0330d tempest-ProjectMemberTests-2097190340 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-4b98060f-e8e6-47c3-8359-436e8b31f27b" returned: 0 in 0.377s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 12:02:12 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-4920805b-7ec4-46e9-8b11-8c86e4e0330d tempest-ProjectMemberTests-2097190340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-4b98060f-e8e6-47c3-8359-436e8b31f27b.cbbe4a1c-ae9a-4fc0-8601-32c2ec061168 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 12:02:12 devstack sudo[107346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-4b98060f-e8e6-47c3-8359-436e8b31f27b.cbbe4a1c-ae9a-4fc0-8601-32c2ec061168 Nov 06 12:02:12 devstack sudo[107346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 12:02:13 devstack sudo[107340]: pam_unix(sudo:session): session closed for user root Nov 06 12:02:13 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-738e8964-48a4-4e25-af8c-975e6e927af1 tempest-ProjectReaderTests-377170324 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-ba1a2916-c4bb-4016-8167-674ae0700eed" returned: 0 in 0.399s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 12:02:13 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-738e8964-48a4-4e25-af8c-975e6e927af1 tempest-ProjectReaderTests-377170324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-ba1a2916-c4bb-4016-8167-674ae0700eed,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-ba1a2916-c4bb-4016-8167-674ae0700eed.70c24240-dd37-4c9f-b4fe-53bda341cff4 1G {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 12:02:13 devstack sudo[107351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-ba1a2916-c4bb-4016-8167-674ae0700eed,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-ba1a2916-c4bb-4016-8167-674ae0700eed.70c24240-dd37-4c9f-b4fe-53bda341cff4 1G Nov 06 12:02:13 devstack sudo[107351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 12:02:13 devstack sudo[107346]: pam_unix(sudo:session): session closed for user root Nov 06 12:02:13 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-4920805b-7ec4-46e9-8b11-8c86e4e0330d tempest-ProjectMemberTests-2097190340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-4b98060f-e8e6-47c3-8359-436e8b31f27b.cbbe4a1c-ae9a-4fc0-8601-32c2ec061168" returned: 0 in 0.328s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 12:02:13 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-4920805b-7ec4-46e9-8b11-8c86e4e0330d tempest-ProjectMemberTests-2097190340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-4b98060f-e8e6-47c3-8359-436e8b31f27b.cbbe4a1c-ae9a-4fc0-8601-32c2ec061168 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 12:02:13 devstack sudo[107356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-4b98060f-e8e6-47c3-8359-436e8b31f27b.cbbe4a1c-ae9a-4fc0-8601-32c2ec061168 Nov 06 12:02:13 devstack sudo[107356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 12:02:13 devstack sudo[107351]: pam_unix(sudo:session): session closed for user root Nov 06 12:02:13 devstack sudo[107356]: pam_unix(sudo:session): session closed for user root Nov 06 12:02:13 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-738e8964-48a4-4e25-af8c-975e6e927af1 tempest-ProjectReaderTests-377170324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-ba1a2916-c4bb-4016-8167-674ae0700eed,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-ba1a2916-c4bb-4016-8167-674ae0700eed.70c24240-dd37-4c9f-b4fe-53bda341cff4 1G" returned: 0 in 0.407s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 12:02:13 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-738e8964-48a4-4e25-af8c-975e6e927af1 tempest-ProjectReaderTests-377170324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ba1a2916-c4bb-4016-8167-674ae0700eed -F qcow2 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-ba1a2916-c4bb-4016-8167-674ae0700eed.70c24240-dd37-4c9f-b4fe-53bda341cff4 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 12:02:13 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-4920805b-7ec4-46e9-8b11-8c86e4e0330d tempest-ProjectMemberTests-2097190340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-4b98060f-e8e6-47c3-8359-436e8b31f27b.cbbe4a1c-ae9a-4fc0-8601-32c2ec061168" returned: 0 in 0.269s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 12:02:13 devstack sudo[107362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ba1a2916-c4bb-4016-8167-674ae0700eed -F qcow2 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-ba1a2916-c4bb-4016-8167-674ae0700eed.70c24240-dd37-4c9f-b4fe-53bda341cff4 Nov 06 12:02:13 devstack sudo[107362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 12:02:13 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-4920805b-7ec4-46e9-8b11-8c86e4e0330d tempest-ProjectMemberTests-2097190340 None] Lock "cinder-quobyte-cbbe4a1c-ae9a-4fc0-8601-32c2ec061168" released by "_delete_snapshot" :: held 1.485s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 12:02:13 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-4920805b-7ec4-46e9-8b11-8c86e4e0330d tempest-ProjectMemberTests-2097190340 None] Lock "cinder-quobyte-4b98060f-e8e6-47c3-8359-436e8b31f27b" released by "delete_snapshot" :: held 1.506s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 12:02:13 devstack cinder-volume[87116]: DEBUG cinder.quota [None req-4920805b-7ec4-46e9-8b11-8c86e4e0330d tempest-ProjectMemberTests-2097190340 None] Created reservations ['d61aa55a-338b-4b18-91e6-e39eeff0d334', '6224760b-ceeb-4d04-bcdb-e265e4022c03', '06e19e46-a098-46b3-b405-4b9e7e7e66ee', '62706dce-d278-452a-9553-9ceb38c21047'] {{(pid=87116) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 12:02:13 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-4920805b-7ec4-46e9-8b11-8c86e4e0330d tempest-ProjectMemberTests-2097190340 None] Delete snapshot completed successfully. Nov 06 12:02:13 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-4920805b-7ec4-46e9-8b11-8c86e4e0330d tempest-ProjectMemberTests-2097190340 None] Lock "cinder-cbbe4a1c-ae9a-4fc0-8601-32c2ec061168-delete_snapshot" released by "delete_snapshot" :: held 1.639s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 12:02:13 devstack sudo[107362]: pam_unix(sudo:session): session closed for user root Nov 06 12:02:13 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-738e8964-48a4-4e25-af8c-975e6e927af1 tempest-ProjectReaderTests-377170324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ba1a2916-c4bb-4016-8167-674ae0700eed -F qcow2 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-ba1a2916-c4bb-4016-8167-674ae0700eed.70c24240-dd37-4c9f-b4fe-53bda341cff4" returned: 0 in 0.313s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 12:02:13 devstack cinder-volume[87116]: WARNING cinder.volume.drivers.remotefs [None req-738e8964-48a4-4e25-af8c-975e6e927af1 tempest-ProjectReaderTests-377170324 None] /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-ba1a2916-c4bb-4016-8167-674ae0700eed.70c24240-dd37-4c9f-b4fe-53bda341cff4 is being set with open permissions: ugo+rw Nov 06 12:02:13 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-738e8964-48a4-4e25-af8c-975e6e927af1 tempest-ProjectReaderTests-377170324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-ba1a2916-c4bb-4016-8167-674ae0700eed.70c24240-dd37-4c9f-b4fe-53bda341cff4 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 12:02:13 devstack sudo[107367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-ba1a2916-c4bb-4016-8167-674ae0700eed.70c24240-dd37-4c9f-b4fe-53bda341cff4 Nov 06 12:02:13 devstack sudo[107367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 12:02:14 devstack sudo[107367]: pam_unix(sudo:session): session closed for user root Nov 06 12:02:14 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-738e8964-48a4-4e25-af8c-975e6e927af1 tempest-ProjectReaderTests-377170324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-ba1a2916-c4bb-4016-8167-674ae0700eed.70c24240-dd37-4c9f-b4fe-53bda341cff4" returned: 0 in 0.266s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 12:02:14 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-738e8964-48a4-4e25-af8c-975e6e927af1 tempest-ProjectReaderTests-377170324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-ba1a2916-c4bb-4016-8167-674ae0700eed.info {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 12:02:14 devstack sudo[107370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-ba1a2916-c4bb-4016-8167-674ae0700eed.info Nov 06 12:02:14 devstack sudo[107370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 12:02:14 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-61209938-f929-47ab-8381-0a4140f92257 tempest-ProjectMemberTests-2097190340 None] Acquiring lock "cinder-4b98060f-e8e6-47c3-8359-436e8b31f27b-delete_volume" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 12:02:14 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-61209938-f929-47ab-8381-0a4140f92257 tempest-ProjectMemberTests-2097190340 None] Lock "cinder-4b98060f-e8e6-47c3-8359-436e8b31f27b-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 12:02:14 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-61209938-f929-47ab-8381-0a4140f92257 tempest-ProjectMemberTests-2097190340 None] Acquiring lock "cinder-quobyte-4b98060f-e8e6-47c3-8359-436e8b31f27b" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 12:02:14 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-61209938-f929-47ab-8381-0a4140f92257 tempest-ProjectMemberTests-2097190340 None] Lock "cinder-quobyte-4b98060f-e8e6-47c3-8359-436e8b31f27b" acquired by "delete_volume" :: waited 0.016s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 12:02:14 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c1d2211-26da-4d99-a2e5-209330fb1279]: (4, 'qcow2') {{(pid=88420) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 12:02:14 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-61209938-f929-47ab-8381-0a4140f92257 tempest-ProjectMemberTests-2097190340 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-4b98060f-e8e6-47c3-8359-436e8b31f27b {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 12:02:14 devstack sudo[107370]: pam_unix(sudo:session): session closed for user root Nov 06 12:02:14 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-738e8964-48a4-4e25-af8c-975e6e927af1 tempest-ProjectReaderTests-377170324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-ba1a2916-c4bb-4016-8167-674ae0700eed.info" returned: 0 in 0.266s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 12:02:14 devstack cinder-volume[87116]: WARNING cinder.volume.drivers.remotefs [None req-738e8964-48a4-4e25-af8c-975e6e927af1 tempest-ProjectReaderTests-377170324 None] /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-ba1a2916-c4bb-4016-8167-674ae0700eed.info is being set with open permissions: ugo+rw Nov 06 12:02:14 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-738e8964-48a4-4e25-af8c-975e6e927af1 tempest-ProjectReaderTests-377170324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-ba1a2916-c4bb-4016-8167-674ae0700eed.info {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 12:02:14 devstack sudo[107374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-ba1a2916-c4bb-4016-8167-674ae0700eed.info Nov 06 12:02:14 devstack sudo[107374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 12:02:14 devstack sudo[107372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-4b98060f-e8e6-47c3-8359-436e8b31f27b Nov 06 12:02:14 devstack sudo[107372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 12:02:14 devstack sudo[107374]: pam_unix(sudo:session): session closed for user root Nov 06 12:02:14 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-738e8964-48a4-4e25-af8c-975e6e927af1 tempest-ProjectReaderTests-377170324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-ba1a2916-c4bb-4016-8167-674ae0700eed.info" returned: 0 in 0.257s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 12:02:14 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-738e8964-48a4-4e25-af8c-975e6e927af1 tempest-ProjectReaderTests-377170324 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.994s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 12:02:14 devstack sudo[107372]: pam_unix(sudo:session): session closed for user root Nov 06 12:02:14 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-61209938-f929-47ab-8381-0a4140f92257 tempest-ProjectMemberTests-2097190340 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-4b98060f-e8e6-47c3-8359-436e8b31f27b" returned: 0 in 0.372s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 12:02:14 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-61209938-f929-47ab-8381-0a4140f92257 tempest-ProjectMemberTests-2097190340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-4b98060f-e8e6-47c3-8359-436e8b31f27b {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 12:02:14 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-738e8964-48a4-4e25-af8c-975e6e927af1 tempest-ProjectReaderTests-377170324 None] Create snapshot completed successfully Nov 06 12:02:14 devstack sudo[107381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-4b98060f-e8e6-47c3-8359-436e8b31f27b Nov 06 12:02:14 devstack sudo[107381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 12:02:14 devstack sudo[107381]: pam_unix(sudo:session): session closed for user root Nov 06 12:02:14 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-61209938-f929-47ab-8381-0a4140f92257 tempest-ProjectMemberTests-2097190340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-4b98060f-e8e6-47c3-8359-436e8b31f27b" returned: 0 in 0.243s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 12:02:14 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-61209938-f929-47ab-8381-0a4140f92257 tempest-ProjectMemberTests-2097190340 None] Lock "cinder-quobyte-4b98060f-e8e6-47c3-8359-436e8b31f27b" released by "delete_volume" :: held 0.682s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 12:02:14 devstack cinder-volume[87116]: DEBUG cinder.quota [None req-61209938-f929-47ab-8381-0a4140f92257 tempest-ProjectMemberTests-2097190340 None] Created reservations ['f065e031-1e32-40ca-8ad9-10595cd9af47', 'de5493bb-8230-4acf-a517-3a2c4809fe63', '5efc7bc2-1b23-40df-b112-58fa6e26d321', '2ae43cb3-2b1f-403b-951e-e6b769e15c7c'] {{(pid=87116) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 12:02:15 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-61209938-f929-47ab-8381-0a4140f92257 tempest-ProjectMemberTests-2097190340 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 12:02:15 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-61209938-f929-47ab-8381-0a4140f92257 tempest-ProjectMemberTests-2097190340 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 12:02:15 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-61209938-f929-47ab-8381-0a4140f92257 tempest-ProjectMemberTests-2097190340 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 12:02:15 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-61209938-f929-47ab-8381-0a4140f92257 tempest-ProjectMemberTests-2097190340 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 12:02:15 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-61209938-f929-47ab-8381-0a4140f92257 tempest-ProjectMemberTests-2097190340 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 12:02:15 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-61209938-f929-47ab-8381-0a4140f92257 tempest-ProjectMemberTests-2097190340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 12:02:15 devstack sudo[107384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756 Nov 06 12:02:15 devstack sudo[107384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 12:02:15 devstack sudo[107384]: pam_unix(sudo:session): session closed for user root Nov 06 12:02:15 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-61209938-f929-47ab-8381-0a4140f92257 tempest-ProjectMemberTests-2097190340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756" returned: 0 in 0.271s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 12:02:15 devstack cinder-volume[87116]: DEBUG cinder.manager [None req-61209938-f929-47ab-8381-0a4140f92257 tempest-ProjectMemberTests-2097190340 None] Notifying Schedulers of capabilities ... {{(pid=87116) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 12:02:15 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-61209938-f929-47ab-8381-0a4140f92257 tempest-ProjectMemberTests-2097190340 None] Deleted volume successfully. Nov 06 12:02:15 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-61209938-f929-47ab-8381-0a4140f92257 tempest-ProjectMemberTests-2097190340 None] Lock "cinder-4b98060f-e8e6-47c3-8359-436e8b31f27b-delete_volume" released by "delete_volume" :: held 1.151s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 12:02:15 devstack cinder-volume[87116]: DEBUG cinder.volume.flows.manager.create_volume [None req-9407da6c-366e-4468-80a6-501cd8677064 tempest-ProjectMemberTests-2097190340 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87116) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 12:02:15 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-9407da6c-366e-4468-80a6-501cd8677064 tempest-ProjectMemberTests-2097190340 None] Flow 'volume_create_manager' (66498fd8-dc7d-4e51-a29d-6beb56bf0fbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 12:02:15 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-9407da6c-366e-4468-80a6-501cd8677064 tempest-ProjectMemberTests-2097190340 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7e4560e6-4b9e-4294-a474-bbfbd5e8f0f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 12:02:15 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-3fd128a3-c8b4-4150-be24-115d58e15c48 tempest-ProjectReaderTests-377170324 None] Acquiring lock "cinder-70c24240-dd37-4c9f-b4fe-53bda341cff4-delete_snapshot" by "delete_snapshot" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 12:02:15 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-9407da6c-366e-4468-80a6-501cd8677064 tempest-ProjectMemberTests-2097190340 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7e4560e6-4b9e-4294-a474-bbfbd5e8f0f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T11:02:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1599739341',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=94e13d8b-a8b6-4ba9-94b3-afa4caefece0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='49c53ee964024de5ae12252eba82ea98',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T11:02:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T11:02:16Z,use_quota=True,user_id='eec80b5d986049c1b9691925283475b7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(34d3b144-d9b7-480a-a2e3-01e45f3d54c1),volume_type_id=34d3b144-d9b7-480a-a2e3-01e45f3d54c1)' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 12:02:15 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-9407da6c-366e-4468-80a6-501cd8677064 tempest-ProjectMemberTests-2097190340 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3ddc8010-43c2-4015-9e13-0c253c2d87ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 12:02:15 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-9407da6c-366e-4468-80a6-501cd8677064 tempest-ProjectMemberTests-2097190340 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3ddc8010-43c2-4015-9e13-0c253c2d87ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 12:02:15 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-9407da6c-366e-4468-80a6-501cd8677064 tempest-ProjectMemberTests-2097190340 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (29f932b7-fa02-4e7d-bf33-0404f89d113c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 12:02:15 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-9407da6c-366e-4468-80a6-501cd8677064 tempest-ProjectMemberTests-2097190340 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (29f932b7-fa02-4e7d-bf33-0404f89d113c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '94e13d8b-a8b6-4ba9-94b3-afa4caefece0', 'volume_name': 'volume-94e13d8b-a8b6-4ba9-94b3-afa4caefece0', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 12:02:15 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-9407da6c-366e-4468-80a6-501cd8677064 tempest-ProjectMemberTests-2097190340 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2639034f-eb86-4870-84c7-755230403ac8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 12:02:15 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-9407da6c-366e-4468-80a6-501cd8677064 tempest-ProjectMemberTests-2097190340 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2639034f-eb86-4870-84c7-755230403ac8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 12:02:15 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-9407da6c-366e-4468-80a6-501cd8677064 tempest-ProjectMemberTests-2097190340 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a851112f-b87e-4a14-96b8-9a2973562763) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 12:02:15 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-9407da6c-366e-4468-80a6-501cd8677064 tempest-ProjectMemberTests-2097190340 None] Volume 94e13d8b-a8b6-4ba9-94b3-afa4caefece0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-94e13d8b-a8b6-4ba9-94b3-afa4caefece0', 'volume_size': 1} Nov 06 12:02:15 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-9407da6c-366e-4468-80a6-501cd8677064 tempest-ProjectMemberTests-2097190340 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 12:02:15 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-9407da6c-366e-4468-80a6-501cd8677064 tempest-ProjectMemberTests-2097190340 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 12:02:15 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-9407da6c-366e-4468-80a6-501cd8677064 tempest-ProjectMemberTests-2097190340 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T11:02:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1599739341',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=94e13d8b-a8b6-4ba9-94b3-afa4caefece0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='49c53ee964024de5ae12252eba82ea98',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T11:02:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T11:02:16Z,use_quota=True,user_id='eec80b5d986049c1b9691925283475b7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(34d3b144-d9b7-480a-a2e3-01e45f3d54c1),volume_type_id=34d3b144-d9b7-480a-a2e3-01e45f3d54c1)}" {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 12:02:15 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-9407da6c-366e-4468-80a6-501cd8677064 tempest-ProjectMemberTests-2097190340 None] Creating volume 94e13d8b-a8b6-4ba9-94b3-afa4caefece0 {{(pid=87116) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 12:02:15 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-9407da6c-366e-4468-80a6-501cd8677064 tempest-ProjectMemberTests-2097190340 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 12:02:15 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-9407da6c-366e-4468-80a6-501cd8677064 tempest-ProjectMemberTests-2097190340 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 12:02:15 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-9407da6c-366e-4468-80a6-501cd8677064 tempest-ProjectMemberTests-2097190340 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 12:02:15 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-9407da6c-366e-4468-80a6-501cd8677064 tempest-ProjectMemberTests-2097190340 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 12:02:15 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-9407da6c-366e-4468-80a6-501cd8677064 tempest-ProjectMemberTests-2097190340 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 12:02:15 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-9407da6c-366e-4468-80a6-501cd8677064 tempest-ProjectMemberTests-2097190340 None] Selected osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f as target Quobyte volume. {{(pid=87116) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 12:02:15 devstack cinder-volume[87116]: INFO cinder.volume.drivers.remotefs [None req-9407da6c-366e-4468-80a6-501cd8677064 tempest-ProjectMemberTests-2097190340 None] casted to osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f Nov 06 12:02:15 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-9407da6c-366e-4468-80a6-501cd8677064 tempest-ProjectMemberTests-2097190340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-94e13d8b-a8b6-4ba9-94b3-afa4caefece0 1073741824 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 12:02:15 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-3fd128a3-c8b4-4150-be24-115d58e15c48 tempest-ProjectReaderTests-377170324 None] Lock "cinder-70c24240-dd37-4c9f-b4fe-53bda341cff4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.080s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 12:02:15 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-3fd128a3-c8b4-4150-be24-115d58e15c48 tempest-ProjectReaderTests-377170324 None] Acquiring lock "cinder-quobyte-ba1a2916-c4bb-4016-8167-674ae0700eed" by "delete_snapshot" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 12:02:15 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-3fd128a3-c8b4-4150-be24-115d58e15c48 tempest-ProjectReaderTests-377170324 None] Lock "cinder-quobyte-ba1a2916-c4bb-4016-8167-674ae0700eed" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 12:02:15 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-3fd128a3-c8b4-4150-be24-115d58e15c48 tempest-ProjectReaderTests-377170324 None] Acquiring lock "cinder-quobyte-70c24240-dd37-4c9f-b4fe-53bda341cff4" by "_delete_snapshot" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 12:02:15 devstack sudo[107387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-94e13d8b-a8b6-4ba9-94b3-afa4caefece0 1073741824 Nov 06 12:02:15 devstack sudo[107387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 12:02:15 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-3fd128a3-c8b4-4150-be24-115d58e15c48 tempest-ProjectReaderTests-377170324 None] Lock "cinder-quobyte-70c24240-dd37-4c9f-b4fe-53bda341cff4" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 12:02:15 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-3fd128a3-c8b4-4150-be24-115d58e15c48 tempest-ProjectReaderTests-377170324 None] Deleting offline snapshot 70c24240-dd37-4c9f-b4fe-53bda341cff4 of volume ba1a2916-c4bb-4016-8167-674ae0700eed {{(pid=87116) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 06 12:02:16 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-3fd128a3-c8b4-4150-be24-115d58e15c48 tempest-ProjectReaderTests-377170324 None] snapshot_file for this snap is: volume-ba1a2916-c4bb-4016-8167-674ae0700eed.70c24240-dd37-4c9f-b4fe-53bda341cff4 {{(pid=87116) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 06 12:02:16 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[c31d9bb0-6d63-4132-beee-6ed007db5b28]: (4, 'qcow2') {{(pid=88420) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 12:02:16 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-3fd128a3-c8b4-4150-be24-115d58e15c48 tempest-ProjectReaderTests-377170324 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-ba1a2916-c4bb-4016-8167-674ae0700eed.70c24240-dd37-4c9f-b4fe-53bda341cff4 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 12:02:16 devstack sudo[107389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-ba1a2916-c4bb-4016-8167-674ae0700eed.70c24240-dd37-4c9f-b4fe-53bda341cff4 Nov 06 12:02:16 devstack sudo[107389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 12:02:16 devstack sudo[107387]: pam_unix(sudo:session): session closed for user root Nov 06 12:02:16 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-9407da6c-366e-4468-80a6-501cd8677064 tempest-ProjectMemberTests-2097190340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-94e13d8b-a8b6-4ba9-94b3-afa4caefece0 1073741824" returned: 0 in 0.431s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 12:02:16 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-9407da6c-366e-4468-80a6-501cd8677064 tempest-ProjectMemberTests-2097190340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-94e13d8b-a8b6-4ba9-94b3-afa4caefece0 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 12:02:16 devstack sudo[107389]: pam_unix(sudo:session): session closed for user root Nov 06 12:02:16 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-3fd128a3-c8b4-4150-be24-115d58e15c48 tempest-ProjectReaderTests-377170324 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-ba1a2916-c4bb-4016-8167-674ae0700eed.70c24240-dd37-4c9f-b4fe-53bda341cff4" returned: 0 in 0.396s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 12:02:16 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-3fd128a3-c8b4-4150-be24-115d58e15c48 tempest-ProjectReaderTests-377170324 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ba1a2916-c4bb-4016-8167-674ae0700eed(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87116) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 12:02:16 devstack sudo[107397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-94e13d8b-a8b6-4ba9-94b3-afa4caefece0 Nov 06 12:02:16 devstack sudo[107397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 12:02:16 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[f008b1c8-56a7-4949-9d3f-63b107781378]: (4, 'qcow2') {{(pid=88420) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 12:02:16 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-3fd128a3-c8b4-4150-be24-115d58e15c48 tempest-ProjectReaderTests-377170324 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-ba1a2916-c4bb-4016-8167-674ae0700eed {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 12:02:16 devstack sudo[107399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-ba1a2916-c4bb-4016-8167-674ae0700eed Nov 06 12:02:16 devstack sudo[107399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 12:02:16 devstack sudo[107397]: pam_unix(sudo:session): session closed for user root Nov 06 12:02:16 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-9407da6c-366e-4468-80a6-501cd8677064 tempest-ProjectMemberTests-2097190340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-94e13d8b-a8b6-4ba9-94b3-afa4caefece0" returned: 0 in 0.264s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 12:02:16 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-9407da6c-366e-4468-80a6-501cd8677064 tempest-ProjectMemberTests-2097190340 None] <== create_volume: return (740ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f'} {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 12:02:16 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-9407da6c-366e-4468-80a6-501cd8677064 tempest-ProjectMemberTests-2097190340 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.742s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 12:02:16 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-9407da6c-366e-4468-80a6-501cd8677064 tempest-ProjectMemberTests-2097190340 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a851112f-b87e-4a14-96b8-9a2973562763) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-94e13d8b-a8b6-4ba9-94b3-afa4caefece0', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 12:02:16 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-9407da6c-366e-4468-80a6-501cd8677064 tempest-ProjectMemberTests-2097190340 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f602e7a4-ff44-43a3-b049-9041e71e20cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 12:02:16 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-9407da6c-366e-4468-80a6-501cd8677064 tempest-ProjectMemberTests-2097190340 None] Volume volume-94e13d8b-a8b6-4ba9-94b3-afa4caefece0 (94e13d8b-a8b6-4ba9-94b3-afa4caefece0): created successfully Nov 06 12:02:16 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-9407da6c-366e-4468-80a6-501cd8677064 tempest-ProjectMemberTests-2097190340 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f602e7a4-ff44-43a3-b049-9041e71e20cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 12:02:16 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-9407da6c-366e-4468-80a6-501cd8677064 tempest-ProjectMemberTests-2097190340 None] Flow 'volume_create_manager' (66498fd8-dc7d-4e51-a29d-6beb56bf0fbd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 12:02:16 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-9407da6c-366e-4468-80a6-501cd8677064 tempest-ProjectMemberTests-2097190340 None] Created volume successfully. Nov 06 12:02:16 devstack sudo[107399]: pam_unix(sudo:session): session closed for user root Nov 06 12:02:16 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-3fd128a3-c8b4-4150-be24-115d58e15c48 tempest-ProjectReaderTests-377170324 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-ba1a2916-c4bb-4016-8167-674ae0700eed" returned: 0 in 0.359s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 12:02:16 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-3fd128a3-c8b4-4150-be24-115d58e15c48 tempest-ProjectReaderTests-377170324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-ba1a2916-c4bb-4016-8167-674ae0700eed.70c24240-dd37-4c9f-b4fe-53bda341cff4 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 12:02:16 devstack sudo[107405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-ba1a2916-c4bb-4016-8167-674ae0700eed.70c24240-dd37-4c9f-b4fe-53bda341cff4 Nov 06 12:02:16 devstack sudo[107405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 12:02:17 devstack sudo[107405]: pam_unix(sudo:session): session closed for user root Nov 06 12:02:17 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-3fd128a3-c8b4-4150-be24-115d58e15c48 tempest-ProjectReaderTests-377170324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-ba1a2916-c4bb-4016-8167-674ae0700eed.70c24240-dd37-4c9f-b4fe-53bda341cff4" returned: 0 in 0.353s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 12:02:17 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-3fd128a3-c8b4-4150-be24-115d58e15c48 tempest-ProjectReaderTests-377170324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-ba1a2916-c4bb-4016-8167-674ae0700eed.70c24240-dd37-4c9f-b4fe-53bda341cff4 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 12:02:17 devstack sudo[107410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-ba1a2916-c4bb-4016-8167-674ae0700eed.70c24240-dd37-4c9f-b4fe-53bda341cff4 Nov 06 12:02:17 devstack sudo[107410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 12:02:17 devstack sudo[107410]: pam_unix(sudo:session): session closed for user root Nov 06 12:02:17 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-3fd128a3-c8b4-4150-be24-115d58e15c48 tempest-ProjectReaderTests-377170324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-ba1a2916-c4bb-4016-8167-674ae0700eed.70c24240-dd37-4c9f-b4fe-53bda341cff4" returned: 0 in 0.254s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 12:02:17 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-3fd128a3-c8b4-4150-be24-115d58e15c48 tempest-ProjectReaderTests-377170324 None] Lock "cinder-quobyte-70c24240-dd37-4c9f-b4fe-53bda341cff4" released by "_delete_snapshot" :: held 1.486s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 12:02:17 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-3fd128a3-c8b4-4150-be24-115d58e15c48 tempest-ProjectReaderTests-377170324 None] Lock "cinder-quobyte-ba1a2916-c4bb-4016-8167-674ae0700eed" released by "delete_snapshot" :: held 1.512s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 12:02:17 devstack cinder-volume[87116]: DEBUG cinder.quota [None req-3fd128a3-c8b4-4150-be24-115d58e15c48 tempest-ProjectReaderTests-377170324 None] Created reservations ['e68cea0b-97f3-4723-8032-e443b7c5487a', '55fc75d3-7b05-4287-ae53-9d475a4b5bd4', '63a4b433-573c-419b-bd47-cb528f21c3a6', '84f2f5c6-30a6-4ca2-a72b-60c00b8dc096'] {{(pid=87116) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 12:02:17 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-3fd128a3-c8b4-4150-be24-115d58e15c48 tempest-ProjectReaderTests-377170324 None] Delete snapshot completed successfully. Nov 06 12:02:17 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-3fd128a3-c8b4-4150-be24-115d58e15c48 tempest-ProjectReaderTests-377170324 None] Lock "cinder-70c24240-dd37-4c9f-b4fe-53bda341cff4-delete_snapshot" released by "delete_snapshot" :: held 1.648s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 12:02:18 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-4514d60f-996e-4898-9f11-46f60b6bb5c3 tempest-ProjectReaderTests-377170324 None] Acquiring lock "cinder-ba1a2916-c4bb-4016-8167-674ae0700eed-delete_volume" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 12:02:18 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-4514d60f-996e-4898-9f11-46f60b6bb5c3 tempest-ProjectReaderTests-377170324 None] Lock "cinder-ba1a2916-c4bb-4016-8167-674ae0700eed-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 12:02:18 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-49fc9d79-6926-453a-a827-4be69b1fb448 tempest-ProjectMemberTests-2097190340 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 12:02:18 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-49fc9d79-6926-453a-a827-4be69b1fb448 tempest-ProjectMemberTests-2097190340 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 12:02:18 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-49fc9d79-6926-453a-a827-4be69b1fb448 tempest-ProjectMemberTests-2097190340 None] Creating offline snapshot b068802e-7ae8-49c1-b232-d5e200c4effc of volume 94e13d8b-a8b6-4ba9-94b3-afa4caefece0 {{(pid=87116) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 06 12:02:18 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-4514d60f-996e-4898-9f11-46f60b6bb5c3 tempest-ProjectReaderTests-377170324 None] Acquiring lock "cinder-quobyte-ba1a2916-c4bb-4016-8167-674ae0700eed" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 12:02:18 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[9192fff5-6c0e-4206-b367-07d00947ca0e]: (4, 'qcow2') {{(pid=88420) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 12:02:18 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-49fc9d79-6926-453a-a827-4be69b1fb448 tempest-ProjectMemberTests-2097190340 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-94e13d8b-a8b6-4ba9-94b3-afa4caefece0 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 12:02:18 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-4514d60f-996e-4898-9f11-46f60b6bb5c3 tempest-ProjectReaderTests-377170324 None] Lock "cinder-quobyte-ba1a2916-c4bb-4016-8167-674ae0700eed" acquired by "delete_volume" :: waited 0.028s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 12:02:18 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb5b9a1a-1eff-4c45-a865-ab1910496b7f]: (4, 'qcow2') {{(pid=88420) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 12:02:18 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-4514d60f-996e-4898-9f11-46f60b6bb5c3 tempest-ProjectReaderTests-377170324 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-ba1a2916-c4bb-4016-8167-674ae0700eed {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 12:02:18 devstack sudo[107413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-94e13d8b-a8b6-4ba9-94b3-afa4caefece0 Nov 06 12:02:18 devstack sudo[107413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 12:02:18 devstack sudo[107414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-ba1a2916-c4bb-4016-8167-674ae0700eed Nov 06 12:02:18 devstack sudo[107414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 12:02:18 devstack sudo[107413]: pam_unix(sudo:session): session closed for user root Nov 06 12:02:18 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-49fc9d79-6926-453a-a827-4be69b1fb448 tempest-ProjectMemberTests-2097190340 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-94e13d8b-a8b6-4ba9-94b3-afa4caefece0" returned: 0 in 0.357s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 12:02:18 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-49fc9d79-6926-453a-a827-4be69b1fb448 tempest-ProjectMemberTests-2097190340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-94e13d8b-a8b6-4ba9-94b3-afa4caefece0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-94e13d8b-a8b6-4ba9-94b3-afa4caefece0.b068802e-7ae8-49c1-b232-d5e200c4effc 1G {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 12:02:18 devstack sudo[107421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-94e13d8b-a8b6-4ba9-94b3-afa4caefece0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-94e13d8b-a8b6-4ba9-94b3-afa4caefece0.b068802e-7ae8-49c1-b232-d5e200c4effc 1G Nov 06 12:02:18 devstack sudo[107421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 12:02:18 devstack sudo[107414]: pam_unix(sudo:session): session closed for user root Nov 06 12:02:18 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-4514d60f-996e-4898-9f11-46f60b6bb5c3 tempest-ProjectReaderTests-377170324 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-ba1a2916-c4bb-4016-8167-674ae0700eed" returned: 0 in 0.379s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 12:02:18 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-4514d60f-996e-4898-9f11-46f60b6bb5c3 tempest-ProjectReaderTests-377170324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-ba1a2916-c4bb-4016-8167-674ae0700eed {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 12:02:18 devstack sudo[107425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-ba1a2916-c4bb-4016-8167-674ae0700eed Nov 06 12:02:18 devstack sudo[107425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 12:02:18 devstack sudo[107425]: pam_unix(sudo:session): session closed for user root Nov 06 12:02:18 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-4514d60f-996e-4898-9f11-46f60b6bb5c3 tempest-ProjectReaderTests-377170324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-ba1a2916-c4bb-4016-8167-674ae0700eed" returned: 0 in 0.255s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 12:02:18 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-4514d60f-996e-4898-9f11-46f60b6bb5c3 tempest-ProjectReaderTests-377170324 None] Lock "cinder-quobyte-ba1a2916-c4bb-4016-8167-674ae0700eed" released by "delete_volume" :: held 0.701s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 12:02:18 devstack cinder-volume[87116]: DEBUG cinder.quota [None req-4514d60f-996e-4898-9f11-46f60b6bb5c3 tempest-ProjectReaderTests-377170324 None] Created reservations ['f36a55e0-a757-43d1-bc85-485c6216cd2f', 'f5195d61-7b29-4632-848e-64fbf01e52c0', 'fa64b49a-0708-435a-a40a-c37dce958da5', '7db52c56-4e8b-4b16-adc2-4ba3cfe8622c'] {{(pid=87116) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 12:02:18 devstack sudo[107421]: pam_unix(sudo:session): session closed for user root Nov 06 12:02:18 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-49fc9d79-6926-453a-a827-4be69b1fb448 tempest-ProjectMemberTests-2097190340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-94e13d8b-a8b6-4ba9-94b3-afa4caefece0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-94e13d8b-a8b6-4ba9-94b3-afa4caefece0.b068802e-7ae8-49c1-b232-d5e200c4effc 1G" returned: 0 in 0.426s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 12:02:18 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-49fc9d79-6926-453a-a827-4be69b1fb448 tempest-ProjectMemberTests-2097190340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-94e13d8b-a8b6-4ba9-94b3-afa4caefece0 -F qcow2 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-94e13d8b-a8b6-4ba9-94b3-afa4caefece0.b068802e-7ae8-49c1-b232-d5e200c4effc {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 12:02:18 devstack sudo[107432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-94e13d8b-a8b6-4ba9-94b3-afa4caefece0 -F qcow2 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-94e13d8b-a8b6-4ba9-94b3-afa4caefece0.b068802e-7ae8-49c1-b232-d5e200c4effc Nov 06 12:02:18 devstack sudo[107432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 12:02:19 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-4514d60f-996e-4898-9f11-46f60b6bb5c3 tempest-ProjectReaderTests-377170324 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 12:02:19 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-4514d60f-996e-4898-9f11-46f60b6bb5c3 tempest-ProjectReaderTests-377170324 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 12:02:19 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-4514d60f-996e-4898-9f11-46f60b6bb5c3 tempest-ProjectReaderTests-377170324 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 12:02:19 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-4514d60f-996e-4898-9f11-46f60b6bb5c3 tempest-ProjectReaderTests-377170324 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 12:02:19 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-4514d60f-996e-4898-9f11-46f60b6bb5c3 tempest-ProjectReaderTests-377170324 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 12:02:19 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-4514d60f-996e-4898-9f11-46f60b6bb5c3 tempest-ProjectReaderTests-377170324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 12:02:19 devstack sudo[107435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756 Nov 06 12:02:19 devstack sudo[107435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 12:02:19 devstack sudo[107432]: pam_unix(sudo:session): session closed for user root Nov 06 12:02:19 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-49fc9d79-6926-453a-a827-4be69b1fb448 tempest-ProjectMemberTests-2097190340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-94e13d8b-a8b6-4ba9-94b3-afa4caefece0 -F qcow2 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-94e13d8b-a8b6-4ba9-94b3-afa4caefece0.b068802e-7ae8-49c1-b232-d5e200c4effc" returned: 0 in 0.331s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 12:02:19 devstack cinder-volume[87116]: WARNING cinder.volume.drivers.remotefs [None req-49fc9d79-6926-453a-a827-4be69b1fb448 tempest-ProjectMemberTests-2097190340 None] /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-94e13d8b-a8b6-4ba9-94b3-afa4caefece0.b068802e-7ae8-49c1-b232-d5e200c4effc is being set with open permissions: ugo+rw Nov 06 12:02:19 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-49fc9d79-6926-453a-a827-4be69b1fb448 tempest-ProjectMemberTests-2097190340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-94e13d8b-a8b6-4ba9-94b3-afa4caefece0.b068802e-7ae8-49c1-b232-d5e200c4effc {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 12:02:19 devstack sudo[107440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-94e13d8b-a8b6-4ba9-94b3-afa4caefece0.b068802e-7ae8-49c1-b232-d5e200c4effc Nov 06 12:02:19 devstack sudo[107440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 12:02:19 devstack sudo[107435]: pam_unix(sudo:session): session closed for user root Nov 06 12:02:19 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-4514d60f-996e-4898-9f11-46f60b6bb5c3 tempest-ProjectReaderTests-377170324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756" returned: 0 in 0.263s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 12:02:19 devstack cinder-volume[87116]: DEBUG cinder.manager [None req-4514d60f-996e-4898-9f11-46f60b6bb5c3 tempest-ProjectReaderTests-377170324 None] Notifying Schedulers of capabilities ... {{(pid=87116) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 12:02:19 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-4514d60f-996e-4898-9f11-46f60b6bb5c3 tempest-ProjectReaderTests-377170324 None] Deleted volume successfully. Nov 06 12:02:19 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-4514d60f-996e-4898-9f11-46f60b6bb5c3 tempest-ProjectReaderTests-377170324 None] Lock "cinder-ba1a2916-c4bb-4016-8167-674ae0700eed-delete_volume" released by "delete_volume" :: held 1.279s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 12:02:19 devstack sudo[107440]: pam_unix(sudo:session): session closed for user root Nov 06 12:02:19 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-49fc9d79-6926-453a-a827-4be69b1fb448 tempest-ProjectMemberTests-2097190340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-94e13d8b-a8b6-4ba9-94b3-afa4caefece0.b068802e-7ae8-49c1-b232-d5e200c4effc" returned: 0 in 0.261s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 12:02:19 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-49fc9d79-6926-453a-a827-4be69b1fb448 tempest-ProjectMemberTests-2097190340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-94e13d8b-a8b6-4ba9-94b3-afa4caefece0.info {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 12:02:19 devstack sudo[107444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-94e13d8b-a8b6-4ba9-94b3-afa4caefece0.info Nov 06 12:02:19 devstack sudo[107444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 12:02:19 devstack sudo[107444]: pam_unix(sudo:session): session closed for user root Nov 06 12:02:19 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-49fc9d79-6926-453a-a827-4be69b1fb448 tempest-ProjectMemberTests-2097190340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-94e13d8b-a8b6-4ba9-94b3-afa4caefece0.info" returned: 0 in 0.259s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 12:02:19 devstack cinder-volume[87116]: WARNING cinder.volume.drivers.remotefs [None req-49fc9d79-6926-453a-a827-4be69b1fb448 tempest-ProjectMemberTests-2097190340 None] /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-94e13d8b-a8b6-4ba9-94b3-afa4caefece0.info is being set with open permissions: ugo+rw Nov 06 12:02:19 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-49fc9d79-6926-453a-a827-4be69b1fb448 tempest-ProjectMemberTests-2097190340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-94e13d8b-a8b6-4ba9-94b3-afa4caefece0.info {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 12:02:19 devstack sudo[107447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-94e13d8b-a8b6-4ba9-94b3-afa4caefece0.info Nov 06 12:02:19 devstack sudo[107447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 12:02:20 devstack sudo[107447]: pam_unix(sudo:session): session closed for user root Nov 06 12:02:20 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-49fc9d79-6926-453a-a827-4be69b1fb448 tempest-ProjectMemberTests-2097190340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-94e13d8b-a8b6-4ba9-94b3-afa4caefece0.info" returned: 0 in 0.261s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 12:02:20 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-49fc9d79-6926-453a-a827-4be69b1fb448 tempest-ProjectMemberTests-2097190340 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.002s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 12:02:20 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-49fc9d79-6926-453a-a827-4be69b1fb448 tempest-ProjectMemberTests-2097190340 None] Create snapshot completed successfully Nov 06 12:02:21 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-9780d8ff-b085-4f08-b586-468a155b9938 tempest-ProjectMemberTests-2097190340 None] Acquiring lock "cinder-b068802e-7ae8-49c1-b232-d5e200c4effc-delete_snapshot" by "delete_snapshot" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 12:02:21 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-9780d8ff-b085-4f08-b586-468a155b9938 tempest-ProjectMemberTests-2097190340 None] Lock "cinder-b068802e-7ae8-49c1-b232-d5e200c4effc-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 12:02:21 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-9780d8ff-b085-4f08-b586-468a155b9938 tempest-ProjectMemberTests-2097190340 None] Acquiring lock "cinder-quobyte-94e13d8b-a8b6-4ba9-94b3-afa4caefece0" by "delete_snapshot" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 12:02:21 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-9780d8ff-b085-4f08-b586-468a155b9938 tempest-ProjectMemberTests-2097190340 None] Lock "cinder-quobyte-94e13d8b-a8b6-4ba9-94b3-afa4caefece0" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 12:02:21 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-9780d8ff-b085-4f08-b586-468a155b9938 tempest-ProjectMemberTests-2097190340 None] Acquiring lock "cinder-quobyte-b068802e-7ae8-49c1-b232-d5e200c4effc" by "_delete_snapshot" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 12:02:21 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-9780d8ff-b085-4f08-b586-468a155b9938 tempest-ProjectMemberTests-2097190340 None] Lock "cinder-quobyte-b068802e-7ae8-49c1-b232-d5e200c4effc" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 12:02:21 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-9780d8ff-b085-4f08-b586-468a155b9938 tempest-ProjectMemberTests-2097190340 None] Deleting offline snapshot b068802e-7ae8-49c1-b232-d5e200c4effc of volume 94e13d8b-a8b6-4ba9-94b3-afa4caefece0 {{(pid=87116) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 06 12:02:21 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-9780d8ff-b085-4f08-b586-468a155b9938 tempest-ProjectMemberTests-2097190340 None] snapshot_file for this snap is: volume-94e13d8b-a8b6-4ba9-94b3-afa4caefece0.b068802e-7ae8-49c1-b232-d5e200c4effc {{(pid=87116) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 06 12:02:21 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[96c20daf-4d31-4e46-8dcb-13f5025e10b5]: (4, 'qcow2') {{(pid=88420) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 12:02:21 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-9780d8ff-b085-4f08-b586-468a155b9938 tempest-ProjectMemberTests-2097190340 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-94e13d8b-a8b6-4ba9-94b3-afa4caefece0.b068802e-7ae8-49c1-b232-d5e200c4effc {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 12:02:21 devstack sudo[107451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-94e13d8b-a8b6-4ba9-94b3-afa4caefece0.b068802e-7ae8-49c1-b232-d5e200c4effc Nov 06 12:02:21 devstack sudo[107451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 12:02:21 devstack sudo[107451]: pam_unix(sudo:session): session closed for user root Nov 06 12:02:21 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-9780d8ff-b085-4f08-b586-468a155b9938 tempest-ProjectMemberTests-2097190340 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-94e13d8b-a8b6-4ba9-94b3-afa4caefece0.b068802e-7ae8-49c1-b232-d5e200c4effc" returned: 0 in 0.397s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 12:02:21 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-9780d8ff-b085-4f08-b586-468a155b9938 tempest-ProjectMemberTests-2097190340 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-94e13d8b-a8b6-4ba9-94b3-afa4caefece0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87116) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 12:02:21 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[08b6cbe7-3cbb-4153-a211-29867f68f83f]: (4, 'qcow2') {{(pid=88420) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 12:02:21 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-9780d8ff-b085-4f08-b586-468a155b9938 tempest-ProjectMemberTests-2097190340 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-94e13d8b-a8b6-4ba9-94b3-afa4caefece0 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 12:02:21 devstack sudo[107458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-94e13d8b-a8b6-4ba9-94b3-afa4caefece0 Nov 06 12:02:21 devstack sudo[107458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 12:02:22 devstack sudo[107458]: pam_unix(sudo:session): session closed for user root Nov 06 12:02:22 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-9780d8ff-b085-4f08-b586-468a155b9938 tempest-ProjectMemberTests-2097190340 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-94e13d8b-a8b6-4ba9-94b3-afa4caefece0" returned: 0 in 0.400s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 12:02:22 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-9780d8ff-b085-4f08-b586-468a155b9938 tempest-ProjectMemberTests-2097190340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-94e13d8b-a8b6-4ba9-94b3-afa4caefece0.b068802e-7ae8-49c1-b232-d5e200c4effc {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 12:02:22 devstack sudo[107463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-94e13d8b-a8b6-4ba9-94b3-afa4caefece0.b068802e-7ae8-49c1-b232-d5e200c4effc Nov 06 12:02:22 devstack sudo[107463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 12:02:22 devstack sudo[107463]: pam_unix(sudo:session): session closed for user root Nov 06 12:02:22 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-9780d8ff-b085-4f08-b586-468a155b9938 tempest-ProjectMemberTests-2097190340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-94e13d8b-a8b6-4ba9-94b3-afa4caefece0.b068802e-7ae8-49c1-b232-d5e200c4effc" returned: 0 in 0.368s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 12:02:22 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-9780d8ff-b085-4f08-b586-468a155b9938 tempest-ProjectMemberTests-2097190340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-94e13d8b-a8b6-4ba9-94b3-afa4caefece0.b068802e-7ae8-49c1-b232-d5e200c4effc {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 12:02:22 devstack sudo[107468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-94e13d8b-a8b6-4ba9-94b3-afa4caefece0.b068802e-7ae8-49c1-b232-d5e200c4effc Nov 06 12:02:22 devstack sudo[107468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 12:02:22 devstack sudo[107468]: pam_unix(sudo:session): session closed for user root Nov 06 12:02:22 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-9780d8ff-b085-4f08-b586-468a155b9938 tempest-ProjectMemberTests-2097190340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-94e13d8b-a8b6-4ba9-94b3-afa4caefece0.b068802e-7ae8-49c1-b232-d5e200c4effc" returned: 0 in 0.290s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 12:02:22 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-9780d8ff-b085-4f08-b586-468a155b9938 tempest-ProjectMemberTests-2097190340 None] Lock "cinder-quobyte-b068802e-7ae8-49c1-b232-d5e200c4effc" released by "_delete_snapshot" :: held 1.572s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 12:02:22 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-9780d8ff-b085-4f08-b586-468a155b9938 tempest-ProjectMemberTests-2097190340 None] Lock "cinder-quobyte-94e13d8b-a8b6-4ba9-94b3-afa4caefece0" released by "delete_snapshot" :: held 1.598s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 12:02:22 devstack cinder-volume[87116]: DEBUG cinder.quota [None req-9780d8ff-b085-4f08-b586-468a155b9938 tempest-ProjectMemberTests-2097190340 None] Created reservations ['897f6e68-455e-42db-a0bc-f62bf2e48eb5', 'fc5e0d5b-214b-4068-9f5d-b52a277a28b0', 'fdc66984-6693-450e-b2ef-5b21143d575d', 'a7e472b0-d56e-49e2-951d-f70479ea194f'] {{(pid=87116) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 12:02:22 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-9780d8ff-b085-4f08-b586-468a155b9938 tempest-ProjectMemberTests-2097190340 None] Delete snapshot completed successfully. Nov 06 12:02:22 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-9780d8ff-b085-4f08-b586-468a155b9938 tempest-ProjectMemberTests-2097190340 None] Lock "cinder-b068802e-7ae8-49c1-b232-d5e200c4effc-delete_snapshot" released by "delete_snapshot" :: held 1.743s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 12:02:23 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-5b37e996-c961-4391-bf9e-e4fde3709e45 tempest-ProjectMemberTests-2097190340 None] Acquiring lock "cinder-94e13d8b-a8b6-4ba9-94b3-afa4caefece0-delete_volume" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 12:02:23 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-5b37e996-c961-4391-bf9e-e4fde3709e45 tempest-ProjectMemberTests-2097190340 None] Lock "cinder-94e13d8b-a8b6-4ba9-94b3-afa4caefece0-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 12:02:23 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-5b37e996-c961-4391-bf9e-e4fde3709e45 tempest-ProjectMemberTests-2097190340 None] Acquiring lock "cinder-quobyte-94e13d8b-a8b6-4ba9-94b3-afa4caefece0" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 12:02:23 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-5b37e996-c961-4391-bf9e-e4fde3709e45 tempest-ProjectMemberTests-2097190340 None] Lock "cinder-quobyte-94e13d8b-a8b6-4ba9-94b3-afa4caefece0" acquired by "delete_volume" :: waited 0.015s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 12:02:23 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[c138ac35-621e-4785-a08a-7a0a8409d6ca]: (4, 'qcow2') {{(pid=88420) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 12:02:23 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-5b37e996-c961-4391-bf9e-e4fde3709e45 tempest-ProjectMemberTests-2097190340 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-94e13d8b-a8b6-4ba9-94b3-afa4caefece0 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 12:02:23 devstack sudo[107472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-94e13d8b-a8b6-4ba9-94b3-afa4caefece0 Nov 06 12:02:23 devstack sudo[107472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 12:02:23 devstack sudo[107472]: pam_unix(sudo:session): session closed for user root Nov 06 12:02:23 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-5b37e996-c961-4391-bf9e-e4fde3709e45 tempest-ProjectMemberTests-2097190340 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-94e13d8b-a8b6-4ba9-94b3-afa4caefece0" returned: 0 in 0.359s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 12:02:23 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-5b37e996-c961-4391-bf9e-e4fde3709e45 tempest-ProjectMemberTests-2097190340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-94e13d8b-a8b6-4ba9-94b3-afa4caefece0 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 12:02:23 devstack sudo[107477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-94e13d8b-a8b6-4ba9-94b3-afa4caefece0 Nov 06 12:02:23 devstack sudo[107477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 12:02:24 devstack sudo[107477]: pam_unix(sudo:session): session closed for user root Nov 06 12:02:24 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-5b37e996-c961-4391-bf9e-e4fde3709e45 tempest-ProjectMemberTests-2097190340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-94e13d8b-a8b6-4ba9-94b3-afa4caefece0" returned: 0 in 0.255s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 12:02:24 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-5b37e996-c961-4391-bf9e-e4fde3709e45 tempest-ProjectMemberTests-2097190340 None] Lock "cinder-quobyte-94e13d8b-a8b6-4ba9-94b3-afa4caefece0" released by "delete_volume" :: held 0.685s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 12:02:24 devstack cinder-volume[87116]: DEBUG cinder.quota [None req-5b37e996-c961-4391-bf9e-e4fde3709e45 tempest-ProjectMemberTests-2097190340 None] Created reservations ['8cb85e19-d290-4ac4-a89b-680f16bd0418', '83ebfb9e-7979-4ee7-94a4-50452ca31ca0', '1f166b11-7413-4918-9714-40505cdce6af', '8ade9405-e8a0-4a84-a873-a01ad1fe8265'] {{(pid=87116) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 12:02:24 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-5b37e996-c961-4391-bf9e-e4fde3709e45 tempest-ProjectMemberTests-2097190340 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 12:02:24 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-5b37e996-c961-4391-bf9e-e4fde3709e45 tempest-ProjectMemberTests-2097190340 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 12:02:24 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-5b37e996-c961-4391-bf9e-e4fde3709e45 tempest-ProjectMemberTests-2097190340 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 12:02:24 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-5b37e996-c961-4391-bf9e-e4fde3709e45 tempest-ProjectMemberTests-2097190340 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 12:02:24 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-5b37e996-c961-4391-bf9e-e4fde3709e45 tempest-ProjectMemberTests-2097190340 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 12:02:24 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-5b37e996-c961-4391-bf9e-e4fde3709e45 tempest-ProjectMemberTests-2097190340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 12:02:24 devstack sudo[107480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756 Nov 06 12:02:24 devstack sudo[107480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 12:02:24 devstack sudo[107480]: pam_unix(sudo:session): session closed for user root Nov 06 12:02:24 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-5b37e996-c961-4391-bf9e-e4fde3709e45 tempest-ProjectMemberTests-2097190340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756" returned: 0 in 0.258s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 12:02:24 devstack cinder-volume[87116]: DEBUG cinder.manager [None req-5b37e996-c961-4391-bf9e-e4fde3709e45 tempest-ProjectMemberTests-2097190340 None] Notifying Schedulers of capabilities ... {{(pid=87116) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 12:02:24 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-5b37e996-c961-4391-bf9e-e4fde3709e45 tempest-ProjectMemberTests-2097190340 None] Deleted volume successfully. Nov 06 12:02:24 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-5b37e996-c961-4391-bf9e-e4fde3709e45 tempest-ProjectMemberTests-2097190340 None] Lock "cinder-94e13d8b-a8b6-4ba9-94b3-afa4caefece0-delete_volume" released by "delete_volume" :: held 1.155s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 12:02:25 devstack cinder-volume[87116]: DEBUG cinder.volume.flows.manager.create_volume [None req-f7d41966-69ab-48bd-99fb-28b292c97772 tempest-ProjectMemberTests-2097190340 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87116) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 12:02:25 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-f7d41966-69ab-48bd-99fb-28b292c97772 tempest-ProjectMemberTests-2097190340 None] Flow 'volume_create_manager' (f4fe0f7c-43b3-4407-afa0-13cccc79f0ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 12:02:25 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-f7d41966-69ab-48bd-99fb-28b292c97772 tempest-ProjectMemberTests-2097190340 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a29c873d-4567-45b5-93ab-e6770cf6d823) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 12:02:25 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-f7d41966-69ab-48bd-99fb-28b292c97772 tempest-ProjectMemberTests-2097190340 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a29c873d-4567-45b5-93ab-e6770cf6d823) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T11:02:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1478769416',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c7ab98b7-00de-42e0-af52-2fd343f5aced,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='49c53ee964024de5ae12252eba82ea98',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T11:02:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T11:02:25Z,use_quota=True,user_id='eec80b5d986049c1b9691925283475b7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(34d3b144-d9b7-480a-a2e3-01e45f3d54c1),volume_type_id=34d3b144-d9b7-480a-a2e3-01e45f3d54c1)' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 12:02:25 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-f7d41966-69ab-48bd-99fb-28b292c97772 tempest-ProjectMemberTests-2097190340 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b498659e-997c-4ee5-a3c8-087bc21e5435) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 12:02:25 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-f7d41966-69ab-48bd-99fb-28b292c97772 tempest-ProjectMemberTests-2097190340 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b498659e-997c-4ee5-a3c8-087bc21e5435) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 12:02:25 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-f7d41966-69ab-48bd-99fb-28b292c97772 tempest-ProjectMemberTests-2097190340 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1463d004-2380-499b-8dc5-1549cc3a5ccd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 12:02:25 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-f7d41966-69ab-48bd-99fb-28b292c97772 tempest-ProjectMemberTests-2097190340 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1463d004-2380-499b-8dc5-1549cc3a5ccd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c7ab98b7-00de-42e0-af52-2fd343f5aced', 'volume_name': 'volume-c7ab98b7-00de-42e0-af52-2fd343f5aced', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 12:02:25 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-f7d41966-69ab-48bd-99fb-28b292c97772 tempest-ProjectMemberTests-2097190340 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c5f94b73-c124-4c5c-a750-603123660caf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 12:02:25 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-f7d41966-69ab-48bd-99fb-28b292c97772 tempest-ProjectMemberTests-2097190340 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c5f94b73-c124-4c5c-a750-603123660caf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 12:02:25 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-f7d41966-69ab-48bd-99fb-28b292c97772 tempest-ProjectMemberTests-2097190340 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (df68e526-c5cb-4a0d-a2d1-48a549ec6145) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 12:02:25 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-f7d41966-69ab-48bd-99fb-28b292c97772 tempest-ProjectMemberTests-2097190340 None] Volume c7ab98b7-00de-42e0-af52-2fd343f5aced: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c7ab98b7-00de-42e0-af52-2fd343f5aced', 'volume_size': 1} Nov 06 12:02:25 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-f7d41966-69ab-48bd-99fb-28b292c97772 tempest-ProjectMemberTests-2097190340 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 12:02:25 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-f7d41966-69ab-48bd-99fb-28b292c97772 tempest-ProjectMemberTests-2097190340 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 12:02:25 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-f7d41966-69ab-48bd-99fb-28b292c97772 tempest-ProjectMemberTests-2097190340 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T11:02:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1478769416',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c7ab98b7-00de-42e0-af52-2fd343f5aced,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='49c53ee964024de5ae12252eba82ea98',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T11:02:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T11:02:25Z,use_quota=True,user_id='eec80b5d986049c1b9691925283475b7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(34d3b144-d9b7-480a-a2e3-01e45f3d54c1),volume_type_id=34d3b144-d9b7-480a-a2e3-01e45f3d54c1)}" {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 12:02:25 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-f7d41966-69ab-48bd-99fb-28b292c97772 tempest-ProjectMemberTests-2097190340 None] Creating volume c7ab98b7-00de-42e0-af52-2fd343f5aced {{(pid=87116) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 12:02:25 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-f7d41966-69ab-48bd-99fb-28b292c97772 tempest-ProjectMemberTests-2097190340 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 12:02:25 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-f7d41966-69ab-48bd-99fb-28b292c97772 tempest-ProjectMemberTests-2097190340 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 12:02:25 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-f7d41966-69ab-48bd-99fb-28b292c97772 tempest-ProjectMemberTests-2097190340 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 12:02:25 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-f7d41966-69ab-48bd-99fb-28b292c97772 tempest-ProjectMemberTests-2097190340 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 12:02:25 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-f7d41966-69ab-48bd-99fb-28b292c97772 tempest-ProjectMemberTests-2097190340 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 12:02:25 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-f7d41966-69ab-48bd-99fb-28b292c97772 tempest-ProjectMemberTests-2097190340 None] Selected osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f as target Quobyte volume. {{(pid=87116) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 12:02:25 devstack cinder-volume[87116]: INFO cinder.volume.drivers.remotefs [None req-f7d41966-69ab-48bd-99fb-28b292c97772 tempest-ProjectMemberTests-2097190340 None] casted to osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f Nov 06 12:02:25 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-f7d41966-69ab-48bd-99fb-28b292c97772 tempest-ProjectMemberTests-2097190340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-c7ab98b7-00de-42e0-af52-2fd343f5aced 1073741824 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 12:02:25 devstack sudo[107483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-c7ab98b7-00de-42e0-af52-2fd343f5aced 1073741824 Nov 06 12:02:25 devstack sudo[107483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 12:02:25 devstack sudo[107483]: pam_unix(sudo:session): session closed for user root Nov 06 12:02:25 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-f7d41966-69ab-48bd-99fb-28b292c97772 tempest-ProjectMemberTests-2097190340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-c7ab98b7-00de-42e0-af52-2fd343f5aced 1073741824" returned: 0 in 0.418s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 12:02:25 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-f7d41966-69ab-48bd-99fb-28b292c97772 tempest-ProjectMemberTests-2097190340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-c7ab98b7-00de-42e0-af52-2fd343f5aced {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 12:02:25 devstack sudo[107488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-c7ab98b7-00de-42e0-af52-2fd343f5aced Nov 06 12:02:25 devstack sudo[107488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 12:02:26 devstack sudo[107488]: pam_unix(sudo:session): session closed for user root Nov 06 12:02:26 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-f7d41966-69ab-48bd-99fb-28b292c97772 tempest-ProjectMemberTests-2097190340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-c7ab98b7-00de-42e0-af52-2fd343f5aced" returned: 0 in 0.316s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 12:02:26 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-f7d41966-69ab-48bd-99fb-28b292c97772 tempest-ProjectMemberTests-2097190340 None] <== create_volume: return (777ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f'} {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 12:02:26 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-f7d41966-69ab-48bd-99fb-28b292c97772 tempest-ProjectMemberTests-2097190340 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.780s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 12:02:26 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-f7d41966-69ab-48bd-99fb-28b292c97772 tempest-ProjectMemberTests-2097190340 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (df68e526-c5cb-4a0d-a2d1-48a549ec6145) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c7ab98b7-00de-42e0-af52-2fd343f5aced', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 12:02:26 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-f7d41966-69ab-48bd-99fb-28b292c97772 tempest-ProjectMemberTests-2097190340 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d750744e-57af-4f10-b713-b268cfd3a788) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 12:02:26 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-f7d41966-69ab-48bd-99fb-28b292c97772 tempest-ProjectMemberTests-2097190340 None] Volume volume-c7ab98b7-00de-42e0-af52-2fd343f5aced (c7ab98b7-00de-42e0-af52-2fd343f5aced): created successfully Nov 06 12:02:26 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-f7d41966-69ab-48bd-99fb-28b292c97772 tempest-ProjectMemberTests-2097190340 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d750744e-57af-4f10-b713-b268cfd3a788) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 12:02:26 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-f7d41966-69ab-48bd-99fb-28b292c97772 tempest-ProjectMemberTests-2097190340 None] Flow 'volume_create_manager' (f4fe0f7c-43b3-4407-afa0-13cccc79f0ec) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 12:02:26 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-f7d41966-69ab-48bd-99fb-28b292c97772 tempest-ProjectMemberTests-2097190340 None] Created volume successfully. Nov 06 12:02:27 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-e9246127-a30b-4115-98c8-0c4c1438484f tempest-ProjectMemberTests-2097190340 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 12:02:27 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-e9246127-a30b-4115-98c8-0c4c1438484f tempest-ProjectMemberTests-2097190340 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 12:02:27 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-e9246127-a30b-4115-98c8-0c4c1438484f tempest-ProjectMemberTests-2097190340 None] Creating offline snapshot cf85f128-f11f-447d-b5ed-ebfe68d98385 of volume c7ab98b7-00de-42e0-af52-2fd343f5aced {{(pid=87116) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 06 12:02:27 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[0169a1c0-6d38-4fd0-8fde-9348d1376e46]: (4, 'qcow2') {{(pid=88420) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 12:02:27 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-e9246127-a30b-4115-98c8-0c4c1438484f tempest-ProjectMemberTests-2097190340 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-c7ab98b7-00de-42e0-af52-2fd343f5aced {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 12:02:27 devstack sudo[107491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-c7ab98b7-00de-42e0-af52-2fd343f5aced Nov 06 12:02:27 devstack sudo[107491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 12:02:27 devstack sudo[107491]: pam_unix(sudo:session): session closed for user root Nov 06 12:02:27 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-e9246127-a30b-4115-98c8-0c4c1438484f tempest-ProjectMemberTests-2097190340 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-c7ab98b7-00de-42e0-af52-2fd343f5aced" returned: 0 in 0.345s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 12:02:27 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-e9246127-a30b-4115-98c8-0c4c1438484f tempest-ProjectMemberTests-2097190340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-c7ab98b7-00de-42e0-af52-2fd343f5aced,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-c7ab98b7-00de-42e0-af52-2fd343f5aced.cf85f128-f11f-447d-b5ed-ebfe68d98385 1G {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 12:02:27 devstack sudo[107496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-c7ab98b7-00de-42e0-af52-2fd343f5aced,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-c7ab98b7-00de-42e0-af52-2fd343f5aced.cf85f128-f11f-447d-b5ed-ebfe68d98385 1G Nov 06 12:02:27 devstack sudo[107496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 12:02:28 devstack sudo[107496]: pam_unix(sudo:session): session closed for user root Nov 06 12:02:28 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-e9246127-a30b-4115-98c8-0c4c1438484f tempest-ProjectMemberTests-2097190340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-c7ab98b7-00de-42e0-af52-2fd343f5aced,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-c7ab98b7-00de-42e0-af52-2fd343f5aced.cf85f128-f11f-447d-b5ed-ebfe68d98385 1G" returned: 0 in 0.423s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 12:02:28 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-e9246127-a30b-4115-98c8-0c4c1438484f tempest-ProjectMemberTests-2097190340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c7ab98b7-00de-42e0-af52-2fd343f5aced -F qcow2 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-c7ab98b7-00de-42e0-af52-2fd343f5aced.cf85f128-f11f-447d-b5ed-ebfe68d98385 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 12:02:28 devstack sudo[107502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c7ab98b7-00de-42e0-af52-2fd343f5aced -F qcow2 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-c7ab98b7-00de-42e0-af52-2fd343f5aced.cf85f128-f11f-447d-b5ed-ebfe68d98385 Nov 06 12:02:28 devstack sudo[107502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 12:02:28 devstack sudo[107502]: pam_unix(sudo:session): session closed for user root Nov 06 12:02:28 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-e9246127-a30b-4115-98c8-0c4c1438484f tempest-ProjectMemberTests-2097190340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c7ab98b7-00de-42e0-af52-2fd343f5aced -F qcow2 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-c7ab98b7-00de-42e0-af52-2fd343f5aced.cf85f128-f11f-447d-b5ed-ebfe68d98385" returned: 0 in 0.300s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 12:02:28 devstack cinder-volume[87116]: WARNING cinder.volume.drivers.remotefs [None req-e9246127-a30b-4115-98c8-0c4c1438484f tempest-ProjectMemberTests-2097190340 None] /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-c7ab98b7-00de-42e0-af52-2fd343f5aced.cf85f128-f11f-447d-b5ed-ebfe68d98385 is being set with open permissions: ugo+rw Nov 06 12:02:28 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-e9246127-a30b-4115-98c8-0c4c1438484f tempest-ProjectMemberTests-2097190340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-c7ab98b7-00de-42e0-af52-2fd343f5aced.cf85f128-f11f-447d-b5ed-ebfe68d98385 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 12:02:28 devstack sudo[107507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-c7ab98b7-00de-42e0-af52-2fd343f5aced.cf85f128-f11f-447d-b5ed-ebfe68d98385 Nov 06 12:02:28 devstack sudo[107507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 12:02:28 devstack sudo[107507]: pam_unix(sudo:session): session closed for user root Nov 06 12:02:28 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-e9246127-a30b-4115-98c8-0c4c1438484f tempest-ProjectMemberTests-2097190340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-c7ab98b7-00de-42e0-af52-2fd343f5aced.cf85f128-f11f-447d-b5ed-ebfe68d98385" returned: 0 in 0.241s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 12:02:28 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-e9246127-a30b-4115-98c8-0c4c1438484f tempest-ProjectMemberTests-2097190340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-c7ab98b7-00de-42e0-af52-2fd343f5aced.info {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 12:02:28 devstack sudo[107510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-c7ab98b7-00de-42e0-af52-2fd343f5aced.info Nov 06 12:02:28 devstack sudo[107510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 12:02:28 devstack sudo[107510]: pam_unix(sudo:session): session closed for user root Nov 06 12:02:28 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-e9246127-a30b-4115-98c8-0c4c1438484f tempest-ProjectMemberTests-2097190340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-c7ab98b7-00de-42e0-af52-2fd343f5aced.info" returned: 0 in 0.245s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 12:02:28 devstack cinder-volume[87116]: WARNING cinder.volume.drivers.remotefs [None req-e9246127-a30b-4115-98c8-0c4c1438484f tempest-ProjectMemberTests-2097190340 None] /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-c7ab98b7-00de-42e0-af52-2fd343f5aced.info is being set with open permissions: ugo+rw Nov 06 12:02:28 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-e9246127-a30b-4115-98c8-0c4c1438484f tempest-ProjectMemberTests-2097190340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-c7ab98b7-00de-42e0-af52-2fd343f5aced.info {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 12:02:28 devstack sudo[107513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-c7ab98b7-00de-42e0-af52-2fd343f5aced.info Nov 06 12:02:28 devstack sudo[107513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 12:02:29 devstack sudo[107513]: pam_unix(sudo:session): session closed for user root Nov 06 12:02:29 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-e9246127-a30b-4115-98c8-0c4c1438484f tempest-ProjectMemberTests-2097190340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-c7ab98b7-00de-42e0-af52-2fd343f5aced.info" returned: 0 in 0.273s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 12:02:29 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-e9246127-a30b-4115-98c8-0c4c1438484f tempest-ProjectMemberTests-2097190340 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.913s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 12:02:29 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-e9246127-a30b-4115-98c8-0c4c1438484f tempest-ProjectMemberTests-2097190340 None] Create snapshot completed successfully Nov 06 12:02:29 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-a4029d69-4cb0-48ae-b1bc-8b9b35e03ecc tempest-ProjectMemberTests-2097190340 None] Acquiring lock "cinder-cf85f128-f11f-447d-b5ed-ebfe68d98385-delete_snapshot" by "delete_snapshot" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 12:02:29 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-a4029d69-4cb0-48ae-b1bc-8b9b35e03ecc tempest-ProjectMemberTests-2097190340 None] Lock "cinder-cf85f128-f11f-447d-b5ed-ebfe68d98385-delete_snapshot" acquired by "delete_snapshot" :: waited 0.032s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 12:02:29 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-a4029d69-4cb0-48ae-b1bc-8b9b35e03ecc tempest-ProjectMemberTests-2097190340 None] Acquiring lock "cinder-quobyte-c7ab98b7-00de-42e0-af52-2fd343f5aced" by "delete_snapshot" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 12:02:29 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-a4029d69-4cb0-48ae-b1bc-8b9b35e03ecc tempest-ProjectMemberTests-2097190340 None] Lock "cinder-quobyte-c7ab98b7-00de-42e0-af52-2fd343f5aced" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 12:02:29 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-a4029d69-4cb0-48ae-b1bc-8b9b35e03ecc tempest-ProjectMemberTests-2097190340 None] Acquiring lock "cinder-quobyte-cf85f128-f11f-447d-b5ed-ebfe68d98385" by "_delete_snapshot" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 12:02:29 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-a4029d69-4cb0-48ae-b1bc-8b9b35e03ecc tempest-ProjectMemberTests-2097190340 None] Lock "cinder-quobyte-cf85f128-f11f-447d-b5ed-ebfe68d98385" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 12:02:29 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-a4029d69-4cb0-48ae-b1bc-8b9b35e03ecc tempest-ProjectMemberTests-2097190340 None] Deleting offline snapshot cf85f128-f11f-447d-b5ed-ebfe68d98385 of volume c7ab98b7-00de-42e0-af52-2fd343f5aced {{(pid=87116) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 06 12:02:29 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-a4029d69-4cb0-48ae-b1bc-8b9b35e03ecc tempest-ProjectMemberTests-2097190340 None] snapshot_file for this snap is: volume-c7ab98b7-00de-42e0-af52-2fd343f5aced.cf85f128-f11f-447d-b5ed-ebfe68d98385 {{(pid=87116) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 06 12:02:29 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[b640f8ab-68c1-4265-b62b-e8e91e55cb6c]: (4, 'qcow2') {{(pid=88420) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 12:02:29 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-a4029d69-4cb0-48ae-b1bc-8b9b35e03ecc tempest-ProjectMemberTests-2097190340 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-c7ab98b7-00de-42e0-af52-2fd343f5aced.cf85f128-f11f-447d-b5ed-ebfe68d98385 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 12:02:29 devstack sudo[107516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-c7ab98b7-00de-42e0-af52-2fd343f5aced.cf85f128-f11f-447d-b5ed-ebfe68d98385 Nov 06 12:02:29 devstack sudo[107516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 12:02:29 devstack sudo[107516]: pam_unix(sudo:session): session closed for user root Nov 06 12:02:29 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-a4029d69-4cb0-48ae-b1bc-8b9b35e03ecc tempest-ProjectMemberTests-2097190340 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-c7ab98b7-00de-42e0-af52-2fd343f5aced.cf85f128-f11f-447d-b5ed-ebfe68d98385" returned: 0 in 0.405s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 12:02:29 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-a4029d69-4cb0-48ae-b1bc-8b9b35e03ecc tempest-ProjectMemberTests-2097190340 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c7ab98b7-00de-42e0-af52-2fd343f5aced(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87116) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 12:02:30 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d75e34c-7fd6-4bd9-ac58-024ed72745c0]: (4, 'qcow2') {{(pid=88420) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 12:02:30 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-a4029d69-4cb0-48ae-b1bc-8b9b35e03ecc tempest-ProjectMemberTests-2097190340 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-c7ab98b7-00de-42e0-af52-2fd343f5aced {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 12:02:30 devstack sudo[107521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-c7ab98b7-00de-42e0-af52-2fd343f5aced Nov 06 12:02:30 devstack sudo[107521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 12:02:30 devstack sudo[107521]: pam_unix(sudo:session): session closed for user root Nov 06 12:02:30 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-a4029d69-4cb0-48ae-b1bc-8b9b35e03ecc tempest-ProjectMemberTests-2097190340 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-c7ab98b7-00de-42e0-af52-2fd343f5aced" returned: 0 in 0.429s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 12:02:30 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-a4029d69-4cb0-48ae-b1bc-8b9b35e03ecc tempest-ProjectMemberTests-2097190340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-c7ab98b7-00de-42e0-af52-2fd343f5aced.cf85f128-f11f-447d-b5ed-ebfe68d98385 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 12:02:30 devstack sudo[107527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-c7ab98b7-00de-42e0-af52-2fd343f5aced.cf85f128-f11f-447d-b5ed-ebfe68d98385 Nov 06 12:02:30 devstack sudo[107527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 12:02:30 devstack sudo[107527]: pam_unix(sudo:session): session closed for user root Nov 06 12:02:30 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-a4029d69-4cb0-48ae-b1bc-8b9b35e03ecc tempest-ProjectMemberTests-2097190340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-c7ab98b7-00de-42e0-af52-2fd343f5aced.cf85f128-f11f-447d-b5ed-ebfe68d98385" returned: 0 in 0.348s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 12:02:30 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-a4029d69-4cb0-48ae-b1bc-8b9b35e03ecc tempest-ProjectMemberTests-2097190340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-c7ab98b7-00de-42e0-af52-2fd343f5aced.cf85f128-f11f-447d-b5ed-ebfe68d98385 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 12:02:30 devstack sudo[107532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-c7ab98b7-00de-42e0-af52-2fd343f5aced.cf85f128-f11f-447d-b5ed-ebfe68d98385 Nov 06 12:02:30 devstack sudo[107532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 12:02:31 devstack sudo[107532]: pam_unix(sudo:session): session closed for user root Nov 06 12:02:31 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-a4029d69-4cb0-48ae-b1bc-8b9b35e03ecc tempest-ProjectMemberTests-2097190340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-c7ab98b7-00de-42e0-af52-2fd343f5aced.cf85f128-f11f-447d-b5ed-ebfe68d98385" returned: 0 in 0.290s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 12:02:31 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-a4029d69-4cb0-48ae-b1bc-8b9b35e03ecc tempest-ProjectMemberTests-2097190340 None] Lock "cinder-quobyte-cf85f128-f11f-447d-b5ed-ebfe68d98385" released by "_delete_snapshot" :: held 1.610s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 12:02:31 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-a4029d69-4cb0-48ae-b1bc-8b9b35e03ecc tempest-ProjectMemberTests-2097190340 None] Lock "cinder-quobyte-c7ab98b7-00de-42e0-af52-2fd343f5aced" released by "delete_snapshot" :: held 1.637s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 12:02:31 devstack cinder-volume[87116]: DEBUG cinder.quota [None req-a4029d69-4cb0-48ae-b1bc-8b9b35e03ecc tempest-ProjectMemberTests-2097190340 None] Created reservations ['0fd5bc52-6a5d-4ebd-8ba8-4f3fd02ff8b8', '5b764aa8-5193-4dd7-bb05-e6156d4d8972', '0ea0ed7e-85cd-4073-8df4-ed3ea2d95ff3', '1d78ba78-5b5e-4e04-98ff-63148afec8c0'] {{(pid=87116) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 12:02:31 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-a4029d69-4cb0-48ae-b1bc-8b9b35e03ecc tempest-ProjectMemberTests-2097190340 None] Delete snapshot completed successfully. Nov 06 12:02:31 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-a4029d69-4cb0-48ae-b1bc-8b9b35e03ecc tempest-ProjectMemberTests-2097190340 None] Lock "cinder-cf85f128-f11f-447d-b5ed-ebfe68d98385-delete_snapshot" released by "delete_snapshot" :: held 1.811s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 12:02:31 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-b5bb96dc-d76f-4ae0-b5f9-3618f9fb0465 tempest-ProjectMemberTests-2097190340 None] Acquiring lock "cinder-c7ab98b7-00de-42e0-af52-2fd343f5aced-delete_volume" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 12:02:31 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-b5bb96dc-d76f-4ae0-b5f9-3618f9fb0465 tempest-ProjectMemberTests-2097190340 None] Lock "cinder-c7ab98b7-00de-42e0-af52-2fd343f5aced-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 12:02:31 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-b5bb96dc-d76f-4ae0-b5f9-3618f9fb0465 tempest-ProjectMemberTests-2097190340 None] Acquiring lock "cinder-quobyte-c7ab98b7-00de-42e0-af52-2fd343f5aced" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 12:02:31 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-b5bb96dc-d76f-4ae0-b5f9-3618f9fb0465 tempest-ProjectMemberTests-2097190340 None] Lock "cinder-quobyte-c7ab98b7-00de-42e0-af52-2fd343f5aced" acquired by "delete_volume" :: waited 0.017s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 12:02:31 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[98f55b32-9621-4eaa-96aa-d0f3747d3e78]: (4, 'qcow2') {{(pid=88420) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 12:02:31 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-b5bb96dc-d76f-4ae0-b5f9-3618f9fb0465 tempest-ProjectMemberTests-2097190340 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-c7ab98b7-00de-42e0-af52-2fd343f5aced {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 12:02:31 devstack sudo[107535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-c7ab98b7-00de-42e0-af52-2fd343f5aced Nov 06 12:02:31 devstack sudo[107535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 12:02:32 devstack sudo[107535]: pam_unix(sudo:session): session closed for user root Nov 06 12:02:32 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-b5bb96dc-d76f-4ae0-b5f9-3618f9fb0465 tempest-ProjectMemberTests-2097190340 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-c7ab98b7-00de-42e0-af52-2fd343f5aced" returned: 0 in 0.400s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 12:02:32 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-b5bb96dc-d76f-4ae0-b5f9-3618f9fb0465 tempest-ProjectMemberTests-2097190340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-c7ab98b7-00de-42e0-af52-2fd343f5aced {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 12:02:32 devstack sudo[107540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-c7ab98b7-00de-42e0-af52-2fd343f5aced Nov 06 12:02:32 devstack sudo[107540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 12:02:32 devstack sudo[107540]: pam_unix(sudo:session): session closed for user root Nov 06 12:02:32 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-b5bb96dc-d76f-4ae0-b5f9-3618f9fb0465 tempest-ProjectMemberTests-2097190340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-c7ab98b7-00de-42e0-af52-2fd343f5aced" returned: 0 in 0.258s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 12:02:32 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-b5bb96dc-d76f-4ae0-b5f9-3618f9fb0465 tempest-ProjectMemberTests-2097190340 None] Lock "cinder-quobyte-c7ab98b7-00de-42e0-af52-2fd343f5aced" released by "delete_volume" :: held 0.733s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 12:02:32 devstack cinder-volume[87116]: DEBUG cinder.quota [None req-b5bb96dc-d76f-4ae0-b5f9-3618f9fb0465 tempest-ProjectMemberTests-2097190340 None] Created reservations ['5e1d160b-dd4d-4513-abcc-334a19784901', 'dd198eb7-c326-4cbd-960f-cb41e1ab54d0', '899040a6-f4eb-427b-b6d6-a7c0c512dd51', '8dbb142c-5bba-4814-a188-a31ee805e868'] {{(pid=87116) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 12:02:32 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-b5bb96dc-d76f-4ae0-b5f9-3618f9fb0465 tempest-ProjectMemberTests-2097190340 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 12:02:32 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-b5bb96dc-d76f-4ae0-b5f9-3618f9fb0465 tempest-ProjectMemberTests-2097190340 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 12:02:32 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-b5bb96dc-d76f-4ae0-b5f9-3618f9fb0465 tempest-ProjectMemberTests-2097190340 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 12:02:32 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-b5bb96dc-d76f-4ae0-b5f9-3618f9fb0465 tempest-ProjectMemberTests-2097190340 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 12:02:32 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-b5bb96dc-d76f-4ae0-b5f9-3618f9fb0465 tempest-ProjectMemberTests-2097190340 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 12:02:32 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-b5bb96dc-d76f-4ae0-b5f9-3618f9fb0465 tempest-ProjectMemberTests-2097190340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 12:02:32 devstack sudo[107543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756 Nov 06 12:02:32 devstack sudo[107543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 12:02:32 devstack sudo[107543]: pam_unix(sudo:session): session closed for user root Nov 06 12:02:32 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-b5bb96dc-d76f-4ae0-b5f9-3618f9fb0465 tempest-ProjectMemberTests-2097190340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756" returned: 0 in 0.254s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 12:02:32 devstack cinder-volume[87116]: DEBUG cinder.manager [None req-b5bb96dc-d76f-4ae0-b5f9-3618f9fb0465 tempest-ProjectMemberTests-2097190340 None] Notifying Schedulers of capabilities ... {{(pid=87116) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 12:02:32 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-b5bb96dc-d76f-4ae0-b5f9-3618f9fb0465 tempest-ProjectMemberTests-2097190340 None] Deleted volume successfully. Nov 06 12:02:32 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-b5bb96dc-d76f-4ae0-b5f9-3618f9fb0465 tempest-ProjectMemberTests-2097190340 None] Lock "cinder-c7ab98b7-00de-42e0-af52-2fd343f5aced-delete_volume" released by "delete_volume" :: held 1.214s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 12:02:33 devstack cinder-volume[87116]: DEBUG cinder.volume.flows.manager.create_volume [None req-89a5079d-da7c-49c4-9351-d987365eb8ba tempest-ProjectMemberTests-2097190340 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87116) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 12:02:33 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-89a5079d-da7c-49c4-9351-d987365eb8ba tempest-ProjectMemberTests-2097190340 None] Flow 'volume_create_manager' (ec4361a3-d8f4-401b-a227-4cc7f53d7610) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 12:02:33 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-89a5079d-da7c-49c4-9351-d987365eb8ba tempest-ProjectMemberTests-2097190340 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7d7b7baa-0dcb-465f-819b-0f3e0d901028) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 12:02:33 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-89a5079d-da7c-49c4-9351-d987365eb8ba tempest-ProjectMemberTests-2097190340 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7d7b7baa-0dcb-465f-819b-0f3e0d901028) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T11:02:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1951164286',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5223c616-7b58-4bdf-87b5-05add7cad917,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='49c53ee964024de5ae12252eba82ea98',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T11:02:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T11:02:33Z,use_quota=True,user_id='eec80b5d986049c1b9691925283475b7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(34d3b144-d9b7-480a-a2e3-01e45f3d54c1),volume_type_id=34d3b144-d9b7-480a-a2e3-01e45f3d54c1)' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 12:02:33 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-89a5079d-da7c-49c4-9351-d987365eb8ba tempest-ProjectMemberTests-2097190340 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ab711aca-9a09-4ab3-a858-fceb2b951502) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 12:02:33 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-89a5079d-da7c-49c4-9351-d987365eb8ba tempest-ProjectMemberTests-2097190340 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ab711aca-9a09-4ab3-a858-fceb2b951502) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 12:02:33 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-89a5079d-da7c-49c4-9351-d987365eb8ba tempest-ProjectMemberTests-2097190340 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (676f51ce-deae-4c58-957a-ddf1e6c330d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 12:02:33 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-89a5079d-da7c-49c4-9351-d987365eb8ba tempest-ProjectMemberTests-2097190340 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (676f51ce-deae-4c58-957a-ddf1e6c330d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5223c616-7b58-4bdf-87b5-05add7cad917', 'volume_name': 'volume-5223c616-7b58-4bdf-87b5-05add7cad917', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 12:02:33 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-89a5079d-da7c-49c4-9351-d987365eb8ba tempest-ProjectMemberTests-2097190340 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f3dc9a80-b8fb-4c4f-81c4-eef2ca495c0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 12:02:33 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-89a5079d-da7c-49c4-9351-d987365eb8ba tempest-ProjectMemberTests-2097190340 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f3dc9a80-b8fb-4c4f-81c4-eef2ca495c0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 12:02:33 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-89a5079d-da7c-49c4-9351-d987365eb8ba tempest-ProjectMemberTests-2097190340 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ef39fbff-63f9-44b5-bd52-aa25cba1fe09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 12:02:33 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-89a5079d-da7c-49c4-9351-d987365eb8ba tempest-ProjectMemberTests-2097190340 None] Volume 5223c616-7b58-4bdf-87b5-05add7cad917: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5223c616-7b58-4bdf-87b5-05add7cad917', 'volume_size': 1} Nov 06 12:02:33 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-89a5079d-da7c-49c4-9351-d987365eb8ba tempest-ProjectMemberTests-2097190340 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 12:02:33 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-89a5079d-da7c-49c4-9351-d987365eb8ba tempest-ProjectMemberTests-2097190340 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 12:02:33 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-89a5079d-da7c-49c4-9351-d987365eb8ba tempest-ProjectMemberTests-2097190340 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T11:02:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1951164286',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5223c616-7b58-4bdf-87b5-05add7cad917,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='49c53ee964024de5ae12252eba82ea98',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T11:02:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T11:02:33Z,use_quota=True,user_id='eec80b5d986049c1b9691925283475b7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(34d3b144-d9b7-480a-a2e3-01e45f3d54c1),volume_type_id=34d3b144-d9b7-480a-a2e3-01e45f3d54c1)}" {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 12:02:33 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-89a5079d-da7c-49c4-9351-d987365eb8ba tempest-ProjectMemberTests-2097190340 None] Creating volume 5223c616-7b58-4bdf-87b5-05add7cad917 {{(pid=87116) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 12:02:33 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-89a5079d-da7c-49c4-9351-d987365eb8ba tempest-ProjectMemberTests-2097190340 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 12:02:33 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-89a5079d-da7c-49c4-9351-d987365eb8ba tempest-ProjectMemberTests-2097190340 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 12:02:33 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-89a5079d-da7c-49c4-9351-d987365eb8ba tempest-ProjectMemberTests-2097190340 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 12:02:33 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-89a5079d-da7c-49c4-9351-d987365eb8ba tempest-ProjectMemberTests-2097190340 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 12:02:33 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-89a5079d-da7c-49c4-9351-d987365eb8ba tempest-ProjectMemberTests-2097190340 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 12:02:33 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-89a5079d-da7c-49c4-9351-d987365eb8ba tempest-ProjectMemberTests-2097190340 None] Selected osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f as target Quobyte volume. {{(pid=87116) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 12:02:33 devstack cinder-volume[87116]: INFO cinder.volume.drivers.remotefs [None req-89a5079d-da7c-49c4-9351-d987365eb8ba tempest-ProjectMemberTests-2097190340 None] casted to osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f Nov 06 12:02:33 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-89a5079d-da7c-49c4-9351-d987365eb8ba tempest-ProjectMemberTests-2097190340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-5223c616-7b58-4bdf-87b5-05add7cad917 1073741824 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 12:02:33 devstack sudo[107547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-5223c616-7b58-4bdf-87b5-05add7cad917 1073741824 Nov 06 12:02:33 devstack sudo[107547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 12:02:33 devstack sudo[107547]: pam_unix(sudo:session): session closed for user root Nov 06 12:02:33 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-89a5079d-da7c-49c4-9351-d987365eb8ba tempest-ProjectMemberTests-2097190340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-5223c616-7b58-4bdf-87b5-05add7cad917 1073741824" returned: 0 in 0.484s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 12:02:33 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-89a5079d-da7c-49c4-9351-d987365eb8ba tempest-ProjectMemberTests-2097190340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-5223c616-7b58-4bdf-87b5-05add7cad917 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 12:02:33 devstack sudo[107553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-5223c616-7b58-4bdf-87b5-05add7cad917 Nov 06 12:02:33 devstack sudo[107553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 12:02:34 devstack sudo[107553]: pam_unix(sudo:session): session closed for user root Nov 06 12:02:34 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-89a5079d-da7c-49c4-9351-d987365eb8ba tempest-ProjectMemberTests-2097190340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-5223c616-7b58-4bdf-87b5-05add7cad917" returned: 0 in 0.248s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 12:02:34 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-89a5079d-da7c-49c4-9351-d987365eb8ba tempest-ProjectMemberTests-2097190340 None] <== create_volume: return (777ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f'} {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 12:02:34 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-89a5079d-da7c-49c4-9351-d987365eb8ba tempest-ProjectMemberTests-2097190340 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.780s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 12:02:34 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-89a5079d-da7c-49c4-9351-d987365eb8ba tempest-ProjectMemberTests-2097190340 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ef39fbff-63f9-44b5-bd52-aa25cba1fe09) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5223c616-7b58-4bdf-87b5-05add7cad917', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 12:02:34 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-89a5079d-da7c-49c4-9351-d987365eb8ba tempest-ProjectMemberTests-2097190340 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9868da1d-66d6-46e3-926a-c6074150c75c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 12:02:34 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-89a5079d-da7c-49c4-9351-d987365eb8ba tempest-ProjectMemberTests-2097190340 None] Volume volume-5223c616-7b58-4bdf-87b5-05add7cad917 (5223c616-7b58-4bdf-87b5-05add7cad917): created successfully Nov 06 12:02:34 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-89a5079d-da7c-49c4-9351-d987365eb8ba tempest-ProjectMemberTests-2097190340 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9868da1d-66d6-46e3-926a-c6074150c75c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 12:02:34 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-89a5079d-da7c-49c4-9351-d987365eb8ba tempest-ProjectMemberTests-2097190340 None] Flow 'volume_create_manager' (ec4361a3-d8f4-401b-a227-4cc7f53d7610) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 12:02:34 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-89a5079d-da7c-49c4-9351-d987365eb8ba tempest-ProjectMemberTests-2097190340 None] Created volume successfully. Nov 06 12:02:34 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-d3e70f4f-08a3-40c6-aa28-053bfd4eebbb tempest-ProjectMemberTests-2097190340 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 12:02:34 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-d3e70f4f-08a3-40c6-aa28-053bfd4eebbb tempest-ProjectMemberTests-2097190340 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 12:02:34 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-d3e70f4f-08a3-40c6-aa28-053bfd4eebbb tempest-ProjectMemberTests-2097190340 None] Creating offline snapshot ff29e4c0-0ca7-4915-ac6d-dcf88f5050ab of volume 5223c616-7b58-4bdf-87b5-05add7cad917 {{(pid=87116) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 06 12:02:34 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[815c1e2e-bd88-4db8-a735-84f2d14af21d]: (4, 'qcow2') {{(pid=88420) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 12:02:34 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-d3e70f4f-08a3-40c6-aa28-053bfd4eebbb tempest-ProjectMemberTests-2097190340 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-5223c616-7b58-4bdf-87b5-05add7cad917 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 12:02:34 devstack sudo[107556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-5223c616-7b58-4bdf-87b5-05add7cad917 Nov 06 12:02:34 devstack sudo[107556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 12:02:34 devstack sudo[107556]: pam_unix(sudo:session): session closed for user root Nov 06 12:02:34 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-d3e70f4f-08a3-40c6-aa28-053bfd4eebbb tempest-ProjectMemberTests-2097190340 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-5223c616-7b58-4bdf-87b5-05add7cad917" returned: 0 in 0.396s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 12:02:34 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-d3e70f4f-08a3-40c6-aa28-053bfd4eebbb tempest-ProjectMemberTests-2097190340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-5223c616-7b58-4bdf-87b5-05add7cad917,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-5223c616-7b58-4bdf-87b5-05add7cad917.ff29e4c0-0ca7-4915-ac6d-dcf88f5050ab 1G {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 12:02:34 devstack sudo[107561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-5223c616-7b58-4bdf-87b5-05add7cad917,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-5223c616-7b58-4bdf-87b5-05add7cad917.ff29e4c0-0ca7-4915-ac6d-dcf88f5050ab 1G Nov 06 12:02:34 devstack sudo[107561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 12:02:35 devstack sudo[107561]: pam_unix(sudo:session): session closed for user root Nov 06 12:02:35 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-d3e70f4f-08a3-40c6-aa28-053bfd4eebbb tempest-ProjectMemberTests-2097190340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-5223c616-7b58-4bdf-87b5-05add7cad917,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-5223c616-7b58-4bdf-87b5-05add7cad917.ff29e4c0-0ca7-4915-ac6d-dcf88f5050ab 1G" returned: 0 in 0.439s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 12:02:35 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-d3e70f4f-08a3-40c6-aa28-053bfd4eebbb tempest-ProjectMemberTests-2097190340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5223c616-7b58-4bdf-87b5-05add7cad917 -F qcow2 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-5223c616-7b58-4bdf-87b5-05add7cad917.ff29e4c0-0ca7-4915-ac6d-dcf88f5050ab {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 12:02:35 devstack sudo[107567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5223c616-7b58-4bdf-87b5-05add7cad917 -F qcow2 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-5223c616-7b58-4bdf-87b5-05add7cad917.ff29e4c0-0ca7-4915-ac6d-dcf88f5050ab Nov 06 12:02:35 devstack sudo[107567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 12:02:35 devstack sudo[107567]: pam_unix(sudo:session): session closed for user root Nov 06 12:02:35 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-d3e70f4f-08a3-40c6-aa28-053bfd4eebbb tempest-ProjectMemberTests-2097190340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5223c616-7b58-4bdf-87b5-05add7cad917 -F qcow2 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-5223c616-7b58-4bdf-87b5-05add7cad917.ff29e4c0-0ca7-4915-ac6d-dcf88f5050ab" returned: 0 in 0.356s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 12:02:35 devstack cinder-volume[87116]: WARNING cinder.volume.drivers.remotefs [None req-d3e70f4f-08a3-40c6-aa28-053bfd4eebbb tempest-ProjectMemberTests-2097190340 None] /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-5223c616-7b58-4bdf-87b5-05add7cad917.ff29e4c0-0ca7-4915-ac6d-dcf88f5050ab is being set with open permissions: ugo+rw Nov 06 12:02:35 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-d3e70f4f-08a3-40c6-aa28-053bfd4eebbb tempest-ProjectMemberTests-2097190340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-5223c616-7b58-4bdf-87b5-05add7cad917.ff29e4c0-0ca7-4915-ac6d-dcf88f5050ab {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 12:02:35 devstack sudo[107572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-5223c616-7b58-4bdf-87b5-05add7cad917.ff29e4c0-0ca7-4915-ac6d-dcf88f5050ab Nov 06 12:02:35 devstack sudo[107572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 12:02:35 devstack sudo[107572]: pam_unix(sudo:session): session closed for user root Nov 06 12:02:35 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-d3e70f4f-08a3-40c6-aa28-053bfd4eebbb tempest-ProjectMemberTests-2097190340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-5223c616-7b58-4bdf-87b5-05add7cad917.ff29e4c0-0ca7-4915-ac6d-dcf88f5050ab" returned: 0 in 0.247s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 12:02:35 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-d3e70f4f-08a3-40c6-aa28-053bfd4eebbb tempest-ProjectMemberTests-2097190340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-5223c616-7b58-4bdf-87b5-05add7cad917.info {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 12:02:35 devstack sudo[107575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-5223c616-7b58-4bdf-87b5-05add7cad917.info Nov 06 12:02:35 devstack sudo[107575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 12:02:36 devstack sudo[107575]: pam_unix(sudo:session): session closed for user root Nov 06 12:02:36 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-d3e70f4f-08a3-40c6-aa28-053bfd4eebbb tempest-ProjectMemberTests-2097190340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-5223c616-7b58-4bdf-87b5-05add7cad917.info" returned: 0 in 0.259s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 12:02:36 devstack cinder-volume[87116]: WARNING cinder.volume.drivers.remotefs [None req-d3e70f4f-08a3-40c6-aa28-053bfd4eebbb tempest-ProjectMemberTests-2097190340 None] /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-5223c616-7b58-4bdf-87b5-05add7cad917.info is being set with open permissions: ugo+rw Nov 06 12:02:36 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-d3e70f4f-08a3-40c6-aa28-053bfd4eebbb tempest-ProjectMemberTests-2097190340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-5223c616-7b58-4bdf-87b5-05add7cad917.info {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 12:02:36 devstack sudo[107578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-5223c616-7b58-4bdf-87b5-05add7cad917.info Nov 06 12:02:36 devstack sudo[107578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 12:02:36 devstack sudo[107578]: pam_unix(sudo:session): session closed for user root Nov 06 12:02:36 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-d3e70f4f-08a3-40c6-aa28-053bfd4eebbb tempest-ProjectMemberTests-2097190340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-5223c616-7b58-4bdf-87b5-05add7cad917.info" returned: 0 in 0.277s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 12:02:36 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-d3e70f4f-08a3-40c6-aa28-053bfd4eebbb tempest-ProjectMemberTests-2097190340 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.074s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 12:02:36 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-d3e70f4f-08a3-40c6-aa28-053bfd4eebbb tempest-ProjectMemberTests-2097190340 None] Create snapshot completed successfully Nov 06 12:02:37 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-81fe379c-a8bf-4c26-a70e-6723bed2c406 tempest-ProjectMemberTests-2097190340 None] Acquiring lock "cinder-ff29e4c0-0ca7-4915-ac6d-dcf88f5050ab-delete_snapshot" by "delete_snapshot" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 12:02:37 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-81fe379c-a8bf-4c26-a70e-6723bed2c406 tempest-ProjectMemberTests-2097190340 None] Lock "cinder-ff29e4c0-0ca7-4915-ac6d-dcf88f5050ab-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 12:02:37 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-81fe379c-a8bf-4c26-a70e-6723bed2c406 tempest-ProjectMemberTests-2097190340 None] Acquiring lock "cinder-quobyte-5223c616-7b58-4bdf-87b5-05add7cad917" by "delete_snapshot" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 12:02:37 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-81fe379c-a8bf-4c26-a70e-6723bed2c406 tempest-ProjectMemberTests-2097190340 None] Lock "cinder-quobyte-5223c616-7b58-4bdf-87b5-05add7cad917" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 12:02:37 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-81fe379c-a8bf-4c26-a70e-6723bed2c406 tempest-ProjectMemberTests-2097190340 None] Acquiring lock "cinder-quobyte-ff29e4c0-0ca7-4915-ac6d-dcf88f5050ab" by "_delete_snapshot" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 12:02:37 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-81fe379c-a8bf-4c26-a70e-6723bed2c406 tempest-ProjectMemberTests-2097190340 None] Lock "cinder-quobyte-ff29e4c0-0ca7-4915-ac6d-dcf88f5050ab" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 12:02:37 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-81fe379c-a8bf-4c26-a70e-6723bed2c406 tempest-ProjectMemberTests-2097190340 None] Deleting offline snapshot ff29e4c0-0ca7-4915-ac6d-dcf88f5050ab of volume 5223c616-7b58-4bdf-87b5-05add7cad917 {{(pid=87116) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 06 12:02:37 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-81fe379c-a8bf-4c26-a70e-6723bed2c406 tempest-ProjectMemberTests-2097190340 None] snapshot_file for this snap is: volume-5223c616-7b58-4bdf-87b5-05add7cad917.ff29e4c0-0ca7-4915-ac6d-dcf88f5050ab {{(pid=87116) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 06 12:02:37 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[41d260c3-3604-43b0-8a8b-5c74b7824e23]: (4, 'qcow2') {{(pid=88420) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 12:02:37 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-81fe379c-a8bf-4c26-a70e-6723bed2c406 tempest-ProjectMemberTests-2097190340 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-5223c616-7b58-4bdf-87b5-05add7cad917.ff29e4c0-0ca7-4915-ac6d-dcf88f5050ab {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 12:02:37 devstack sudo[107581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-5223c616-7b58-4bdf-87b5-05add7cad917.ff29e4c0-0ca7-4915-ac6d-dcf88f5050ab Nov 06 12:02:37 devstack sudo[107581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 12:02:38 devstack sudo[107581]: pam_unix(sudo:session): session closed for user root Nov 06 12:02:38 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-81fe379c-a8bf-4c26-a70e-6723bed2c406 tempest-ProjectMemberTests-2097190340 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-5223c616-7b58-4bdf-87b5-05add7cad917.ff29e4c0-0ca7-4915-ac6d-dcf88f5050ab" returned: 0 in 0.403s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 12:02:38 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-81fe379c-a8bf-4c26-a70e-6723bed2c406 tempest-ProjectMemberTests-2097190340 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5223c616-7b58-4bdf-87b5-05add7cad917(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87116) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 12:02:38 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[002a7cf2-5c66-4f92-a1f8-8c7f731f4278]: (4, 'qcow2') {{(pid=88420) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 12:02:38 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-81fe379c-a8bf-4c26-a70e-6723bed2c406 tempest-ProjectMemberTests-2097190340 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-5223c616-7b58-4bdf-87b5-05add7cad917 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 12:02:38 devstack sudo[107586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-5223c616-7b58-4bdf-87b5-05add7cad917 Nov 06 12:02:38 devstack sudo[107586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 12:02:38 devstack sudo[107586]: pam_unix(sudo:session): session closed for user root Nov 06 12:02:38 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-81fe379c-a8bf-4c26-a70e-6723bed2c406 tempest-ProjectMemberTests-2097190340 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-5223c616-7b58-4bdf-87b5-05add7cad917" returned: 0 in 0.392s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 12:02:38 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-81fe379c-a8bf-4c26-a70e-6723bed2c406 tempest-ProjectMemberTests-2097190340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-5223c616-7b58-4bdf-87b5-05add7cad917.ff29e4c0-0ca7-4915-ac6d-dcf88f5050ab {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 12:02:38 devstack sudo[107597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-5223c616-7b58-4bdf-87b5-05add7cad917.ff29e4c0-0ca7-4915-ac6d-dcf88f5050ab Nov 06 12:02:38 devstack sudo[107597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 12:02:38 devstack sudo[107597]: pam_unix(sudo:session): session closed for user root Nov 06 12:02:38 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-81fe379c-a8bf-4c26-a70e-6723bed2c406 tempest-ProjectMemberTests-2097190340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-5223c616-7b58-4bdf-87b5-05add7cad917.ff29e4c0-0ca7-4915-ac6d-dcf88f5050ab" returned: 0 in 0.399s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 12:02:38 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-81fe379c-a8bf-4c26-a70e-6723bed2c406 tempest-ProjectMemberTests-2097190340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-5223c616-7b58-4bdf-87b5-05add7cad917.ff29e4c0-0ca7-4915-ac6d-dcf88f5050ab {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 12:02:38 devstack sudo[107603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-5223c616-7b58-4bdf-87b5-05add7cad917.ff29e4c0-0ca7-4915-ac6d-dcf88f5050ab Nov 06 12:02:38 devstack sudo[107603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 12:02:39 devstack sudo[107603]: pam_unix(sudo:session): session closed for user root Nov 06 12:02:39 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-81fe379c-a8bf-4c26-a70e-6723bed2c406 tempest-ProjectMemberTests-2097190340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-5223c616-7b58-4bdf-87b5-05add7cad917.ff29e4c0-0ca7-4915-ac6d-dcf88f5050ab" returned: 0 in 0.273s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 12:02:39 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-81fe379c-a8bf-4c26-a70e-6723bed2c406 tempest-ProjectMemberTests-2097190340 None] Lock "cinder-quobyte-ff29e4c0-0ca7-4915-ac6d-dcf88f5050ab" released by "_delete_snapshot" :: held 1.581s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 12:02:39 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-81fe379c-a8bf-4c26-a70e-6723bed2c406 tempest-ProjectMemberTests-2097190340 None] Lock "cinder-quobyte-5223c616-7b58-4bdf-87b5-05add7cad917" released by "delete_snapshot" :: held 1.611s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 12:02:39 devstack cinder-volume[87116]: DEBUG cinder.quota [None req-81fe379c-a8bf-4c26-a70e-6723bed2c406 tempest-ProjectMemberTests-2097190340 None] Created reservations ['97f81c91-5591-4d51-902a-bc4b0ed7e370', '683f6867-2907-4322-91c3-822283206abb', '7b45151c-df9b-4024-8bd0-d33f736f5bf4', '6b144ebe-456d-4a05-94e0-29957c2a3a5b'] {{(pid=87116) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 12:02:39 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-81fe379c-a8bf-4c26-a70e-6723bed2c406 tempest-ProjectMemberTests-2097190340 None] Delete snapshot completed successfully. Nov 06 12:02:39 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-81fe379c-a8bf-4c26-a70e-6723bed2c406 tempest-ProjectMemberTests-2097190340 None] Lock "cinder-ff29e4c0-0ca7-4915-ac6d-dcf88f5050ab-delete_snapshot" released by "delete_snapshot" :: held 1.757s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 12:02:39 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-c34add48-f967-4177-abf6-79b9e31c3069 tempest-ProjectMemberTests-2097190340 None] Acquiring lock "cinder-5223c616-7b58-4bdf-87b5-05add7cad917-delete_volume" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 12:02:39 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-c34add48-f967-4177-abf6-79b9e31c3069 tempest-ProjectMemberTests-2097190340 None] Lock "cinder-5223c616-7b58-4bdf-87b5-05add7cad917-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 12:02:39 devstack cinder-volume[87116]: DEBUG oslo_service.periodic_task [None req-4fab4816-ec2b-4b19-b2ff-8548f2084354 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87116) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 12:02:39 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-4fab4816-ec2b-4b19-b2ff-8548f2084354 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 12:02:39 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-4fab4816-ec2b-4b19-b2ff-8548f2084354 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 12:02:39 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-4fab4816-ec2b-4b19-b2ff-8548f2084354 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 12:02:39 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-4fab4816-ec2b-4b19-b2ff-8548f2084354 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 12:02:39 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-4fab4816-ec2b-4b19-b2ff-8548f2084354 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 12:02:39 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-4fab4816-ec2b-4b19-b2ff-8548f2084354 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 12:02:39 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-c34add48-f967-4177-abf6-79b9e31c3069 tempest-ProjectMemberTests-2097190340 None] Acquiring lock "cinder-quobyte-5223c616-7b58-4bdf-87b5-05add7cad917" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 12:02:39 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-c34add48-f967-4177-abf6-79b9e31c3069 tempest-ProjectMemberTests-2097190340 None] Lock "cinder-quobyte-5223c616-7b58-4bdf-87b5-05add7cad917" acquired by "delete_volume" :: waited 0.029s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 12:02:39 devstack sudo[107642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756 Nov 06 12:02:39 devstack sudo[107642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 12:02:40 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2358db9-4f1e-4d1f-af66-82b360f27e74]: (4, 'qcow2') {{(pid=88420) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 12:02:40 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-c34add48-f967-4177-abf6-79b9e31c3069 tempest-ProjectMemberTests-2097190340 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-5223c616-7b58-4bdf-87b5-05add7cad917 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 12:02:40 devstack sudo[107644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-5223c616-7b58-4bdf-87b5-05add7cad917 Nov 06 12:02:40 devstack sudo[107644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 12:02:40 devstack sudo[107642]: pam_unix(sudo:session): session closed for user root Nov 06 12:02:40 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-4fab4816-ec2b-4b19-b2ff-8548f2084354 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756" returned: 0 in 0.318s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 12:02:40 devstack cinder-volume[87116]: DEBUG cinder.manager [None req-4fab4816-ec2b-4b19-b2ff-8548f2084354 None None] Notifying Schedulers of capabilities ... {{(pid=87116) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 12:02:40 devstack cinder-volume[87116]: DEBUG oslo_service.periodic_task [None req-4fab4816-ec2b-4b19-b2ff-8548f2084354 None None] Running periodic task VolumeManager._thread_info {{(pid=87116) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 12:02:40 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-4fab4816-ec2b-4b19-b2ff-8548f2084354 None None] thread count: 28 {{(pid=87116) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 06 12:02:40 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-4fab4816-ec2b-4b19-b2ff-8548f2084354 None None] thread info: [<_MainThread(MainThread, started 131399520669824)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87116) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 06 12:02:40 devstack sudo[107644]: pam_unix(sudo:session): session closed for user root Nov 06 12:02:40 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-c34add48-f967-4177-abf6-79b9e31c3069 tempest-ProjectMemberTests-2097190340 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-5223c616-7b58-4bdf-87b5-05add7cad917" returned: 0 in 0.430s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 12:02:40 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-c34add48-f967-4177-abf6-79b9e31c3069 tempest-ProjectMemberTests-2097190340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-5223c616-7b58-4bdf-87b5-05add7cad917 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 12:02:40 devstack sudo[107651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-5223c616-7b58-4bdf-87b5-05add7cad917 Nov 06 12:02:40 devstack sudo[107651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 12:02:40 devstack sudo[107651]: pam_unix(sudo:session): session closed for user root Nov 06 12:02:40 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-c34add48-f967-4177-abf6-79b9e31c3069 tempest-ProjectMemberTests-2097190340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-5223c616-7b58-4bdf-87b5-05add7cad917" returned: 0 in 0.294s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 12:02:40 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-c34add48-f967-4177-abf6-79b9e31c3069 tempest-ProjectMemberTests-2097190340 None] Lock "cinder-quobyte-5223c616-7b58-4bdf-87b5-05add7cad917" released by "delete_volume" :: held 0.827s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 12:02:40 devstack cinder-volume[87116]: DEBUG cinder.quota [None req-c34add48-f967-4177-abf6-79b9e31c3069 tempest-ProjectMemberTests-2097190340 None] Created reservations ['5d73f332-9b19-4044-9b31-c0165a8305af', 'a10daba5-bc52-4941-b780-95b8d9acc179', '7a4dbcaf-e9b3-4111-975a-c5c15de5fdd9', 'bdf9a0f7-bc6a-4c68-aaf7-15563b801a7c'] {{(pid=87116) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 12:02:40 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-c34add48-f967-4177-abf6-79b9e31c3069 tempest-ProjectMemberTests-2097190340 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 12:02:40 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-c34add48-f967-4177-abf6-79b9e31c3069 tempest-ProjectMemberTests-2097190340 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 12:02:40 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-c34add48-f967-4177-abf6-79b9e31c3069 tempest-ProjectMemberTests-2097190340 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 12:02:40 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-c34add48-f967-4177-abf6-79b9e31c3069 tempest-ProjectMemberTests-2097190340 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 12:02:40 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-c34add48-f967-4177-abf6-79b9e31c3069 tempest-ProjectMemberTests-2097190340 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 12:02:40 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-c34add48-f967-4177-abf6-79b9e31c3069 tempest-ProjectMemberTests-2097190340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 12:02:40 devstack sudo[107654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756 Nov 06 12:02:40 devstack sudo[107654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 12:02:41 devstack sudo[107654]: pam_unix(sudo:session): session closed for user root Nov 06 12:02:41 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-c34add48-f967-4177-abf6-79b9e31c3069 tempest-ProjectMemberTests-2097190340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756" returned: 0 in 0.294s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 12:02:41 devstack cinder-volume[87116]: DEBUG cinder.manager [None req-c34add48-f967-4177-abf6-79b9e31c3069 tempest-ProjectMemberTests-2097190340 None] Notifying Schedulers of capabilities ... {{(pid=87116) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 12:02:41 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-c34add48-f967-4177-abf6-79b9e31c3069 tempest-ProjectMemberTests-2097190340 None] Deleted volume successfully. Nov 06 12:02:41 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-c34add48-f967-4177-abf6-79b9e31c3069 tempest-ProjectMemberTests-2097190340 None] Lock "cinder-5223c616-7b58-4bdf-87b5-05add7cad917-delete_volume" released by "delete_volume" :: held 1.398s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 12:02:41 devstack cinder-volume[87116]: DEBUG cinder.volume.flows.manager.create_volume [None req-a236418e-42fa-4b53-8772-137af95fea3d tempest-ProjectMemberTests-2097190340 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87116) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 12:02:41 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-a236418e-42fa-4b53-8772-137af95fea3d tempest-ProjectMemberTests-2097190340 None] Flow 'volume_create_manager' (39ad9082-5f12-4276-9631-78ff328cbb4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 12:02:41 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-a236418e-42fa-4b53-8772-137af95fea3d tempest-ProjectMemberTests-2097190340 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e95058ff-7d3e-42cf-a0b3-c3980bbfee8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 12:02:41 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-a236418e-42fa-4b53-8772-137af95fea3d tempest-ProjectMemberTests-2097190340 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e95058ff-7d3e-42cf-a0b3-c3980bbfee8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T11:02:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-303391531',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cfeda39a-f867-4655-bb8b-536da52acb83,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='49c53ee964024de5ae12252eba82ea98',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T11:02:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T11:02:42Z,use_quota=True,user_id='eec80b5d986049c1b9691925283475b7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(34d3b144-d9b7-480a-a2e3-01e45f3d54c1),volume_type_id=34d3b144-d9b7-480a-a2e3-01e45f3d54c1)' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 12:02:41 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-a236418e-42fa-4b53-8772-137af95fea3d tempest-ProjectMemberTests-2097190340 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b14ca60d-c91e-4778-bcb5-b14f9193bcd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 12:02:41 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-a236418e-42fa-4b53-8772-137af95fea3d tempest-ProjectMemberTests-2097190340 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b14ca60d-c91e-4778-bcb5-b14f9193bcd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 12:02:41 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-a236418e-42fa-4b53-8772-137af95fea3d tempest-ProjectMemberTests-2097190340 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2a66c005-63cb-4296-bc46-a77ded5106d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 12:02:41 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-a236418e-42fa-4b53-8772-137af95fea3d tempest-ProjectMemberTests-2097190340 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2a66c005-63cb-4296-bc46-a77ded5106d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cfeda39a-f867-4655-bb8b-536da52acb83', 'volume_name': 'volume-cfeda39a-f867-4655-bb8b-536da52acb83', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 12:02:41 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-a236418e-42fa-4b53-8772-137af95fea3d tempest-ProjectMemberTests-2097190340 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d4378c7f-fefe-4d37-ae51-d930bfa343f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 12:02:41 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-a236418e-42fa-4b53-8772-137af95fea3d tempest-ProjectMemberTests-2097190340 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d4378c7f-fefe-4d37-ae51-d930bfa343f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 12:02:41 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-a236418e-42fa-4b53-8772-137af95fea3d tempest-ProjectMemberTests-2097190340 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a2383745-d16c-4557-80ab-f5497a0174d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 12:02:41 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-a236418e-42fa-4b53-8772-137af95fea3d tempest-ProjectMemberTests-2097190340 None] Volume cfeda39a-f867-4655-bb8b-536da52acb83: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cfeda39a-f867-4655-bb8b-536da52acb83', 'volume_size': 1} Nov 06 12:02:41 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-a236418e-42fa-4b53-8772-137af95fea3d tempest-ProjectMemberTests-2097190340 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 12:02:41 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-a236418e-42fa-4b53-8772-137af95fea3d tempest-ProjectMemberTests-2097190340 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 12:02:41 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-a236418e-42fa-4b53-8772-137af95fea3d tempest-ProjectMemberTests-2097190340 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T11:02:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-303391531',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cfeda39a-f867-4655-bb8b-536da52acb83,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='49c53ee964024de5ae12252eba82ea98',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T11:02:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T11:02:42Z,use_quota=True,user_id='eec80b5d986049c1b9691925283475b7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(34d3b144-d9b7-480a-a2e3-01e45f3d54c1),volume_type_id=34d3b144-d9b7-480a-a2e3-01e45f3d54c1)}" {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 12:02:41 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-a236418e-42fa-4b53-8772-137af95fea3d tempest-ProjectMemberTests-2097190340 None] Creating volume cfeda39a-f867-4655-bb8b-536da52acb83 {{(pid=87116) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 12:02:41 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-a236418e-42fa-4b53-8772-137af95fea3d tempest-ProjectMemberTests-2097190340 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 12:02:41 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-a236418e-42fa-4b53-8772-137af95fea3d tempest-ProjectMemberTests-2097190340 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 12:02:41 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-a236418e-42fa-4b53-8772-137af95fea3d tempest-ProjectMemberTests-2097190340 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 12:02:41 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-a236418e-42fa-4b53-8772-137af95fea3d tempest-ProjectMemberTests-2097190340 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 12:02:41 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-a236418e-42fa-4b53-8772-137af95fea3d tempest-ProjectMemberTests-2097190340 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 12:02:41 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-a236418e-42fa-4b53-8772-137af95fea3d tempest-ProjectMemberTests-2097190340 None] Selected osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f as target Quobyte volume. {{(pid=87116) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 12:02:41 devstack cinder-volume[87116]: INFO cinder.volume.drivers.remotefs [None req-a236418e-42fa-4b53-8772-137af95fea3d tempest-ProjectMemberTests-2097190340 None] casted to osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f Nov 06 12:02:41 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-a236418e-42fa-4b53-8772-137af95fea3d tempest-ProjectMemberTests-2097190340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-cfeda39a-f867-4655-bb8b-536da52acb83 1073741824 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 12:02:41 devstack sudo[107659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-cfeda39a-f867-4655-bb8b-536da52acb83 1073741824 Nov 06 12:02:41 devstack sudo[107659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 12:02:42 devstack sudo[107659]: pam_unix(sudo:session): session closed for user root Nov 06 12:02:42 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-a236418e-42fa-4b53-8772-137af95fea3d tempest-ProjectMemberTests-2097190340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-cfeda39a-f867-4655-bb8b-536da52acb83 1073741824" returned: 0 in 0.475s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 12:02:42 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-a236418e-42fa-4b53-8772-137af95fea3d tempest-ProjectMemberTests-2097190340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-cfeda39a-f867-4655-bb8b-536da52acb83 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 12:02:42 devstack sudo[107665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-cfeda39a-f867-4655-bb8b-536da52acb83 Nov 06 12:02:42 devstack sudo[107665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 12:02:42 devstack sudo[107665]: pam_unix(sudo:session): session closed for user root Nov 06 12:02:42 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-a236418e-42fa-4b53-8772-137af95fea3d tempest-ProjectMemberTests-2097190340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-cfeda39a-f867-4655-bb8b-536da52acb83" returned: 0 in 0.254s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 12:02:42 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-a236418e-42fa-4b53-8772-137af95fea3d tempest-ProjectMemberTests-2097190340 None] <== create_volume: return (777ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f'} {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 12:02:42 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-a236418e-42fa-4b53-8772-137af95fea3d tempest-ProjectMemberTests-2097190340 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.780s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 12:02:42 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-a236418e-42fa-4b53-8772-137af95fea3d tempest-ProjectMemberTests-2097190340 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a2383745-d16c-4557-80ab-f5497a0174d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cfeda39a-f867-4655-bb8b-536da52acb83', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 12:02:42 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-a236418e-42fa-4b53-8772-137af95fea3d tempest-ProjectMemberTests-2097190340 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (44650c98-2b7c-43c9-ad7f-9a7393445261) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 12:02:42 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-a236418e-42fa-4b53-8772-137af95fea3d tempest-ProjectMemberTests-2097190340 None] Volume volume-cfeda39a-f867-4655-bb8b-536da52acb83 (cfeda39a-f867-4655-bb8b-536da52acb83): created successfully Nov 06 12:02:42 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-a236418e-42fa-4b53-8772-137af95fea3d tempest-ProjectMemberTests-2097190340 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (44650c98-2b7c-43c9-ad7f-9a7393445261) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 12:02:42 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-a236418e-42fa-4b53-8772-137af95fea3d tempest-ProjectMemberTests-2097190340 None] Flow 'volume_create_manager' (39ad9082-5f12-4276-9631-78ff328cbb4e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 12:02:42 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-a236418e-42fa-4b53-8772-137af95fea3d tempest-ProjectMemberTests-2097190340 None] Created volume successfully. Nov 06 12:02:43 devstack cinder-volume[87116]: DEBUG dbcounter [-] [87116] Writing DB stats cinder:UPDATE=248,cinder:SELECT=196,cinder:INSERT=71,cinder:DELETE=25 {{(pid=87116) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 12:02:43 devstack cinder-volume[87116]: DEBUG dbcounter [-] [87116] Writing DB stats cinder:SELECT=168,cinder:INSERT=58,cinder:UPDATE=244,cinder:DELETE=16 {{(pid=87116) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 12:02:43 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-948312fb-3b79-4563-b416-3ff67ec21be3 tempest-ProjectMemberTests-2097190340 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 12:02:43 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-948312fb-3b79-4563-b416-3ff67ec21be3 tempest-ProjectMemberTests-2097190340 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 12:02:43 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-948312fb-3b79-4563-b416-3ff67ec21be3 tempest-ProjectMemberTests-2097190340 None] Creating offline snapshot 1e68b8e6-4eef-4c39-9a7d-466d33f51d10 of volume cfeda39a-f867-4655-bb8b-536da52acb83 {{(pid=87116) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 06 12:02:43 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[1105ba55-afce-4772-92bd-3b35ad6cee35]: (4, 'qcow2') {{(pid=88420) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 12:02:43 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-948312fb-3b79-4563-b416-3ff67ec21be3 tempest-ProjectMemberTests-2097190340 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-cfeda39a-f867-4655-bb8b-536da52acb83 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 12:02:43 devstack sudo[107669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-cfeda39a-f867-4655-bb8b-536da52acb83 Nov 06 12:02:44 devstack sudo[107669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 12:02:44 devstack sudo[107669]: pam_unix(sudo:session): session closed for user root Nov 06 12:02:44 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-948312fb-3b79-4563-b416-3ff67ec21be3 tempest-ProjectMemberTests-2097190340 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-cfeda39a-f867-4655-bb8b-536da52acb83" returned: 0 in 0.368s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 12:02:44 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-948312fb-3b79-4563-b416-3ff67ec21be3 tempest-ProjectMemberTests-2097190340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-cfeda39a-f867-4655-bb8b-536da52acb83,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-cfeda39a-f867-4655-bb8b-536da52acb83.1e68b8e6-4eef-4c39-9a7d-466d33f51d10 1G {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 12:02:44 devstack sudo[107674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-cfeda39a-f867-4655-bb8b-536da52acb83,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-cfeda39a-f867-4655-bb8b-536da52acb83.1e68b8e6-4eef-4c39-9a7d-466d33f51d10 1G Nov 06 12:02:44 devstack sudo[107674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 12:02:44 devstack sudo[107674]: pam_unix(sudo:session): session closed for user root Nov 06 12:02:44 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-948312fb-3b79-4563-b416-3ff67ec21be3 tempest-ProjectMemberTests-2097190340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-cfeda39a-f867-4655-bb8b-536da52acb83,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-cfeda39a-f867-4655-bb8b-536da52acb83.1e68b8e6-4eef-4c39-9a7d-466d33f51d10 1G" returned: 0 in 0.376s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 12:02:44 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-948312fb-3b79-4563-b416-3ff67ec21be3 tempest-ProjectMemberTests-2097190340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cfeda39a-f867-4655-bb8b-536da52acb83 -F qcow2 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-cfeda39a-f867-4655-bb8b-536da52acb83.1e68b8e6-4eef-4c39-9a7d-466d33f51d10 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 12:02:44 devstack sudo[107680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cfeda39a-f867-4655-bb8b-536da52acb83 -F qcow2 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-cfeda39a-f867-4655-bb8b-536da52acb83.1e68b8e6-4eef-4c39-9a7d-466d33f51d10 Nov 06 12:02:44 devstack sudo[107680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 12:02:44 devstack sudo[107680]: pam_unix(sudo:session): session closed for user root Nov 06 12:02:44 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-948312fb-3b79-4563-b416-3ff67ec21be3 tempest-ProjectMemberTests-2097190340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cfeda39a-f867-4655-bb8b-536da52acb83 -F qcow2 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-cfeda39a-f867-4655-bb8b-536da52acb83.1e68b8e6-4eef-4c39-9a7d-466d33f51d10" returned: 0 in 0.278s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 12:02:44 devstack cinder-volume[87116]: WARNING cinder.volume.drivers.remotefs [None req-948312fb-3b79-4563-b416-3ff67ec21be3 tempest-ProjectMemberTests-2097190340 None] /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-cfeda39a-f867-4655-bb8b-536da52acb83.1e68b8e6-4eef-4c39-9a7d-466d33f51d10 is being set with open permissions: ugo+rw Nov 06 12:02:44 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-948312fb-3b79-4563-b416-3ff67ec21be3 tempest-ProjectMemberTests-2097190340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-cfeda39a-f867-4655-bb8b-536da52acb83.1e68b8e6-4eef-4c39-9a7d-466d33f51d10 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 12:02:44 devstack sudo[107685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-cfeda39a-f867-4655-bb8b-536da52acb83.1e68b8e6-4eef-4c39-9a7d-466d33f51d10 Nov 06 12:02:44 devstack sudo[107685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 12:02:45 devstack sudo[107685]: pam_unix(sudo:session): session closed for user root Nov 06 12:02:45 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-948312fb-3b79-4563-b416-3ff67ec21be3 tempest-ProjectMemberTests-2097190340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-cfeda39a-f867-4655-bb8b-536da52acb83.1e68b8e6-4eef-4c39-9a7d-466d33f51d10" returned: 0 in 0.230s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 12:02:45 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-948312fb-3b79-4563-b416-3ff67ec21be3 tempest-ProjectMemberTests-2097190340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-cfeda39a-f867-4655-bb8b-536da52acb83.info {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 12:02:45 devstack sudo[107688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-cfeda39a-f867-4655-bb8b-536da52acb83.info Nov 06 12:02:45 devstack sudo[107688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 12:02:45 devstack sudo[107688]: pam_unix(sudo:session): session closed for user root Nov 06 12:02:45 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-948312fb-3b79-4563-b416-3ff67ec21be3 tempest-ProjectMemberTests-2097190340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-cfeda39a-f867-4655-bb8b-536da52acb83.info" returned: 0 in 0.232s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 12:02:45 devstack cinder-volume[87116]: WARNING cinder.volume.drivers.remotefs [None req-948312fb-3b79-4563-b416-3ff67ec21be3 tempest-ProjectMemberTests-2097190340 None] /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-cfeda39a-f867-4655-bb8b-536da52acb83.info is being set with open permissions: ugo+rw Nov 06 12:02:45 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-948312fb-3b79-4563-b416-3ff67ec21be3 tempest-ProjectMemberTests-2097190340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-cfeda39a-f867-4655-bb8b-536da52acb83.info {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 12:02:45 devstack sudo[107691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-cfeda39a-f867-4655-bb8b-536da52acb83.info Nov 06 12:02:45 devstack sudo[107691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 12:02:45 devstack sudo[107691]: pam_unix(sudo:session): session closed for user root Nov 06 12:02:45 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-948312fb-3b79-4563-b416-3ff67ec21be3 tempest-ProjectMemberTests-2097190340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-cfeda39a-f867-4655-bb8b-536da52acb83.info" returned: 0 in 0.235s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 12:02:45 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-948312fb-3b79-4563-b416-3ff67ec21be3 tempest-ProjectMemberTests-2097190340 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.796s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 12:02:45 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-948312fb-3b79-4563-b416-3ff67ec21be3 tempest-ProjectMemberTests-2097190340 None] Create snapshot completed successfully Nov 06 12:02:45 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-41b421d7-ce4c-495f-8dda-e9ef4bf40150 tempest-ProjectMemberTests-2097190340 None] Acquiring lock "cinder-1e68b8e6-4eef-4c39-9a7d-466d33f51d10-delete_snapshot" by "delete_snapshot" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 12:02:45 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-41b421d7-ce4c-495f-8dda-e9ef4bf40150 tempest-ProjectMemberTests-2097190340 None] Lock "cinder-1e68b8e6-4eef-4c39-9a7d-466d33f51d10-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 12:02:45 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-41b421d7-ce4c-495f-8dda-e9ef4bf40150 tempest-ProjectMemberTests-2097190340 None] Acquiring lock "cinder-quobyte-cfeda39a-f867-4655-bb8b-536da52acb83" by "delete_snapshot" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 12:02:45 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-41b421d7-ce4c-495f-8dda-e9ef4bf40150 tempest-ProjectMemberTests-2097190340 None] Lock "cinder-quobyte-cfeda39a-f867-4655-bb8b-536da52acb83" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 12:02:45 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-41b421d7-ce4c-495f-8dda-e9ef4bf40150 tempest-ProjectMemberTests-2097190340 None] Acquiring lock "cinder-quobyte-1e68b8e6-4eef-4c39-9a7d-466d33f51d10" by "_delete_snapshot" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 12:02:46 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-41b421d7-ce4c-495f-8dda-e9ef4bf40150 tempest-ProjectMemberTests-2097190340 None] Lock "cinder-quobyte-1e68b8e6-4eef-4c39-9a7d-466d33f51d10" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 12:02:46 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-41b421d7-ce4c-495f-8dda-e9ef4bf40150 tempest-ProjectMemberTests-2097190340 None] Deleting offline snapshot 1e68b8e6-4eef-4c39-9a7d-466d33f51d10 of volume cfeda39a-f867-4655-bb8b-536da52acb83 {{(pid=87116) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 06 12:02:46 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-41b421d7-ce4c-495f-8dda-e9ef4bf40150 tempest-ProjectMemberTests-2097190340 None] snapshot_file for this snap is: volume-cfeda39a-f867-4655-bb8b-536da52acb83.1e68b8e6-4eef-4c39-9a7d-466d33f51d10 {{(pid=87116) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 06 12:02:46 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[b15afbd3-ac62-4380-8744-0b36135ecfea]: (4, 'qcow2') {{(pid=88420) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 12:02:46 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-41b421d7-ce4c-495f-8dda-e9ef4bf40150 tempest-ProjectMemberTests-2097190340 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-cfeda39a-f867-4655-bb8b-536da52acb83.1e68b8e6-4eef-4c39-9a7d-466d33f51d10 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 12:02:46 devstack sudo[107694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-cfeda39a-f867-4655-bb8b-536da52acb83.1e68b8e6-4eef-4c39-9a7d-466d33f51d10 Nov 06 12:02:46 devstack sudo[107694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 12:02:46 devstack sudo[107694]: pam_unix(sudo:session): session closed for user root Nov 06 12:02:46 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-41b421d7-ce4c-495f-8dda-e9ef4bf40150 tempest-ProjectMemberTests-2097190340 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-cfeda39a-f867-4655-bb8b-536da52acb83.1e68b8e6-4eef-4c39-9a7d-466d33f51d10" returned: 0 in 0.337s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 12:02:46 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-41b421d7-ce4c-495f-8dda-e9ef4bf40150 tempest-ProjectMemberTests-2097190340 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cfeda39a-f867-4655-bb8b-536da52acb83(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87116) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 12:02:46 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c653076-a36d-4a8a-b02a-5c585aba32ab]: (4, 'qcow2') {{(pid=88420) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 12:02:46 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-41b421d7-ce4c-495f-8dda-e9ef4bf40150 tempest-ProjectMemberTests-2097190340 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-cfeda39a-f867-4655-bb8b-536da52acb83 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 12:02:46 devstack sudo[107699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-cfeda39a-f867-4655-bb8b-536da52acb83 Nov 06 12:02:46 devstack sudo[107699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 12:02:46 devstack sudo[107699]: pam_unix(sudo:session): session closed for user root Nov 06 12:02:46 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-41b421d7-ce4c-495f-8dda-e9ef4bf40150 tempest-ProjectMemberTests-2097190340 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-cfeda39a-f867-4655-bb8b-536da52acb83" returned: 0 in 0.334s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 12:02:46 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-41b421d7-ce4c-495f-8dda-e9ef4bf40150 tempest-ProjectMemberTests-2097190340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-cfeda39a-f867-4655-bb8b-536da52acb83.1e68b8e6-4eef-4c39-9a7d-466d33f51d10 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 12:02:46 devstack sudo[107704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-cfeda39a-f867-4655-bb8b-536da52acb83.1e68b8e6-4eef-4c39-9a7d-466d33f51d10 Nov 06 12:02:46 devstack sudo[107704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 12:02:47 devstack sudo[107704]: pam_unix(sudo:session): session closed for user root Nov 06 12:02:47 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-41b421d7-ce4c-495f-8dda-e9ef4bf40150 tempest-ProjectMemberTests-2097190340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-cfeda39a-f867-4655-bb8b-536da52acb83.1e68b8e6-4eef-4c39-9a7d-466d33f51d10" returned: 0 in 0.313s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 12:02:47 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-41b421d7-ce4c-495f-8dda-e9ef4bf40150 tempest-ProjectMemberTests-2097190340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-cfeda39a-f867-4655-bb8b-536da52acb83.1e68b8e6-4eef-4c39-9a7d-466d33f51d10 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 12:02:47 devstack sudo[107709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-cfeda39a-f867-4655-bb8b-536da52acb83.1e68b8e6-4eef-4c39-9a7d-466d33f51d10 Nov 06 12:02:47 devstack sudo[107709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 12:02:47 devstack sudo[107709]: pam_unix(sudo:session): session closed for user root Nov 06 12:02:47 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-41b421d7-ce4c-495f-8dda-e9ef4bf40150 tempest-ProjectMemberTests-2097190340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-cfeda39a-f867-4655-bb8b-536da52acb83.1e68b8e6-4eef-4c39-9a7d-466d33f51d10" returned: 0 in 0.236s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 12:02:47 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-41b421d7-ce4c-495f-8dda-e9ef4bf40150 tempest-ProjectMemberTests-2097190340 None] Lock "cinder-quobyte-1e68b8e6-4eef-4c39-9a7d-466d33f51d10" released by "_delete_snapshot" :: held 1.307s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 12:02:47 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-41b421d7-ce4c-495f-8dda-e9ef4bf40150 tempest-ProjectMemberTests-2097190340 None] Lock "cinder-quobyte-cfeda39a-f867-4655-bb8b-536da52acb83" released by "delete_snapshot" :: held 1.327s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 12:02:47 devstack cinder-volume[87116]: DEBUG cinder.quota [None req-41b421d7-ce4c-495f-8dda-e9ef4bf40150 tempest-ProjectMemberTests-2097190340 None] Created reservations ['1754a04c-1bbc-4a08-a082-7f6bbf9049ea', '7a29d666-611e-4127-a2ca-70beec8bfb2b', '71d064da-de6c-4b27-aed7-3c59bcceb18c', 'f221e02a-cdbe-4888-b8ca-3ddea1b63ea0'] {{(pid=87116) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 12:02:47 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-41b421d7-ce4c-495f-8dda-e9ef4bf40150 tempest-ProjectMemberTests-2097190340 None] Delete snapshot completed successfully. Nov 06 12:02:47 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-41b421d7-ce4c-495f-8dda-e9ef4bf40150 tempest-ProjectMemberTests-2097190340 None] Lock "cinder-1e68b8e6-4eef-4c39-9a7d-466d33f51d10-delete_snapshot" released by "delete_snapshot" :: held 1.450s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 12:02:48 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-83151371-bd4d-4e54-8c0d-1429e4c8a467 tempest-ProjectMemberTests-2097190340 None] Acquiring lock "cinder-cfeda39a-f867-4655-bb8b-536da52acb83-delete_volume" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 12:02:48 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-83151371-bd4d-4e54-8c0d-1429e4c8a467 tempest-ProjectMemberTests-2097190340 None] Lock "cinder-cfeda39a-f867-4655-bb8b-536da52acb83-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 12:02:48 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-83151371-bd4d-4e54-8c0d-1429e4c8a467 tempest-ProjectMemberTests-2097190340 None] Acquiring lock "cinder-quobyte-cfeda39a-f867-4655-bb8b-536da52acb83" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 12:02:48 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-83151371-bd4d-4e54-8c0d-1429e4c8a467 tempest-ProjectMemberTests-2097190340 None] Lock "cinder-quobyte-cfeda39a-f867-4655-bb8b-536da52acb83" acquired by "delete_volume" :: waited 0.015s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 12:02:48 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcc02213-d949-4b7f-a824-30c6c0f45584]: (4, 'qcow2') {{(pid=88420) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 12:02:48 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-83151371-bd4d-4e54-8c0d-1429e4c8a467 tempest-ProjectMemberTests-2097190340 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-cfeda39a-f867-4655-bb8b-536da52acb83 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 12:02:48 devstack sudo[107712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-cfeda39a-f867-4655-bb8b-536da52acb83 Nov 06 12:02:48 devstack sudo[107712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 12:02:48 devstack sudo[107712]: pam_unix(sudo:session): session closed for user root Nov 06 12:02:48 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-83151371-bd4d-4e54-8c0d-1429e4c8a467 tempest-ProjectMemberTests-2097190340 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-cfeda39a-f867-4655-bb8b-536da52acb83" returned: 0 in 0.343s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 12:02:48 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-83151371-bd4d-4e54-8c0d-1429e4c8a467 tempest-ProjectMemberTests-2097190340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-cfeda39a-f867-4655-bb8b-536da52acb83 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 12:02:48 devstack sudo[107717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-cfeda39a-f867-4655-bb8b-536da52acb83 Nov 06 12:02:48 devstack sudo[107717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 12:02:48 devstack sudo[107717]: pam_unix(sudo:session): session closed for user root Nov 06 12:02:48 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-83151371-bd4d-4e54-8c0d-1429e4c8a467 tempest-ProjectMemberTests-2097190340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-cfeda39a-f867-4655-bb8b-536da52acb83" returned: 0 in 0.228s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 12:02:48 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-83151371-bd4d-4e54-8c0d-1429e4c8a467 tempest-ProjectMemberTests-2097190340 None] Lock "cinder-quobyte-cfeda39a-f867-4655-bb8b-536da52acb83" released by "delete_volume" :: held 0.625s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 12:02:48 devstack cinder-volume[87116]: DEBUG cinder.quota [None req-83151371-bd4d-4e54-8c0d-1429e4c8a467 tempest-ProjectMemberTests-2097190340 None] Created reservations ['3cac5dc1-428d-4f85-a466-848e47b3543c', 'd2d002b3-f07f-4312-a76d-d7689d479080', '34595574-f4f3-4954-bd77-dc60b606bd09', '9bd54e51-1d1b-419f-bf9e-67f4ad9247f2'] {{(pid=87116) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 12:02:48 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-83151371-bd4d-4e54-8c0d-1429e4c8a467 tempest-ProjectMemberTests-2097190340 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 12:02:48 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-83151371-bd4d-4e54-8c0d-1429e4c8a467 tempest-ProjectMemberTests-2097190340 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 12:02:48 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-83151371-bd4d-4e54-8c0d-1429e4c8a467 tempest-ProjectMemberTests-2097190340 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 12:02:48 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-83151371-bd4d-4e54-8c0d-1429e4c8a467 tempest-ProjectMemberTests-2097190340 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 12:02:48 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-83151371-bd4d-4e54-8c0d-1429e4c8a467 tempest-ProjectMemberTests-2097190340 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 12:02:48 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-83151371-bd4d-4e54-8c0d-1429e4c8a467 tempest-ProjectMemberTests-2097190340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 12:02:48 devstack sudo[107720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756 Nov 06 12:02:48 devstack sudo[107720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 12:02:49 devstack sudo[107720]: pam_unix(sudo:session): session closed for user root Nov 06 12:02:49 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-83151371-bd4d-4e54-8c0d-1429e4c8a467 tempest-ProjectMemberTests-2097190340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756" returned: 0 in 0.238s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 12:02:49 devstack cinder-volume[87116]: DEBUG cinder.manager [None req-83151371-bd4d-4e54-8c0d-1429e4c8a467 tempest-ProjectMemberTests-2097190340 None] Notifying Schedulers of capabilities ... {{(pid=87116) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 12:02:49 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-83151371-bd4d-4e54-8c0d-1429e4c8a467 tempest-ProjectMemberTests-2097190340 None] Deleted volume successfully. Nov 06 12:02:49 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-83151371-bd4d-4e54-8c0d-1429e4c8a467 tempest-ProjectMemberTests-2097190340 None] Lock "cinder-cfeda39a-f867-4655-bb8b-536da52acb83-delete_volume" released by "delete_volume" :: held 1.046s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 12:02:49 devstack cinder-volume[87116]: DEBUG cinder.volume.flows.manager.create_volume [None req-35953d3a-8220-4451-ab4e-2de5dde9041c tempest-ProjectMemberTests-2097190340 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87116) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 12:02:49 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-35953d3a-8220-4451-ab4e-2de5dde9041c tempest-ProjectMemberTests-2097190340 None] Flow 'volume_create_manager' (d506f580-dca7-4262-9a3e-62914bf440ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 12:02:49 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-35953d3a-8220-4451-ab4e-2de5dde9041c tempest-ProjectMemberTests-2097190340 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4f27b75e-05c9-42bc-bab3-43bf9509f636) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 12:02:49 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-35953d3a-8220-4451-ab4e-2de5dde9041c tempest-ProjectMemberTests-2097190340 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4f27b75e-05c9-42bc-bab3-43bf9509f636) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T11:02:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-286140665',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ef11a0ae-6d93-42a1-be78-71ec7fd6e5e7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='49c53ee964024de5ae12252eba82ea98',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T11:02:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T11:02:50Z,use_quota=True,user_id='eec80b5d986049c1b9691925283475b7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(34d3b144-d9b7-480a-a2e3-01e45f3d54c1),volume_type_id=34d3b144-d9b7-480a-a2e3-01e45f3d54c1)' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 12:02:49 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-35953d3a-8220-4451-ab4e-2de5dde9041c tempest-ProjectMemberTests-2097190340 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1623a5d8-fe3d-4427-b452-10046da7c0b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 12:02:49 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-35953d3a-8220-4451-ab4e-2de5dde9041c tempest-ProjectMemberTests-2097190340 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1623a5d8-fe3d-4427-b452-10046da7c0b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 12:02:49 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-35953d3a-8220-4451-ab4e-2de5dde9041c tempest-ProjectMemberTests-2097190340 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ea781fe5-72a5-47d1-b03b-02205e414102) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 12:02:49 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-35953d3a-8220-4451-ab4e-2de5dde9041c tempest-ProjectMemberTests-2097190340 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ea781fe5-72a5-47d1-b03b-02205e414102) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ef11a0ae-6d93-42a1-be78-71ec7fd6e5e7', 'volume_name': 'volume-ef11a0ae-6d93-42a1-be78-71ec7fd6e5e7', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 12:02:49 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-35953d3a-8220-4451-ab4e-2de5dde9041c tempest-ProjectMemberTests-2097190340 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1ec6c772-bf02-411e-a677-24396fcf008c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 12:02:49 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-35953d3a-8220-4451-ab4e-2de5dde9041c tempest-ProjectMemberTests-2097190340 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1ec6c772-bf02-411e-a677-24396fcf008c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 12:02:49 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-35953d3a-8220-4451-ab4e-2de5dde9041c tempest-ProjectMemberTests-2097190340 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a860cf41-cf73-4459-b044-7319cebf8999) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 12:02:49 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-35953d3a-8220-4451-ab4e-2de5dde9041c tempest-ProjectMemberTests-2097190340 None] Volume ef11a0ae-6d93-42a1-be78-71ec7fd6e5e7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ef11a0ae-6d93-42a1-be78-71ec7fd6e5e7', 'volume_size': 1} Nov 06 12:02:49 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-35953d3a-8220-4451-ab4e-2de5dde9041c tempest-ProjectMemberTests-2097190340 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 12:02:49 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-35953d3a-8220-4451-ab4e-2de5dde9041c tempest-ProjectMemberTests-2097190340 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 12:02:49 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-35953d3a-8220-4451-ab4e-2de5dde9041c tempest-ProjectMemberTests-2097190340 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T11:02:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-286140665',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ef11a0ae-6d93-42a1-be78-71ec7fd6e5e7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='49c53ee964024de5ae12252eba82ea98',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T11:02:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T11:02:50Z,use_quota=True,user_id='eec80b5d986049c1b9691925283475b7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(34d3b144-d9b7-480a-a2e3-01e45f3d54c1),volume_type_id=34d3b144-d9b7-480a-a2e3-01e45f3d54c1)}" {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 12:02:49 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-35953d3a-8220-4451-ab4e-2de5dde9041c tempest-ProjectMemberTests-2097190340 None] Creating volume ef11a0ae-6d93-42a1-be78-71ec7fd6e5e7 {{(pid=87116) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 12:02:49 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-35953d3a-8220-4451-ab4e-2de5dde9041c tempest-ProjectMemberTests-2097190340 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 12:02:49 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-35953d3a-8220-4451-ab4e-2de5dde9041c tempest-ProjectMemberTests-2097190340 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 12:02:49 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-35953d3a-8220-4451-ab4e-2de5dde9041c tempest-ProjectMemberTests-2097190340 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 12:02:49 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-35953d3a-8220-4451-ab4e-2de5dde9041c tempest-ProjectMemberTests-2097190340 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 12:02:49 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-35953d3a-8220-4451-ab4e-2de5dde9041c tempest-ProjectMemberTests-2097190340 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 12:02:49 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-35953d3a-8220-4451-ab4e-2de5dde9041c tempest-ProjectMemberTests-2097190340 None] Selected osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f as target Quobyte volume. {{(pid=87116) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 12:02:49 devstack cinder-volume[87116]: INFO cinder.volume.drivers.remotefs [None req-35953d3a-8220-4451-ab4e-2de5dde9041c tempest-ProjectMemberTests-2097190340 None] casted to osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f Nov 06 12:02:49 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-35953d3a-8220-4451-ab4e-2de5dde9041c tempest-ProjectMemberTests-2097190340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-ef11a0ae-6d93-42a1-be78-71ec7fd6e5e7 1073741824 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 12:02:49 devstack sudo[107723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-ef11a0ae-6d93-42a1-be78-71ec7fd6e5e7 1073741824 Nov 06 12:02:49 devstack sudo[107723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 12:02:50 devstack sudo[107723]: pam_unix(sudo:session): session closed for user root Nov 06 12:02:50 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-35953d3a-8220-4451-ab4e-2de5dde9041c tempest-ProjectMemberTests-2097190340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-ef11a0ae-6d93-42a1-be78-71ec7fd6e5e7 1073741824" returned: 0 in 0.400s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 12:02:50 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-35953d3a-8220-4451-ab4e-2de5dde9041c tempest-ProjectMemberTests-2097190340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-ef11a0ae-6d93-42a1-be78-71ec7fd6e5e7 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 12:02:50 devstack sudo[107728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-ef11a0ae-6d93-42a1-be78-71ec7fd6e5e7 Nov 06 12:02:50 devstack sudo[107728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 12:02:50 devstack sudo[107728]: pam_unix(sudo:session): session closed for user root Nov 06 12:02:50 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-35953d3a-8220-4451-ab4e-2de5dde9041c tempest-ProjectMemberTests-2097190340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-ef11a0ae-6d93-42a1-be78-71ec7fd6e5e7" returned: 0 in 0.226s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 12:02:50 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-35953d3a-8220-4451-ab4e-2de5dde9041c tempest-ProjectMemberTests-2097190340 None] <== create_volume: return (663ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f'} {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 12:02:50 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-35953d3a-8220-4451-ab4e-2de5dde9041c tempest-ProjectMemberTests-2097190340 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.666s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 12:02:50 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-35953d3a-8220-4451-ab4e-2de5dde9041c tempest-ProjectMemberTests-2097190340 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a860cf41-cf73-4459-b044-7319cebf8999) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ef11a0ae-6d93-42a1-be78-71ec7fd6e5e7', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 12:02:50 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-35953d3a-8220-4451-ab4e-2de5dde9041c tempest-ProjectMemberTests-2097190340 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cda4f403-3c1e-4e65-abbb-908950b2d9f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 12:02:50 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-35953d3a-8220-4451-ab4e-2de5dde9041c tempest-ProjectMemberTests-2097190340 None] Volume volume-ef11a0ae-6d93-42a1-be78-71ec7fd6e5e7 (ef11a0ae-6d93-42a1-be78-71ec7fd6e5e7): created successfully Nov 06 12:02:50 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-35953d3a-8220-4451-ab4e-2de5dde9041c tempest-ProjectMemberTests-2097190340 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cda4f403-3c1e-4e65-abbb-908950b2d9f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 12:02:50 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-35953d3a-8220-4451-ab4e-2de5dde9041c tempest-ProjectMemberTests-2097190340 None] Flow 'volume_create_manager' (d506f580-dca7-4262-9a3e-62914bf440ec) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 12:02:50 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-35953d3a-8220-4451-ab4e-2de5dde9041c tempest-ProjectMemberTests-2097190340 None] Created volume successfully. Nov 06 12:02:50 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-cffdf831-e25e-43b2-a657-696c8124de48 tempest-ProjectMemberTests-2097190340 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 12:02:50 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-cffdf831-e25e-43b2-a657-696c8124de48 tempest-ProjectMemberTests-2097190340 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 12:02:50 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-cffdf831-e25e-43b2-a657-696c8124de48 tempest-ProjectMemberTests-2097190340 None] Creating offline snapshot ad297e9b-f558-4be5-8dde-6f59030c84cb of volume ef11a0ae-6d93-42a1-be78-71ec7fd6e5e7 {{(pid=87116) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 06 12:02:50 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bf3dd5f-0d17-449b-907f-d57fbc28cfb4]: (4, 'qcow2') {{(pid=88420) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 12:02:50 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-cffdf831-e25e-43b2-a657-696c8124de48 tempest-ProjectMemberTests-2097190340 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-ef11a0ae-6d93-42a1-be78-71ec7fd6e5e7 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 12:02:50 devstack sudo[107731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-ef11a0ae-6d93-42a1-be78-71ec7fd6e5e7 Nov 06 12:02:50 devstack sudo[107731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 12:02:51 devstack sudo[107731]: pam_unix(sudo:session): session closed for user root Nov 06 12:02:51 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-cffdf831-e25e-43b2-a657-696c8124de48 tempest-ProjectMemberTests-2097190340 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-ef11a0ae-6d93-42a1-be78-71ec7fd6e5e7" returned: 0 in 0.349s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 12:02:51 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-cffdf831-e25e-43b2-a657-696c8124de48 tempest-ProjectMemberTests-2097190340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-ef11a0ae-6d93-42a1-be78-71ec7fd6e5e7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-ef11a0ae-6d93-42a1-be78-71ec7fd6e5e7.ad297e9b-f558-4be5-8dde-6f59030c84cb 1G {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 12:02:51 devstack sudo[107736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-ef11a0ae-6d93-42a1-be78-71ec7fd6e5e7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-ef11a0ae-6d93-42a1-be78-71ec7fd6e5e7.ad297e9b-f558-4be5-8dde-6f59030c84cb 1G Nov 06 12:02:51 devstack sudo[107736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 12:02:51 devstack sudo[107736]: pam_unix(sudo:session): session closed for user root Nov 06 12:02:51 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-cffdf831-e25e-43b2-a657-696c8124de48 tempest-ProjectMemberTests-2097190340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-ef11a0ae-6d93-42a1-be78-71ec7fd6e5e7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-ef11a0ae-6d93-42a1-be78-71ec7fd6e5e7.ad297e9b-f558-4be5-8dde-6f59030c84cb 1G" returned: 0 in 0.380s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 12:02:51 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-cffdf831-e25e-43b2-a657-696c8124de48 tempest-ProjectMemberTests-2097190340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ef11a0ae-6d93-42a1-be78-71ec7fd6e5e7 -F qcow2 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-ef11a0ae-6d93-42a1-be78-71ec7fd6e5e7.ad297e9b-f558-4be5-8dde-6f59030c84cb {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 12:02:51 devstack sudo[107742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ef11a0ae-6d93-42a1-be78-71ec7fd6e5e7 -F qcow2 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-ef11a0ae-6d93-42a1-be78-71ec7fd6e5e7.ad297e9b-f558-4be5-8dde-6f59030c84cb Nov 06 12:02:51 devstack sudo[107742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 12:02:51 devstack sudo[107742]: pam_unix(sudo:session): session closed for user root Nov 06 12:02:51 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-cffdf831-e25e-43b2-a657-696c8124de48 tempest-ProjectMemberTests-2097190340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ef11a0ae-6d93-42a1-be78-71ec7fd6e5e7 -F qcow2 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-ef11a0ae-6d93-42a1-be78-71ec7fd6e5e7.ad297e9b-f558-4be5-8dde-6f59030c84cb" returned: 0 in 0.291s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 12:02:51 devstack cinder-volume[87116]: WARNING cinder.volume.drivers.remotefs [None req-cffdf831-e25e-43b2-a657-696c8124de48 tempest-ProjectMemberTests-2097190340 None] /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-ef11a0ae-6d93-42a1-be78-71ec7fd6e5e7.ad297e9b-f558-4be5-8dde-6f59030c84cb is being set with open permissions: ugo+rw Nov 06 12:02:51 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-cffdf831-e25e-43b2-a657-696c8124de48 tempest-ProjectMemberTests-2097190340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-ef11a0ae-6d93-42a1-be78-71ec7fd6e5e7.ad297e9b-f558-4be5-8dde-6f59030c84cb {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 12:02:51 devstack sudo[107748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-ef11a0ae-6d93-42a1-be78-71ec7fd6e5e7.ad297e9b-f558-4be5-8dde-6f59030c84cb Nov 06 12:02:51 devstack sudo[107748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 12:02:52 devstack sudo[107748]: pam_unix(sudo:session): session closed for user root Nov 06 12:02:52 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-cffdf831-e25e-43b2-a657-696c8124de48 tempest-ProjectMemberTests-2097190340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-ef11a0ae-6d93-42a1-be78-71ec7fd6e5e7.ad297e9b-f558-4be5-8dde-6f59030c84cb" returned: 0 in 0.235s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 12:02:52 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-cffdf831-e25e-43b2-a657-696c8124de48 tempest-ProjectMemberTests-2097190340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-ef11a0ae-6d93-42a1-be78-71ec7fd6e5e7.info {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 12:02:52 devstack sudo[107751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-ef11a0ae-6d93-42a1-be78-71ec7fd6e5e7.info Nov 06 12:02:52 devstack sudo[107751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 12:02:52 devstack sudo[107751]: pam_unix(sudo:session): session closed for user root Nov 06 12:02:52 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-cffdf831-e25e-43b2-a657-696c8124de48 tempest-ProjectMemberTests-2097190340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-ef11a0ae-6d93-42a1-be78-71ec7fd6e5e7.info" returned: 0 in 0.235s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 12:02:52 devstack cinder-volume[87116]: WARNING cinder.volume.drivers.remotefs [None req-cffdf831-e25e-43b2-a657-696c8124de48 tempest-ProjectMemberTests-2097190340 None] /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-ef11a0ae-6d93-42a1-be78-71ec7fd6e5e7.info is being set with open permissions: ugo+rw Nov 06 12:02:52 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-cffdf831-e25e-43b2-a657-696c8124de48 tempest-ProjectMemberTests-2097190340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-ef11a0ae-6d93-42a1-be78-71ec7fd6e5e7.info {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 12:02:52 devstack sudo[107754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-ef11a0ae-6d93-42a1-be78-71ec7fd6e5e7.info Nov 06 12:02:52 devstack sudo[107754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 12:02:52 devstack sudo[107754]: pam_unix(sudo:session): session closed for user root Nov 06 12:02:52 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-cffdf831-e25e-43b2-a657-696c8124de48 tempest-ProjectMemberTests-2097190340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-ef11a0ae-6d93-42a1-be78-71ec7fd6e5e7.info" returned: 0 in 0.243s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 12:02:52 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-cffdf831-e25e-43b2-a657-696c8124de48 tempest-ProjectMemberTests-2097190340 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.809s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 12:02:52 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-cffdf831-e25e-43b2-a657-696c8124de48 tempest-ProjectMemberTests-2097190340 None] Create snapshot completed successfully Nov 06 12:02:52 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-59b635b7-53a1-469f-b32f-ad075dec64f8 tempest-ProjectMemberTests-2097190340 None] Acquiring lock "cinder-ad297e9b-f558-4be5-8dde-6f59030c84cb-delete_snapshot" by "delete_snapshot" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 12:02:52 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-59b635b7-53a1-469f-b32f-ad075dec64f8 tempest-ProjectMemberTests-2097190340 None] Lock "cinder-ad297e9b-f558-4be5-8dde-6f59030c84cb-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 12:02:52 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-59b635b7-53a1-469f-b32f-ad075dec64f8 tempest-ProjectMemberTests-2097190340 None] Acquiring lock "cinder-quobyte-ef11a0ae-6d93-42a1-be78-71ec7fd6e5e7" by "delete_snapshot" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 12:02:52 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-59b635b7-53a1-469f-b32f-ad075dec64f8 tempest-ProjectMemberTests-2097190340 None] Lock "cinder-quobyte-ef11a0ae-6d93-42a1-be78-71ec7fd6e5e7" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 12:02:52 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-59b635b7-53a1-469f-b32f-ad075dec64f8 tempest-ProjectMemberTests-2097190340 None] Acquiring lock "cinder-quobyte-ad297e9b-f558-4be5-8dde-6f59030c84cb" by "_delete_snapshot" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 12:02:53 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-59b635b7-53a1-469f-b32f-ad075dec64f8 tempest-ProjectMemberTests-2097190340 None] Lock "cinder-quobyte-ad297e9b-f558-4be5-8dde-6f59030c84cb" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 12:02:53 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-59b635b7-53a1-469f-b32f-ad075dec64f8 tempest-ProjectMemberTests-2097190340 None] Deleting offline snapshot ad297e9b-f558-4be5-8dde-6f59030c84cb of volume ef11a0ae-6d93-42a1-be78-71ec7fd6e5e7 {{(pid=87116) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 06 12:02:53 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-59b635b7-53a1-469f-b32f-ad075dec64f8 tempest-ProjectMemberTests-2097190340 None] snapshot_file for this snap is: volume-ef11a0ae-6d93-42a1-be78-71ec7fd6e5e7.ad297e9b-f558-4be5-8dde-6f59030c84cb {{(pid=87116) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 06 12:02:53 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[a17eb84b-e02c-4d8c-9ac5-4121a9a53397]: (4, 'qcow2') {{(pid=88420) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 12:02:53 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-59b635b7-53a1-469f-b32f-ad075dec64f8 tempest-ProjectMemberTests-2097190340 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-ef11a0ae-6d93-42a1-be78-71ec7fd6e5e7.ad297e9b-f558-4be5-8dde-6f59030c84cb {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 12:02:53 devstack sudo[107758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-ef11a0ae-6d93-42a1-be78-71ec7fd6e5e7.ad297e9b-f558-4be5-8dde-6f59030c84cb Nov 06 12:02:53 devstack sudo[107758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 12:02:53 devstack sudo[107758]: pam_unix(sudo:session): session closed for user root Nov 06 12:02:53 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-59b635b7-53a1-469f-b32f-ad075dec64f8 tempest-ProjectMemberTests-2097190340 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-ef11a0ae-6d93-42a1-be78-71ec7fd6e5e7.ad297e9b-f558-4be5-8dde-6f59030c84cb" returned: 0 in 0.356s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 12:02:53 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-59b635b7-53a1-469f-b32f-ad075dec64f8 tempest-ProjectMemberTests-2097190340 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ef11a0ae-6d93-42a1-be78-71ec7fd6e5e7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87116) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 12:02:53 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fe234a5-f396-4b13-8739-fb57da642419]: (4, 'qcow2') {{(pid=88420) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 12:02:53 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-59b635b7-53a1-469f-b32f-ad075dec64f8 tempest-ProjectMemberTests-2097190340 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-ef11a0ae-6d93-42a1-be78-71ec7fd6e5e7 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 12:02:53 devstack sudo[107763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-ef11a0ae-6d93-42a1-be78-71ec7fd6e5e7 Nov 06 12:02:53 devstack sudo[107763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 12:02:53 devstack sudo[107763]: pam_unix(sudo:session): session closed for user root Nov 06 12:02:53 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-59b635b7-53a1-469f-b32f-ad075dec64f8 tempest-ProjectMemberTests-2097190340 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-ef11a0ae-6d93-42a1-be78-71ec7fd6e5e7" returned: 0 in 0.342s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 12:02:53 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-59b635b7-53a1-469f-b32f-ad075dec64f8 tempest-ProjectMemberTests-2097190340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-ef11a0ae-6d93-42a1-be78-71ec7fd6e5e7.ad297e9b-f558-4be5-8dde-6f59030c84cb {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 12:02:53 devstack sudo[107768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-ef11a0ae-6d93-42a1-be78-71ec7fd6e5e7.ad297e9b-f558-4be5-8dde-6f59030c84cb Nov 06 12:02:53 devstack sudo[107768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 12:02:54 devstack sudo[107768]: pam_unix(sudo:session): session closed for user root Nov 06 12:02:54 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-59b635b7-53a1-469f-b32f-ad075dec64f8 tempest-ProjectMemberTests-2097190340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-ef11a0ae-6d93-42a1-be78-71ec7fd6e5e7.ad297e9b-f558-4be5-8dde-6f59030c84cb" returned: 0 in 0.331s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 12:02:54 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-59b635b7-53a1-469f-b32f-ad075dec64f8 tempest-ProjectMemberTests-2097190340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-ef11a0ae-6d93-42a1-be78-71ec7fd6e5e7.ad297e9b-f558-4be5-8dde-6f59030c84cb {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 12:02:54 devstack sudo[107773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-ef11a0ae-6d93-42a1-be78-71ec7fd6e5e7.ad297e9b-f558-4be5-8dde-6f59030c84cb Nov 06 12:02:54 devstack sudo[107773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 12:02:54 devstack sudo[107773]: pam_unix(sudo:session): session closed for user root Nov 06 12:02:54 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-59b635b7-53a1-469f-b32f-ad075dec64f8 tempest-ProjectMemberTests-2097190340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-ef11a0ae-6d93-42a1-be78-71ec7fd6e5e7.ad297e9b-f558-4be5-8dde-6f59030c84cb" returned: 0 in 0.235s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 12:02:54 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-59b635b7-53a1-469f-b32f-ad075dec64f8 tempest-ProjectMemberTests-2097190340 None] Lock "cinder-quobyte-ad297e9b-f558-4be5-8dde-6f59030c84cb" released by "_delete_snapshot" :: held 1.361s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 12:02:54 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-59b635b7-53a1-469f-b32f-ad075dec64f8 tempest-ProjectMemberTests-2097190340 None] Lock "cinder-quobyte-ef11a0ae-6d93-42a1-be78-71ec7fd6e5e7" released by "delete_snapshot" :: held 1.386s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 12:02:54 devstack cinder-volume[87116]: DEBUG cinder.quota [None req-59b635b7-53a1-469f-b32f-ad075dec64f8 tempest-ProjectMemberTests-2097190340 None] Created reservations ['12226ec8-6cce-44ef-8ff3-96cda7ec651b', 'ecc9f3ad-878e-4215-a810-7671018f9ee9', 'b5df2739-7edc-4911-8d33-64c7ce71a17e', '2add8d6e-139b-41b9-b640-6b6f51bf657e'] {{(pid=87116) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 12:02:54 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-59b635b7-53a1-469f-b32f-ad075dec64f8 tempest-ProjectMemberTests-2097190340 None] Delete snapshot completed successfully. Nov 06 12:02:54 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-59b635b7-53a1-469f-b32f-ad075dec64f8 tempest-ProjectMemberTests-2097190340 None] Lock "cinder-ad297e9b-f558-4be5-8dde-6f59030c84cb-delete_snapshot" released by "delete_snapshot" :: held 1.504s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 12:02:55 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-9b481251-cd73-4f02-96f4-fd9e69c4467a tempest-ProjectMemberTests-2097190340 None] Acquiring lock "cinder-ef11a0ae-6d93-42a1-be78-71ec7fd6e5e7-delete_volume" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 12:02:55 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-9b481251-cd73-4f02-96f4-fd9e69c4467a tempest-ProjectMemberTests-2097190340 None] Lock "cinder-ef11a0ae-6d93-42a1-be78-71ec7fd6e5e7-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 12:02:55 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-9b481251-cd73-4f02-96f4-fd9e69c4467a tempest-ProjectMemberTests-2097190340 None] Acquiring lock "cinder-quobyte-ef11a0ae-6d93-42a1-be78-71ec7fd6e5e7" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 12:02:55 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-9b481251-cd73-4f02-96f4-fd9e69c4467a tempest-ProjectMemberTests-2097190340 None] Lock "cinder-quobyte-ef11a0ae-6d93-42a1-be78-71ec7fd6e5e7" acquired by "delete_volume" :: waited 0.017s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 12:02:55 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[e25388cc-fa8e-40ea-9c67-99dd7b004bbb]: (4, 'qcow2') {{(pid=88420) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 12:02:55 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-9b481251-cd73-4f02-96f4-fd9e69c4467a tempest-ProjectMemberTests-2097190340 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-ef11a0ae-6d93-42a1-be78-71ec7fd6e5e7 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 12:02:55 devstack sudo[107776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-ef11a0ae-6d93-42a1-be78-71ec7fd6e5e7 Nov 06 12:02:55 devstack sudo[107776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 12:02:55 devstack sudo[107776]: pam_unix(sudo:session): session closed for user root Nov 06 12:02:55 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-9b481251-cd73-4f02-96f4-fd9e69c4467a tempest-ProjectMemberTests-2097190340 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-ef11a0ae-6d93-42a1-be78-71ec7fd6e5e7" returned: 0 in 0.371s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 12:02:55 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-9b481251-cd73-4f02-96f4-fd9e69c4467a tempest-ProjectMemberTests-2097190340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-ef11a0ae-6d93-42a1-be78-71ec7fd6e5e7 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 12:02:55 devstack sudo[107781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-ef11a0ae-6d93-42a1-be78-71ec7fd6e5e7 Nov 06 12:02:55 devstack sudo[107781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 12:02:55 devstack sudo[107781]: pam_unix(sudo:session): session closed for user root Nov 06 12:02:55 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-9b481251-cd73-4f02-96f4-fd9e69c4467a tempest-ProjectMemberTests-2097190340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-ef11a0ae-6d93-42a1-be78-71ec7fd6e5e7" returned: 0 in 0.229s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 12:02:55 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-9b481251-cd73-4f02-96f4-fd9e69c4467a tempest-ProjectMemberTests-2097190340 None] Lock "cinder-quobyte-ef11a0ae-6d93-42a1-be78-71ec7fd6e5e7" released by "delete_volume" :: held 0.658s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 12:02:55 devstack cinder-volume[87116]: DEBUG cinder.quota [None req-9b481251-cd73-4f02-96f4-fd9e69c4467a tempest-ProjectMemberTests-2097190340 None] Created reservations ['7d975b56-9bcc-41cd-8835-54d39bdf3d04', '0c4ac753-8f70-4177-a801-666ff217b355', 'f9745a3b-b2e7-451a-9e2d-d12b701dea7a', '9d9fd745-248c-4df0-918a-4ed115858f0a'] {{(pid=87116) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 12:02:55 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-9b481251-cd73-4f02-96f4-fd9e69c4467a tempest-ProjectMemberTests-2097190340 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 12:02:55 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-9b481251-cd73-4f02-96f4-fd9e69c4467a tempest-ProjectMemberTests-2097190340 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 12:02:55 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-9b481251-cd73-4f02-96f4-fd9e69c4467a tempest-ProjectMemberTests-2097190340 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 12:02:55 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-9b481251-cd73-4f02-96f4-fd9e69c4467a tempest-ProjectMemberTests-2097190340 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 12:02:55 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-9b481251-cd73-4f02-96f4-fd9e69c4467a tempest-ProjectMemberTests-2097190340 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 12:02:55 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-9b481251-cd73-4f02-96f4-fd9e69c4467a tempest-ProjectMemberTests-2097190340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 12:02:55 devstack sudo[107784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756 Nov 06 12:02:55 devstack sudo[107784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 12:02:56 devstack sudo[107784]: pam_unix(sudo:session): session closed for user root Nov 06 12:02:56 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-9b481251-cd73-4f02-96f4-fd9e69c4467a tempest-ProjectMemberTests-2097190340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756" returned: 0 in 0.235s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 12:02:56 devstack cinder-volume[87116]: DEBUG cinder.manager [None req-9b481251-cd73-4f02-96f4-fd9e69c4467a tempest-ProjectMemberTests-2097190340 None] Notifying Schedulers of capabilities ... {{(pid=87116) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 12:02:56 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-9b481251-cd73-4f02-96f4-fd9e69c4467a tempest-ProjectMemberTests-2097190340 None] Deleted volume successfully. Nov 06 12:02:56 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-9b481251-cd73-4f02-96f4-fd9e69c4467a tempest-ProjectMemberTests-2097190340 None] Lock "cinder-ef11a0ae-6d93-42a1-be78-71ec7fd6e5e7-delete_volume" released by "delete_volume" :: held 1.089s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 12:02:56 devstack cinder-volume[87116]: DEBUG cinder.volume.flows.manager.create_volume [None req-deab87ce-f515-4df1-ac6f-f0f9f52044a4 tempest-ProjectMemberTests-2097190340 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87116) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 12:02:56 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-deab87ce-f515-4df1-ac6f-f0f9f52044a4 tempest-ProjectMemberTests-2097190340 None] Flow 'volume_create_manager' (fc747cf0-c80d-41ce-82b5-fa14565d7f96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 12:02:56 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-deab87ce-f515-4df1-ac6f-f0f9f52044a4 tempest-ProjectMemberTests-2097190340 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fca73044-792e-462c-b21d-493209495e4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 12:02:56 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-deab87ce-f515-4df1-ac6f-f0f9f52044a4 tempest-ProjectMemberTests-2097190340 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fca73044-792e-462c-b21d-493209495e4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T11:02:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1512445583',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f2206de6-c1c1-4120-975b-d17eadb11a60,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='49c53ee964024de5ae12252eba82ea98',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T11:02:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T11:02:57Z,use_quota=True,user_id='eec80b5d986049c1b9691925283475b7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(34d3b144-d9b7-480a-a2e3-01e45f3d54c1),volume_type_id=34d3b144-d9b7-480a-a2e3-01e45f3d54c1)' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 12:02:56 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-deab87ce-f515-4df1-ac6f-f0f9f52044a4 tempest-ProjectMemberTests-2097190340 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eb40cfcf-c58b-45e1-82a1-95f87f2027df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 12:02:56 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-deab87ce-f515-4df1-ac6f-f0f9f52044a4 tempest-ProjectMemberTests-2097190340 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eb40cfcf-c58b-45e1-82a1-95f87f2027df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 12:02:56 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-deab87ce-f515-4df1-ac6f-f0f9f52044a4 tempest-ProjectMemberTests-2097190340 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e62adda1-f650-4093-a338-15f1729b5fae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 12:02:56 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-deab87ce-f515-4df1-ac6f-f0f9f52044a4 tempest-ProjectMemberTests-2097190340 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e62adda1-f650-4093-a338-15f1729b5fae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f2206de6-c1c1-4120-975b-d17eadb11a60', 'volume_name': 'volume-f2206de6-c1c1-4120-975b-d17eadb11a60', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 12:02:56 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-deab87ce-f515-4df1-ac6f-f0f9f52044a4 tempest-ProjectMemberTests-2097190340 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f2aaa152-20cf-490b-a085-cbcd0acb15a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 12:02:56 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-deab87ce-f515-4df1-ac6f-f0f9f52044a4 tempest-ProjectMemberTests-2097190340 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f2aaa152-20cf-490b-a085-cbcd0acb15a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 12:02:56 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-deab87ce-f515-4df1-ac6f-f0f9f52044a4 tempest-ProjectMemberTests-2097190340 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1e2fed7c-eeb5-43ff-815a-ea817b79bc55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 12:02:56 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-deab87ce-f515-4df1-ac6f-f0f9f52044a4 tempest-ProjectMemberTests-2097190340 None] Volume f2206de6-c1c1-4120-975b-d17eadb11a60: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f2206de6-c1c1-4120-975b-d17eadb11a60', 'volume_size': 1} Nov 06 12:02:56 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-deab87ce-f515-4df1-ac6f-f0f9f52044a4 tempest-ProjectMemberTests-2097190340 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 12:02:56 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-deab87ce-f515-4df1-ac6f-f0f9f52044a4 tempest-ProjectMemberTests-2097190340 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 12:02:56 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-deab87ce-f515-4df1-ac6f-f0f9f52044a4 tempest-ProjectMemberTests-2097190340 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T11:02:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1512445583',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f2206de6-c1c1-4120-975b-d17eadb11a60,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='49c53ee964024de5ae12252eba82ea98',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T11:02:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T11:02:57Z,use_quota=True,user_id='eec80b5d986049c1b9691925283475b7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(34d3b144-d9b7-480a-a2e3-01e45f3d54c1),volume_type_id=34d3b144-d9b7-480a-a2e3-01e45f3d54c1)}" {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 12:02:56 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-deab87ce-f515-4df1-ac6f-f0f9f52044a4 tempest-ProjectMemberTests-2097190340 None] Creating volume f2206de6-c1c1-4120-975b-d17eadb11a60 {{(pid=87116) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 12:02:56 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-deab87ce-f515-4df1-ac6f-f0f9f52044a4 tempest-ProjectMemberTests-2097190340 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 12:02:56 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-deab87ce-f515-4df1-ac6f-f0f9f52044a4 tempest-ProjectMemberTests-2097190340 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 12:02:56 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-deab87ce-f515-4df1-ac6f-f0f9f52044a4 tempest-ProjectMemberTests-2097190340 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 12:02:56 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-deab87ce-f515-4df1-ac6f-f0f9f52044a4 tempest-ProjectMemberTests-2097190340 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 12:02:56 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-deab87ce-f515-4df1-ac6f-f0f9f52044a4 tempest-ProjectMemberTests-2097190340 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 12:02:56 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-deab87ce-f515-4df1-ac6f-f0f9f52044a4 tempest-ProjectMemberTests-2097190340 None] Selected osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f as target Quobyte volume. {{(pid=87116) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 12:02:56 devstack cinder-volume[87116]: INFO cinder.volume.drivers.remotefs [None req-deab87ce-f515-4df1-ac6f-f0f9f52044a4 tempest-ProjectMemberTests-2097190340 None] casted to osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f Nov 06 12:02:56 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-deab87ce-f515-4df1-ac6f-f0f9f52044a4 tempest-ProjectMemberTests-2097190340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-f2206de6-c1c1-4120-975b-d17eadb11a60 1073741824 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 12:02:56 devstack sudo[107787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-f2206de6-c1c1-4120-975b-d17eadb11a60 1073741824 Nov 06 12:02:56 devstack sudo[107787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 12:02:57 devstack sudo[107787]: pam_unix(sudo:session): session closed for user root Nov 06 12:02:57 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-deab87ce-f515-4df1-ac6f-f0f9f52044a4 tempest-ProjectMemberTests-2097190340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-f2206de6-c1c1-4120-975b-d17eadb11a60 1073741824" returned: 0 in 0.401s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 12:02:57 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-deab87ce-f515-4df1-ac6f-f0f9f52044a4 tempest-ProjectMemberTests-2097190340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-f2206de6-c1c1-4120-975b-d17eadb11a60 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 12:02:57 devstack sudo[107792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-f2206de6-c1c1-4120-975b-d17eadb11a60 Nov 06 12:02:57 devstack sudo[107792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 12:02:57 devstack sudo[107792]: pam_unix(sudo:session): session closed for user root Nov 06 12:02:57 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-deab87ce-f515-4df1-ac6f-f0f9f52044a4 tempest-ProjectMemberTests-2097190340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-f2206de6-c1c1-4120-975b-d17eadb11a60" returned: 0 in 0.235s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 12:02:57 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-deab87ce-f515-4df1-ac6f-f0f9f52044a4 tempest-ProjectMemberTests-2097190340 None] <== create_volume: return (676ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f'} {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 12:02:57 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-deab87ce-f515-4df1-ac6f-f0f9f52044a4 tempest-ProjectMemberTests-2097190340 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.679s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 12:02:57 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-deab87ce-f515-4df1-ac6f-f0f9f52044a4 tempest-ProjectMemberTests-2097190340 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1e2fed7c-eeb5-43ff-815a-ea817b79bc55) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f2206de6-c1c1-4120-975b-d17eadb11a60', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 12:02:57 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-deab87ce-f515-4df1-ac6f-f0f9f52044a4 tempest-ProjectMemberTests-2097190340 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b22954f5-51d3-4351-9427-70f2d031f3bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 12:02:57 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-deab87ce-f515-4df1-ac6f-f0f9f52044a4 tempest-ProjectMemberTests-2097190340 None] Volume volume-f2206de6-c1c1-4120-975b-d17eadb11a60 (f2206de6-c1c1-4120-975b-d17eadb11a60): created successfully Nov 06 12:02:57 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-deab87ce-f515-4df1-ac6f-f0f9f52044a4 tempest-ProjectMemberTests-2097190340 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b22954f5-51d3-4351-9427-70f2d031f3bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 12:02:57 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-deab87ce-f515-4df1-ac6f-f0f9f52044a4 tempest-ProjectMemberTests-2097190340 None] Flow 'volume_create_manager' (fc747cf0-c80d-41ce-82b5-fa14565d7f96) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 12:02:57 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-deab87ce-f515-4df1-ac6f-f0f9f52044a4 tempest-ProjectMemberTests-2097190340 None] Created volume successfully. Nov 06 12:02:57 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-a4fcdc93-3d8c-4fcf-90ff-ccc220abac09 tempest-ProjectMemberTests-2097190340 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 12:02:57 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-a4fcdc93-3d8c-4fcf-90ff-ccc220abac09 tempest-ProjectMemberTests-2097190340 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 12:02:57 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-a4fcdc93-3d8c-4fcf-90ff-ccc220abac09 tempest-ProjectMemberTests-2097190340 None] Creating offline snapshot f0300d7d-8615-4f88-868c-af6d28934f25 of volume f2206de6-c1c1-4120-975b-d17eadb11a60 {{(pid=87116) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 06 12:02:57 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e15a25a-7358-48e5-9fbb-d8a154402db2]: (4, 'qcow2') {{(pid=88420) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 12:02:57 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-a4fcdc93-3d8c-4fcf-90ff-ccc220abac09 tempest-ProjectMemberTests-2097190340 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-f2206de6-c1c1-4120-975b-d17eadb11a60 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 12:02:57 devstack sudo[107795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-f2206de6-c1c1-4120-975b-d17eadb11a60 Nov 06 12:02:57 devstack sudo[107795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 12:02:58 devstack sudo[107795]: pam_unix(sudo:session): session closed for user root Nov 06 12:02:58 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-a4fcdc93-3d8c-4fcf-90ff-ccc220abac09 tempest-ProjectMemberTests-2097190340 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-f2206de6-c1c1-4120-975b-d17eadb11a60" returned: 0 in 0.347s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 12:02:58 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-a4fcdc93-3d8c-4fcf-90ff-ccc220abac09 tempest-ProjectMemberTests-2097190340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-f2206de6-c1c1-4120-975b-d17eadb11a60,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-f2206de6-c1c1-4120-975b-d17eadb11a60.f0300d7d-8615-4f88-868c-af6d28934f25 1G {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 12:02:58 devstack sudo[107800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-f2206de6-c1c1-4120-975b-d17eadb11a60,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-f2206de6-c1c1-4120-975b-d17eadb11a60.f0300d7d-8615-4f88-868c-af6d28934f25 1G Nov 06 12:02:58 devstack sudo[107800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 12:02:58 devstack sudo[107800]: pam_unix(sudo:session): session closed for user root Nov 06 12:02:58 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-a4fcdc93-3d8c-4fcf-90ff-ccc220abac09 tempest-ProjectMemberTests-2097190340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-f2206de6-c1c1-4120-975b-d17eadb11a60,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-f2206de6-c1c1-4120-975b-d17eadb11a60.f0300d7d-8615-4f88-868c-af6d28934f25 1G" returned: 0 in 0.382s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 12:02:58 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-a4fcdc93-3d8c-4fcf-90ff-ccc220abac09 tempest-ProjectMemberTests-2097190340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f2206de6-c1c1-4120-975b-d17eadb11a60 -F qcow2 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-f2206de6-c1c1-4120-975b-d17eadb11a60.f0300d7d-8615-4f88-868c-af6d28934f25 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 12:02:58 devstack sudo[107805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f2206de6-c1c1-4120-975b-d17eadb11a60 -F qcow2 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-f2206de6-c1c1-4120-975b-d17eadb11a60.f0300d7d-8615-4f88-868c-af6d28934f25 Nov 06 12:02:58 devstack sudo[107805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 12:02:58 devstack sudo[107805]: pam_unix(sudo:session): session closed for user root Nov 06 12:02:58 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-a4fcdc93-3d8c-4fcf-90ff-ccc220abac09 tempest-ProjectMemberTests-2097190340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f2206de6-c1c1-4120-975b-d17eadb11a60 -F qcow2 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-f2206de6-c1c1-4120-975b-d17eadb11a60.f0300d7d-8615-4f88-868c-af6d28934f25" returned: 0 in 0.281s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 12:02:58 devstack cinder-volume[87116]: WARNING cinder.volume.drivers.remotefs [None req-a4fcdc93-3d8c-4fcf-90ff-ccc220abac09 tempest-ProjectMemberTests-2097190340 None] /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-f2206de6-c1c1-4120-975b-d17eadb11a60.f0300d7d-8615-4f88-868c-af6d28934f25 is being set with open permissions: ugo+rw Nov 06 12:02:58 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-a4fcdc93-3d8c-4fcf-90ff-ccc220abac09 tempest-ProjectMemberTests-2097190340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-f2206de6-c1c1-4120-975b-d17eadb11a60.f0300d7d-8615-4f88-868c-af6d28934f25 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 12:02:58 devstack sudo[107810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-f2206de6-c1c1-4120-975b-d17eadb11a60.f0300d7d-8615-4f88-868c-af6d28934f25 Nov 06 12:02:58 devstack sudo[107810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 12:02:59 devstack sudo[107810]: pam_unix(sudo:session): session closed for user root Nov 06 12:02:59 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-a4fcdc93-3d8c-4fcf-90ff-ccc220abac09 tempest-ProjectMemberTests-2097190340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-f2206de6-c1c1-4120-975b-d17eadb11a60.f0300d7d-8615-4f88-868c-af6d28934f25" returned: 0 in 0.231s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 12:02:59 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-a4fcdc93-3d8c-4fcf-90ff-ccc220abac09 tempest-ProjectMemberTests-2097190340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-f2206de6-c1c1-4120-975b-d17eadb11a60.info {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 12:02:59 devstack sudo[107813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-f2206de6-c1c1-4120-975b-d17eadb11a60.info Nov 06 12:02:59 devstack sudo[107813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 12:02:59 devstack sudo[107813]: pam_unix(sudo:session): session closed for user root Nov 06 12:02:59 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-a4fcdc93-3d8c-4fcf-90ff-ccc220abac09 tempest-ProjectMemberTests-2097190340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-f2206de6-c1c1-4120-975b-d17eadb11a60.info" returned: 0 in 0.238s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 12:02:59 devstack cinder-volume[87116]: WARNING cinder.volume.drivers.remotefs [None req-a4fcdc93-3d8c-4fcf-90ff-ccc220abac09 tempest-ProjectMemberTests-2097190340 None] /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-f2206de6-c1c1-4120-975b-d17eadb11a60.info is being set with open permissions: ugo+rw Nov 06 12:02:59 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-a4fcdc93-3d8c-4fcf-90ff-ccc220abac09 tempest-ProjectMemberTests-2097190340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-f2206de6-c1c1-4120-975b-d17eadb11a60.info {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 12:02:59 devstack sudo[107816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-f2206de6-c1c1-4120-975b-d17eadb11a60.info Nov 06 12:02:59 devstack sudo[107816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 12:02:59 devstack sudo[107816]: pam_unix(sudo:session): session closed for user root Nov 06 12:02:59 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-a4fcdc93-3d8c-4fcf-90ff-ccc220abac09 tempest-ProjectMemberTests-2097190340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-f2206de6-c1c1-4120-975b-d17eadb11a60.info" returned: 0 in 0.238s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 12:02:59 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-a4fcdc93-3d8c-4fcf-90ff-ccc220abac09 tempest-ProjectMemberTests-2097190340 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.796s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 12:02:59 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-a4fcdc93-3d8c-4fcf-90ff-ccc220abac09 tempest-ProjectMemberTests-2097190340 None] Create snapshot completed successfully Nov 06 12:03:00 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-215b301f-8b59-43db-91dd-2d2d05bc614b tempest-ProjectMemberTests-2097190340 None] Acquiring lock "cinder-f0300d7d-8615-4f88-868c-af6d28934f25-delete_snapshot" by "delete_snapshot" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 12:03:00 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-215b301f-8b59-43db-91dd-2d2d05bc614b tempest-ProjectMemberTests-2097190340 None] Lock "cinder-f0300d7d-8615-4f88-868c-af6d28934f25-delete_snapshot" acquired by "delete_snapshot" :: waited 0.014s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 12:03:00 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-215b301f-8b59-43db-91dd-2d2d05bc614b tempest-ProjectMemberTests-2097190340 None] Acquiring lock "cinder-quobyte-f2206de6-c1c1-4120-975b-d17eadb11a60" by "delete_snapshot" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 12:03:00 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-215b301f-8b59-43db-91dd-2d2d05bc614b tempest-ProjectMemberTests-2097190340 None] Lock "cinder-quobyte-f2206de6-c1c1-4120-975b-d17eadb11a60" acquired by "delete_snapshot" :: waited 0.013s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 12:03:00 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-215b301f-8b59-43db-91dd-2d2d05bc614b tempest-ProjectMemberTests-2097190340 None] Acquiring lock "cinder-quobyte-f0300d7d-8615-4f88-868c-af6d28934f25" by "_delete_snapshot" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 12:03:00 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-215b301f-8b59-43db-91dd-2d2d05bc614b tempest-ProjectMemberTests-2097190340 None] Lock "cinder-quobyte-f0300d7d-8615-4f88-868c-af6d28934f25" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 12:03:00 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-215b301f-8b59-43db-91dd-2d2d05bc614b tempest-ProjectMemberTests-2097190340 None] Deleting offline snapshot f0300d7d-8615-4f88-868c-af6d28934f25 of volume f2206de6-c1c1-4120-975b-d17eadb11a60 {{(pid=87116) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 06 12:03:00 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-215b301f-8b59-43db-91dd-2d2d05bc614b tempest-ProjectMemberTests-2097190340 None] snapshot_file for this snap is: volume-f2206de6-c1c1-4120-975b-d17eadb11a60.f0300d7d-8615-4f88-868c-af6d28934f25 {{(pid=87116) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 06 12:03:00 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5a60faf-bc7a-46d5-8357-512697abd98f]: (4, 'qcow2') {{(pid=88420) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 12:03:00 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-215b301f-8b59-43db-91dd-2d2d05bc614b tempest-ProjectMemberTests-2097190340 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-f2206de6-c1c1-4120-975b-d17eadb11a60.f0300d7d-8615-4f88-868c-af6d28934f25 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 12:03:00 devstack sudo[107819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-f2206de6-c1c1-4120-975b-d17eadb11a60.f0300d7d-8615-4f88-868c-af6d28934f25 Nov 06 12:03:00 devstack sudo[107819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 12:03:00 devstack sudo[107819]: pam_unix(sudo:session): session closed for user root Nov 06 12:03:00 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-215b301f-8b59-43db-91dd-2d2d05bc614b tempest-ProjectMemberTests-2097190340 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-f2206de6-c1c1-4120-975b-d17eadb11a60.f0300d7d-8615-4f88-868c-af6d28934f25" returned: 0 in 0.342s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 12:03:00 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-215b301f-8b59-43db-91dd-2d2d05bc614b tempest-ProjectMemberTests-2097190340 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f2206de6-c1c1-4120-975b-d17eadb11a60(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87116) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 12:03:00 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[b81b75d6-ea6e-4690-8544-575736828d45]: (4, 'qcow2') {{(pid=88420) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 12:03:00 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-215b301f-8b59-43db-91dd-2d2d05bc614b tempest-ProjectMemberTests-2097190340 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-f2206de6-c1c1-4120-975b-d17eadb11a60 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 12:03:00 devstack sudo[107824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-f2206de6-c1c1-4120-975b-d17eadb11a60 Nov 06 12:03:00 devstack sudo[107824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 12:03:00 devstack sudo[107824]: pam_unix(sudo:session): session closed for user root Nov 06 12:03:00 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-215b301f-8b59-43db-91dd-2d2d05bc614b tempest-ProjectMemberTests-2097190340 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-f2206de6-c1c1-4120-975b-d17eadb11a60" returned: 0 in 0.342s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 12:03:00 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-215b301f-8b59-43db-91dd-2d2d05bc614b tempest-ProjectMemberTests-2097190340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-f2206de6-c1c1-4120-975b-d17eadb11a60.f0300d7d-8615-4f88-868c-af6d28934f25 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 12:03:00 devstack sudo[107829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-f2206de6-c1c1-4120-975b-d17eadb11a60.f0300d7d-8615-4f88-868c-af6d28934f25 Nov 06 12:03:00 devstack sudo[107829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 12:03:01 devstack sudo[107829]: pam_unix(sudo:session): session closed for user root Nov 06 12:03:01 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-215b301f-8b59-43db-91dd-2d2d05bc614b tempest-ProjectMemberTests-2097190340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-f2206de6-c1c1-4120-975b-d17eadb11a60.f0300d7d-8615-4f88-868c-af6d28934f25" returned: 0 in 0.313s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 12:03:01 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-215b301f-8b59-43db-91dd-2d2d05bc614b tempest-ProjectMemberTests-2097190340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-f2206de6-c1c1-4120-975b-d17eadb11a60.f0300d7d-8615-4f88-868c-af6d28934f25 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 12:03:01 devstack sudo[107835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-f2206de6-c1c1-4120-975b-d17eadb11a60.f0300d7d-8615-4f88-868c-af6d28934f25 Nov 06 12:03:01 devstack sudo[107835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 12:03:01 devstack sudo[107835]: pam_unix(sudo:session): session closed for user root Nov 06 12:03:01 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-215b301f-8b59-43db-91dd-2d2d05bc614b tempest-ProjectMemberTests-2097190340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-f2206de6-c1c1-4120-975b-d17eadb11a60.f0300d7d-8615-4f88-868c-af6d28934f25" returned: 0 in 0.236s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 12:03:01 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-215b301f-8b59-43db-91dd-2d2d05bc614b tempest-ProjectMemberTests-2097190340 None] Lock "cinder-quobyte-f0300d7d-8615-4f88-868c-af6d28934f25" released by "_delete_snapshot" :: held 1.324s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 12:03:01 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-215b301f-8b59-43db-91dd-2d2d05bc614b tempest-ProjectMemberTests-2097190340 None] Lock "cinder-quobyte-f2206de6-c1c1-4120-975b-d17eadb11a60" released by "delete_snapshot" :: held 1.344s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 12:03:01 devstack cinder-volume[87116]: DEBUG cinder.quota [None req-215b301f-8b59-43db-91dd-2d2d05bc614b tempest-ProjectMemberTests-2097190340 None] Created reservations ['1c85be39-6924-44ba-8c75-de1eadc5a522', 'de304424-309f-4461-bed4-e05614ff8cf3', '1d753d19-63f7-4f73-8150-fc064efa0e25', '364630e8-1319-4d9c-bacd-76e801e38666'] {{(pid=87116) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 12:03:01 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-215b301f-8b59-43db-91dd-2d2d05bc614b tempest-ProjectMemberTests-2097190340 None] Delete snapshot completed successfully. Nov 06 12:03:01 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-215b301f-8b59-43db-91dd-2d2d05bc614b tempest-ProjectMemberTests-2097190340 None] Lock "cinder-f0300d7d-8615-4f88-868c-af6d28934f25-delete_snapshot" released by "delete_snapshot" :: held 1.461s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 12:03:02 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-b0228a4e-94f1-43c6-a98f-1f6071625f6e tempest-ProjectMemberTests-2097190340 None] Acquiring lock "cinder-f2206de6-c1c1-4120-975b-d17eadb11a60-delete_volume" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 12:03:02 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-b0228a4e-94f1-43c6-a98f-1f6071625f6e tempest-ProjectMemberTests-2097190340 None] Lock "cinder-f2206de6-c1c1-4120-975b-d17eadb11a60-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 12:03:02 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-b0228a4e-94f1-43c6-a98f-1f6071625f6e tempest-ProjectMemberTests-2097190340 None] Acquiring lock "cinder-quobyte-f2206de6-c1c1-4120-975b-d17eadb11a60" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 12:03:02 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-b0228a4e-94f1-43c6-a98f-1f6071625f6e tempest-ProjectMemberTests-2097190340 None] Lock "cinder-quobyte-f2206de6-c1c1-4120-975b-d17eadb11a60" acquired by "delete_volume" :: waited 0.014s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 12:03:02 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fb2be8f-4920-487d-a003-29e4bad3fd05]: (4, 'qcow2') {{(pid=88420) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 12:03:02 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-b0228a4e-94f1-43c6-a98f-1f6071625f6e tempest-ProjectMemberTests-2097190340 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-f2206de6-c1c1-4120-975b-d17eadb11a60 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 12:03:02 devstack sudo[107838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-f2206de6-c1c1-4120-975b-d17eadb11a60 Nov 06 12:03:02 devstack sudo[107838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 12:03:02 devstack sudo[107838]: pam_unix(sudo:session): session closed for user root Nov 06 12:03:02 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-b0228a4e-94f1-43c6-a98f-1f6071625f6e tempest-ProjectMemberTests-2097190340 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-f2206de6-c1c1-4120-975b-d17eadb11a60" returned: 0 in 0.334s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 12:03:02 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-b0228a4e-94f1-43c6-a98f-1f6071625f6e tempest-ProjectMemberTests-2097190340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-f2206de6-c1c1-4120-975b-d17eadb11a60 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 12:03:02 devstack sudo[107843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-f2206de6-c1c1-4120-975b-d17eadb11a60 Nov 06 12:03:02 devstack sudo[107843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 12:03:02 devstack sudo[107843]: pam_unix(sudo:session): session closed for user root Nov 06 12:03:02 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-b0228a4e-94f1-43c6-a98f-1f6071625f6e tempest-ProjectMemberTests-2097190340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-f2206de6-c1c1-4120-975b-d17eadb11a60" returned: 0 in 0.228s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 12:03:02 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-b0228a4e-94f1-43c6-a98f-1f6071625f6e tempest-ProjectMemberTests-2097190340 None] Lock "cinder-quobyte-f2206de6-c1c1-4120-975b-d17eadb11a60" released by "delete_volume" :: held 0.625s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 12:03:02 devstack cinder-volume[87116]: DEBUG cinder.quota [None req-b0228a4e-94f1-43c6-a98f-1f6071625f6e tempest-ProjectMemberTests-2097190340 None] Created reservations ['0dd496ef-7936-4ad8-9c3b-debecdc3243a', '931cebe2-5566-4f5b-9b91-bfd45dbe41d4', 'a1b7c05c-70a5-43c8-9bcd-520be2769bf2', '9a47da89-4e90-4609-a56c-57b6a40acc8c'] {{(pid=87116) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 12:03:02 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-b0228a4e-94f1-43c6-a98f-1f6071625f6e tempest-ProjectMemberTests-2097190340 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 12:03:02 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-b0228a4e-94f1-43c6-a98f-1f6071625f6e tempest-ProjectMemberTests-2097190340 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 12:03:02 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-b0228a4e-94f1-43c6-a98f-1f6071625f6e tempest-ProjectMemberTests-2097190340 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 12:03:02 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-b0228a4e-94f1-43c6-a98f-1f6071625f6e tempest-ProjectMemberTests-2097190340 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 12:03:02 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-b0228a4e-94f1-43c6-a98f-1f6071625f6e tempest-ProjectMemberTests-2097190340 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 12:03:02 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-b0228a4e-94f1-43c6-a98f-1f6071625f6e tempest-ProjectMemberTests-2097190340 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 12:03:02 devstack sudo[107847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756 Nov 06 12:03:02 devstack sudo[107847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 12:03:03 devstack sudo[107847]: pam_unix(sudo:session): session closed for user root Nov 06 12:03:03 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-b0228a4e-94f1-43c6-a98f-1f6071625f6e tempest-ProjectMemberTests-2097190340 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756" returned: 0 in 0.229s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 12:03:03 devstack cinder-volume[87116]: DEBUG cinder.manager [None req-b0228a4e-94f1-43c6-a98f-1f6071625f6e tempest-ProjectMemberTests-2097190340 None] Notifying Schedulers of capabilities ... {{(pid=87116) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 12:03:03 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-b0228a4e-94f1-43c6-a98f-1f6071625f6e tempest-ProjectMemberTests-2097190340 None] Deleted volume successfully. Nov 06 12:03:03 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-b0228a4e-94f1-43c6-a98f-1f6071625f6e tempest-ProjectMemberTests-2097190340 None] Lock "cinder-f2206de6-c1c1-4120-975b-d17eadb11a60-delete_volume" released by "delete_volume" :: held 1.032s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 12:03:12 devstack cinder-volume[87116]: DEBUG dbcounter [-] [87116] Writing DB stats cinder:INSERT=15,cinder:SELECT=35,cinder:DELETE=4,cinder:UPDATE=53 {{(pid=87116) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 12:03:13 devstack cinder-volume[87116]: DEBUG dbcounter [-] [87116] Writing DB stats cinder:SELECT=44,cinder:UPDATE=48,cinder:INSERT=14,cinder:DELETE=4 {{(pid=87116) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 12:03:30 devstack cinder-volume[87116]: DEBUG cinder.volume.flows.manager.create_volume [None req-eec47f1e-20c8-470d-8e0f-ecc9ea76e574 tempest-SnapshotDependencyTests-2068439515 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87116) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 12:03:30 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-eec47f1e-20c8-470d-8e0f-ecc9ea76e574 tempest-SnapshotDependencyTests-2068439515 None] Flow 'volume_create_manager' (ec86e93b-5100-4c01-b99e-ec9eaad63109) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 12:03:30 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-eec47f1e-20c8-470d-8e0f-ecc9ea76e574 tempest-SnapshotDependencyTests-2068439515 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (36df1699-835b-498a-a209-7de81d896c20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 12:03:30 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-eec47f1e-20c8-470d-8e0f-ecc9ea76e574 tempest-SnapshotDependencyTests-2068439515 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (36df1699-835b-498a-a209-7de81d896c20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T11:03:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-422689225',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8737d659-8d59-4f41-9ccc-933e0d8cf1cb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e4297aa13d5945a1adc00e8099556ddf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T11:03:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T11:03:31Z,use_quota=True,user_id='797bd10e1a5e449283b5a57cbe02d11b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(34d3b144-d9b7-480a-a2e3-01e45f3d54c1),volume_type_id=34d3b144-d9b7-480a-a2e3-01e45f3d54c1)' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 12:03:30 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-eec47f1e-20c8-470d-8e0f-ecc9ea76e574 tempest-SnapshotDependencyTests-2068439515 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e538931b-9270-4a99-b1d9-dc287027ce49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 12:03:30 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-eec47f1e-20c8-470d-8e0f-ecc9ea76e574 tempest-SnapshotDependencyTests-2068439515 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e538931b-9270-4a99-b1d9-dc287027ce49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 12:03:30 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-eec47f1e-20c8-470d-8e0f-ecc9ea76e574 tempest-SnapshotDependencyTests-2068439515 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0666a76e-365d-4bbd-8c1f-f8663a0e0dea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 12:03:30 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-eec47f1e-20c8-470d-8e0f-ecc9ea76e574 tempest-SnapshotDependencyTests-2068439515 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0666a76e-365d-4bbd-8c1f-f8663a0e0dea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8737d659-8d59-4f41-9ccc-933e0d8cf1cb', 'volume_name': 'volume-8737d659-8d59-4f41-9ccc-933e0d8cf1cb', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 12:03:30 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-eec47f1e-20c8-470d-8e0f-ecc9ea76e574 tempest-SnapshotDependencyTests-2068439515 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c072b2b0-2896-4624-945b-8c6962f43230) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 12:03:30 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-eec47f1e-20c8-470d-8e0f-ecc9ea76e574 tempest-SnapshotDependencyTests-2068439515 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c072b2b0-2896-4624-945b-8c6962f43230) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 12:03:30 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-eec47f1e-20c8-470d-8e0f-ecc9ea76e574 tempest-SnapshotDependencyTests-2068439515 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3c050158-7fc2-4a83-a06b-9c7c6564359d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 12:03:30 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-eec47f1e-20c8-470d-8e0f-ecc9ea76e574 tempest-SnapshotDependencyTests-2068439515 None] Volume 8737d659-8d59-4f41-9ccc-933e0d8cf1cb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8737d659-8d59-4f41-9ccc-933e0d8cf1cb', 'volume_size': 1} Nov 06 12:03:30 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-eec47f1e-20c8-470d-8e0f-ecc9ea76e574 tempest-SnapshotDependencyTests-2068439515 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 12:03:30 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-eec47f1e-20c8-470d-8e0f-ecc9ea76e574 tempest-SnapshotDependencyTests-2068439515 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 12:03:30 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-eec47f1e-20c8-470d-8e0f-ecc9ea76e574 tempest-SnapshotDependencyTests-2068439515 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T11:03:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-422689225',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8737d659-8d59-4f41-9ccc-933e0d8cf1cb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e4297aa13d5945a1adc00e8099556ddf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T11:03:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T11:03:31Z,use_quota=True,user_id='797bd10e1a5e449283b5a57cbe02d11b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(34d3b144-d9b7-480a-a2e3-01e45f3d54c1),volume_type_id=34d3b144-d9b7-480a-a2e3-01e45f3d54c1)}" {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 06 12:03:30 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-eec47f1e-20c8-470d-8e0f-ecc9ea76e574 tempest-SnapshotDependencyTests-2068439515 None] Creating volume 8737d659-8d59-4f41-9ccc-933e0d8cf1cb {{(pid=87116) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 06 12:03:30 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-eec47f1e-20c8-470d-8e0f-ecc9ea76e574 tempest-SnapshotDependencyTests-2068439515 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 12:03:30 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-eec47f1e-20c8-470d-8e0f-ecc9ea76e574 tempest-SnapshotDependencyTests-2068439515 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 12:03:30 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-eec47f1e-20c8-470d-8e0f-ecc9ea76e574 tempest-SnapshotDependencyTests-2068439515 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 12:03:30 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-eec47f1e-20c8-470d-8e0f-ecc9ea76e574 tempest-SnapshotDependencyTests-2068439515 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 12:03:30 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-eec47f1e-20c8-470d-8e0f-ecc9ea76e574 tempest-SnapshotDependencyTests-2068439515 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 12:03:30 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-eec47f1e-20c8-470d-8e0f-ecc9ea76e574 tempest-SnapshotDependencyTests-2068439515 None] Selected osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f as target Quobyte volume. {{(pid=87116) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 12:03:30 devstack cinder-volume[87116]: INFO cinder.volume.drivers.remotefs [None req-eec47f1e-20c8-470d-8e0f-ecc9ea76e574 tempest-SnapshotDependencyTests-2068439515 None] casted to osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f Nov 06 12:03:30 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-eec47f1e-20c8-470d-8e0f-ecc9ea76e574 tempest-SnapshotDependencyTests-2068439515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-8737d659-8d59-4f41-9ccc-933e0d8cf1cb 1073741824 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 12:03:30 devstack sudo[107857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-8737d659-8d59-4f41-9ccc-933e0d8cf1cb 1073741824 Nov 06 12:03:30 devstack sudo[107857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 12:03:31 devstack sudo[107857]: pam_unix(sudo:session): session closed for user root Nov 06 12:03:31 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-eec47f1e-20c8-470d-8e0f-ecc9ea76e574 tempest-SnapshotDependencyTests-2068439515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-8737d659-8d59-4f41-9ccc-933e0d8cf1cb 1073741824" returned: 0 in 0.393s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 12:03:31 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-eec47f1e-20c8-470d-8e0f-ecc9ea76e574 tempest-SnapshotDependencyTests-2068439515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-8737d659-8d59-4f41-9ccc-933e0d8cf1cb {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 12:03:31 devstack sudo[107862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-8737d659-8d59-4f41-9ccc-933e0d8cf1cb Nov 06 12:03:31 devstack sudo[107862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 12:03:31 devstack sudo[107862]: pam_unix(sudo:session): session closed for user root Nov 06 12:03:31 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-eec47f1e-20c8-470d-8e0f-ecc9ea76e574 tempest-SnapshotDependencyTests-2068439515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-8737d659-8d59-4f41-9ccc-933e0d8cf1cb" returned: 0 in 0.234s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 12:03:31 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-eec47f1e-20c8-470d-8e0f-ecc9ea76e574 tempest-SnapshotDependencyTests-2068439515 None] <== create_volume: return (666ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f'} {{(pid=87116) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 06 12:03:31 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-eec47f1e-20c8-470d-8e0f-ecc9ea76e574 tempest-SnapshotDependencyTests-2068439515 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.669s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 12:03:31 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-eec47f1e-20c8-470d-8e0f-ecc9ea76e574 tempest-SnapshotDependencyTests-2068439515 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3c050158-7fc2-4a83-a06b-9c7c6564359d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8737d659-8d59-4f41-9ccc-933e0d8cf1cb', 'volume_size': 1}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 12:03:31 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-eec47f1e-20c8-470d-8e0f-ecc9ea76e574 tempest-SnapshotDependencyTests-2068439515 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ac51bc4e-f562-4ae2-ab72-887543850c53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 12:03:31 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-eec47f1e-20c8-470d-8e0f-ecc9ea76e574 tempest-SnapshotDependencyTests-2068439515 None] Volume volume-8737d659-8d59-4f41-9ccc-933e0d8cf1cb (8737d659-8d59-4f41-9ccc-933e0d8cf1cb): created successfully Nov 06 12:03:31 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-eec47f1e-20c8-470d-8e0f-ecc9ea76e574 tempest-SnapshotDependencyTests-2068439515 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ac51bc4e-f562-4ae2-ab72-887543850c53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 12:03:31 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-eec47f1e-20c8-470d-8e0f-ecc9ea76e574 tempest-SnapshotDependencyTests-2068439515 None] Flow 'volume_create_manager' (ec86e93b-5100-4c01-b99e-ec9eaad63109) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 12:03:31 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-eec47f1e-20c8-470d-8e0f-ecc9ea76e574 tempest-SnapshotDependencyTests-2068439515 None] Created volume successfully. Nov 06 12:03:31 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-8f861b9d-ef3d-4001-81c1-5a7b27ca659f tempest-SnapshotDependencyTests-2068439515 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 12:03:31 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-8f861b9d-ef3d-4001-81c1-5a7b27ca659f tempest-SnapshotDependencyTests-2068439515 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 12:03:31 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-8f861b9d-ef3d-4001-81c1-5a7b27ca659f tempest-SnapshotDependencyTests-2068439515 None] Creating offline snapshot 3a688874-583c-4d09-a60d-bb924e39154a of volume 8737d659-8d59-4f41-9ccc-933e0d8cf1cb {{(pid=87116) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 06 12:03:31 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5d88441-f1c3-4148-a9f0-0d949f765ef5]: (4, 'qcow2') {{(pid=88420) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 12:03:31 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-8f861b9d-ef3d-4001-81c1-5a7b27ca659f tempest-SnapshotDependencyTests-2068439515 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-8737d659-8d59-4f41-9ccc-933e0d8cf1cb {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 12:03:32 devstack sudo[107865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-8737d659-8d59-4f41-9ccc-933e0d8cf1cb Nov 06 12:03:32 devstack sudo[107865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 12:03:32 devstack sudo[107865]: pam_unix(sudo:session): session closed for user root Nov 06 12:03:32 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-8f861b9d-ef3d-4001-81c1-5a7b27ca659f tempest-SnapshotDependencyTests-2068439515 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-8737d659-8d59-4f41-9ccc-933e0d8cf1cb" returned: 0 in 0.338s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 12:03:32 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-8f861b9d-ef3d-4001-81c1-5a7b27ca659f tempest-SnapshotDependencyTests-2068439515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-8737d659-8d59-4f41-9ccc-933e0d8cf1cb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-8737d659-8d59-4f41-9ccc-933e0d8cf1cb.3a688874-583c-4d09-a60d-bb924e39154a 1G {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 12:03:32 devstack sudo[107870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-8737d659-8d59-4f41-9ccc-933e0d8cf1cb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-8737d659-8d59-4f41-9ccc-933e0d8cf1cb.3a688874-583c-4d09-a60d-bb924e39154a 1G Nov 06 12:03:32 devstack sudo[107870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 12:03:32 devstack sudo[107870]: pam_unix(sudo:session): session closed for user root Nov 06 12:03:32 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-8f861b9d-ef3d-4001-81c1-5a7b27ca659f tempest-SnapshotDependencyTests-2068439515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-8737d659-8d59-4f41-9ccc-933e0d8cf1cb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-8737d659-8d59-4f41-9ccc-933e0d8cf1cb.3a688874-583c-4d09-a60d-bb924e39154a 1G" returned: 0 in 0.368s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 12:03:32 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-8f861b9d-ef3d-4001-81c1-5a7b27ca659f tempest-SnapshotDependencyTests-2068439515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8737d659-8d59-4f41-9ccc-933e0d8cf1cb -F qcow2 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-8737d659-8d59-4f41-9ccc-933e0d8cf1cb.3a688874-583c-4d09-a60d-bb924e39154a {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 12:03:32 devstack sudo[107875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8737d659-8d59-4f41-9ccc-933e0d8cf1cb -F qcow2 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-8737d659-8d59-4f41-9ccc-933e0d8cf1cb.3a688874-583c-4d09-a60d-bb924e39154a Nov 06 12:03:32 devstack sudo[107875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 12:03:32 devstack sudo[107875]: pam_unix(sudo:session): session closed for user root Nov 06 12:03:32 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-8f861b9d-ef3d-4001-81c1-5a7b27ca659f tempest-SnapshotDependencyTests-2068439515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8737d659-8d59-4f41-9ccc-933e0d8cf1cb -F qcow2 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-8737d659-8d59-4f41-9ccc-933e0d8cf1cb.3a688874-583c-4d09-a60d-bb924e39154a" returned: 0 in 0.270s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 12:03:32 devstack cinder-volume[87116]: WARNING cinder.volume.drivers.remotefs [None req-8f861b9d-ef3d-4001-81c1-5a7b27ca659f tempest-SnapshotDependencyTests-2068439515 None] /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-8737d659-8d59-4f41-9ccc-933e0d8cf1cb.3a688874-583c-4d09-a60d-bb924e39154a is being set with open permissions: ugo+rw Nov 06 12:03:32 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-8f861b9d-ef3d-4001-81c1-5a7b27ca659f tempest-SnapshotDependencyTests-2068439515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-8737d659-8d59-4f41-9ccc-933e0d8cf1cb.3a688874-583c-4d09-a60d-bb924e39154a {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 12:03:32 devstack sudo[107880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-8737d659-8d59-4f41-9ccc-933e0d8cf1cb.3a688874-583c-4d09-a60d-bb924e39154a Nov 06 12:03:32 devstack sudo[107880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 12:03:33 devstack sudo[107880]: pam_unix(sudo:session): session closed for user root Nov 06 12:03:33 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-8f861b9d-ef3d-4001-81c1-5a7b27ca659f tempest-SnapshotDependencyTests-2068439515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-8737d659-8d59-4f41-9ccc-933e0d8cf1cb.3a688874-583c-4d09-a60d-bb924e39154a" returned: 0 in 0.229s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 12:03:33 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-8f861b9d-ef3d-4001-81c1-5a7b27ca659f tempest-SnapshotDependencyTests-2068439515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-8737d659-8d59-4f41-9ccc-933e0d8cf1cb.info {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 12:03:33 devstack sudo[107884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-8737d659-8d59-4f41-9ccc-933e0d8cf1cb.info Nov 06 12:03:33 devstack sudo[107884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 12:03:33 devstack sudo[107884]: pam_unix(sudo:session): session closed for user root Nov 06 12:03:33 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-8f861b9d-ef3d-4001-81c1-5a7b27ca659f tempest-SnapshotDependencyTests-2068439515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-8737d659-8d59-4f41-9ccc-933e0d8cf1cb.info" returned: 0 in 0.234s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 12:03:33 devstack cinder-volume[87116]: WARNING cinder.volume.drivers.remotefs [None req-8f861b9d-ef3d-4001-81c1-5a7b27ca659f tempest-SnapshotDependencyTests-2068439515 None] /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-8737d659-8d59-4f41-9ccc-933e0d8cf1cb.info is being set with open permissions: ugo+rw Nov 06 12:03:33 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-8f861b9d-ef3d-4001-81c1-5a7b27ca659f tempest-SnapshotDependencyTests-2068439515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-8737d659-8d59-4f41-9ccc-933e0d8cf1cb.info {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 12:03:33 devstack sudo[107887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-8737d659-8d59-4f41-9ccc-933e0d8cf1cb.info Nov 06 12:03:33 devstack sudo[107887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 12:03:33 devstack sudo[107887]: pam_unix(sudo:session): session closed for user root Nov 06 12:03:33 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-8f861b9d-ef3d-4001-81c1-5a7b27ca659f tempest-SnapshotDependencyTests-2068439515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-8737d659-8d59-4f41-9ccc-933e0d8cf1cb.info" returned: 0 in 0.255s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 12:03:33 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-8f861b9d-ef3d-4001-81c1-5a7b27ca659f tempest-SnapshotDependencyTests-2068439515 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.786s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 12:03:33 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-8f861b9d-ef3d-4001-81c1-5a7b27ca659f tempest-SnapshotDependencyTests-2068439515 None] Create snapshot completed successfully Nov 06 12:03:34 devstack cinder-volume[87116]: DEBUG cinder.volume.flows.manager.create_volume [None req-343b8a09-9d8e-48b2-b5da-cc22269cd57a tempest-SnapshotDependencyTests-2068439515 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87116) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 06 12:03:34 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-343b8a09-9d8e-48b2-b5da-cc22269cd57a tempest-SnapshotDependencyTests-2068439515 None] Flow 'volume_create_manager' (c5ea5b94-628a-4ef9-9631-313c1c2c5630) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 12:03:34 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-343b8a09-9d8e-48b2-b5da-cc22269cd57a tempest-SnapshotDependencyTests-2068439515 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (972ae33e-6b70-49b6-93a8-4094068e2ecd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 12:03:34 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-343b8a09-9d8e-48b2-b5da-cc22269cd57a tempest-SnapshotDependencyTests-2068439515 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (972ae33e-6b70-49b6-93a8-4094068e2ecd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-06T11:03:34Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=259f7135-97f6-495f-a14f-bc5af7f2fd0d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e4297aa13d5945a1adc00e8099556ddf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-06T11:03:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=3a688874-583c-4d09-a60d-bb924e39154a,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-06T11:03:35Z,use_quota=True,user_id='797bd10e1a5e449283b5a57cbe02d11b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(34d3b144-d9b7-480a-a2e3-01e45f3d54c1),volume_type_id=34d3b144-d9b7-480a-a2e3-01e45f3d54c1)' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 12:03:34 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-343b8a09-9d8e-48b2-b5da-cc22269cd57a tempest-SnapshotDependencyTests-2068439515 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (78caba56-3033-410a-aa65-06c262b39a69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 12:03:34 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-343b8a09-9d8e-48b2-b5da-cc22269cd57a tempest-SnapshotDependencyTests-2068439515 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (78caba56-3033-410a-aa65-06c262b39a69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 12:03:34 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-343b8a09-9d8e-48b2-b5da-cc22269cd57a tempest-SnapshotDependencyTests-2068439515 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1e70df8d-1411-4d83-bb87-14b614dabfc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 12:03:34 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-343b8a09-9d8e-48b2-b5da-cc22269cd57a tempest-SnapshotDependencyTests-2068439515 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1e70df8d-1411-4d83-bb87-14b614dabfc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '259f7135-97f6-495f-a14f-bc5af7f2fd0d', 'volume_name': 'volume-259f7135-97f6-495f-a14f-bc5af7f2fd0d', 'volume_size': 1, 'snapshot_id': '3a688874-583c-4d09-a60d-bb924e39154a'}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 12:03:34 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-343b8a09-9d8e-48b2-b5da-cc22269cd57a tempest-SnapshotDependencyTests-2068439515 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9dadd4b7-28da-4fad-a612-62d626b8705f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 12:03:34 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-343b8a09-9d8e-48b2-b5da-cc22269cd57a tempest-SnapshotDependencyTests-2068439515 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9dadd4b7-28da-4fad-a612-62d626b8705f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 12:03:34 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-343b8a09-9d8e-48b2-b5da-cc22269cd57a tempest-SnapshotDependencyTests-2068439515 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de0d719d-21ba-4fa1-bb26-2c4aed4cadd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 12:03:34 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-343b8a09-9d8e-48b2-b5da-cc22269cd57a tempest-SnapshotDependencyTests-2068439515 None] Volume 259f7135-97f6-495f-a14f-bc5af7f2fd0d: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-259f7135-97f6-495f-a14f-bc5af7f2fd0d', 'volume_size': 1, 'snapshot_id': '3a688874-583c-4d09-a60d-bb924e39154a'} Nov 06 12:03:34 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-343b8a09-9d8e-48b2-b5da-cc22269cd57a tempest-SnapshotDependencyTests-2068439515 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 12:03:34 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-343b8a09-9d8e-48b2-b5da-cc22269cd57a tempest-SnapshotDependencyTests-2068439515 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 12:03:34 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-343b8a09-9d8e-48b2-b5da-cc22269cd57a tempest-SnapshotDependencyTests-2068439515 None] Acquiring lock "cinder-quobyte-3a688874-583c-4d09-a60d-bb924e39154a-259f7135-97f6-495f-a14f-bc5af7f2fd0d" by "_create_volume_from_snapshot" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 12:03:34 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-343b8a09-9d8e-48b2-b5da-cc22269cd57a tempest-SnapshotDependencyTests-2068439515 None] Lock "cinder-quobyte-3a688874-583c-4d09-a60d-bb924e39154a-259f7135-97f6-495f-a14f-bc5af7f2fd0d" acquired by "_create_volume_from_snapshot" :: waited 0.017s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 12:03:34 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-343b8a09-9d8e-48b2-b5da-cc22269cd57a tempest-SnapshotDependencyTests-2068439515 None] Creating volume 259f7135-97f6-495f-a14f-bc5af7f2fd0d from snapshot 3a688874-583c-4d09-a60d-bb924e39154a {{(pid=87116) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Nov 06 12:03:34 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-343b8a09-9d8e-48b2-b5da-cc22269cd57a tempest-SnapshotDependencyTests-2068439515 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 12:03:34 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-343b8a09-9d8e-48b2-b5da-cc22269cd57a tempest-SnapshotDependencyTests-2068439515 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 12:03:34 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-343b8a09-9d8e-48b2-b5da-cc22269cd57a tempest-SnapshotDependencyTests-2068439515 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 12:03:34 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-343b8a09-9d8e-48b2-b5da-cc22269cd57a tempest-SnapshotDependencyTests-2068439515 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 12:03:34 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-343b8a09-9d8e-48b2-b5da-cc22269cd57a tempest-SnapshotDependencyTests-2068439515 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 12:03:34 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-343b8a09-9d8e-48b2-b5da-cc22269cd57a tempest-SnapshotDependencyTests-2068439515 None] Selected osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f as target Quobyte volume. {{(pid=87116) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 06 12:03:34 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-343b8a09-9d8e-48b2-b5da-cc22269cd57a tempest-SnapshotDependencyTests-2068439515 None] Acquiring lock "cinder-quobyte-259f7135-97f6-495f-a14f-bc5af7f2fd0d" by "_copy_volume_from_snapshot" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 12:03:34 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-343b8a09-9d8e-48b2-b5da-cc22269cd57a tempest-SnapshotDependencyTests-2068439515 None] Lock "cinder-quobyte-259f7135-97f6-495f-a14f-bc5af7f2fd0d" acquired by "_copy_volume_from_snapshot" :: waited 0.013s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 12:03:34 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-343b8a09-9d8e-48b2-b5da-cc22269cd57a tempest-SnapshotDependencyTests-2068439515 None] snapshot: 3a688874-583c-4d09-a60d-bb924e39154a, volume: 259f7135-97f6-495f-a14f-bc5af7f2fd0d, {{(pid=87116) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 06 12:03:34 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-343b8a09-9d8e-48b2-b5da-cc22269cd57a tempest-SnapshotDependencyTests-2068439515 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 12:03:34 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-343b8a09-9d8e-48b2-b5da-cc22269cd57a tempest-SnapshotDependencyTests-2068439515 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 12:03:34 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-343b8a09-9d8e-48b2-b5da-cc22269cd57a tempest-SnapshotDependencyTests-2068439515 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 12:03:34 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-343b8a09-9d8e-48b2-b5da-cc22269cd57a tempest-SnapshotDependencyTests-2068439515 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 12:03:34 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-343b8a09-9d8e-48b2-b5da-cc22269cd57a tempest-SnapshotDependencyTests-2068439515 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 12:03:34 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[947a9136-05be-4974-8e2e-ff921d28800e]: (4, 'qcow2') {{(pid=88420) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 12:03:34 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-343b8a09-9d8e-48b2-b5da-cc22269cd57a tempest-SnapshotDependencyTests-2068439515 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-8737d659-8d59-4f41-9ccc-933e0d8cf1cb.3a688874-583c-4d09-a60d-bb924e39154a {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 12:03:34 devstack sudo[107890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-8737d659-8d59-4f41-9ccc-933e0d8cf1cb.3a688874-583c-4d09-a60d-bb924e39154a Nov 06 12:03:34 devstack sudo[107890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 12:03:35 devstack sudo[107890]: pam_unix(sudo:session): session closed for user root Nov 06 12:03:35 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-343b8a09-9d8e-48b2-b5da-cc22269cd57a tempest-SnapshotDependencyTests-2068439515 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-8737d659-8d59-4f41-9ccc-933e0d8cf1cb.3a688874-583c-4d09-a60d-bb924e39154a" returned: 0 in 0.335s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 12:03:35 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-343b8a09-9d8e-48b2-b5da-cc22269cd57a tempest-SnapshotDependencyTests-2068439515 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8737d659-8d59-4f41-9ccc-933e0d8cf1cb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87116) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 12:03:35 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bf6c7dc-b796-4a3e-8452-656359de58dd]: (4, 'qcow2') {{(pid=88420) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 12:03:35 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-343b8a09-9d8e-48b2-b5da-cc22269cd57a tempest-SnapshotDependencyTests-2068439515 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-8737d659-8d59-4f41-9ccc-933e0d8cf1cb {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 12:03:35 devstack sudo[107895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-8737d659-8d59-4f41-9ccc-933e0d8cf1cb Nov 06 12:03:35 devstack sudo[107895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 12:03:35 devstack sudo[107895]: pam_unix(sudo:session): session closed for user root Nov 06 12:03:35 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-343b8a09-9d8e-48b2-b5da-cc22269cd57a tempest-SnapshotDependencyTests-2068439515 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-8737d659-8d59-4f41-9ccc-933e0d8cf1cb" returned: 0 in 0.336s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 12:03:35 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-343b8a09-9d8e-48b2-b5da-cc22269cd57a tempest-SnapshotDependencyTests-2068439515 None] will copy from snapshot at /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-8737d659-8d59-4f41-9ccc-933e0d8cf1cb {{(pid=87116) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 06 12:03:35 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-343b8a09-9d8e-48b2-b5da-cc22269cd57a tempest-SnapshotDependencyTests-2068439515 None] Creating direct copy from snapshot {{(pid=87116) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 06 12:03:35 devstack cinder-volume[87116]: DEBUG cinder.utils [None req-343b8a09-9d8e-48b2-b5da-cc22269cd57a tempest-SnapshotDependencyTests-2068439515 None] Path /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-259f7135-97f6-495f-a14f-bc5af7f2fd0d not found in is_blk_device check {{(pid=87116) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 06 12:03:35 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-343b8a09-9d8e-48b2-b5da-cc22269cd57a tempest-SnapshotDependencyTests-2068439515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-8737d659-8d59-4f41-9ccc-933e0d8cf1cb /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-259f7135-97f6-495f-a14f-bc5af7f2fd0d {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 12:03:35 devstack sudo[107901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-8737d659-8d59-4f41-9ccc-933e0d8cf1cb /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-259f7135-97f6-495f-a14f-bc5af7f2fd0d Nov 06 12:03:35 devstack sudo[107901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 12:03:39 devstack cinder-volume[87116]: DEBUG oslo_service.periodic_task [None req-4fab4816-ec2b-4b19-b2ff-8548f2084354 None None] Running periodic task VolumeManager._thread_info {{(pid=87116) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 06 12:03:39 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-4fab4816-ec2b-4b19-b2ff-8548f2084354 None None] thread count: 28 {{(pid=87116) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 06 12:03:39 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-4fab4816-ec2b-4b19-b2ff-8548f2084354 None None] thread info: [<_MainThread(MainThread, started 131399520669824)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87116) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 06 12:03:40 devstack sudo[107901]: pam_unix(sudo:session): session closed for user root Nov 06 12:03:40 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-343b8a09-9d8e-48b2-b5da-cc22269cd57a tempest-SnapshotDependencyTests-2068439515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-8737d659-8d59-4f41-9ccc-933e0d8cf1cb /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-259f7135-97f6-495f-a14f-bc5af7f2fd0d" returned: 0 in 5.422s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 12:03:40 devstack cinder-volume[87116]: DEBUG cinder.image.image_utils [None req-343b8a09-9d8e-48b2-b5da-cc22269cd57a tempest-SnapshotDependencyTests-2068439515 None] Image conversion details: src /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-8737d659-8d59-4f41-9ccc-933e0d8cf1cb, size 1024.00 MB, duration 5.42 sec, destination /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-259f7135-97f6-495f-a14f-bc5af7f2fd0d {{(pid=87116) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 06 12:03:40 devstack cinder-volume[87116]: INFO cinder.image.image_utils [None req-343b8a09-9d8e-48b2-b5da-cc22269cd57a tempest-SnapshotDependencyTests-2068439515 None] Converted 1024.00 MB image at 188.84 MB/s Nov 06 12:03:40 devstack cinder-volume[87116]: WARNING cinder.volume.drivers.remotefs [None req-343b8a09-9d8e-48b2-b5da-cc22269cd57a tempest-SnapshotDependencyTests-2068439515 None] /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-259f7135-97f6-495f-a14f-bc5af7f2fd0d is being set with open permissions: ugo+rw Nov 06 12:03:40 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-343b8a09-9d8e-48b2-b5da-cc22269cd57a tempest-SnapshotDependencyTests-2068439515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-259f7135-97f6-495f-a14f-bc5af7f2fd0d {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 12:03:40 devstack sudo[107956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-259f7135-97f6-495f-a14f-bc5af7f2fd0d Nov 06 12:03:40 devstack sudo[107956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 12:03:41 devstack sudo[107956]: pam_unix(sudo:session): session closed for user root Nov 06 12:03:41 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-343b8a09-9d8e-48b2-b5da-cc22269cd57a tempest-SnapshotDependencyTests-2068439515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-259f7135-97f6-495f-a14f-bc5af7f2fd0d" returned: 0 in 0.233s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 12:03:41 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-343b8a09-9d8e-48b2-b5da-cc22269cd57a tempest-SnapshotDependencyTests-2068439515 None] Lock "cinder-quobyte-259f7135-97f6-495f-a14f-bc5af7f2fd0d" released by "_copy_volume_from_snapshot" :: held 6.404s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 12:03:41 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-343b8a09-9d8e-48b2-b5da-cc22269cd57a tempest-SnapshotDependencyTests-2068439515 None] Lock "cinder-quobyte-3a688874-583c-4d09-a60d-bb924e39154a-259f7135-97f6-495f-a14f-bc5af7f2fd0d" released by "_create_volume_from_snapshot" :: held 6.461s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 12:03:41 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-343b8a09-9d8e-48b2-b5da-cc22269cd57a tempest-SnapshotDependencyTests-2068439515 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 6.480s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 12:03:41 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-343b8a09-9d8e-48b2-b5da-cc22269cd57a tempest-SnapshotDependencyTests-2068439515 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de0d719d-21ba-4fa1-bb26-2c4aed4cadd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-259f7135-97f6-495f-a14f-bc5af7f2fd0d', 'volume_size': 1, 'snapshot_id': '3a688874-583c-4d09-a60d-bb924e39154a'}' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 12:03:41 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-343b8a09-9d8e-48b2-b5da-cc22269cd57a tempest-SnapshotDependencyTests-2068439515 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (63b93b18-6ed7-4a08-ac2b-ac498b0b1c04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 06 12:03:41 devstack cinder-volume[87116]: INFO cinder.volume.flows.manager.create_volume [None req-343b8a09-9d8e-48b2-b5da-cc22269cd57a tempest-SnapshotDependencyTests-2068439515 None] Volume volume-259f7135-97f6-495f-a14f-bc5af7f2fd0d (259f7135-97f6-495f-a14f-bc5af7f2fd0d): created successfully Nov 06 12:03:41 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-343b8a09-9d8e-48b2-b5da-cc22269cd57a tempest-SnapshotDependencyTests-2068439515 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (63b93b18-6ed7-4a08-ac2b-ac498b0b1c04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87116) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 06 12:03:41 devstack cinder-volume[87116]: DEBUG cinder.volume.manager [None req-343b8a09-9d8e-48b2-b5da-cc22269cd57a tempest-SnapshotDependencyTests-2068439515 None] Flow 'volume_create_manager' (c5ea5b94-628a-4ef9-9631-313c1c2c5630) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87116) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 06 12:03:41 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-343b8a09-9d8e-48b2-b5da-cc22269cd57a tempest-SnapshotDependencyTests-2068439515 None] Created volume successfully. Nov 06 12:03:42 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-90d6e00b-a25d-4595-9eb3-aa7027276915 tempest-SnapshotDependencyTests-2068439515 None] Acquiring lock "cinder-3a688874-583c-4d09-a60d-bb924e39154a-delete_snapshot" by "delete_snapshot" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 12:03:42 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-90d6e00b-a25d-4595-9eb3-aa7027276915 tempest-SnapshotDependencyTests-2068439515 None] Lock "cinder-3a688874-583c-4d09-a60d-bb924e39154a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 12:03:42 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-90d6e00b-a25d-4595-9eb3-aa7027276915 tempest-SnapshotDependencyTests-2068439515 None] Acquiring lock "cinder-quobyte-8737d659-8d59-4f41-9ccc-933e0d8cf1cb" by "delete_snapshot" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 12:03:42 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-90d6e00b-a25d-4595-9eb3-aa7027276915 tempest-SnapshotDependencyTests-2068439515 None] Lock "cinder-quobyte-8737d659-8d59-4f41-9ccc-933e0d8cf1cb" acquired by "delete_snapshot" :: waited 0.014s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 12:03:42 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-90d6e00b-a25d-4595-9eb3-aa7027276915 tempest-SnapshotDependencyTests-2068439515 None] Acquiring lock "cinder-quobyte-3a688874-583c-4d09-a60d-bb924e39154a" by "_delete_snapshot" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 12:03:42 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-90d6e00b-a25d-4595-9eb3-aa7027276915 tempest-SnapshotDependencyTests-2068439515 None] Lock "cinder-quobyte-3a688874-583c-4d09-a60d-bb924e39154a" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 12:03:42 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-90d6e00b-a25d-4595-9eb3-aa7027276915 tempest-SnapshotDependencyTests-2068439515 None] Deleting offline snapshot 3a688874-583c-4d09-a60d-bb924e39154a of volume 8737d659-8d59-4f41-9ccc-933e0d8cf1cb {{(pid=87116) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 06 12:03:42 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-90d6e00b-a25d-4595-9eb3-aa7027276915 tempest-SnapshotDependencyTests-2068439515 None] snapshot_file for this snap is: volume-8737d659-8d59-4f41-9ccc-933e0d8cf1cb.3a688874-583c-4d09-a60d-bb924e39154a {{(pid=87116) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 06 12:03:42 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6fcb295-1998-4380-80c3-350c3964653b]: (4, 'qcow2') {{(pid=88420) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 12:03:42 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-90d6e00b-a25d-4595-9eb3-aa7027276915 tempest-SnapshotDependencyTests-2068439515 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-8737d659-8d59-4f41-9ccc-933e0d8cf1cb.3a688874-583c-4d09-a60d-bb924e39154a {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 12:03:42 devstack sudo[107959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-8737d659-8d59-4f41-9ccc-933e0d8cf1cb.3a688874-583c-4d09-a60d-bb924e39154a Nov 06 12:03:42 devstack sudo[107959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 12:03:42 devstack sudo[107959]: pam_unix(sudo:session): session closed for user root Nov 06 12:03:42 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-90d6e00b-a25d-4595-9eb3-aa7027276915 tempest-SnapshotDependencyTests-2068439515 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-8737d659-8d59-4f41-9ccc-933e0d8cf1cb.3a688874-583c-4d09-a60d-bb924e39154a" returned: 0 in 0.351s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 12:03:42 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.remotefs [None req-90d6e00b-a25d-4595-9eb3-aa7027276915 tempest-SnapshotDependencyTests-2068439515 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8737d659-8d59-4f41-9ccc-933e0d8cf1cb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87116) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 06 12:03:42 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[280b3d87-5c65-4ba2-b540-ba30c7193f9a]: (4, 'qcow2') {{(pid=88420) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 12:03:42 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-90d6e00b-a25d-4595-9eb3-aa7027276915 tempest-SnapshotDependencyTests-2068439515 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-8737d659-8d59-4f41-9ccc-933e0d8cf1cb {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 12:03:42 devstack sudo[107964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-8737d659-8d59-4f41-9ccc-933e0d8cf1cb Nov 06 12:03:42 devstack sudo[107964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 12:03:43 devstack sudo[107964]: pam_unix(sudo:session): session closed for user root Nov 06 12:03:43 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-90d6e00b-a25d-4595-9eb3-aa7027276915 tempest-SnapshotDependencyTests-2068439515 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-8737d659-8d59-4f41-9ccc-933e0d8cf1cb" returned: 0 in 0.512s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 12:03:43 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-90d6e00b-a25d-4595-9eb3-aa7027276915 tempest-SnapshotDependencyTests-2068439515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-8737d659-8d59-4f41-9ccc-933e0d8cf1cb.3a688874-583c-4d09-a60d-bb924e39154a {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 12:03:43 devstack sudo[107970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-8737d659-8d59-4f41-9ccc-933e0d8cf1cb.3a688874-583c-4d09-a60d-bb924e39154a Nov 06 12:03:43 devstack sudo[107970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 12:03:43 devstack sudo[107970]: pam_unix(sudo:session): session closed for user root Nov 06 12:03:43 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-90d6e00b-a25d-4595-9eb3-aa7027276915 tempest-SnapshotDependencyTests-2068439515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-8737d659-8d59-4f41-9ccc-933e0d8cf1cb.3a688874-583c-4d09-a60d-bb924e39154a" returned: 0 in 0.362s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 12:03:43 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-90d6e00b-a25d-4595-9eb3-aa7027276915 tempest-SnapshotDependencyTests-2068439515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-8737d659-8d59-4f41-9ccc-933e0d8cf1cb.3a688874-583c-4d09-a60d-bb924e39154a {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 12:03:43 devstack sudo[107977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-8737d659-8d59-4f41-9ccc-933e0d8cf1cb.3a688874-583c-4d09-a60d-bb924e39154a Nov 06 12:03:43 devstack sudo[107977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 12:03:43 devstack sudo[107977]: pam_unix(sudo:session): session closed for user root Nov 06 12:03:43 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-90d6e00b-a25d-4595-9eb3-aa7027276915 tempest-SnapshotDependencyTests-2068439515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-8737d659-8d59-4f41-9ccc-933e0d8cf1cb.3a688874-583c-4d09-a60d-bb924e39154a" returned: 0 in 0.235s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 12:03:43 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-90d6e00b-a25d-4595-9eb3-aa7027276915 tempest-SnapshotDependencyTests-2068439515 None] Lock "cinder-quobyte-3a688874-583c-4d09-a60d-bb924e39154a" released by "_delete_snapshot" :: held 1.565s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 12:03:43 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-90d6e00b-a25d-4595-9eb3-aa7027276915 tempest-SnapshotDependencyTests-2068439515 None] Lock "cinder-quobyte-8737d659-8d59-4f41-9ccc-933e0d8cf1cb" released by "delete_snapshot" :: held 1.584s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 12:03:43 devstack cinder-volume[87116]: DEBUG cinder.quota [None req-90d6e00b-a25d-4595-9eb3-aa7027276915 tempest-SnapshotDependencyTests-2068439515 None] Created reservations ['2f304e89-f859-44c8-901b-6ecc2875ddb0', '66c0ef39-99e2-4cd6-b2b6-7ff4853be54d', 'b28221c3-73d6-4cf6-b1a2-4a5e0f415901', 'e8a1e7ea-e56f-49a1-bf70-31e127640b4f'] {{(pid=87116) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 12:03:43 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-90d6e00b-a25d-4595-9eb3-aa7027276915 tempest-SnapshotDependencyTests-2068439515 None] Delete snapshot completed successfully. Nov 06 12:03:43 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-90d6e00b-a25d-4595-9eb3-aa7027276915 tempest-SnapshotDependencyTests-2068439515 None] Lock "cinder-3a688874-583c-4d09-a60d-bb924e39154a-delete_snapshot" released by "delete_snapshot" :: held 1.703s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 12:03:44 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-e890e4a6-b396-40b3-bb5d-22df98a4c2ee tempest-SnapshotDependencyTests-2068439515 None] Acquiring lock "cinder-8737d659-8d59-4f41-9ccc-933e0d8cf1cb-delete_volume" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 12:03:44 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-e890e4a6-b396-40b3-bb5d-22df98a4c2ee tempest-SnapshotDependencyTests-2068439515 None] Lock "cinder-8737d659-8d59-4f41-9ccc-933e0d8cf1cb-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 12:03:44 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-e890e4a6-b396-40b3-bb5d-22df98a4c2ee tempest-SnapshotDependencyTests-2068439515 None] Acquiring lock "cinder-quobyte-8737d659-8d59-4f41-9ccc-933e0d8cf1cb" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 12:03:44 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-e890e4a6-b396-40b3-bb5d-22df98a4c2ee tempest-SnapshotDependencyTests-2068439515 None] Lock "cinder-quobyte-8737d659-8d59-4f41-9ccc-933e0d8cf1cb" acquired by "delete_volume" :: waited 0.015s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 12:03:44 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[8166e269-3384-44b5-b439-f43639df2161]: (4, 'qcow2') {{(pid=88420) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 12:03:44 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-e890e4a6-b396-40b3-bb5d-22df98a4c2ee tempest-SnapshotDependencyTests-2068439515 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-8737d659-8d59-4f41-9ccc-933e0d8cf1cb {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 12:03:44 devstack sudo[107980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-8737d659-8d59-4f41-9ccc-933e0d8cf1cb Nov 06 12:03:44 devstack sudo[107980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 12:03:44 devstack sudo[107980]: pam_unix(sudo:session): session closed for user root Nov 06 12:03:44 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-e890e4a6-b396-40b3-bb5d-22df98a4c2ee tempest-SnapshotDependencyTests-2068439515 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-8737d659-8d59-4f41-9ccc-933e0d8cf1cb" returned: 0 in 0.342s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 12:03:44 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-e890e4a6-b396-40b3-bb5d-22df98a4c2ee tempest-SnapshotDependencyTests-2068439515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-8737d659-8d59-4f41-9ccc-933e0d8cf1cb {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 12:03:44 devstack sudo[107985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-8737d659-8d59-4f41-9ccc-933e0d8cf1cb Nov 06 12:03:44 devstack sudo[107985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 12:03:44 devstack sudo[107985]: pam_unix(sudo:session): session closed for user root Nov 06 12:03:44 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-e890e4a6-b396-40b3-bb5d-22df98a4c2ee tempest-SnapshotDependencyTests-2068439515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-8737d659-8d59-4f41-9ccc-933e0d8cf1cb" returned: 0 in 0.241s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 12:03:44 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-e890e4a6-b396-40b3-bb5d-22df98a4c2ee tempest-SnapshotDependencyTests-2068439515 None] Lock "cinder-quobyte-8737d659-8d59-4f41-9ccc-933e0d8cf1cb" released by "delete_volume" :: held 0.642s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 12:03:45 devstack cinder-volume[87116]: DEBUG cinder.quota [None req-e890e4a6-b396-40b3-bb5d-22df98a4c2ee tempest-SnapshotDependencyTests-2068439515 None] Created reservations ['be3cbdd6-4817-403f-bcc9-12e7d6714492', '54a5ec12-2191-4358-b2f1-283f8b7b9944', 'b7e8884f-156d-4aca-98c6-f370a43a50bd', 'ab80e7cd-d7b5-4110-b16b-2d3591a90c9e'] {{(pid=87116) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 12:03:45 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-e890e4a6-b396-40b3-bb5d-22df98a4c2ee tempest-SnapshotDependencyTests-2068439515 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 12:03:45 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-e890e4a6-b396-40b3-bb5d-22df98a4c2ee tempest-SnapshotDependencyTests-2068439515 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 12:03:45 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-e890e4a6-b396-40b3-bb5d-22df98a4c2ee tempest-SnapshotDependencyTests-2068439515 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 12:03:45 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-e890e4a6-b396-40b3-bb5d-22df98a4c2ee tempest-SnapshotDependencyTests-2068439515 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 12:03:45 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-e890e4a6-b396-40b3-bb5d-22df98a4c2ee tempest-SnapshotDependencyTests-2068439515 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 12:03:45 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-e890e4a6-b396-40b3-bb5d-22df98a4c2ee tempest-SnapshotDependencyTests-2068439515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 12:03:45 devstack sudo[107988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756 Nov 06 12:03:45 devstack sudo[107988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 12:03:45 devstack sudo[107988]: pam_unix(sudo:session): session closed for user root Nov 06 12:03:45 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-e890e4a6-b396-40b3-bb5d-22df98a4c2ee tempest-SnapshotDependencyTests-2068439515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756" returned: 0 in 0.257s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 12:03:45 devstack cinder-volume[87116]: DEBUG cinder.manager [None req-e890e4a6-b396-40b3-bb5d-22df98a4c2ee tempest-SnapshotDependencyTests-2068439515 None] Notifying Schedulers of capabilities ... {{(pid=87116) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 12:03:45 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-e890e4a6-b396-40b3-bb5d-22df98a4c2ee tempest-SnapshotDependencyTests-2068439515 None] Deleted volume successfully. Nov 06 12:03:45 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-e890e4a6-b396-40b3-bb5d-22df98a4c2ee tempest-SnapshotDependencyTests-2068439515 None] Lock "cinder-8737d659-8d59-4f41-9ccc-933e0d8cf1cb-delete_volume" released by "delete_volume" :: held 1.091s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 12:03:45 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-65faab4c-bc53-4d4a-a2b4-9539728370f4 tempest-SnapshotDependencyTests-2068439515 None] Acquiring lock "cinder-259f7135-97f6-495f-a14f-bc5af7f2fd0d-delete_volume" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 12:03:45 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-65faab4c-bc53-4d4a-a2b4-9539728370f4 tempest-SnapshotDependencyTests-2068439515 None] Lock "cinder-259f7135-97f6-495f-a14f-bc5af7f2fd0d-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 12:03:45 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-65faab4c-bc53-4d4a-a2b4-9539728370f4 tempest-SnapshotDependencyTests-2068439515 None] Acquiring lock "cinder-quobyte-259f7135-97f6-495f-a14f-bc5af7f2fd0d" by "delete_volume" {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 06 12:03:45 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-65faab4c-bc53-4d4a-a2b4-9539728370f4 tempest-SnapshotDependencyTests-2068439515 None] Lock "cinder-quobyte-259f7135-97f6-495f-a14f-bc5af7f2fd0d" acquired by "delete_volume" :: waited 0.014s {{(pid=87116) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 06 12:03:45 devstack cinder-volume[87116]: DEBUG oslo.privsep.daemon [-] privsep: reply[2538766e-6baa-4f11-9a63-b95992baa78f]: (4, 'qcow2') {{(pid=88420) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 06 12:03:45 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-65faab4c-bc53-4d4a-a2b4-9539728370f4 tempest-SnapshotDependencyTests-2068439515 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-259f7135-97f6-495f-a14f-bc5af7f2fd0d {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 12:03:45 devstack sudo[107991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-259f7135-97f6-495f-a14f-bc5af7f2fd0d Nov 06 12:03:45 devstack sudo[107991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 12:03:45 devstack sudo[107991]: pam_unix(sudo:session): session closed for user root Nov 06 12:03:45 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-65faab4c-bc53-4d4a-a2b4-9539728370f4 tempest-SnapshotDependencyTests-2068439515 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-259f7135-97f6-495f-a14f-bc5af7f2fd0d" returned: 0 in 0.352s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 12:03:45 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-65faab4c-bc53-4d4a-a2b4-9539728370f4 tempest-SnapshotDependencyTests-2068439515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-259f7135-97f6-495f-a14f-bc5af7f2fd0d {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 12:03:45 devstack sudo[107996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-259f7135-97f6-495f-a14f-bc5af7f2fd0d Nov 06 12:03:45 devstack sudo[107996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 12:03:46 devstack sudo[107996]: pam_unix(sudo:session): session closed for user root Nov 06 12:03:46 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-65faab4c-bc53-4d4a-a2b4-9539728370f4 tempest-SnapshotDependencyTests-2068439515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756/volume-259f7135-97f6-495f-a14f-bc5af7f2fd0d" returned: 0 in 0.244s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 12:03:46 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-65faab4c-bc53-4d4a-a2b4-9539728370f4 tempest-SnapshotDependencyTests-2068439515 None] Lock "cinder-quobyte-259f7135-97f6-495f-a14f-bc5af7f2fd0d" released by "delete_volume" :: held 0.635s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 12:03:46 devstack cinder-volume[87116]: DEBUG cinder.quota [None req-65faab4c-bc53-4d4a-a2b4-9539728370f4 tempest-SnapshotDependencyTests-2068439515 None] Created reservations ['172e6247-9aab-4134-adb9-350dfc69aa61', 'fa0603e7-ee45-4d53-9bb6-4f25ed1e22d5', '4b1c30ec-3106-4c60-a5ed-e12676826fda', '3aeff52e-edc8-473a-923e-dcc572e3ede3'] {{(pid=87116) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 06 12:03:46 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-65faab4c-bc53-4d4a-a2b4-9539728370f4 tempest-SnapshotDependencyTests-2068439515 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 06 12:03:46 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-65faab4c-bc53-4d4a-a2b4-9539728370f4 tempest-SnapshotDependencyTests-2068439515 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 06 12:03:46 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-65faab4c-bc53-4d4a-a2b4-9539728370f4 tempest-SnapshotDependencyTests-2068439515 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f': None} {{(pid=87116) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 06 12:03:46 devstack cinder-volume[87116]: DEBUG cinder.volume.drivers.quobyte [None req-65faab4c-bc53-4d4a-a2b4-9539728370f4 tempest-SnapshotDependencyTests-2068439515 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-313f1dcd-a48e-4df6-bb14-90431c58c24f'] {{(pid=87116) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 06 12:03:46 devstack cinder-volume[87116]: DEBUG oslo_concurrency.lockutils [None req-65faab4c-bc53-4d4a-a2b4-9539728370f4 tempest-SnapshotDependencyTests-2068439515 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87116) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 06 12:03:46 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-65faab4c-bc53-4d4a-a2b4-9539728370f4 tempest-SnapshotDependencyTests-2068439515 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756 {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 06 12:03:46 devstack sudo[107999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756 Nov 06 12:03:46 devstack sudo[107999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 06 12:03:46 devstack sudo[107999]: pam_unix(sudo:session): session closed for user root Nov 06 12:03:46 devstack cinder-volume[87116]: DEBUG oslo_concurrency.processutils [None req-65faab4c-bc53-4d4a-a2b4-9539728370f4 tempest-SnapshotDependencyTests-2068439515 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/225080247e6743e82a9f4ad437ffa756" returned: 0 in 0.231s {{(pid=87116) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 06 12:03:46 devstack cinder-volume[87116]: DEBUG cinder.manager [None req-65faab4c-bc53-4d4a-a2b4-9539728370f4 tempest-SnapshotDependencyTests-2068439515 None] Notifying Schedulers of capabilities ... {{(pid=87116) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 06 12:03:46 devstack cinder-volume[87116]: INFO cinder.volume.manager [None req-65faab4c-bc53-4d4a-a2b4-9539728370f4 tempest-SnapshotDependencyTests-2068439515 None] Deleted volume successfully. Nov 06 12:03:46 devstack cinder-volume[87116]: DEBUG cinder.coordination [None req-65faab4c-bc53-4d4a-a2b4-9539728370f4 tempest-SnapshotDependencyTests-2068439515 None] Lock "cinder-259f7135-97f6-495f-a14f-bc5af7f2fd0d-delete_volume" released by "delete_volume" :: held 1.061s {{(pid=87116) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 06 12:03:56 devstack cinder-volume[87116]: DEBUG dbcounter [-] [87116] Writing DB stats cinder:UPDATE=35,cinder:SELECT=21,cinder:INSERT=8,cinder:DELETE=4 {{(pid=87116) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 06 12:03:56 devstack cinder-volume[87116]: DEBUG dbcounter [-] [87116] Writing DB stats cinder:SELECT=29,cinder:UPDATE=24,cinder:INSERT=7,cinder:DELETE=1 {{(pid=87116) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}